self-attention
nounEtymology From self- + attention.
1
A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.
Machine learning
2
Human sciences, Psychology, Sciences Conscious attention to one's own physiological and emotional state and behavior.
- According to self-attention theory in general, it can be predicted that heightened self-attention leads to a closer fit between observed behavior and some underlying salient standard.1986, Ralf Schwarzer, editor, Self-related Cognitions in Anxiety and Motivation, Psychology Press, →ISBN:
- Interest in the consequences of self-attention spread fairly quickly from social to personality psychologists.2012, C. S. Carver, M. F. Scheier, Attention and Self-Regulation, page 45:
- Related terms
- transformer