"self-attention" meaning in English

See self-attention in All languages combined, or Wiktionary

Noun

Etymology: From self- + attention. Etymology templates: {{prefix|en|self|attention}} self- + attention Head templates: {{en-noun|-|head=self-attention}} self-attention (uncountable)
  1. (machine learning) A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same. Tags: uncountable Categories (topical): Machine learning
    Sense id: en-self-attention-en-noun-34ZnYx17 Categories (other): English entries with incorrect language header, English terms prefixed with self-, Pages with 1 entry, Pages with entries Disambiguation of English entries with incorrect language header: 81 19 Disambiguation of English terms prefixed with self-: 54 46 Disambiguation of Pages with 1 entry: 88 12 Disambiguation of Pages with entries: 93 7
  2. (psychology) Conscious attention to one's own physiological and emotional state and behavior. Tags: uncountable Categories (topical): Psychology
    Sense id: en-self-attention-en-noun-LE5W1YPi Categories (other): English terms prefixed with self- Disambiguation of English terms prefixed with self-: 54 46 Topics: human-sciences, psychology, sciences
The following are not (yet) sense-disambiguated
Related terms: transformer
{
  "etymology_templates": [
    {
      "args": {
        "1": "en",
        "2": "self",
        "3": "attention"
      },
      "expansion": "self- + attention",
      "name": "prefix"
    }
  ],
  "etymology_text": "From self- + attention.",
  "head_templates": [
    {
      "args": {
        "1": "-",
        "head": "self-attention"
      },
      "expansion": "self-attention (uncountable)",
      "name": "en-noun"
    }
  ],
  "lang": "English",
  "lang_code": "en",
  "pos": "noun",
  "related": [
    {
      "_dis1": "0 0",
      "word": "transformer"
    }
  ],
  "senses": [
    {
      "antonyms": [
        {
          "word": "cross-attention"
        }
      ],
      "categories": [
        {
          "kind": "topical",
          "langcode": "en",
          "name": "Machine learning",
          "orig": "en:Machine learning",
          "parents": [
            "Artificial intelligence",
            "Computer science",
            "Cybernetics",
            "Computing",
            "Sciences",
            "Applied mathematics",
            "Systems theory",
            "Technology",
            "All topics",
            "Mathematics",
            "Systems",
            "Fundamental",
            "Formal sciences",
            "Interdisciplinary fields",
            "Society"
          ],
          "source": "w"
        },
        {
          "_dis": "81 19",
          "kind": "other",
          "name": "English entries with incorrect language header",
          "parents": [
            "Entries with incorrect language header",
            "Entry maintenance"
          ],
          "source": "w+disamb"
        },
        {
          "_dis": "54 46",
          "kind": "other",
          "name": "English terms prefixed with self-",
          "parents": [],
          "source": "w+disamb"
        },
        {
          "_dis": "88 12",
          "kind": "other",
          "name": "Pages with 1 entry",
          "parents": [],
          "source": "w+disamb"
        },
        {
          "_dis": "93 7",
          "kind": "other",
          "name": "Pages with entries",
          "parents": [],
          "source": "w+disamb"
        }
      ],
      "glosses": [
        "A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same."
      ],
      "id": "en-self-attention-en-noun-34ZnYx17",
      "links": [
        [
          "machine learning",
          "machine learning"
        ],
        [
          "attention",
          "attention"
        ],
        [
          "input",
          "input"
        ],
        [
          "sequence",
          "sequence"
        ],
        [
          "compare",
          "compare"
        ],
        [
          "key",
          "key"
        ],
        [
          "queries",
          "query"
        ]
      ],
      "qualifier": "machine learning",
      "raw_glosses": [
        "(machine learning) A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same."
      ],
      "tags": [
        "uncountable"
      ]
    },
    {
      "categories": [
        {
          "kind": "topical",
          "langcode": "en",
          "name": "Psychology",
          "orig": "en:Psychology",
          "parents": [
            "Social sciences",
            "Sciences",
            "Society",
            "All topics",
            "Fundamental"
          ],
          "source": "w"
        },
        {
          "_dis": "54 46",
          "kind": "other",
          "name": "English terms prefixed with self-",
          "parents": [],
          "source": "w+disamb"
        }
      ],
      "examples": [
        {
          "ref": "1986, Ralf Schwarzer, editor, Self-related Cognitions in Anxiety and Motivation, Psychology Press, →ISBN:",
          "text": "According to self-attention theory in general, it can be predicted that heightened self-attention leads to a closer fit between observed behavior and some underlying salient standard.",
          "type": "quote"
        },
        {
          "ref": "2012, C. S. Carver, M. F. Scheier, Attention and Self-Regulation, page 45:",
          "text": "Interest in the consequences of self-attention spread fairly quickly from social to personality psychologists.",
          "type": "quote"
        }
      ],
      "glosses": [
        "Conscious attention to one's own physiological and emotional state and behavior."
      ],
      "id": "en-self-attention-en-noun-LE5W1YPi",
      "links": [
        [
          "psychology",
          "psychology"
        ],
        [
          "Conscious",
          "conscious"
        ],
        [
          "attention",
          "attention"
        ],
        [
          "physiological",
          "physiological"
        ],
        [
          "emotional",
          "emotional"
        ],
        [
          "behavior",
          "behavior"
        ]
      ],
      "raw_glosses": [
        "(psychology) Conscious attention to one's own physiological and emotional state and behavior."
      ],
      "tags": [
        "uncountable"
      ],
      "topics": [
        "human-sciences",
        "psychology",
        "sciences"
      ]
    }
  ],
  "word": "self-attention"
}
{
  "categories": [
    "English entries with incorrect language header",
    "English lemmas",
    "English multiword terms",
    "English nouns",
    "English terms prefixed with self-",
    "English uncountable nouns",
    "Pages with 1 entry",
    "Pages with entries"
  ],
  "etymology_templates": [
    {
      "args": {
        "1": "en",
        "2": "self",
        "3": "attention"
      },
      "expansion": "self- + attention",
      "name": "prefix"
    }
  ],
  "etymology_text": "From self- + attention.",
  "head_templates": [
    {
      "args": {
        "1": "-",
        "head": "self-attention"
      },
      "expansion": "self-attention (uncountable)",
      "name": "en-noun"
    }
  ],
  "lang": "English",
  "lang_code": "en",
  "pos": "noun",
  "related": [
    {
      "word": "transformer"
    }
  ],
  "senses": [
    {
      "antonyms": [
        {
          "word": "cross-attention"
        }
      ],
      "categories": [
        "en:Machine learning"
      ],
      "glosses": [
        "A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same."
      ],
      "links": [
        [
          "machine learning",
          "machine learning"
        ],
        [
          "attention",
          "attention"
        ],
        [
          "input",
          "input"
        ],
        [
          "sequence",
          "sequence"
        ],
        [
          "compare",
          "compare"
        ],
        [
          "key",
          "key"
        ],
        [
          "queries",
          "query"
        ]
      ],
      "qualifier": "machine learning",
      "raw_glosses": [
        "(machine learning) A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same."
      ],
      "tags": [
        "uncountable"
      ]
    },
    {
      "categories": [
        "English terms with quotations",
        "en:Psychology"
      ],
      "examples": [
        {
          "ref": "1986, Ralf Schwarzer, editor, Self-related Cognitions in Anxiety and Motivation, Psychology Press, →ISBN:",
          "text": "According to self-attention theory in general, it can be predicted that heightened self-attention leads to a closer fit between observed behavior and some underlying salient standard.",
          "type": "quote"
        },
        {
          "ref": "2012, C. S. Carver, M. F. Scheier, Attention and Self-Regulation, page 45:",
          "text": "Interest in the consequences of self-attention spread fairly quickly from social to personality psychologists.",
          "type": "quote"
        }
      ],
      "glosses": [
        "Conscious attention to one's own physiological and emotional state and behavior."
      ],
      "links": [
        [
          "psychology",
          "psychology"
        ],
        [
          "Conscious",
          "conscious"
        ],
        [
          "attention",
          "attention"
        ],
        [
          "physiological",
          "physiological"
        ],
        [
          "emotional",
          "emotional"
        ],
        [
          "behavior",
          "behavior"
        ]
      ],
      "raw_glosses": [
        "(psychology) Conscious attention to one's own physiological and emotional state and behavior."
      ],
      "tags": [
        "uncountable"
      ],
      "topics": [
        "human-sciences",
        "psychology",
        "sciences"
      ]
    }
  ],
  "word": "self-attention"
}

Download raw JSONL data for self-attention meaning in English (2.4kB)


This page is a part of the kaikki.org machine-readable English dictionary. This dictionary is based on structured data extracted on 2024-12-21 from the enwiktionary dump dated 2024-12-04 using wiktextract (d8cb2f3 and 4e554ae). The data shown on this site has been post-processed and various details (e.g., extra categories) removed, some information disambiguated, and additional data merged from other sources. See the raw data download page for the unprocessed wiktextract data.

If you use this data in academic research, please cite Tatu Ylonen: Wiktextract: Wiktionary as Machine-Readable Structured Data, Proceedings of the 13th Conference on Language Resources and Evaluation (LREC), pp. 1317-1325, Marseille, 20-25 June 2022. Linking to the relevant page(s) under https://kaikki.org would also be greatly appreciated.