"pretrain" meaning in English

See pretrain in All languages combined, or Wiktionary

Verb

Forms: pretrains [present, singular, third-person], pretraining [participle, present], pretrained [participle, past], pretrained [past]
Etymology: pre- + train Etymology templates: {{prefix|en|pre|train}} pre- + train Head templates: {{en-verb}} pretrain (third-person singular simple present pretrains, present participle pretraining, simple past and past participle pretrained)
  1. (machine learning) To train (a neural network) on some data set (typically a large generic data set, the output of which one is not directly interested in) before fine-tuning the network on another dataset one is interested in. Categories (topical): Artificial intelligence Synonyms: pre-train
    Sense id: en-pretrain-en-verb-fYM7VZMj Categories (other): English entries with incorrect language header, English terms prefixed with pre-

Inflected forms

Alternative forms

Download JSON data for pretrain meaning in English (2.3kB)

{
  "etymology_templates": [
    {
      "args": {
        "1": "en",
        "2": "pre",
        "3": "train"
      },
      "expansion": "pre- + train",
      "name": "prefix"
    }
  ],
  "etymology_text": "pre- + train",
  "forms": [
    {
      "form": "pretrains",
      "tags": [
        "present",
        "singular",
        "third-person"
      ]
    },
    {
      "form": "pretraining",
      "tags": [
        "participle",
        "present"
      ]
    },
    {
      "form": "pretrained",
      "tags": [
        "participle",
        "past"
      ]
    },
    {
      "form": "pretrained",
      "tags": [
        "past"
      ]
    }
  ],
  "head_templates": [
    {
      "args": {},
      "expansion": "pretrain (third-person singular simple present pretrains, present participle pretraining, simple past and past participle pretrained)",
      "name": "en-verb"
    }
  ],
  "lang": "English",
  "lang_code": "en",
  "pos": "verb",
  "senses": [
    {
      "categories": [
        {
          "kind": "other",
          "name": "English entries with incorrect language header",
          "parents": [
            "Entries with incorrect language header",
            "Entry maintenance"
          ],
          "source": "w"
        },
        {
          "kind": "other",
          "name": "English terms prefixed with pre-",
          "parents": [],
          "source": "w"
        },
        {
          "kind": "topical",
          "langcode": "en",
          "name": "Artificial intelligence",
          "orig": "en:Artificial intelligence",
          "parents": [
            "Computer science",
            "Cybernetics",
            "Computing",
            "Sciences",
            "Applied mathematics",
            "Systems theory",
            "Technology",
            "All topics",
            "Mathematics",
            "Systems",
            "Fundamental",
            "Formal sciences",
            "Interdisciplinary fields",
            "Society"
          ],
          "source": "w"
        }
      ],
      "examples": [
        {
          "ref": "2015, Hyeonseob Nam, Bohyung Han, “Learning Multi-Domain Convolutional Neural Networks for Visual Tracking”, in arXiv",
          "text": "Our algorithm pretrains a CNN using a large set of videos with tracking ground-truths to obtain a generic target representation.",
          "type": "quotation"
        }
      ],
      "glosses": [
        "To train (a neural network) on some data set (typically a large generic data set, the output of which one is not directly interested in) before fine-tuning the network on another dataset one is interested in."
      ],
      "id": "en-pretrain-en-verb-fYM7VZMj",
      "links": [
        [
          "machine learning",
          "machine learning"
        ],
        [
          "neural network",
          "neural network"
        ],
        [
          "data set",
          "data set"
        ],
        [
          "fine-tuning",
          "fine-tune"
        ]
      ],
      "qualifier": "machine learning",
      "raw_glosses": [
        "(machine learning) To train (a neural network) on some data set (typically a large generic data set, the output of which one is not directly interested in) before fine-tuning the network on another dataset one is interested in."
      ],
      "synonyms": [
        {
          "word": "pre-train"
        }
      ]
    }
  ],
  "word": "pretrain"
}
{
  "etymology_templates": [
    {
      "args": {
        "1": "en",
        "2": "pre",
        "3": "train"
      },
      "expansion": "pre- + train",
      "name": "prefix"
    }
  ],
  "etymology_text": "pre- + train",
  "forms": [
    {
      "form": "pretrains",
      "tags": [
        "present",
        "singular",
        "third-person"
      ]
    },
    {
      "form": "pretraining",
      "tags": [
        "participle",
        "present"
      ]
    },
    {
      "form": "pretrained",
      "tags": [
        "participle",
        "past"
      ]
    },
    {
      "form": "pretrained",
      "tags": [
        "past"
      ]
    }
  ],
  "head_templates": [
    {
      "args": {},
      "expansion": "pretrain (third-person singular simple present pretrains, present participle pretraining, simple past and past participle pretrained)",
      "name": "en-verb"
    }
  ],
  "lang": "English",
  "lang_code": "en",
  "pos": "verb",
  "senses": [
    {
      "categories": [
        "English entries with incorrect language header",
        "English lemmas",
        "English terms prefixed with pre-",
        "English terms with quotations",
        "English verbs",
        "en:Artificial intelligence"
      ],
      "examples": [
        {
          "ref": "2015, Hyeonseob Nam, Bohyung Han, “Learning Multi-Domain Convolutional Neural Networks for Visual Tracking”, in arXiv",
          "text": "Our algorithm pretrains a CNN using a large set of videos with tracking ground-truths to obtain a generic target representation.",
          "type": "quotation"
        }
      ],
      "glosses": [
        "To train (a neural network) on some data set (typically a large generic data set, the output of which one is not directly interested in) before fine-tuning the network on another dataset one is interested in."
      ],
      "links": [
        [
          "machine learning",
          "machine learning"
        ],
        [
          "neural network",
          "neural network"
        ],
        [
          "data set",
          "data set"
        ],
        [
          "fine-tuning",
          "fine-tune"
        ]
      ],
      "qualifier": "machine learning",
      "raw_glosses": [
        "(machine learning) To train (a neural network) on some data set (typically a large generic data set, the output of which one is not directly interested in) before fine-tuning the network on another dataset one is interested in."
      ]
    }
  ],
  "synonyms": [
    {
      "word": "pre-train"
    }
  ],
  "word": "pretrain"
}

This page is a part of the kaikki.org machine-readable English dictionary. This dictionary is based on structured data extracted on 2024-05-06 from the enwiktionary dump dated 2024-05-02 using wiktextract (f4fd8c9 and c9440ce). The data shown on this site has been post-processed and various details (e.g., extra categories) removed, some information disambiguated, and additional data merged from other sources. See the raw data download page for the unprocessed wiktextract data.

If you use this data in academic research, please cite Tatu Ylonen: Wiktextract: Wiktionary as Machine-Readable Structured Data, Proceedings of the 13th Conference on Language Resources and Evaluation (LREC), pp. 1317-1325, Marseille, 20-25 June 2022. Linking to the relevant page(s) under https://kaikki.org would also be greatly appreciated.