"tokeniser" meaning in All languages combined

See tokeniser on Wiktionary

Noun [Anglais]

Forms: tokenisers [plural]
  1. Variante orthographique de tokenizer.
    Sense id: fr-tokeniser-en-noun-KxGMTvkr
The following are not (yet) sense-disambiguated

Verb [Français]

IPA: \tɔ.kɛ.ni.ze\
Forms: tokeniser [infinitive, present], avoir tokenisé [infinitive, past], en tokenisant [gerund, present], en ayant tokenisé [gerund, past], tokenisant [participle, present], tokenisé [participle, past], je tokenise [indicative, present], tu tokenises [indicative, present], il/elle/on tokenise [indicative, present], nous tokenisons [indicative, present], vous tokenisez [indicative, present], ils/elles tokenisent [indicative, present], je tokenisais [indicative, imperfect], tu tokenisais [indicative, imperfect], il/elle/on tokenisait [indicative, imperfect], nous tokenisions [indicative, imperfect], vous tokenisiez [indicative, imperfect], ils/elles tokenisaient [indicative, imperfect], je tokenisai [indicative, past], tu tokenisas [indicative, past], il/elle/on tokenisa [indicative, past], nous tokenisâmes [indicative, past], vous tokenisâtes [indicative, past], ils/elles tokenisèrent [indicative, past], je tokeniserai [indicative, future], tu tokeniseras [indicative, future], il/elle/on tokenisera [indicative, future], nous tokeniserons [indicative, future], vous tokeniserez [indicative, future], ils/elles tokeniseront [indicative, future], que je tokenise [subjunctive, present], que tu tokenises [subjunctive, present], qu’il/elle/on tokenise [subjunctive, present], que nous tokenisions [subjunctive, present], que vous tokenisiez [subjunctive, present], qu’ils/elles tokenisent [subjunctive, present], que je tokenisasse [subjunctive, imperfect], que tu tokenisasses [subjunctive, imperfect], qu’il/elle/on tokenisât [subjunctive, imperfect], que nous tokenisassions [subjunctive, imperfect], que vous tokenisassiez [subjunctive, imperfect], qu’ils/elles tokenisassent [subjunctive, imperfect], je tokeniserais [conditional, present], tu tokeniserais [conditional, present], il/elle/on tokeniserait [conditional, present], nous tokeniserions [conditional, present], vous tokeniseriez [conditional, present], ils/elles tokeniseraient [conditional, present]
  1. Découper automatiquement un texte en unités lexicales grâce à une analyse lexicale.
    Sense id: fr-tokeniser-fr-verb-96JxgOcj Categories (other): Exemples en français
  2. Associer un jeton NFT dans une blockchain à un bien réel.
    Sense id: fr-tokeniser-fr-verb-gJbDktPz Categories (other): Exemples en français
The following are not (yet) sense-disambiguated
Derived forms: détokeniser, retokeniser Related terms: tokéniser Translations: tokenize (Anglais)

Inflected forms

{
  "categories": [
    {
      "kind": "other",
      "name": "Lemmes en français",
      "parents": [],
      "source": "w"
    },
    {
      "kind": "other",
      "name": "Traductions en anglais",
      "parents": [],
      "source": "w"
    },
    {
      "kind": "other",
      "name": "Verbes du premier groupe en français",
      "parents": [],
      "source": "w"
    },
    {
      "kind": "other",
      "name": "Verbes en français",
      "parents": [],
      "source": "w"
    },
    {
      "kind": "other",
      "name": "Verbes transitifs sans langue précisée",
      "parents": [],
      "source": "w"
    },
    {
      "kind": "other",
      "name": "Français",
      "orig": "français",
      "parents": [],
      "source": "w"
    }
  ],
  "derived": [
    {
      "word": "détokeniser"
    },
    {
      "word": "retokeniser"
    }
  ],
  "etymology_texts": [
    "Francisation du verbe anglais tokenize."
  ],
  "forms": [
    {
      "form": "tokeniser",
      "ipas": [
        "\\tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "infinitive",
        "present"
      ]
    },
    {
      "form": "avoir tokenisé",
      "ipas": [
        "\\a.vwaʁ tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "infinitive",
        "past"
      ]
    },
    {
      "form": "en tokenisant",
      "ipas": [
        "\\ɑ̃ tɔ.kɛ.ni.zɑ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "gerund",
        "present"
      ]
    },
    {
      "form": "en ayant tokenisé",
      "ipas": [
        "\\ɑ̃.n‿ɛ.jɑ̃ tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "gerund",
        "past"
      ]
    },
    {
      "form": "tokenisant",
      "ipas": [
        "\\tɔ.kɛ.ni.zɑ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "participle",
        "present"
      ]
    },
    {
      "form": "tokenisé",
      "ipas": [
        "\\tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "participle",
        "past"
      ]
    },
    {
      "form": "je tokenise",
      "ipas": [
        "\\ʒə tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "tu tokenises",
      "ipas": [
        "\\ty tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "il/elle/on tokenise",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "nous tokenisons",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "vous tokenisez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "ils/elles tokenisent",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "je tokenisais",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "tu tokenisais",
      "ipas": [
        "\\ty tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "il/elle/on tokenisait",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "nous tokenisions",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "vous tokenisiez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.zje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "ils/elles tokenisaient",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "je tokenisai",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "tu tokenisas",
      "ipas": [
        "\\ty tɔ.kɛ.ni.za\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "il/elle/on tokenisa",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.za\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "nous tokenisâmes",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zam\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "vous tokenisâtes",
      "ipas": [
        "\\vu tɔ.kɛ.ni.zat\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "ils/elles tokenisèrent",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.zɛʁ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "je tokeniserai",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.z(ə.)ʁe\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "tu tokeniseras",
      "ipas": [
        "\\ty tɔ.kɛ.ni.z(ə.)ʁa\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "il/elle/on tokenisera",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.z(ə.)ʁa\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "nous tokeniserons",
      "ipas": [
        "\\nu tɔ.kɛ.ni.z(ə.)ʁɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "vous tokeniserez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.z(ə.)ʁe\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "ils/elles tokeniseront",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.z(ə.)ʁɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "que je tokenise",
      "ipas": [
        "\\kə ʒə tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que tu tokenises",
      "ipas": [
        "\\kə ty tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "qu’il/elle/on tokenise",
      "ipas": [
        "\\k‿[il/ɛl/ɔ̃] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que nous tokenisions",
      "ipas": [
        "\\kə nu tɔ.kɛ.ni.zjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que vous tokenisiez",
      "ipas": [
        "\\kə vu tɔ.kɛ.ni.zje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "qu’ils/elles tokenisent",
      "ipas": [
        "\\k‿[il/ɛl] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que je tokenisasse",
      "ipas": [
        "\\kə ʒə tɔ.kɛ.ni.zas\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "que tu tokenisasses",
      "ipas": [
        "\\kə ty tɔ.kɛ.ni.zas\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "qu’il/elle/on tokenisât",
      "ipas": [
        "\\k‿[il/ɛl/ɔ̃] tɔ.kɛ.ni.za\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "que nous tokenisassions",
      "ipas": [
        "\\kə nu tɔ.kɛ.ni.za.sjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "que vous tokenisassiez",
      "ipas": [
        "\\kə vu tɔ.kɛ.ni.za.sje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "qu’ils/elles tokenisassent",
      "ipas": [
        "\\k‿[il/ɛl] tɔ.kɛ.ni.zas\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "je tokeniserais",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "tu tokeniserais",
      "ipas": [
        "\\ty tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "il/elle/on tokeniserait",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "nous tokeniserions",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zə.ʁjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "vous tokeniseriez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.zə.ʁje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "ils/elles tokeniseraient",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    }
  ],
  "lang": "Français",
  "lang_code": "fr",
  "pos": "verb",
  "pos_title": "Verbe",
  "raw_tags": [
    "1ᵉʳ groupe"
  ],
  "related": [
    {
      "word": "tokéniser"
    }
  ],
  "senses": [
    {
      "categories": [
        {
          "kind": "other",
          "name": "Exemples en français",
          "parents": [],
          "source": "w"
        }
      ],
      "examples": [
        {
          "ref": "site dumas.ccsd.cnrs.fr, 17 décembre 2021",
          "text": "Dans une première phase d’observation, nous avons donc comparé les données du fichier Input sur un même texte qui est tokenisé de deux manières."
        }
      ],
      "glosses": [
        "Découper automatiquement un texte en unités lexicales grâce à une analyse lexicale."
      ],
      "id": "fr-tokeniser-fr-verb-96JxgOcj"
    },
    {
      "categories": [
        {
          "kind": "other",
          "name": "Exemples en français",
          "parents": [],
          "source": "w"
        }
      ],
      "examples": [
        {
          "ref": "journal 20 minutes, édition Paris-IDF, 14 juin 2023, page 16",
          "text": "La perspective de « tokeniser des biens », c’est-à-dire de les mettre sur la blockchain, émerge, notamment dans le monde de l’immobilier."
        },
        {
          "ref": "site beaubourg-avocats.fr, 23 mars 2022",
          "text": "Lorsqu’un émetteur de jetons souhaite tokeniser un actif financier, celui-ci devra connaître la qualification juridique du token émis."
        },
        {
          "ref": "site www.dsavocats.com, novembre 2020",
          "text": "Tokeniser un actif immobilier suppose d’associer un jeton numérique inscrit sur une blockchain à un bien immobilier."
        }
      ],
      "glosses": [
        "Associer un jeton NFT dans une blockchain à un bien réel."
      ],
      "id": "fr-tokeniser-fr-verb-gJbDktPz"
    }
  ],
  "sounds": [
    {
      "ipa": "\\tɔ.kɛ.ni.ze\\"
    }
  ],
  "tags": [
    "transitive"
  ],
  "translations": [
    {
      "lang": "Anglais",
      "lang_code": "en",
      "word": "tokenize"
    }
  ],
  "word": "tokeniser"
}

{
  "categories": [
    {
      "kind": "other",
      "name": "Lemmes en anglais",
      "parents": [],
      "source": "w"
    },
    {
      "kind": "other",
      "name": "Noms communs en anglais",
      "parents": [],
      "source": "w"
    },
    {
      "kind": "other",
      "name": "Anglais",
      "orig": "anglais",
      "parents": [],
      "source": "w"
    }
  ],
  "forms": [
    {
      "form": "tokenisers",
      "tags": [
        "plural"
      ]
    }
  ],
  "lang": "Anglais",
  "lang_code": "en",
  "pos": "noun",
  "pos_title": "Nom commun",
  "senses": [
    {
      "glosses": [
        "Variante orthographique de tokenizer."
      ],
      "id": "fr-tokeniser-en-noun-KxGMTvkr"
    }
  ],
  "word": "tokeniser"
}
{
  "categories": [
    "Lemmes en anglais",
    "Noms communs en anglais",
    "anglais"
  ],
  "forms": [
    {
      "form": "tokenisers",
      "tags": [
        "plural"
      ]
    }
  ],
  "lang": "Anglais",
  "lang_code": "en",
  "pos": "noun",
  "pos_title": "Nom commun",
  "senses": [
    {
      "glosses": [
        "Variante orthographique de tokenizer."
      ]
    }
  ],
  "word": "tokeniser"
}

{
  "categories": [
    "Lemmes en français",
    "Traductions en anglais",
    "Verbes du premier groupe en français",
    "Verbes en français",
    "Verbes transitifs sans langue précisée",
    "français"
  ],
  "derived": [
    {
      "word": "détokeniser"
    },
    {
      "word": "retokeniser"
    }
  ],
  "etymology_texts": [
    "Francisation du verbe anglais tokenize."
  ],
  "forms": [
    {
      "form": "tokeniser",
      "ipas": [
        "\\tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "infinitive",
        "present"
      ]
    },
    {
      "form": "avoir tokenisé",
      "ipas": [
        "\\a.vwaʁ tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "infinitive",
        "past"
      ]
    },
    {
      "form": "en tokenisant",
      "ipas": [
        "\\ɑ̃ tɔ.kɛ.ni.zɑ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "gerund",
        "present"
      ]
    },
    {
      "form": "en ayant tokenisé",
      "ipas": [
        "\\ɑ̃.n‿ɛ.jɑ̃ tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "gerund",
        "past"
      ]
    },
    {
      "form": "tokenisant",
      "ipas": [
        "\\tɔ.kɛ.ni.zɑ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "participle",
        "present"
      ]
    },
    {
      "form": "tokenisé",
      "ipas": [
        "\\tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "participle",
        "past"
      ]
    },
    {
      "form": "je tokenise",
      "ipas": [
        "\\ʒə tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "tu tokenises",
      "ipas": [
        "\\ty tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "il/elle/on tokenise",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "nous tokenisons",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "vous tokenisez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "ils/elles tokenisent",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "present"
      ]
    },
    {
      "form": "je tokenisais",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "tu tokenisais",
      "ipas": [
        "\\ty tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "il/elle/on tokenisait",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "nous tokenisions",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "vous tokenisiez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.zje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "ils/elles tokenisaient",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.zɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "imperfect"
      ]
    },
    {
      "form": "je tokenisai",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.ze\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "tu tokenisas",
      "ipas": [
        "\\ty tɔ.kɛ.ni.za\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "il/elle/on tokenisa",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.za\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "nous tokenisâmes",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zam\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "vous tokenisâtes",
      "ipas": [
        "\\vu tɔ.kɛ.ni.zat\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "ils/elles tokenisèrent",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.zɛʁ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "past"
      ]
    },
    {
      "form": "je tokeniserai",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.z(ə.)ʁe\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "tu tokeniseras",
      "ipas": [
        "\\ty tɔ.kɛ.ni.z(ə.)ʁa\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "il/elle/on tokenisera",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.z(ə.)ʁa\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "nous tokeniserons",
      "ipas": [
        "\\nu tɔ.kɛ.ni.z(ə.)ʁɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "vous tokeniserez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.z(ə.)ʁe\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "ils/elles tokeniseront",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.z(ə.)ʁɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "indicative",
        "future"
      ]
    },
    {
      "form": "que je tokenise",
      "ipas": [
        "\\kə ʒə tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que tu tokenises",
      "ipas": [
        "\\kə ty tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "qu’il/elle/on tokenise",
      "ipas": [
        "\\k‿[il/ɛl/ɔ̃] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que nous tokenisions",
      "ipas": [
        "\\kə nu tɔ.kɛ.ni.zjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que vous tokenisiez",
      "ipas": [
        "\\kə vu tɔ.kɛ.ni.zje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "qu’ils/elles tokenisent",
      "ipas": [
        "\\k‿[il/ɛl] tɔ.kɛ.niz\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "present"
      ]
    },
    {
      "form": "que je tokenisasse",
      "ipas": [
        "\\kə ʒə tɔ.kɛ.ni.zas\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "que tu tokenisasses",
      "ipas": [
        "\\kə ty tɔ.kɛ.ni.zas\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "qu’il/elle/on tokenisât",
      "ipas": [
        "\\k‿[il/ɛl/ɔ̃] tɔ.kɛ.ni.za\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "que nous tokenisassions",
      "ipas": [
        "\\kə nu tɔ.kɛ.ni.za.sjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "que vous tokenisassiez",
      "ipas": [
        "\\kə vu tɔ.kɛ.ni.za.sje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "qu’ils/elles tokenisassent",
      "ipas": [
        "\\k‿[il/ɛl] tɔ.kɛ.ni.zas\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "subjunctive",
        "imperfect"
      ]
    },
    {
      "form": "je tokeniserais",
      "ipas": [
        "\\ʒə tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "tu tokeniserais",
      "ipas": [
        "\\ty tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "il/elle/on tokeniserait",
      "ipas": [
        "\\[il/ɛl/ɔ̃] tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "nous tokeniserions",
      "ipas": [
        "\\nu tɔ.kɛ.ni.zə.ʁjɔ̃\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "vous tokeniseriez",
      "ipas": [
        "\\vu tɔ.kɛ.ni.zə.ʁje\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    },
    {
      "form": "ils/elles tokeniseraient",
      "ipas": [
        "\\[il/ɛl] tɔ.kɛ.ni.z(ə.)ʁɛ\\"
      ],
      "source": "Conjugaison:français/tokeniser",
      "tags": [
        "conditional",
        "present"
      ]
    }
  ],
  "lang": "Français",
  "lang_code": "fr",
  "pos": "verb",
  "pos_title": "Verbe",
  "raw_tags": [
    "1ᵉʳ groupe"
  ],
  "related": [
    {
      "word": "tokéniser"
    }
  ],
  "senses": [
    {
      "categories": [
        "Exemples en français"
      ],
      "examples": [
        {
          "ref": "site dumas.ccsd.cnrs.fr, 17 décembre 2021",
          "text": "Dans une première phase d’observation, nous avons donc comparé les données du fichier Input sur un même texte qui est tokenisé de deux manières."
        }
      ],
      "glosses": [
        "Découper automatiquement un texte en unités lexicales grâce à une analyse lexicale."
      ]
    },
    {
      "categories": [
        "Exemples en français"
      ],
      "examples": [
        {
          "ref": "journal 20 minutes, édition Paris-IDF, 14 juin 2023, page 16",
          "text": "La perspective de « tokeniser des biens », c’est-à-dire de les mettre sur la blockchain, émerge, notamment dans le monde de l’immobilier."
        },
        {
          "ref": "site beaubourg-avocats.fr, 23 mars 2022",
          "text": "Lorsqu’un émetteur de jetons souhaite tokeniser un actif financier, celui-ci devra connaître la qualification juridique du token émis."
        },
        {
          "ref": "site www.dsavocats.com, novembre 2020",
          "text": "Tokeniser un actif immobilier suppose d’associer un jeton numérique inscrit sur une blockchain à un bien immobilier."
        }
      ],
      "glosses": [
        "Associer un jeton NFT dans une blockchain à un bien réel."
      ]
    }
  ],
  "sounds": [
    {
      "ipa": "\\tɔ.kɛ.ni.ze\\"
    }
  ],
  "tags": [
    "transitive"
  ],
  "translations": [
    {
      "lang": "Anglais",
      "lang_code": "en",
      "word": "tokenize"
    }
  ],
  "word": "tokeniser"
}

Download raw JSONL data for tokeniser meaning in All languages combined (9.2kB)


This page is a part of the kaikki.org machine-readable All languages combined dictionary. This dictionary is based on structured data extracted on 2024-11-03 from the frwiktionary dump dated 2024-10-20 using wiktextract (d6bf104 and a5af179). The data shown on this site has been post-processed and various details (e.g., extra categories) removed, some information disambiguated, and additional data merged from other sources. See the raw data download page for the unprocessed wiktextract data.

If you use this data in academic research, please cite Tatu Ylonen: Wiktextract: Wiktionary as Machine-Readable Structured Data, Proceedings of the 13th Conference on Language Resources and Evaluation (LREC), pp. 1317-1325, Marseille, 20-25 June 2022. Linking to the relevant page(s) under https://kaikki.org would also be greatly appreciated.