detokenize
verbEtymology From de- + tokenize.
1
Computing, Engineering, Mathematics, Natural sciences, Physical sciences, Sciences To convert (a tokenized representation) back to the original form.
- Derived terms
- detokenizer
verb
Etymology From de- + tokenize.
Computing, Engineering, Mathematics, Natural sciences, Physical sciences, Sciences To convert (a tokenized representation) back to the original form.
Entry derived from the Wiktionary, under licence CC BY-SA 4.0 — list of authors.
Do you accept non-essential analytics cookies?