Item

OpenAI Tokenizer (Q2799)

Revision as of 09:15, 2 February 2026 by Leonie (talk | contribs) (‎Added [en] alias: Tokenizer)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
A tool to show the how a large language model tokenizes a text
  • Tokenizer
Language Label Description Also known as
English
OpenAI Tokenizer
A tool to show the how a large language model tokenizes a text
  • Tokenizer

Statements

instance of
Software
0 references
author
OpenAI
0 references
 
Retrieved from "https://graphit.ur.de/w/index.php?title=Item:Q2799&oldid=25337"