Item

OpenAI Tokenizer (Q2799)

Revision as of 11:52, 18 June 2026 by Fabian (talk | contribs) (‎Changed label, description and/or aliases in de, and other parts: Added german label and description)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
A tool to show the how a large language model tokenizes a text
  • Tokenizer
Language Label Description Also known as
English
OpenAI Tokenizer
A tool to show the how a large language model tokenizes a text
  • Tokenizer

Statements

instance of
Software
0 references
author
OpenAI
0 references
 
Retrieved from "https://graphit.ur.de/w/index.php?title=Item:Q2799&oldid=28524"