OpenAI Tokenizer (Q2799): Difference between revisions
(Created claim: url (P20): https://platform.openai.com/tokenizer) |
(Changed label, description and/or aliases in de, and other parts: Added german label and description) |
||
| (2 intermediate revisions by one other user not shown) | |||
| label / de | label / de | ||
OpenAI Tokenizer | |||
| aliases / en / 0 | aliases / en / 0 | ||
Tokenizer | |||
| description / de | description / de | ||
Ein Tool, das zeigt, wie ein großes Sprachmodell einen Text tokenisiert | |||
| Property / author | |||
OpenAI | |||
| Property / author: OpenAI / rank | |||
Normal rank | |||
Latest revision as of 11:52, 18 June 2026
A tool to show the how a large language model tokenizes a text
- Tokenizer
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | OpenAI Tokenizer |
A tool to show the how a large language model tokenizes a text |
|
Statements
OpenAI
0 references