OpenAI Tokenizer (Q2799): Difference between revisions
(Created a new Item: OpenAI Tokenizer, A tool to show the how a large language model tokenizes a text) |
(Changed label, description and/or aliases in de, and other parts: Added german label and description) |
||
| (4 intermediate revisions by one other user not shown) | |||
| label / de | label / de | ||
OpenAI Tokenizer | |||
| aliases / en / 0 | aliases / en / 0 | ||
Tokenizer | |||
| description / de | description / de | ||
Ein Tool, das zeigt, wie ein großes Sprachmodell einen Text tokenisiert | |||
| Property / instance of | |||
| Property / instance of: Software / rank | |||
Normal rank | |||
| Property / url | |||
| Property / url: https://platform.openai.com/tokenizer / rank | |||
Normal rank | |||
| Property / author | |||
OpenAI | |||
| Property / author: OpenAI / rank | |||
Normal rank | |||
Latest revision as of 11:52, 18 June 2026
A tool to show the how a large language model tokenizes a text
- Tokenizer
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | OpenAI Tokenizer |
A tool to show the how a large language model tokenizes a text |
|
Statements
OpenAI
0 references