The Tokenizer Playground
Experiment with different tokenizers (running
locally
in your browser).
gpt-4 / gpt-3.5-turbo / text-embedding-ada-002
text-davinci-003 / text-davinci-002
gpt-3
Grok-1
Claude
Mistral v3
Mistral v1
Gemma
Llama 3
LLaMA / Llama 2
Cohere Command-R
T5
bert-base-cased
Custom
Tokens
0
Characters
0
Text
Token IDs
Hide