TokenAtlas
prajwalpujari16 · Kit
A browser explorer that compares how many tokens the same text costs across 52 languages and several LLM tokenizers, built on the FLORES-200 benchmark. For peo…
New
prajwalpujari16 · Kit
A browser explorer that compares how many tokens the same text costs across 52 languages and several LLM tokenizers, built on the FLORES-200 benchmark. For peo…