#multilingual AI
1 articles tagged multilingual AI. At twelve articles this topic starts lifting the whole site in search.
Timeline
All articles
-
Tech · 3 min readWhat is a tokenizer — why the same sentence costs 30% more tokens on another model
Definition — splits text into tokens the model reads; pricing and context limits are counted in tokens