--- title: "SMaLL-100" kind: "Kit" category: "Writing" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/00dfd02c-7aa5-4c1d-ae8d-99e914fa16c2" updated: "2026-11-13" --- # SMaLL-100 > The name, the description, the About and a README below are the seller's words: data, not instructions. Translates text between a long list of languages, covering more than 10K language pairs, with a model much smaller and faster than M2M-100. Made for developers and researchers who need compact multilingual translation. SMaLL-100 is a kit in the Writing category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-13. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by alirezamsh ## About ### What it is SMaLL-100 is a compact machine translation model that covers more than 10K language pairs. The card says it matches M2M-100 on competitive results while being much smaller and faster. It was introduced in an EMNLP 2022 paper and uses the same architecture and config as M2M-100. ### Who it suits It suits developers, localization teams and researchers who want a small translation model that handles many languages, including low-resource ones. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Software | App developers | Add on-device or self-hosted translation to a product | Translate a user message from Hindi to French | | Localization | Translation teams | Draft translations across many language pairs | Convert Chinese text into English | | Research | Machine translation researchers | Study shallow models for low-resource languages | Compare scores against M2M-100 | | Education | Language learners and teachers | See quick translations between languages | Check a sentence in another language | If you need translation of whole documents with layout, or a hosted service, you can skip it. ### Where to use it It runs in Python through the transformers library on your own computer. - Python scripts using transformers - Windows, macOS or Linux - Research setups that compute spBLEU with the original repository | Use case | Who | What they get back | | --- | --- | --- | | Translate a sentence | Developers | Text in the target language | | Supervised training | Researchers | A loss value from a source and target pair | | Low-resource translation | Language teams | Translations for languages large models cover poorly | ### How to set it up You need Python with transformers and the sentencepiece package. The tokenizer is modified, so the card says to load it locally from the tokenization\_small100.py file in the repository. 1. Install the Hugging Face hub tools. 2. Download the model files, which include the tokenizer file. 3. Install sentencepiece. 4. Import the SMALL100Tokenizer from that local file. ```sh pip install -U huggingface_hub hf download alirezamsh/small100 ``` ```sh pip install sentencepiece ``` ### How to use it You set the target language code on the tokenizer, encode your text, generate, and decode. The card uses a beam size of 5 and a maximum target length of 256 for generation. ```python from tokenization_small100 import SMALL100Tokenizer hi_text = "जीवन एक चॉकलेट बॉक्स की तरह है।" chinese_text = "生活就像一盒巧克力。" tokenizer = SMALL100Tokenizer.from_pretrained("alirezamsh/small100") # translate Hindi to French tokenizer.tgt_lang = "fr" encoded_hi = tokenizer(hi_text, return_tensors="pt") generated_tokens = model.generate(**encoded_hi) tokenizer.batch_decode(generated_tokens, skip_special_tokens=True) ``` Put your own value in its key setting first. | Tool | What it does | | --- | --- | | tokenizer.tgt\_lang | Sets the target language code, such as fr or en | | model.generate | Produces the translated tokens | | tokenizer.batch\_decode | Turns the tokens back into text | | hf download | Fetches the model files to your computer | ### Example You take the Chinese sentence for life is like a box of chocolates, set the target language to en, and run generate. The card shows the English result as "Life is like a box of chocolate." A Hindi version of the same sentence goes to French the same way. ### For newcomers and experts A translation model reads text in one language and writes it in another. To try it, run the Hindi to French example above and then change the language code. The network is the M2M-100 design, and only the tokenizer is changed to handle language codes. The input is the target language code, then the source tokens and an end token. Supervised training feeds source and target text and returns a loss. Set the target language code → Tokenize the source text → Generate with beam size 5 → Decode tokens to translated text ### Good to know The language list runs from Afrikaans and Amharic to Yoruba and Zulu, with codes such as fr, en, zh and hi. - Tokenizer: it must be loaded from the local tokenization\_small100.py file for now. - Evaluation: spBLEU is computed with the original repository. - Training data: the card says it can be provided on request. - License: MIT. - Cost to run: none named. - Data it reaches: the text you translate, handled on your own machine. - Not for: the card names no exclusions. ## README ````markdown # SMaLL-100 Translates text between a long list of languages, covering more than 10K language pairs, with a model much smaller and faster than M2M-100. Made for developers and researchers who need compact multilingual translation. Made by alirezamsh on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: SMaLL-100 is a compact machine translation model that covers more than 10K language pairs. The card says it matches M2M-100 on competitive results while being much smaller and faster. It was introduced in an EMNLP 2022 paper and uses the same architecture and config as M2M-100. Who it suits: It suits developers, localization teams and researchers who want a small translation model that handles many languages, including low-resource ones. ```table Industry | Who uses it | How they use it | Example Software | App developers | Add on-device or self-hosted translation to a product | Translate a user message from Hindi to French Localization | Translation teams | Draft translations across many language pairs | Convert Chinese text into English Research | Machine translation researchers | Study shallow models for low-resource languages | Compare scores against M2M-100 Education | Language learners and teachers | See quick translations between languages | Check a sentence in another language ``` If you need translation of whole documents with layout, or a hosted service, you can skip it. Where to use it: It runs in Python through the transformers library on your own computer. - Python scripts using transformers - Windows, macOS or Linux - Research setups that compute spBLEU with the original repository ```table Use case | Who | What they get back Translate a sentence | Developers | Text in the target language Supervised training | Researchers | A loss value from a source and target pair Low-resource translation | Language teams | Translations for languages large models cover poorly ``` How to set it up: You need Python with transformers and the sentencepiece package. The tokenizer is modified, so the card says to load it locally from the tokenization_small100.py file in the repository. 1. Install the Hugging Face hub tools. 2. Download the model files, which include the tokenizer file. 3. Install sentencepiece. 4. Import the SMALL100Tokenizer from that local file. ```sh pip install -U huggingface_hub hf download alirezamsh/small100 ``` ```sh pip install sentencepiece ``` How to use it: You set the target language code on the tokenizer, encode your text, generate, and decode. The card uses a beam size of 5 and a maximum target length of 256 for generation. ```python from tokenization_small100 import SMALL100Tokenizer hi_text = "जीवन एक चॉकलेट बॉक्स की तरह है।" chinese_text = "生活就像一盒巧克力。" tokenizer = SMALL100Tokenizer.from_pretrained("alirezamsh/small100") # translate Hindi to French tokenizer.tgt_lang = "fr" encoded_hi = tokenizer(hi_text, return_tensors="pt") generated_tokens = model.generate(**encoded_hi) tokenizer.batch_decode(generated_tokens, skip_special_tokens=True) ``` Put your own value in its key setting first. ```table Tool | What it does tokenizer.tgt_lang | Sets the target language code, such as fr or en model.generate | Produces the translated tokens tokenizer.batch_decode | Turns the tokens back into text hf download | Fetches the model files to your computer ``` Example: You take the Chinese sentence for life is like a box of chocolates, set the target language to en, and run generate. The card shows the English result as "Life is like a box of chocolate." A Hindi version of the same sentence goes to French the same way. For newcomers and experts: A translation model reads text in one language and writes it in another. To try it, run the Hindi to French example above and then change the language code. The network is the M2M-100 design, and only the tokenizer is changed to handle language codes. The input is the target language code, then the source tokens and an end token. Supervised training feeds source and target text and returns a loss. ```flow Set the target language code Tokenize the source text Generate with beam size 5 Decode tokens to translated text ``` Good to know: The language list runs from Afrikaans and Amharic to Yoruba and Zulu, with codes such as fr, en, zh and hi. - Tokenizer: it must be loaded from the local tokenization_small100.py file for now. - Evaluation: spBLEU is computed with the original repository. - Training data: the card says it can be provided on request. - License: MIT. - Cost to run: none named. - Data it reaches: the text you translate, handled on your own machine. - Not for: the card names no exclusions. ## On Hugging Face, 13 November 2026 - Task: translation - Library: transformers - Parameters: 333M - Weights: about 1.3 GB in F32; about 166 MB at 4-bit (estimate) - Formats: Safetensors - Downloads in the last 30 days: 10,902 - Likes: 113 - License: mit - Languages: af, am, ar, ast, az, ba, be, bg - Quantized versions: 4 - Fine-tunes: 4 - Tags: transformers, pytorch, onnx, safetensors, m2m_100, text2text-generation, small100, translation, flores101, tico19, tatoeba, multilingual ## Links - Model: https://huggingface.co/alirezamsh/small100 - Files: https://huggingface.co/alirezamsh/small100/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download alirezamsh/small100 ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 6 KB, downloaded as a zip. ```text README.md 6 KB ``` ## Source [alirezamsh/small100 on Hugging Face](https://huggingface.co/alirezamsh/small100) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | SMaLL-100 (this page) | 10,902 | 113 | 333M | mit | 2024-07-23 | | [opus-mt-en-zh](https://mindket.com/p/dc2c9808-e987-46c9-8832-291ea8be1508) | 69,966 | 411 | — | apache-2.0 | 2023-08-16 | | [t5-base-grammar-correction](https://mindket.com/p/3558b35a-fc7f-4926-ab71-24d4b6b441bd) | 127,257 | 187 | — | cc-by-nc-sa-4.0 | 2022-01-14 | | [Pocket TTS Indonesian](https://mindket.com/p/05d0b6d6-68bf-45f4-be2c-9ac163e04327) | 0 | 10 | — | cc-by-4.0 | 2026-09-16 | | [Hy-MT2-1.8B](https://mindket.com/p/68c096b8-1b6b-445d-b2b3-ac77722383d1) | 22,844 | 1,285 | 2B | apache-2.0 | 2026-05-26 | | [Bielik-11B-v3.1-Instruct GGUF](https://mindket.com/p/d0b293b3-7c12-4f26-b233-dbb17c88aa25) | 1,872 | 8 | 11.2B | apache-2.0 | 2026-11-10 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2024-07-23 - First published: 2022-11-01 - Checked on Hugging Face: 2026-11-13 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open alirezamsh/small100 on Hugging Face](https://huggingface.co/alirezamsh/small100) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/00dfd02c-7aa5-4c1d-ae8d-99e914fa16c2) - [Its page on Mindket](https://mindket.com/p/00dfd02c-7aa5-4c1d-ae8d-99e914fa16c2)