Mindket

multilingual-e5-base

Newversion 1 · updated

Overview

Turns text in about 100 languages into vectors so you can compare meaning across them, for search and matching. Made for developers who build multilingual retrieval.

multilingual-e5-base is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.

At a glance

You need
  • Python and pip
  • torch and transformers, which the sample imports
  • About 1.1 GB of disk for the F32 weights
Runs in
  • Python with the Transformers library, as in the card's sample
  • The sentence-transformers library, which Hugging Face lists for it
  • Windows, macOS or Linux, where you can run Python
  • Your own search or retrieval code
Start with
pip install -U huggingface_hub
hf download intfloat/multilingual-e5-base

Platform

WindowsOperating system
macOSOperating system
LinuxOperating system

About

What it is

multilingual-e5-base turns a piece of text into a list of numbers, called an embedding, so you can compare texts by meaning across languages. It has 12 layers and makes vectors of size 768. Hugging Face lists it at 278M parameters.

Who it suits

It suits developers and data teams who build search, matching or grouping over text in many languages.

IndustryWho uses itHow they use itExample
SoftwareSearch engineersEmbed documents and queries, then rank the documents by scoreFind the passage that answers a question asked in another language
Customer supportHelp desk teamsMatch a customer question to the closest help articleAn English question matched to a Chinese article
PublishingContent teamsGroup articles by topic across languagesGather news pieces about the same story
ResearchData scientistsCompare sentences across languages by scorePair a sentence with its translation

If you need a model that writes text or answers questions itself, you can skip it, because it only produces embeddings.

Where to use it

  • Python with the Transformers library, as in the card's sample
  • The sentence-transformers library, which Hugging Face lists for it
  • Windows, macOS or Linux, where you can run Python
  • Your own search or retrieval code
Use caseWhoWhat they get back
Multilingual searchSearch engineersScores that rank passages for a query in any supported language
Question matchingSupport teamsThe closest stored question or article for a new one
Topic groupingData teamsVectors you can cluster by meaning

How to set it up

You need Python with pip, plus the libraries the sample imports.

  • Python and pip
  • torch and transformers, which the sample imports
  • About 1.1 GB of disk for the F32 weights
  1. Install the Hugging Face client with pip.
  2. Download the repository with the hf command.
  3. Install torch and transformers if you do not have them yet.
  4. Run the card's Python sample with your own texts.
pip install -U huggingface_hub
hf download intfloat/multilingual-e5-base

How to use it

Start every text with "query: " or "passage: ", even when it is not English. For tasks other than retrieval, the card says the "query: " prefix is enough. Then tokenize, run the model, average the token vectors and normalize them.

import torch.nn.functional as F

from torch import Tensor
from transformers import AutoTokenizer, AutoModel

def average_pool(last_hidden_states: Tensor,
                 attention_mask: Tensor) -> Tensor:
    last_hidden = last_hidden_states.masked_fill(~attention_mask[..., None].bool(), 0.0)
    return last_hidden.sum(dim=1) / attention_mask.sum(dim=1)[..., None]

tokenizer = AutoTokenizer.from_pretrained('intfloat/multilingual-e5-base')
model = AutoModel.from_pretrained('intfloat/multilingual-e5-base')

batch_dict = tokenizer(input_texts, max_length=512, padding=True, truncation=True, return_tensors='pt')

outputs = model(**batch_dict)
embeddings = average_pool(outputs.last_hidden_state, batch_dict['attention_mask'])

embeddings = F.normalize(embeddings, p=2, dim=1)
scores = (embeddings[:2] @ embeddings[2:].T) * 100
print(scores.tolist())
ToolWhat it does
AutoTokenizerSplits each text into tokens, cut at 512
AutoModelRuns the model and returns a vector for every token
average_poolAverages the token vectors into one vector per text
F.normalizeScales each vector so the dot product works as a score

Example

You set input_texts to two queries and two passages. One query asks how much protein a woman should eat, and the other asks in Chinese about a home pumpkin dish. The passages are an English nutrition note and a Chinese recipe. The script prints a grid of scores, one for each query and passage pair.

For newcomers and experts

An embedding model gives each text a position in a space, so texts with similar meaning land close together. The first small thing to try is the sample above with two short sentences of your own, each starting with its prefix.

The model starts from xlm-roberta-base. Its first training stage is contrastive pre-training on weakly paired texts, such as titles with page content, news, translation pairs, Wikipedia sections, comments with replies and questions with answers. A second stage adds supervised fine-tuning. Languages with little training data may score lower.

  1. Add the query or passage prefix
  2. Tokenize the text, up to 512 tokens
  3. Run the model
  4. Average the token vectors
  5. Normalize and compare with a dot product

Good to know

  • Prefix: texts without "query: " or "passage: " at the start are not what the card's sample does, so add one.
  • Coverage: it supports 100 languages inherited from its base model.
  • Other versions: Hugging Face lists 280 quantized and 189 fine-tuned versions by other people.
  • License: MIT, as the License line says.
  • Cost to run: no API key, account or paid service is named. It runs on your own computer.
  • Data it reaches: the texts you feed it, and Hugging Face for the model download.
  • Not for: it does not generate text. The card warns that low-resource languages may see weaker results.

README and files

README

multilingual-e5-base

Turns text in about 100 languages into vectors so you can compare meaning across them, for search and matching. Made for developers who build multilingual retrieval.

Made by intfloat on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: multilingual-e5-base turns a piece of text into a list of numbers, called an embedding, so you can compare texts by meaning across languages. It has 12 layers and makes vectors of size 768. Hugging Face lists it at 278M parameters.

Who it suits: It suits developers and data teams who build search, matching or grouping over text in many languages.

Industry | Who uses it | How they use it | Example
Software | Search engineers | Embed documents and queries, then rank the documents by score | Find the passage that answers a question asked in another language
Customer support | Help desk teams | Match a customer question to the closest help article | An English question matched to a Chinese article
Publishing | Content teams | Group articles by topic across languages | Gather news pieces about the same story
Research | Data scientists | Compare sentences across languages by score | Pair a sentence with its translation

If you need a model that writes text or answers questions itself, you can skip it, because it only produces embeddings.

Where to use it:

  • Python with the Transformers library, as in the card's sample
  • The sentence-transformers library, which Hugging Face lists for it
  • Windows, macOS or Linux, where you can run Python
  • Your own search or retrieval code
Use case | Who | What they get back
Multilingual search | Search engineers | Scores that rank passages for a query in any supported language
Question matching | Support teams | The closest stored question or article for a new one
Topic grouping | Data teams | Vectors you can cluster by meaning

How to set it up: You need Python with pip, plus the libraries the sample imports.

  • Python and pip
  • torch and transformers, which the sample imports
  • About 1.1 GB of disk for the F32 weights
  1. Install the Hugging Face client with pip.
  2. Download the repository with the hf command.
  3. Install torch and transformers if you do not have them yet.
  4. Run the card's Python sample with your own texts.
pip install -U huggingface_hub
hf download intfloat/multilingual-e5-base

How to use it: Start every text with "query: " or "passage: ", even when it is not English. For tasks other than retrieval, the card says the "query: " prefix is enough. Then tokenize, run the model, average the token vectors and normalize them.

import torch.nn.functional as F

from torch import Tensor
from transformers import AutoTokenizer, AutoModel

def average_pool(last_hidden_states: Tensor,
                 attention_mask: Tensor) -> Tensor:
    last_hidden = last_hidden_states.masked_fill(~attention_mask[..., None].bool(), 0.0)
    return last_hidden.sum(dim=1) / attention_mask.sum(dim=1)[..., None]

tokenizer = AutoTokenizer.from_pretrained('intfloat/multilingual-e5-base')
model = AutoModel.from_pretrained('intfloat/multilingual-e5-base')

batch_dict = tokenizer(input_texts, max_length=512, padding=True, truncation=True, return_tensors='pt')

outputs = model(**batch_dict)
embeddings = average_pool(outputs.last_hidden_state, batch_dict['attention_mask'])

embeddings = F.normalize(embeddings, p=2, dim=1)
scores = (embeddings[:2] @ embeddings[2:].T) * 100
print(scores.tolist())
Tool | What it does
AutoTokenizer | Splits each text into tokens, cut at 512
AutoModel | Runs the model and returns a vector for every token
average_pool | Averages the token vectors into one vector per text
F.normalize | Scales each vector so the dot product works as a score

Example: You set input_texts to two queries and two passages. One query asks how much protein a woman should eat, and the other asks in Chinese about a home pumpkin dish. The passages are an English nutrition note and a Chinese recipe. The script prints a grid of scores, one for each query and passage pair.

For newcomers and experts: An embedding model gives each text a position in a space, so texts with similar meaning land close together. The first small thing to try is the sample above with two short sentences of your own, each starting with its prefix.

The model starts from xlm-roberta-base. Its first training stage is contrastive pre-training on weakly paired texts, such as titles with page content, news, translation pairs, Wikipedia sections, comments with replies and questions with answers. A second stage adds supervised fine-tuning. Languages with little training data may score lower.

Add the query or passage prefix
Tokenize the text, up to 512 tokens
Run the model
Average the token vectors
Normalize and compare with a dot product

Good to know:

  • Prefix: texts without "query: " or "passage: " at the start are not what the card's sample does, so add one.
  • Coverage: it supports 100 languages inherited from its base model.
  • Other versions: Hugging Face lists 280 quantized and 189 fine-tuned versions by other people.
  • License: MIT, as the License line says.
  • Cost to run: no API key, account or paid service is named. It runs on your own computer.
  • Data it reaches: the texts you feed it, and Hugging Face for the model download.
  • Not for: it does not generate text. The card warns that low-resource languages may see weaker results.

On Hugging Face, 16 November 2026

  • Task: sentence similarity
  • Library: sentence-transformers
  • Parameters: 278M
  • Weights: about 1.1 GB in F32; about 139 MB at 4-bit (estimate)
  • Formats: Safetensors
  • Downloads in the last 30 days: 4,750,367
  • Likes: 422
  • License: mit
  • Languages: af, am, ar, as, az, be, bg, bn
  • Quantized versions: 281
  • Fine-tunes: 192
  • Tags: sentence-transformers, pytorch, onnx, safetensors, openvino, xlm-roberta, mteb, sentence-similarity, multilingual, model-index, text-embeddings-inference

Links

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download intfloat/multilingual-e5-base

Then follow the usage in its model card. Nothing in this kit runs by itself.

Files
README.md  6 KB

1 file, 6 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-16

Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

ProductDownloads, last 30 daysLikesParametersLicenseLast change
multilingual-e5-base This page4,750,367422278Mmit
multilingual-e5-largeShares xlm-roberta · openvino · mteb7,120,5551,284560Mmit
bge-small-en-v1.5Shares mteb · model-index · sentence-similarity45,750,54867133.4Mmit
bge-base-en-v1.5Shares mteb · model-index · sentence-similarity8,508,165542109Mmit
paraphrase-multilingual-MiniLM-L12-v2Shares openvino · sentence-similarity · text-embeddings-inference26,540,1251,505118Mapache-2.0
nomic-embed-text-v1.5Shares mteb · model-index · sentence-similarity11,809,681994137Mapache-2.0
Numbers as Mindket last read them, from 2026-11-13 to 2026-11-16.

Reviews

No ratings yet

Write a review

No reviews yet.

What people say

Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.

Searched

More from Mindket

See all from Mindket

all-mpnet-base-v2

sentence-transformers · Kit

Turns sentences and paragraphs into 768-number vectors so you can search, cluster and compare text by meaning. It suits developers and data teams working in En…

New

sprite-gen

aldegad · Skill

Turns one base drawing of a character into game-ready sprites, either an atlas with a manifest or transparent motion loops, for game developers working in Code…

New4097

Monocolor Editorial Print

yanliudesign · Skill

Makes original one-ink and two-ink editorial images from a theme, an object or your photo, for posters, zines, portraits and packaging. Returns the image, the…

New3662

Similar in Developer

See all in Developer

VibeSkills

foryourhealth111-pixel · Skill

Picks the right skills from a large installed pool and breaks each task into checkable steps for your coding agent. In its own benchmark, mean reward rose 21.1…

New3821

claude-bughunter

elementalsouls · Skill

Gives Claude Code 83 skills and 15 slash commands for bug bounty hunting and authorized red-team work, from web vulnerability classes to enterprise identity at…

New6853

Runs Qwen3.8-27B with a vocabulary cut down to ASCII, so a single 16 GB graphics card can hold a much longer prompt. A GGUF build for English text and code wit…

New