Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Extracts entities, classifies text, pulls out structured data and finds relations in plain text, with one small model that runs on a CPU. It suits developers who want information extraction without a GPU or an outside API.
GLiNER2 base is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install gliner2
GLiNER2 base is an information extraction model from fastino. A single model handles four jobs. It finds named entities, labels whole texts, pulls fields into a structure and links entities through relations. It was made so you do not need a chain of separate tools or an outside API for them.
You describe what you want, such as a list of entity labels or a set of fields, and it reads your text for those. The card says it is built for efficient CPU inference.
Developers and data teams who need to turn free text into labels and fields suit it best. It runs from Python.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Backend developers | Pull people, companies and products out of text | Extract entities from a news line |
| Customer support | Support teams | Sort comments by sentiment or topic | Label a review as positive or negative |
| E-commerce | Catalog teams | Turn product descriptions into fields | Read name, storage and price from a listing |
Anyone who wants a chat assistant can skip it, because it reads text and returns structure, not conversation.
You run it yourself in Python, on Windows, macOS or Linux.
| Use case | Who | What they get back |
|---|---|---|
| Entity extraction | Developers | A dictionary of entities grouped under your labels |
| Text classification | Support teams | A single label or several labels for each text |
| Structured extraction | Catalog teams | Fields such as name, storage and price |
You need Python and the gliner2 package. The model downloads when you load it by name.
pip install gliner2
pip install -U huggingface_hub hf download fastino/gliner2-base-v1
Load the model, then call the method for the job you want. For entities you pass the text and a list of labels.
from gliner2 import GLiNER2
# Load the model
extractor = GLiNER2.from_pretrained("fastino/gliner2-base-v1")
# Extract entities
text = "Apple CEO Tim Cook announced iPhone 15 in Cupertino yesterday."
result = extractor.extract_entities(text, ["company", "person", "product", "location"])
print(result)
# Output: {'entities': {'company': ['Apple'], 'person': ['Tim Cook'], 'product': ['iPhone 15'], 'location': ['Cupertino']}}For classification you pass the text and the labels you allow.
# Single-label classification
result = extractor.classify_text(
"This laptop has amazing performance but terrible battery life!",
{"sentiment": ["positive", "negative", "neutral"]}
)
print(result)
# Output: {'sentiment': 'negative'}| Tool | What it does |
|---|---|
| extract_entities | Finds entities for the labels you give |
| classify_text | Picks one label, or several, for a text |
| extract_json | Fills the fields you describe from a text |
| create_schema | Builds one schema that combines several tasks |
| extract | Runs a combined schema over a text |
You pass a sentence about Apple's CEO Tim Cook announcing a phone in Cupertino, with the labels company, person, product and location. It returns Apple as the company, Tim Cook as the person, the phone as the product and Cupertino as the location.
Think of the model as a reader that marks up a text for you. You say what to look for, and it hands back labels and fields. Your first small try is the entity example above with a sentence of your own.
Under the hood, one model handles four tasks in a single forward pass, and you steer it with labels or a schema at run time. The card describes about 205M parameters and CPU-first inference with local processing. The trade-off is that the labels you write decide what you get back.
The card says processing stays local and needs no outside service once the model files are on your machine.
Extracts entities, classifies text, pulls out structured data and finds relations in plain text, with one small model that runs on a CPU. It suits developers who want information extraction without a GPU or an outside API.
Made by fastino on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: GLiNER2 base is an information extraction model from fastino. A single model handles four jobs. It finds named entities, labels whole texts, pulls fields into a structure and links entities through relations. It was made so you do not need a chain of separate tools or an outside API for them.
You describe what you want, such as a list of entity labels or a set of fields, and it reads your text for those. The card says it is built for efficient CPU inference.
Who it suits: Developers and data teams who need to turn free text into labels and fields suit it best. It runs from Python.
Industry | Who uses it | How they use it | Example
Software | Backend developers | Pull people, companies and products out of text | Extract entities from a news line
Customer support | Support teams | Sort comments by sentiment or topic | Label a review as positive or negative
E-commerce | Catalog teams | Turn product descriptions into fields | Read name, storage and price from a listing
Anyone who wants a chat assistant can skip it, because it reads text and returns structure, not conversation.
Where to use it: You run it yourself in Python, on Windows, macOS or Linux.
Use case | Who | What they get back
Entity extraction | Developers | A dictionary of entities grouped under your labels
Text classification | Support teams | A single label or several labels for each text
Structured extraction | Catalog teams | Fields such as name, storage and price
How to set it up: You need Python and the gliner2 package. The model downloads when you load it by name.
pip install gliner2
pip install -U huggingface_hub
hf download fastino/gliner2-base-v1
How to use it: Load the model, then call the method for the job you want. For entities you pass the text and a list of labels.
from gliner2 import GLiNER2
# Load the model
extractor = GLiNER2.from_pretrained("fastino/gliner2-base-v1")
# Extract entities
text = "Apple CEO Tim Cook announced iPhone 15 in Cupertino yesterday."
result = extractor.extract_entities(text, ["company", "person", "product", "location"])
print(result)
# Output: {'entities': {'company': ['Apple'], 'person': ['Tim Cook'], 'product': ['iPhone 15'], 'location': ['Cupertino']}}
For classification you pass the text and the labels you allow.
# Single-label classification
result = extractor.classify_text(
"This laptop has amazing performance but terrible battery life!",
{"sentiment": ["positive", "negative", "neutral"]}
)
print(result)
# Output: {'sentiment': 'negative'}
Tool | What it does
extract_entities | Finds entities for the labels you give
classify_text | Picks one label, or several, for a text
extract_json | Fills the fields you describe from a text
create_schema | Builds one schema that combines several tasks
extract | Runs a combined schema over a text
Example: You pass a sentence about Apple's CEO Tim Cook announcing a phone in Cupertino, with the labels company, person, product and location. It returns Apple as the company, Tim Cook as the person, the phone as the product and Cupertino as the location.
For newcomers and experts: Think of the model as a reader that marks up a text for you. You say what to look for, and it hands back labels and fields. Your first small try is the entity example above with a sentence of your own.
Under the hood, one model handles four tasks in a single forward pass, and you steer it with labels or a schema at run time. The card describes about 205M parameters and CPU-first inference with local processing. The trade-off is that the labels you write decide what you get back.
Your text and your labels or schema
One model reads them together
Entities, classes, fields or relations
A plain Python dictionary comes back
Good to know: The card says processing stays local and needs no outside service once the model files are on your machine.
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download fastino/gliner2-base-v1
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| GLiNER2 base This page | 353,994 | 106 | 208M | apache-2.0 | |
| GLiNER2.5 BaseShares gliner2 · safetensors | 132,027 | 43 | 194M | apache-2.0 | |
| GLiNER2.5-DecideShares gliner2 · safetensors | 89,759 | 457 | 486M | apache-2.0 | |
| GLiNER2.5 MultiShares gliner2 · safetensors | 88,821 | 300 | 287M | apache-2.0 | |
| GLiNER2.5-multi-DecideShares gliner2 · safetensors | 12,037 | 74 | 287M | apache-2.0 | |
| all-MiniLM-L6-v2Shares safetensors | 174,740,184 | 6,104 | 22.7M | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…