Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Gives you an NVFP4 quantized copy of Ornith-1.5-122B, a 122B mixture-of-experts text model meant for single-GPU use and strong in coding tests. For developers who host large models themselves.
Ornith-1.5-122B-NVFP4 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download ornith-ai/Ornith-1.5-122B-NVFP4
This repository holds a quantized NVFP4 copy of Ornith-1.5-122B, a text generation model from ornith-ai. The card describes the original as a 122B mixture-of-experts model designed to run on a single GPU, with a separate mobile variant for phones.
Ornith-1.5 builds on Ornith-1.0, which started from Qwen3.5 and Gemma4. Its training loop makes new tasks, builds the scaffold to solve them and learns from the attempts through reinforcement learning.
It suits developers and teams who self-host a large model for coding and agent work and want a smaller quantized copy to fit on fewer GPUs.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Developers | Host a coding model on their own server | Fix a failing build from a terminal |
| AI platforms | ML engineers | Serve a quantized large model to internal users | Run a private coding assistant |
| Research | Model researchers | Study self-improving training loops | Compare against other large models |
| Security | Security engineers | Try the model on cyber benchmarks | Run the card's CyberGym style tests |
If you do not have a large GPU machine, or you need a model for images or audio, you can skip it.
You fetch the files on Windows, macOS or Linux with Python. A 64 GB model needs a machine with plenty of GPU memory to run.
| Use case | Who | What they get back |
|---|---|---|
| Coding help | Developers | Code and fixes written as text |
| Agent tasks | Builders | Step-by-step text output for tools and terminals |
| Model testing | Researchers | Scores to compare with other models |
You need Python with pip to fetch the files, and about 64 GB of disk space for the weights. The card does not give run commands in the part shown here, so follow its own instructions to run it.
pip install -U huggingface_hub hf download ornith-ai/Ornith-1.5-122B-NVFP4
Once the model is loaded, you send text prompts and read the text it writes. Coding and terminal tasks are where the card points its results.
You give the model a failing command and the error text and ask for a fix. It answers with a written explanation and the changed code or command.
If you are new, know that this is a huge download meant for strong hardware. Start by reading the model card, then check that your machine has the memory for 64 GB of weights.
If you know the field, the training loop tunes task generation, scaffold construction and solution rollouts together. It improves the policy with reinforcement learning and does not rely on a fixed set of human-written tasks.
The card compares the 122B model with several other models, and some score higher on some tests.
| Benchmark | Ornith-1.5-122B | Qwen3.8-Flash-Next | Qwen3.8 27B |
|---|---|---|---|
| TerminalBench 2.1 | 81.2 | 83.4 | 71.9 |
| CyberGym | 80 | 78 | 55 |
Gives you an NVFP4 quantized copy of Ornith-1.5-122B, a 122B mixture-of-experts text model meant for single-GPU use and strong in coding tests. For developers who host large models themselves.
Made by ornith-ai on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: This repository holds a quantized NVFP4 copy of Ornith-1.5-122B, a text generation model from ornith-ai. The card describes the original as a 122B mixture-of-experts model designed to run on a single GPU, with a separate mobile variant for phones.
Ornith-1.5 builds on Ornith-1.0, which started from Qwen3.5 and Gemma4. Its training loop makes new tasks, builds the scaffold to solve them and learns from the attempts through reinforcement learning.
Who it suits: It suits developers and teams who self-host a large model for coding and agent work and want a smaller quantized copy to fit on fewer GPUs.
Industry | Who uses it | How they use it | Example
Software | Developers | Host a coding model on their own server | Fix a failing build from a terminal
AI platforms | ML engineers | Serve a quantized large model to internal users | Run a private coding assistant
Research | Model researchers | Study self-improving training loops | Compare against other large models
Security | Security engineers | Try the model on cyber benchmarks | Run the card's CyberGym style tests
If you do not have a large GPU machine, or you need a model for images or audio, you can skip it.
Where to use it: You fetch the files on Windows, macOS or Linux with Python. A 64 GB model needs a machine with plenty of GPU memory to run.
Use case | Who | What they get back
Coding help | Developers | Code and fixes written as text
Agent tasks | Builders | Step-by-step text output for tools and terminals
Model testing | Researchers | Scores to compare with other models
How to set it up: You need Python with pip to fetch the files, and about 64 GB of disk space for the weights. The card does not give run commands in the part shown here, so follow its own instructions to run it.
pip install -U huggingface_hub
hf download ornith-ai/Ornith-1.5-122B-NVFP4
How to use it: Once the model is loaded, you send text prompts and read the text it writes. Coding and terminal tasks are where the card points its results.
Example: You give the model a failing command and the error text and ask for a fix. It answers with a written explanation and the changed code or command.
For newcomers and experts: If you are new, know that this is a huge download meant for strong hardware. Start by reading the model card, then check that your machine has the memory for 64 GB of weights.
If you know the field, the training loop tunes task generation, scaffold construction and solution rollouts together. It improves the policy with reinforcement learning and does not rely on a fixed set of human-written tasks.
Generate new training tasks
Build a scaffold to solve them
Run solution rollouts
Improve the policy with RL
Good to know: The card compares the 122B model with several other models, and some score higher on some tests.
Benchmark | Ornith-1.5-122B | Qwen3.8-Flash-Next | Qwen3.8 27B
TerminalBench 2.1 | 81.2 | 83.4 | 71.9
CyberGym | 80 | 78 | 55
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download ornith-ai/Ornith-1.5-122B-NVFP4
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Ornith-1.5-122B-NVFP4 This page | 279,663 | 36 | 64B | mit | |
| Ornith-1.5-35B-A3B-NVFP4Shares modelopt · qwen3_5_moe · 8-bit | 1,124,337 | 73 | 19.5B | mit | |
| Qwen3.6-35B-A3B-NVFP4Shares modelopt · qwen3_5_moe · 8-bit | 4,104,345 | 678 | 18.7B | apache-2.0 | |
| Qwen3.6-35B-A3B-NVFP4-FastShares qwen3_5_moe · 8-bit · image-text-to-text | 695,020 | 134 | 19.8B | apache-2.0 | |
| Ornith-1.5-122B-NVFP4-DFlash2-RTX-SparkShares modelopt · qwen3_5_moe · image-text-to-text | 342 | 2 | 64B | mit | |
| Qwen3.8-27B-NVFP4 by RadixArkShares modelopt · 8-bit · image-text-to-text | 979,445 | 126 | 18.2B | apache-2.0 |
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…