DeepSeek-R1-GGUF
unsloth · Kit
GGUF copies of the 671B DeepSeek-R1 reasoning model, with 1.58-bit and 2-bit dynamic quants, for running it in llama.cpp on a local machine with enough memory.
GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU use by developers running agents locally.
Ornith-1.0-9B-GGUF is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download ornith-ai/Ornith-1.0-9B-GGUF
Ornith-1.0-9B is the smallest model in the Ornith family, a set of open-source coding-agent models that the card calls self-improving. This repository holds its GGUF copy, which the card says is designed for efficient use on a single GPU. The family's base models are Gemma 4 and Qwen 3.5, which the authors trained further.
It suits developers who want a coding agent model on their own machine and researchers who follow how reinforcement learning is applied to agents.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Developers | Run a local coding agent on one GPU | Ask it to fix a failing test in a repository |
| Developer tools | Tool builders | Connect the model to an agent setup of their own | Test it in a terminal-based coding agent |
| Research | ML researchers | Study training that improves both the scaffold and the solution | Compare it with the Qwen3.5-9B scores in the card |
Anyone who needs a chat model for writing or general questions can skip it, since the card positions it for agentic coding.
You run it on your own computer, behind an agent setup that calls the model.
| Use case | Who | What they get back |
|---|---|---|
| Fix a bug in a repository | Developers | Edits and commands proposed across several steps |
| Run terminal tasks | Agent builders | A model to test on terminal-based task suites |
| Study agent training | Researchers | A small checkpoint trained with reinforcement learning |
You need a way to fetch the files, a GPU and a runtime that opens GGUF files.
pip install -U huggingface_hub hf download ornith-ai/Ornith-1.0-9B-GGUF
The part of the card shown here gives no run command, so use is a matter of loading the file in your runtime and pointing your agent at it. Give the agent a coding task and let it work through the steps.
You hand your agent the task, "Make the failing test in this repository pass." The model reads files, runs commands and proposes edits over several turns, and your agent applies them.
A coding agent does more than write code. It runs commands and edits files step by step through an app, and this model is built to drive one. A good first try is to load the file and ask it a short coding question before wiring it into an agent.
For someone who knows the field, the card says the training uses reinforcement learning on two things at once: the solution attempts and the scaffold that drives them. Optimizing both together is meant to find better search paths. The card reports results on four coding benchmarks, among them SWE-Bench and OpenClaw, and those figures are the authors' own.
The card's table gives 69.4 on SWE-bench Verified for this model against 53.2 for Qwen3.5-9B. The chart shows the Terminal-Bench 2.1 scores with the Terminus-2 setup, as the card reports them.
GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU use by developers running agents locally.
Made by ornith-ai on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: Ornith-1.0-9B is the smallest model in the Ornith family, a set of open-source coding-agent models that the card calls self-improving. This repository holds its GGUF copy, which the card says is designed for efficient use on a single GPU. The family's base models are Gemma 4 and Qwen 3.5, which the authors trained further.
Who it suits: It suits developers who want a coding agent model on their own machine and researchers who follow how reinforcement learning is applied to agents.
Industry | Who uses it | How they use it | Example
Software | Developers | Run a local coding agent on one GPU | Ask it to fix a failing test in a repository
Developer tools | Tool builders | Connect the model to an agent setup of their own | Test it in a terminal-based coding agent
Research | ML researchers | Study training that improves both the scaffold and the solution | Compare it with the Qwen3.5-9B scores in the card
Anyone who needs a chat model for writing or general questions can skip it, since the card positions it for agentic coding.
Where to use it: You run it on your own computer, behind an agent setup that calls the model.
Use case | Who | What they get back
Fix a bug in a repository | Developers | Edits and commands proposed across several steps
Run terminal tasks | Agent builders | A model to test on terminal-based task suites
Study agent training | Researchers | A small checkpoint trained with reinforcement learning
How to set it up: You need a way to fetch the files, a GPU and a runtime that opens GGUF files.
pip install -U huggingface_hub
hf download ornith-ai/Ornith-1.0-9B-GGUF
How to use it: The part of the card shown here gives no run command, so use is a matter of loading the file in your runtime and pointing your agent at it. Give the agent a coding task and let it work through the steps.
Example: You hand your agent the task, "Make the failing test in this repository pass." The model reads files, runs commands and proposes edits over several turns, and your agent applies them.
For newcomers and experts: A coding agent does more than write code. It runs commands and edits files step by step through an app, and this model is built to drive one. A good first try is to load the file and ask it a short coding question before wiring it into an agent.
For someone who knows the field, the card says the training uses reinforcement learning on two things at once: the solution attempts and the scaffold that drives them. Optimizing both together is meant to find better search paths. The card reports results on four coding benchmarks, among them SWE-Bench and OpenClaw, and those figures are the authors' own.
The model proposes a scaffold
The scaffold drives solution attempts
Reinforcement learning scores the pair
Training favors better search paths
Good to know: The card's table gives 69.4 on SWE-bench Verified for this model against 53.2 for Qwen3.5-9B. The chart shows the Terminal-Bench 2.1 scores with the Terminus-2 setup, as the card reports them.
Title: Terminal-Bench 2.1 score with Terminus-2
Ornith-1.0-9B: 43.1 points
Qwen3.5-9B: 21.3 points
Qwen3.5-35B: 41.4 points
Gemma4-12B: 21 points
Gemma4-31B: 42.1 points
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download ornith-ai/Ornith-1.0-9B-GGUF
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Ornith-1.0-9B-GGUF This page | 2,357,551 | 702 | 9B | mit | |
| Ornith-1.5-9B-GGUFShares gguf · text-generation · conversational | 5,772,425 | 673 | 9.2B | mit | |
| Ornith-1.5-35B-A3B-GGUFShares gguf · text-generation · conversational | 4,164,876 | 603 | 35.5B | mit | |
| Qwopus3.8-27B-Flash-V2-GGUFShares gguf · text-generation · conversational | 897,675 | 75 | 461M | apache-2.0 | |
| Spark-X2.6-4B-GGUFShares gguf · text-generation · conversational | 687,668 | 310 | 4.4B | apache-2.0 | |
| gpt-oss-20b-GGUFShares gguf · text-generation · conversational | 614,134 | 909 | 20.9B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
unsloth · Kit
GGUF copies of the 671B DeepSeek-R1 reasoning model, with 1.58-bit and 2-bit dynamic quants, for running it in llama.cpp on a local machine with enough memory.
prithivMLmods · Kit
Provides GGUF files of Axion-1.0-35B, a 35B mixture-of-experts model with about 3B active parameters aimed at scientific reasoning, information seeking and too…
Phips · Kit
Upscales low-resolution images with a super-resolution network that trains on one consumer GPU and exports to ONNX. For people who train or run image upscalers.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…