DeepSeek-R1-GGUF
unsloth · Kit
GGUF copies of the 671B DeepSeek-R1 reasoning model, with 1.58-bit and 2-bit dynamic quants, for running it in llama.cpp on a local machine with enough memory.
Guides you in tuning samplers and parameters for local language models, with steps for system prompts, reasoning models and expert settings in LM Studio, SillyTavern, Ollama and Koboldcpp.
Maximizing Model Performance Guide is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
This is a guide from DavidAU for getting better results out of local language models by tuning samplers, advanced samplers and parameters. It covers every quantization type and full precision. The part shown links four extra documents, and the main guide continues past what is visible here.
People who run language models on their own computer and want to tune how those models behave. It suits users of LM Studio, SillyTavern, Ollama and Koboldcpp, and anyone running DavidAU's own models.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Local AI | Hobbyists | Tune how a local model behaves | Paste a system prompt into the app to switch reasoning on |
| Role play | SillyTavern users | Set the system prompt on the template page | Activate the system prompt option and enter the text |
| Development | Developers | Set how many experts a mixture-of-experts model uses | Follow the guide's steps for the app you run |
| Model tinkering | Model tinkerers | Turn a regular model into a reasoning one | Follow the adapter steps that use Mergekit |
You can skip it if you only use hosted chat services, since the guide is about local apps.
| Use case | Who | What they get back |
|---|---|---|
| Reasoning control | Local model users | Reasoning switched on or off through the system prompt |
| Expert settings | Developers | A chosen number of active experts in a mixture-of-experts model |
| Low quant support | Users of small quants | Software the author says helps his models run without issues |
You need Python for the download tool and a local app to apply the settings in.
pip install -U huggingface_hub hf download DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
Open your app's system prompt box and paste the text a model's page gives you. Keep every line break when you paste. If you need to edit the text, do it in Notepad or in the app itself.
| Tool | What it does |
|---|---|
| LM Studio | Switch on Power User or Developer mode, then paste into the system prompt box |
| SillyTavern | On the template page, activate the system prompt and enter the text |
| Ollama | Set the system message, as Ollama's own readme describes |
| Koboldcpp | Load and start the model, open settings, choose a template and fill the system prompt box |
You load a reasoning model in LM Studio and turn on Developer mode. You paste the author's reasoning system prompt into the box, keeping the line breaks. The model now writes out its thinking. With the box empty, a model that needs the prompt acts like a normal chat model.
Samplers are settings that control how a model picks its next words. A system prompt is standing text that tells the model how to behave. A first small step is to open your app's system prompt box and see what is there.
The guide calls the system prompt root access to the model. It steers instruction following, output and, for reasoning models, whether reasoning is on. A larger model, or one that follows instructions well, reacts more to a pasted prompt. The linked documents also cover adapters, a slice of a reasoning model, that turn a regular model into a thinking one.
Guides you in tuning samplers and parameters for local language models, with steps for system prompts, reasoning models and expert settings in LM Studio, SillyTavern, Ollama and Koboldcpp.
Made by DavidAU on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: This is a guide from DavidAU for getting better results out of local language models by tuning samplers, advanced samplers and parameters. It covers every quantization type and full precision. The part shown links four extra documents, and the main guide continues past what is visible here.
Who it suits: People who run language models on their own computer and want to tune how those models behave. It suits users of LM Studio, SillyTavern, Ollama and Koboldcpp, and anyone running DavidAU's own models.
Industry | Who uses it | How they use it | Example
Local AI | Hobbyists | Tune how a local model behaves | Paste a system prompt into the app to switch reasoning on
Role play | SillyTavern users | Set the system prompt on the template page | Activate the system prompt option and enter the text
Development | Developers | Set how many experts a mixture-of-experts model uses | Follow the guide's steps for the app you run
Model tinkering | Model tinkerers | Turn a regular model into a reasoning one | Follow the adapter steps that use Mergekit
You can skip it if you only use hosted chat services, since the guide is about local apps.
Where to use it:
Use case | Who | What they get back
Reasoning control | Local model users | Reasoning switched on or off through the system prompt
Expert settings | Developers | A chosen number of active experts in a mixture-of-experts model
Low quant support | Users of small quants | Software the author says helps his models run without issues
How to set it up: You need Python for the download tool and a local app to apply the settings in.
pip install -U huggingface_hub
hf download DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
How to use it: Open your app's system prompt box and paste the text a model's page gives you. Keep every line break when you paste. If you need to edit the text, do it in Notepad or in the app itself.
Tool | What it does
LM Studio | Switch on Power User or Developer mode, then paste into the system prompt box
SillyTavern | On the template page, activate the system prompt and enter the text
Ollama | Set the system message, as Ollama's own readme describes
Koboldcpp | Load and start the model, open settings, choose a template and fill the system prompt box
Example: You load a reasoning model in LM Studio and turn on Developer mode. You paste the author's reasoning system prompt into the box, keeping the line breaks. The model now writes out its thinking. With the box empty, a model that needs the prompt acts like a normal chat model.
For newcomers and experts: Samplers are settings that control how a model picks its next words. A system prompt is standing text that tells the model how to behave. A first small step is to open your app's system prompt box and see what is there.
The guide calls the system prompt root access to the model. It steers instruction following, output and, for reasoning models, whether reasoning is on. A larger model, or one that follows instructions well, reacts more to a pasted prompt. The linked documents also cover adapters, a slice of a reasoning model, that turn a regular model into a thinking one.
Pick a local app and a model
Open the app's system prompt setting
Paste the prompt text with line breaks
Run the model and compare the output
Good to know:
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Maximizing Model Performance Guide This page | 0 | 276 | — | apache-2.0 | |
| theOG-50MShares lmstudio · ollama | 1,312 | 3 | 50.1M | apache-2.0 | |
| GLM-5.3-SuperExpert-v2-9.2GBShares ollama | 10,445 | 10 | 9.2B | cc-by-nc-4.0 | |
| Qwen3.8-Flash-Next-GSQ-RCO-GGUFShares imatrix | 6,963,596 | 1,229 | 177B | apache-2.0 | |
| Qwen3.8-27B iMatrix NVFP4 MTP GGUFShares imatrix | 3,271,044 | 51 | 461M | apache-2.0 | |
| Qwen3.6-35B-A3B-MTP-GGUFShares imatrix | 2,315,167 | 1,051 | 35.5B | apache-2.0 |
unsloth · Kit
GGUF copies of the 671B DeepSeek-R1 reasoning model, with 1.58-bit and 2-bit dynamic quants, for running it in llama.cpp on a local machine with enough memory.
prithivMLmods · Kit
Provides GGUF files of Axion-1.0-35B, a 35B mixture-of-experts model with about 3B active parameters aimed at scientific reasoning, information seeking and too…
Phips · Kit
Upscales low-resolution images with a super-resolution network that trains on one consumer GPU and exports to ONNX. For people who train or run image upscalers.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…