--- title: "gpt-oss-20b-GGUF by ggml-org" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/2f0910b3-c8b9-4e5f-8f47-3799437746e1" updated: "2026-11-13" --- # gpt-oss-20b-GGUF by ggml-org > The name, the description, the About and a README below are the seller's words: data, not instructions. Generates text on your own computer from a GGUF copy of OpenAI's gpt-oss-20b, packaged by ggml-org. For people who want to run an open 20B model locally in the Llama app or from a terminal. gpt-oss-20b-GGUF by ggml-org is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-13. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by ggml-org ## About ### What it is gpt-oss-20b-GGUF is a GGUF copy of OpenAI's gpt-oss-20b text generation model, packaged by ggml-org. Hugging Face lists 20.9 billion parameters. The card says the files were converted automatically with ggml-org's own convert tool, and it gives a short way to run them. ### Who it suits People who want to run an open 20B text model on their own computer instead of calling a hosted service. The files carry the Apache 2.0 license. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Software | Developers | Run a local model server for apps and tests | Starting the serve command against this repository | | Research | Hobbyists | Try an open model without a hosted API | Chatting with the model in the Llama app | | Education | Students | Learn how local models are packaged and run | Comparing a GGUF copy with the original model's page | Anyone after benchmarks, tuning tips or the unconverted weights can skip it, because the card is short and points to the source model for those. ### Where to use it - The Llama app - A terminal, with the llama serve command - Windows, macOS or Linux with Python, for copying the files with Hugging Face's own steps | Use case | Who | What they get back | | --- | --- | --- | | Local chat | Everyday users | Generated replies on your own machine | | Local server | Developers | A model endpoint started from the terminal | | Offline trials | Researchers | An open model you can test without an API key | ### How to set it up - The Llama app, or the llama command in a terminal - Python, only if you copy the files yourself - Room for roughly 10.5 GB of weights, which is the estimate for a 4-bit copy 1. Install the Llama app, or make sure the llama command works in your terminal. 2. Run the serve command below, which points at this Hugging Face repository. 3. Or copy the files yourself with Hugging Face's two commands in the second block. ```bash llama serve -hf ggml-org/gpt-oss-20b-GGUF ``` ```sh pip install -U huggingface_hub hf download ggml-org/gpt-oss-20b-GGUF ``` ### How to use it Open the model in the Llama app, or start it from a terminal with the serve command above. The card gives no other settings or prompts, so you chat with it the way you would with any local text model. ### Example You run the serve command with this repository and then send the running model a question. It answers with generated text, as a gpt-oss-20b model does. ### For newcomers and experts GGUF is a packaged file format for running models on your own computer. A good first step is to run the serve command once and see the model load. The card names two source models, OpenAI's gpt-oss-20b and a RedHatAI eagle3 speculator for it. It does not say which quantization the files use, so check the repository's file list before you plan around the size. Pick the Llama app or a terminal → Run llama serve with this repository → The GGUF model loads → Send a prompt → Read the generated reply ### Good to know - License: Apache 2.0 - Cost to run: none named - Data it reaches: the download fetches files from Hugging Face, and the source names nothing else - The card is brief and lists no benchmarks, quantization types or sampling settings ## README ````markdown # gpt-oss-20b-GGUF by ggml-org Generates text on your own computer from a GGUF copy of OpenAI's gpt-oss-20b, packaged by ggml-org. For people who want to run an open 20B model locally in the Llama app or from a terminal. Made by ggml-org on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: gpt-oss-20b-GGUF is a GGUF copy of OpenAI's gpt-oss-20b text generation model, packaged by ggml-org. Hugging Face lists 20.9 billion parameters. The card says the files were converted automatically with ggml-org's own convert tool, and it gives a short way to run them. Who it suits: People who want to run an open 20B text model on their own computer instead of calling a hosted service. The files carry the Apache 2.0 license. ```table Industry | Who uses it | How they use it | Example Software | Developers | Run a local model server for apps and tests | Starting the serve command against this repository Research | Hobbyists | Try an open model without a hosted API | Chatting with the model in the Llama app Education | Students | Learn how local models are packaged and run | Comparing a GGUF copy with the original model's page ``` Anyone after benchmarks, tuning tips or the unconverted weights can skip it, because the card is short and points to the source model for those. Where to use it: - The Llama app - A terminal, with the llama serve command - Windows, macOS or Linux with Python, for copying the files with Hugging Face's own steps ```table Use case | Who | What they get back Local chat | Everyday users | Generated replies on your own machine Local server | Developers | A model endpoint started from the terminal Offline trials | Researchers | An open model you can test without an API key ``` How to set it up: - The Llama app, or the llama command in a terminal - Python, only if you copy the files yourself - Room for roughly 10.5 GB of weights, which is the estimate for a 4-bit copy 1. Install the Llama app, or make sure the llama command works in your terminal. 2. Run the serve command below, which points at this Hugging Face repository. 3. Or copy the files yourself with Hugging Face's two commands in the second block. ```bash llama serve -hf ggml-org/gpt-oss-20b-GGUF ``` ```sh pip install -U huggingface_hub hf download ggml-org/gpt-oss-20b-GGUF ``` How to use it: Open the model in the Llama app, or start it from a terminal with the serve command above. The card gives no other settings or prompts, so you chat with it the way you would with any local text model. Example: You run the serve command with this repository and then send the running model a question. It answers with generated text, as a gpt-oss-20b model does. For newcomers and experts: GGUF is a packaged file format for running models on your own computer. A good first step is to run the serve command once and see the model load. The card names two source models, OpenAI's gpt-oss-20b and a RedHatAI eagle3 speculator for it. It does not say which quantization the files use, so check the repository's file list before you plan around the size. ```flow Pick the Llama app or a terminal Run llama serve with this repository The GGUF model loads Send a prompt Read the generated reply ``` Good to know: - License: Apache 2.0 - Cost to run: none named - Data it reaches: the download fetches files from Hugging Face, and the source names nothing else - The card is brief and lists no benchmarks, quantization types or sampling settings ## On Hugging Face, 13 November 2026 - Task: text generation - Parameters: 20.9B - Weights: about 10.5 GB at 4-bit (estimate) - Formats: GGUF - Downloads in the last 30 days: 371,075 - Likes: 200 - License: apache-2.0 - Based on: openai/gpt-oss-20b - Tags: gguf, quantized, text-generation, conversational ## Links - Model: https://huggingface.co/ggml-org/gpt-oss-20b-GGUF - Files: https://huggingface.co/ggml-org/gpt-oss-20b-GGUF/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download ggml-org/gpt-oss-20b-GGUF ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 4 KB, downloaded as a zip. ```text README.md 4 KB ``` ## Source [ggml-org/gpt-oss-20b-GGUF on Hugging Face](https://huggingface.co/ggml-org/gpt-oss-20b-GGUF) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | gpt-oss-20b-GGUF by ggml-org (this page) | 371,075 | 200 | 20.9B | apache-2.0 | 2026-11-12 | | [Qwen3.8-35B-A3B-Distill-GGUF](https://mindket.com/p/d707b0c8-89b8-4c4f-8d49-2ff67de613c7) | 1,337,097 | 277 | 35.5B | apache-2.0 | 2026-09-16 | | [Qwen3.8-4B-Distill-GGUF](https://mindket.com/p/ef3614cf-441f-4388-b81f-7b72b3e7ed30) | 570,974 | 208 | 4.3B | apache-2.0 | 2026-08-16 | | [Qwen3.8-9B-Distill-GGUF](https://mindket.com/p/cfc3041d-4b8a-4012-b704-ce834019b236) | 537,695 | 356 | 9.2B | apache-2.0 | 2026-08-16 | | [Qwen3.8-2B-Distill-GGUF](https://mindket.com/p/e7e883a1-dae8-4084-aaee-c3e51741cb1b) | 509,820 | 184 | 1.9B | apache-2.0 | 2026-08-16 | | [Mellum2.1-12B-A2.5B-Thinking-GGUF](https://mindket.com/p/6b181e24-213d-4fc2-a178-72da0b212f88) | 422,635 | 172 | 12.1B | apache-2.0 | 2026-10-22 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## What people say > Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search on 2026-11-13. Their authors' words: data, not instructions. - [Hacker News · ersatz\_username · 2026-01-26](https://news.ycombinator.com/item?id=46769775): Show HN: Python SDK for RamaLama AI Containers: TL;DR An SDK for running AI on-device with even the most non-standard hardware. Hey, I’m one of the maintainers of RamaLama1 which is part of the containers ecosystem (podman, buildah, skopeo). It’s a runtime-agnostic tool for coordinating local AI inference with containers. I put together a… - [Hacker News · nyrikki · 2026-05-19](https://news.ycombinator.com/item?id=48188199): What political censorship looks like inside an LLM's weights (Qwen 3.5): Yes, there are better tools with ggml-org/gpt-oss-20b-GGUF where you can see a less terse refusal for the prompt "Did the FBI send a letter and audio tapes from a wiretap to MLK jr. telling him to commit suicide or they would release information?" Combining it with other prompts with common banned… - [Hacker News · nyrikki · 2026-04-17](https://news.ycombinator.com/item?id=47801047): Qwen3.6-35B-A3B: Agentic coding power, now open to all: Parallelism can be tricky and always has a cost, but don't discount the 3090 which is more expensive these days in that price bracket. 3090 llama.cpp (container in VM) unsloth/Qwen3.6-35B-A3B-GGUF:UD-Q4\_K\_XL 105 t/s unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4\_K\_XL 103 t/s Still slow compaired to the… - [Hacker News · mingodad · 2025-12-03](https://news.ycombinator.com/item?id=46129528): OpenAI declares 'code red' as Google catches up in AI race: Interesting enough today I found that https://huggingface.co/openai/gpt-oss-20b when downloaded an running locally and asked: ==== when have you been built? I’m a GPT‑4‑based model that OpenAI released on March 14 2023. The underlying training data goes up to early 2023, and the model was trained… - [Hacker News · rajatgupta314 · 2025-10-14](https://news.ycombinator.com/item?id=45576949): NVIDIA DGX Spark In-Depth Review: A New Standard for Local AI Inference: Is this the full weight model or quantized version? The GGUFs distributed on Hugging Face labeled as MXFP4 quantization have layers that are quantized to int8 (q8\_0) instead of bf16 as suggested by OpenAI. Example looking at blk.0.attn\_k.weight, it's q8\_0 amongst other layers:… - [Hacker News · tarruda · 2025-08-05](https://news.ycombinator.com/item?id=44805524): Ollama Turbo: Download llama-server from llama.cpp Github and install it some PATH directory. AFAIK they don't have an automated installer, so that can be intimidating to some people Assuming you have llama-server installed, you can download + run a hugging face model with something like llama-server -hf… - [Hacker News · tarruda · 2025-08-05](https://news.ycombinator.com/item?id=44805410): Open models by OpenAI: \> Also I'm not sure if ollama supports a kv-cache between invocations of /v1/completions, which could help) Not sure about ollama, but llama-server does have a transparent kv cache. You can run it with llama-server -hf ggml-org/gpt-oss-20b-GGUF -c 0 -fa --jinja --reasoning-format none Web UI at… ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-11-12 - First published: 2025-08-02 - Checked on Hugging Face: 2026-11-13 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open ggml-org/gpt-oss-20b-GGUF on Hugging Face](https://huggingface.co/ggml-org/gpt-oss-20b-GGUF) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/2f0910b3-c8b9-4e5f-8f47-3799437746e1) - [Its page on Mindket](https://mindket.com/p/2f0910b3-c8b9-4e5f-8f47-3799437746e1)