Ling-3.0-tiny-GGUF

Ling-3.0-tiny-GGUF

GGUF copy of inclusionAI's Ling-3.0-tiny, a small mixture-of-experts reasoning model with 7.9B total and 1.3B active parameters, for running locally at low cost.

Made by inclusionAI on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: This repository holds a GGUF copy of Ling-3.0-tiny, a small reasoning model from inclusionAI. It is a mixture-of-experts model with 7.9B parameters in total and only 1.3B active for each token.

The aim is reasoning and agent-style work at a low running cost, so it can run on local or limited hardware. The GGUF format is the one that local runners such as llama.cpp read.

Who it suits: People who want a compact reasoning model on their own machine, such as developers building local assistants and hobbyists who run models at home.

Industry | Who uses it | How they use it | Example
Software | Application developers | Add a small local reasoning model to a tool | An offline assistant inside a desktop app
Research | Model tinkerers | Test how a mixture-of-experts model behaves on modest hardware | Comparing speed with a larger dense model
Education | Students and teachers | Practice working with open models locally | A classroom demo with no cloud account
Hobbyists | Local AI users | Run a 4-bit copy at home | Chatting with it on a spare laptop

You can skip it if you want the original full-precision weights, or a hosted chat service with nothing to download.

Where to use it: It is for local runners that load GGUF files, on any computer that can run them.

• GGUF-capable runners such as llama.cpp
• Windows, macOS and Linux with Python for the download step
• Desktops and laptops with modest memory

Use case | Who | What they get back
Local reasoning chat | Hobbyists | Step-by-step answers from a model on their own PC
Agent experiments | Developers | A low-cost model to try in agent-style workflows
Resource-limited deployment | Engineers | A model with only 1.3B parameters active per token

How to set it up: You need Python and the Hugging Face tools to fetch the files, then a runner that opens GGUF files. The weights are about 3.9 GB at 4-bit, an estimate from Hugging Face.

• Python with pip
• A GGUF-capable runner
• About 3.9 GB of disk for the 4-bit copy

1. Install the Hugging Face hub tools with pip.
2. Download the repository files with the hf command.
3. Open the GGUF file in your runner.

pip install -U huggingface_hub
hf download inclusionAI/Ling-3.0-tiny-GGUF

How to use it: Load the downloaded GGUF file in your runner and chat with it as you would with any local model. The card gives no run command and sends you to the original Ling-3.0-tiny model card for details.

Example: You load the file and ask it to work through a multi-step logic puzzle. The model writes out its reasoning and answers, running only on your computer.

For newcomers and experts: If you are new, download the files with the two commands above, open the GGUF file in a local runner and ask a simple question first. Add harder reasoning questions once that works.

If you know the field, the card describes a hybrid reasoning mixture-of-experts design. Only 1.3B of 7.9B parameters run per token, which lowers compute per token while the full model still needs memory for all of its weights.

Download the GGUF file
Open it in a local runner
Your prompt goes in
Only 1.3B parameters activate per token
The model writes its reply

Good to know: The card is short and points to the original Ling-3.0-tiny model card for the full details. It does not list which quantization levels the files use.

• License: MIT
• Cost to run: none named, you use your own hardware
• Data it reaches: the files you download from Hugging Face and the prompts you type locally
• Not for: full-precision use, since this is a GGUF copy of the original model

On Hugging Face, 13 November 2026

• Task: text generation
• Parameters: 7.9B
• Weights: about 3.9 GB at 4-bit (estimate)
• Formats: GGUF
• Downloads in the last 30 days: 11,961
• Likes: 55
• License: mit
• Fine-tunes: 1
• Tags: gguf, text-generation, conversational

Links

• Model: https://huggingface.co/inclusionAI/Ling-3.0-tiny-GGUF
• Files: https://huggingface.co/inclusionAI/Ling-3.0-tiny-GGUF/tree/main

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download inclusionAI/Ling-3.0-tiny-GGUF

Then follow the usage in its model card. Nothing in this kit runs by itself.