Llama-3.2-1B-Instruct-GGUF

Llama-3.2-1B-Instruct-GGUF

Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. For developers and learners.

Made by unsloth on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: This is Unsloth's GGUF copy of Meta's Llama 3.2 1B Instruct, a small text model with about 1.2B parameters. The files come in many precisions, from 16-bit down to 2-bit. Meta tuned the Llama 3.2 instruction models for multilingual dialogue, including agent-style retrieval and summarization. At 4-bit the weights are around 618 MB as an estimate.

Who it suits: It suits developers who want a tiny chat model on modest hardware, and learners who want to see how a small language model behaves.

Industry | Who uses it | How they use it | Example
Software | Developers | Prototype chat or summarizing on a laptop | Summarize a document locally
Education | Students | Compare small models at different precisions | Load the 2-bit and the 16-bit files and compare replies
Research | ML tinkerers | Use Unsloth's free notebooks to fine-tune Llama models | Fine-tune a model, then export it to GGUF

Anyone who needs image input can skip it, since this model takes text in and returns text.

Where to use it:

• Tools that read the GGUF format
• Windows, macOS or Linux, where the files download with Python
• Unsloth's notebooks, for fine-tuning work

Use case | Who | What they get back
Chat and dialogue | Developers | A written reply to each message
Summarizing | Everyday users | A shorter version of text you provide
Agent-style retrieval steps | Agent builders | Text output for a larger workflow

How to set it up:

• Python with pip, for the download
• A runtime that can load GGUF files
• A choice of precision, from 16-bit down to 2-bit

1. Install the Hugging Face hub client.
2. Download the repository's files.
3. Open the precision you chose in your GGUF runtime.

pip install -U huggingface_hub
hf download unsloth/Llama-3.2-1B-Instruct-GGUF

How to use it: Load one GGUF file in your runtime and send it messages as a dialogue. For details about the model itself, the card points to Meta's original model page.

Tool | What it does
Precision uploads | Offer 16, 8, 6, 5, 4, 3 and 2-bit files, where fewer bits give a smaller file
Unsloth notebooks | Fine-tune a model, which can then be exported to GGUF, vLLM or Hugging Face

Example: You load the 4-bit file and paste in a short article, then ask for a summary. The model replies with a shorter text.

For newcomers and experts: At 1B parameters this is a small model, so it loads on ordinary computers. Try the 4-bit file first, ask a plain question and see how the reply looks.

Llama 3.2 is an auto-regressive transformer. The tuned versions use supervised fine-tuning and reinforcement learning with human feedback to align with preferences for helpfulness and safety. Eight languages are officially supported, and training covered a broader set.

You send a message
The model reads it as a dialogue
The model writes a reply
You read or reuse the text

Good to know:

• Languages: eight are officially supported, namely English, Hindi, Thai, Spanish, Portuguese, Italian, French and German
• Size: about 1.2B parameters, with about 618 MB at 4-bit as an estimate
• License: llama3.2, which ties use to the Llama 3.2 Community License
• Cost to run: none named
• Data it reaches: the messages you send, with no web or account access named
• Not for: uses outside the Llama 3.2 Community License and its Acceptable Use Policy

On Hugging Face, 13 November 2026

• Task: text generation
• Library: transformers
• Parameters: 1.2B
• Weights: about 618 MB at 4-bit (estimate)
• Formats: GGUF
• Downloads in the last 30 days: 53,598
• Likes: 85
• License: llama3.2
• Languages: en
• Based on: meta-llama/Llama-3.2-1B-Instruct
• Quantized versions: 5
• Fine-tunes: 1
• Tags: transformers, gguf, llama, text-generation, llama-3, meta, facebook, unsloth, conversational

Links

• Model: https://huggingface.co/unsloth/Llama-3.2-1B-Instruct-GGUF
• Files: https://huggingface.co/unsloth/Llama-3.2-1B-Instruct-GGUF/tree/main

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download unsloth/Llama-3.2-1B-Instruct-GGUF

Then follow the usage in its model card. Nothing in this kit runs by itself.