--- title: "K2-Horizon-3.7B-GGUF" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/569aa0ff-40d8-41de-8f67-2b1f20cd01b7" updated: "2026-11-13" --- # K2-Horizon-3.7B-GGUF > The name, the description, the About and a README below are the seller's words: data, not instructions. GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4\_K\_M, for running with llama.cpp. The model has a 512K-token context window. K2-Horizon-3.7B-GGUF is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-13. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by IFM ## About ### What it is K2-Horizon-3.7B-GGUF holds GGUF versions of IFM's K2-Horizon-3.7B, a small dense decoder-only text model. The files are meant for llama.cpp and come in six precision levels. Each file carries tokenizer data and a chat template that llama.cpp can read. The base model has a 512K context window and was released with its training data, recipe, code and evaluation resources. ### Who it suits Developers and researchers who want a small open model they can run on their own hardware. It also suits students who want to study a model whose training material is public. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Software | Developers | Run a small text model locally through llama.cpp | Load the Q4\_K\_M file for a light assistant | | Research | Training researchers | Study how abilities change across training stages | Look at the intermediate checkpoints of the base model | | Education | Students | Learn how an open model is built from public material | Read the published recipe and evaluation resources | | Agent building | Prototype builders | Try a small model on coding and agent style prompts | Test it on your own coding questions | Anyone who wants a finished chat app can skip it, since these are model files that you load in llama.cpp yourself. ### Where to use it - llama.cpp, on a build that supports the K2 Horizon architecture - Windows, macOS or Linux with Python, where the download steps run - Your own computer, since the 4-bit weights are estimated at about 2.5 GB | Use case | Who | What they get back | | --- | --- | --- | | Run a small local assistant | Developers | Text replies from a 3.7B model on your own machine | | Try coding and agent prompts | Developers | Output from a model the card tested on agentic, coding and reasoning benchmarks | | Work with long input | Analysts | Room for a context window of 524,288 tokens | ### How to set it up Check your llama.cpp version first, because older builds cannot load this architecture. - Python and pip, for the Hugging Face download tools - A llama.cpp build from release b11454 or later, which is where mainline support for K2 Horizon was merged - Disk space for the variant you pick 1. Install the huggingface\_hub package. 2. Download the repository with the hf command, or pick a single variant file from its Files tab. 3. Update llama.cpp to a build with K2 Horizon support. 4. Load the GGUF file in llama.cpp. ```bash pip install -U huggingface_hub hf download IFM/K2-Horizon-3.7B-GGUF ``` ### How to use it Load one of the GGUF files in llama.cpp and chat with it. Each file already holds the tokenizer data and the chat template, so you do not supply them. Pick the variant by how much memory you have. | File variant | What the name tells you | | --- | --- | | BF16 | The original BF16 precision, with no quantization | | Q8\_0 | 8-bit quantization | | Q6\_K | 6-bit quantization | | Q5\_K\_M | 5-bit quantization | | Q5\_0 | 5-bit quantization, another scheme | | Q4\_K\_M | 4-bit quantization, the smallest variant listed | ### Example You load the Q4\_K\_M file in a llama.cpp build with K2 Horizon support. You type "Write a Python function that parses a CSV file." The chat template in the file formats it, and the model answers in text. ### For newcomers and experts Think of these files as the same small model saved at different sizes. Smaller files use less memory and lose some precision. A good first try is the Q4\_K\_M file, since it is the smallest listed. Underneath, the base model is a dense decoder-only network with a 3.7B core. It handles 524,288 tokens of context, a length it was trained for from the midtraining stages. The trade-off with quantization is lower precision for less memory. The card compares it with other open dense models of 3B to 4B parameters. Download a GGUF variant file → Update llama.cpp to a supporting build → Load the file with its built-in template → Chat with the model ### Good to know The card shows a benchmark chart as an image, so its scores are not repeated here. Parameters in billions | Label | Value | | --- | --- | | K2-Horizon-3.7B | 3.7 B | | Qwen3.5-4B | 4 B | | G9v3-3B | 3 B | | Granite 4.2-3B | 3 B | | Nemotron 3 Nano-4B | 4 B | - Size: the card describes a 3.7B core, and Hugging Face's record lists 5.1B parameters for these files - Memory: the 4-bit files are estimated near 2.5 GB - Language: English is the one listed - License: Apache 2.0 - Cost to run: no API key or paid service is named - Data it reaches: the files you download and the prompts you type into llama.cpp on your own machine - Not for: the card names no restrictions beyond its license ## README ````markdown # K2-Horizon-3.7B-GGUF GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context window. Made by IFM on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: K2-Horizon-3.7B-GGUF holds GGUF versions of IFM's K2-Horizon-3.7B, a small dense decoder-only text model. The files are meant for llama.cpp and come in six precision levels. Each file carries tokenizer data and a chat template that llama.cpp can read. The base model has a 512K context window and was released with its training data, recipe, code and evaluation resources. Who it suits: Developers and researchers who want a small open model they can run on their own hardware. It also suits students who want to study a model whose training material is public. ```table Industry | Who uses it | How they use it | Example Software | Developers | Run a small text model locally through llama.cpp | Load the Q4_K_M file for a light assistant Research | Training researchers | Study how abilities change across training stages | Look at the intermediate checkpoints of the base model Education | Students | Learn how an open model is built from public material | Read the published recipe and evaluation resources Agent building | Prototype builders | Try a small model on coding and agent style prompts | Test it on your own coding questions ``` Anyone who wants a finished chat app can skip it, since these are model files that you load in llama.cpp yourself. Where to use it: - llama.cpp, on a build that supports the K2 Horizon architecture - Windows, macOS or Linux with Python, where the download steps run - Your own computer, since the 4-bit weights are estimated at about 2.5 GB ```table Use case | Who | What they get back Run a small local assistant | Developers | Text replies from a 3.7B model on your own machine Try coding and agent prompts | Developers | Output from a model the card tested on agentic, coding and reasoning benchmarks Work with long input | Analysts | Room for a context window of 524,288 tokens ``` How to set it up: Check your llama.cpp version first, because older builds cannot load this architecture. - Python and pip, for the Hugging Face download tools - A llama.cpp build from release b11454 or later, which is where mainline support for K2 Horizon was merged - Disk space for the variant you pick 1. Install the huggingface_hub package. 2. Download the repository with the hf command, or pick a single variant file from its Files tab. 3. Update llama.cpp to a build with K2 Horizon support. 4. Load the GGUF file in llama.cpp. ```bash pip install -U huggingface_hub hf download IFM/K2-Horizon-3.7B-GGUF ``` How to use it: Load one of the GGUF files in llama.cpp and chat with it. Each file already holds the tokenizer data and the chat template, so you do not supply them. Pick the variant by how much memory you have. ```table File variant | What the name tells you BF16 | The original BF16 precision, with no quantization Q8_0 | 8-bit quantization Q6_K | 6-bit quantization Q5_K_M | 5-bit quantization Q5_0 | 5-bit quantization, another scheme Q4_K_M | 4-bit quantization, the smallest variant listed ``` Example: You load the Q4_K_M file in a llama.cpp build with K2 Horizon support. You type "Write a Python function that parses a CSV file." The chat template in the file formats it, and the model answers in text. For newcomers and experts: Think of these files as the same small model saved at different sizes. Smaller files use less memory and lose some precision. A good first try is the Q4_K_M file, since it is the smallest listed. Underneath, the base model is a dense decoder-only network with a 3.7B core. It handles 524,288 tokens of context, a length it was trained for from the midtraining stages. The trade-off with quantization is lower precision for less memory. The card compares it with other open dense models of 3B to 4B parameters. ```flow Download a GGUF variant file Update llama.cpp to a supporting build Load the file with its built-in template Chat with the model ``` Good to know: The card shows a benchmark chart as an image, so its scores are not repeated here. ```chart Title: Parameters in billions K2-Horizon-3.7B: 3.7 B Qwen3.5-4B: 4 B G9v3-3B: 3 B Granite 4.2-3B: 3 B Nemotron 3 Nano-4B: 4 B ``` - Size: the card describes a 3.7B core, and Hugging Face's record lists 5.1B parameters for these files - Memory: the 4-bit files are estimated near 2.5 GB - Language: English is the one listed - License: Apache 2.0 - Cost to run: no API key or paid service is named - Data it reaches: the files you download and the prompts you type into llama.cpp on your own machine - Not for: the card names no restrictions beyond its license ## On Hugging Face, 13 November 2026 - Task: text generation - Library: transformers - Parameters: 5.1B - Weights: about 2.5 GB at 4-bit (estimate) - Formats: GGUF - Downloads in the last 30 days: 19,581 - Likes: 60 - License: apache-2.0 - Languages: en - Based on: IFM/K2-Horizon-3.7B - Tags: transformers, gguf, k2-horizon, 3.7b, dense, open-weights, text-generation, conversational ## Links - Model: https://huggingface.co/IFM/K2-Horizon-3.7B-GGUF - Files: https://huggingface.co/IFM/K2-Horizon-3.7B-GGUF/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download IFM/K2-Horizon-3.7B-GGUF ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 6 KB, downloaded as a zip. ```text README.md 6 KB ``` ## Source [IFM/K2-Horizon-3.7B-GGUF on Hugging Face](https://huggingface.co/IFM/K2-Horizon-3.7B-GGUF) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | K2-Horizon-3.7B-GGUF (this page) | 19,581 | 60 | 5.1B | apache-2.0 | 2026-10-15 | | [K2-Horizon-7B-GGUF](https://mindket.com/p/d3557b60-83d2-4164-8e15-cbf497de8e72) | 24,083 | 84 | 9B | apache-2.0 | 2026-10-15 | | [K2-Horizon-7B](https://mindket.com/p/ed5bb82e-c6d9-4e82-9741-b599322d66fb) | 42,327 | 287 | 9B | apache-2.0 | 2026-11-04 | | [Ming-3.0-tts-0.5B by inclusionAI](https://mindket.com/p/f13d7a41-4e55-40ee-b52d-b5fd3d09578b) | 14,756 | 225 | 1.5B | mit | 2026-10-27 | | [Ornith-1.5-9B-GGUF](https://mindket.com/p/5dd265f6-9a3e-450b-ad2a-b49a78e2700a) | 5,772,425 | 673 | 9.2B | mit | 2026-08-24 | | [Ornith-1.5-35B-A3B-GGUF](https://mindket.com/p/c98822f4-2255-450a-89ce-df15fc0003a1) | 4,164,876 | 603 | 35.5B | mit | 2026-08-24 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-10-15 - First published: 2026-09-03 - Checked on Hugging Face: 2026-11-13 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open IFM/K2-Horizon-3.7B-GGUF on Hugging Face](https://huggingface.co/IFM/K2-Horizon-3.7B-GGUF) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/569aa0ff-40d8-41de-8f67-2b1f20cd01b7) - [Its page on Mindket](https://mindket.com/p/569aa0ff-40d8-41de-8f67-2b1f20cd01b7)