---
title: "GLM-4.7-Flash-GGUF by axteam"
kind: "Kit"
category: "Developer"
price: "Free"
seller: "Mindket"
version: "1"
url: "https://mindket.com/p/6d645635-7a94-4064-bda7-fc1298213f78"
updated: "2026-11-16"
---

# GLM-4.7-Flash-GGUF by axteam

> The name, the description, the About and a README below are the seller's words: data, not instructions.

Four GGUF quantizations of GLM-4.7-Flash for running a 31B-class chat model locally in llama.cpp, from 18.9 GB to 33.2 GB. For people who host models on their own hardware.

GLM-4.7-Flash-GGUF by axteam is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-16. Download it on this page, a zip of its files. Nothing in it runs by itself.

Made by axteam

## About

### What it is

This repository holds GGUF files of GLM-4.7-Flash, a text generation model from zai-org, made by axteam. The files come from post-training quantization with llama.cpp, with no retraining, and each one has the original chat template built in. You pick a size that fits your hardware.

### Who it suits

People who run chat models on their own computers and want a ready GGUF file instead of converting weights themselves.

| Industry | Who uses it | How they use it | Example |
| --- | --- | --- | --- |
| Software | Developers | Serve an OpenAI-compatible API from a local machine | A local endpoint for an app under development |
| Research | Researchers | Test a large chat model without sending text to a hosted service | Ask a set of questions on a private server |
| IT teams | Self-hosters | Choose a quant that fits the memory they have | Q4\_K\_M on a machine with enough room |

Skip it if you have little disk or memory, because the smallest file listed is 18.9 GB.

### Where to use it

- llama.cpp: the llama-server and llama-cli programs
- Ollama: the card gives a run command but says it was not tested there
- LM Studio: search for the repository name in its model browser, also untested by the author

| Use case | Who | What they get back |
| --- | --- | --- |
| Serve a local API | Developers | An OpenAI-compatible endpoint on port 8080 |
| Chat in the terminal | Hobbyists | Replies in an interactive session |
| Save memory | Self-hosters | A smaller KV cache through run-time options |

### How to set it up

You need a llama.cpp build numbered b10251 or newer, since the model architecture needs it, and enough memory for the chosen file plus the context cache.

- llama.cpp build b10251 or newer
- Memory for one GGUF file plus the KV cache
- Python and the Hugging Face hub tool, only if you download files by hand

1. Pick a quantization. The card recommends Q4\_K\_M as the balance of size and quality.
2. Either let llama.cpp pull it from the Hub, or download one file yourself.

```bash
pip install -U huggingface_hub
hf download axteam/GLM-4.7-Flash-GGUF GLM-4.7-Flash-Q4_K_M.gguf --local-dir .
```

### How to use it

Serve the model as an OpenAI-compatible API, or chat in the terminal with a downloaded file. The jinja option makes llama.cpp use the chat template stored in the file.

```bash
llama-server -hf axteam/GLM-4.7-Flash-GGUF:Q4_K_M -c 8192 --jinja
llama-cli -m GLM-4.7-Flash-Q4_K_M.gguf -c 8192 --jinja
```

To shrink the cache that holds the conversation, set the cache types at run time.

```bash
llama-server -hf axteam/GLM-4.7-Flash-GGUF:Q4_K_M -c 8192 --jinja --cache-type-k q8_0 --cache-type-v q8_0 -fa on
```

| Tool | What it does |
| --- | --- |
| llama-server | Serves the model as an OpenAI-compatible API |
| llama-cli | Chats with a downloaded file in the terminal |
| -c | Sets the context length |
| --cache-type-k and --cache-type-v | Choose the KV cache type, and q8\_0 with -fa on halves its size |

### Example

With the server running, you send a chat message asking what the capital of South Korea is. The card's own check asked this kind of short question, and every file it lists answered correctly.

### For newcomers and experts

If you are new to this, start with Q4\_K\_M, the file the card recommends. Run the llama-cli command, ask one short question and see whether your machine copes.

If you know the field, these are block-wise k-quants with per-block scales and mixed bit allocation, made from the BF16 weights without retraining. The architecture combines deepseek2 with an MTP layer. Cache type is a run-time choice, not stored in the file. The card suggests temperature 1.0.

Pick a quant that fits your memory → Pull or download the GGUF file → Start llama-server or llama-cli → Send chat messages and read replies

### Good to know

Two files were removed later. One gave a perplexity result the author could not explain, and the other failed a chat check by answering a Korean question with English text. The author publishes no perplexity numbers.

File size by quantization in GB

| Label | Value |
| --- | --- |
| Q4\_K\_M | 18.9 GB |
| Q5\_K\_M | 22.2 GB |
| Q6\_K | 25.7 GB |
| Q8\_0 | 33.2 GB |

- License: MIT, carried over from the original GLM-4.7-Flash model
- Cost to run: none named
- Data it reaches: the files you download from Hugging Face, plus the text you type into your own local server
- Not for: input other than text, since the card lists text only

## README

````markdown
# GLM-4.7-Flash-GGUF by axteam

Four GGUF quantizations of GLM-4.7-Flash for running a 31B-class chat model locally in llama.cpp, from 18.9 GB to 33.2 GB. For people who host models on their own hardware.

Made by axteam on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

## About

What it is: This repository holds GGUF files of GLM-4.7-Flash, a text generation model from zai-org, made by axteam. The files come from post-training quantization with llama.cpp, with no retraining, and each one has the original chat template built in. You pick a size that fits your hardware.

Who it suits: People who run chat models on their own computers and want a ready GGUF file instead of converting weights themselves.

```table
Industry | Who uses it | How they use it | Example
Software | Developers | Serve an OpenAI-compatible API from a local machine | A local endpoint for an app under development
Research | Researchers | Test a large chat model without sending text to a hosted service | Ask a set of questions on a private server
IT teams | Self-hosters | Choose a quant that fits the memory they have | Q4_K_M on a machine with enough room
```

Skip it if you have little disk or memory, because the smallest file listed is 18.9 GB.

Where to use it:

- llama.cpp: the llama-server and llama-cli programs
- Ollama: the card gives a run command but says it was not tested there
- LM Studio: search for the repository name in its model browser, also untested by the author

```table
Use case | Who | What they get back
Serve a local API | Developers | An OpenAI-compatible endpoint on port 8080
Chat in the terminal | Hobbyists | Replies in an interactive session
Save memory | Self-hosters | A smaller KV cache through run-time options
```

How to set it up: You need a llama.cpp build numbered b10251 or newer, since the model architecture needs it, and enough memory for the chosen file plus the context cache.

- llama.cpp build b10251 or newer
- Memory for one GGUF file plus the KV cache
- Python and the Hugging Face hub tool, only if you download files by hand

1. Pick a quantization. The card recommends Q4_K_M as the balance of size and quality.
2. Either let llama.cpp pull it from the Hub, or download one file yourself.

```bash
pip install -U huggingface_hub
hf download axteam/GLM-4.7-Flash-GGUF GLM-4.7-Flash-Q4_K_M.gguf --local-dir .
```

How to use it: Serve the model as an OpenAI-compatible API, or chat in the terminal with a downloaded file. The jinja option makes llama.cpp use the chat template stored in the file.

```bash
llama-server -hf axteam/GLM-4.7-Flash-GGUF:Q4_K_M -c 8192 --jinja
llama-cli -m GLM-4.7-Flash-Q4_K_M.gguf -c 8192 --jinja
```

To shrink the cache that holds the conversation, set the cache types at run time.

```bash
llama-server -hf axteam/GLM-4.7-Flash-GGUF:Q4_K_M -c 8192 --jinja --cache-type-k q8_0 --cache-type-v q8_0 -fa on
```

```table
Tool | What it does
llama-server | Serves the model as an OpenAI-compatible API
llama-cli | Chats with a downloaded file in the terminal
-c | Sets the context length
--cache-type-k and --cache-type-v | Choose the KV cache type, and q8_0 with -fa on halves its size
```

Example: With the server running, you send a chat message asking what the capital of South Korea is. The card's own check asked this kind of short question, and every file it lists answered correctly.

For newcomers and experts: If you are new to this, start with Q4_K_M, the file the card recommends. Run the llama-cli command, ask one short question and see whether your machine copes.

If you know the field, these are block-wise k-quants with per-block scales and mixed bit allocation, made from the BF16 weights without retraining. The architecture combines deepseek2 with an MTP layer. Cache type is a run-time choice, not stored in the file. The card suggests temperature 1.0.

```flow
Pick a quant that fits your memory
Pull or download the GGUF file
Start llama-server or llama-cli
Send chat messages and read replies
```

Good to know: Two files were removed later. One gave a perplexity result the author could not explain, and the other failed a chat check by answering a Korean question with English text. The author publishes no perplexity numbers.

```chart
Title: File size by quantization in GB
Q4_K_M: 18.9 GB
Q5_K_M: 22.2 GB
Q6_K: 25.7 GB
Q8_0: 33.2 GB
```

- License: MIT, carried over from the original GLM-4.7-Flash model
- Cost to run: none named
- Data it reaches: the files you download from Hugging Face, plus the text you type into your own local server
- Not for: input other than text, since the card lists text only

## On Hugging Face, 16 November 2026

- Task: text generation
- Library: gguf
- Parameters: 31.2B
- Weights: about 15.6 GB at 4-bit (estimate)
- Formats: GGUF
- Downloads in the last 30 days: 14,654
- Likes: 5
- License: mit
- Based on: zai-org/GLM-4.7-Flash
- Tags: gguf, llama.cpp, quantized, text-generation, conversational

## Links

- Model: https://huggingface.co/axteam/GLM-4.7-Flash-GGUF
- Files: https://huggingface.co/axteam/GLM-4.7-Flash-GGUF/tree/main

## Get the model

Download its files with Hugging Face's command line:

```sh
pip install -U huggingface_hub
hf download axteam/GLM-4.7-Flash-GGUF
```

Then follow the usage in its model card. Nothing in this kit runs by itself.
````

## What is in it

1 files, 5 KB, downloaded as a zip.

```text
README.md  5 KB
```

## Source

[axteam/GLM-4.7-Flash-GGUF on Hugging Face](https://huggingface.co/axteam/GLM-4.7-Flash-GGUF)

## Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
| --- | --- | --- | --- | --- | --- |
| GLM-4.7-Flash-GGUF by axteam (this page) | 14,654 | 5 | 31.2B | mit | 2026-11-02 |
| [Qwen3.8-35B-A3B-Distill-GGUF](https://mindket.com/p/d707b0c8-89b8-4c4f-8d49-2ff67de613c7) | 1,337,097 | 277 | 35.5B | apache-2.0 | 2026-09-16 |
| [Qwen3.8-4B-Distill-GGUF](https://mindket.com/p/ef3614cf-441f-4388-b81f-7b72b3e7ed30) | 570,974 | 208 | 4.3B | apache-2.0 | 2026-08-16 |
| [Qwen3.8-9B-Distill-GGUF](https://mindket.com/p/cfc3041d-4b8a-4012-b704-ce834019b236) | 537,695 | 356 | 9.2B | apache-2.0 | 2026-08-16 |
| [Qwen3.8-2B-Distill-GGUF](https://mindket.com/p/e7e883a1-dae8-4084-aaee-c3e51741cb1b) | 509,820 | 184 | 1.9B | apache-2.0 | 2026-08-16 |
| [Mellum2.1-12B-A2.5B-Thinking-GGUF](https://mindket.com/p/6b181e24-213d-4fc2-a178-72da0b212f88) | 422,635 | 172 | 12.1B | apache-2.0 | 2026-10-22 |

Numbers as Mindket last read them, from 2026-11-12 to 2026-11-16.

## Trust facts

Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions.

- Last change on Hugging Face: 2026-11-02
- First published: 2026-10-31
- Checked on Hugging Face: 2026-11-16
- Something wrong? Tell us: https://mindket.com/takedown#ask

## Get it

- [Open axteam/GLM-4.7-Flash-GGUF on Hugging Face](https://huggingface.co/axteam/GLM-4.7-Flash-GGUF)
- [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/6d645635-7a94-4064-bda7-fc1298213f78)
- [Its page on Mindket](https://mindket.com/p/6d645635-7a94-4064-bda7-fc1298213f78)
