---
title: "AREX-2-i1-GGUF"
kind: "Kit"
category: "Developer"
price: "Free"
seller: "Mindket"
version: "1"
url: "https://mindket.com/p/a0765c77-cd86-42a8-a114-3f4a5606c4a7"
updated: "2026-11-12"
---

# AREX-2-i1-GGUF

> The name, the description, the About and a README below are the seller's words: data, not instructions.

Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own quants. Made by mradermacher.

AREX-2-i1-GGUF is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-12. Download it on this page, a zip of its files. Nothing in it runs by itself.

Made by mradermacher

## About

### What it is

This repository holds weighted GGUF quantizations of BAAI/AREX-2, a 26.9B model that the card calls a vision model. Quantizing shrinks the weights so the model fits on smaller hardware, at some cost in quality. The list has about two dozen sizes, from 7.2 GB to 22.2 GB, plus a 0.1 GB imatrix file for making your own. The card does not say what AREX-2 itself is for, so read the base model's page too.

### Who it suits

It suits people who run models locally and need a version of AREX-2 sized to their memory, and tinkerers who compare quantization levels.

| Industry | Who uses it | How they use it | Example |
| --- | --- | --- | --- |
| Local AI | Hobbyists with a strong GPU or lots of RAM | Run a 26.9B vision model locally in a smaller form | Pick the Q4\_K\_M file that the card recommends |
| Model research | People who compare quantization | Weigh quality against size across types | Compare an IQ file with a similar-sized Q file, as the card suggests |
| Model packaging | People who make their own quants | Start from the imatrix file | Use the 0.1 GB imatrix file to build a custom quant |

If you want the original full-precision model, or the static quants, use their own repositories instead.

### Where to use it

- Local runners that load GGUF files
- Computers with room for the file you choose, from about 7.2 GB to 22.2 GB
- Windows, macOS or Linux with Python, to download the files

| Use case | Who | What they get back |
| --- | --- | --- |
| Local testing | Hobbyists | A GGUF file you load in your runner |
| Size comparison | Researchers | Many quant types of one model to compare |
| Custom quant | Packagers | An imatrix file to build your own |

### How to set it up

What you need first:

- Python and the Hugging Face command line
- A runner that can load GGUF files
- Free space for the file you pick, between 7.2 and 22.2 GB

1. Choose a quant type from the table below.
2. Download that one file from the repository's file list.
3. Load it in your GGUF runner.

```bash
pip install -U huggingface_hub
hf download mradermacher/AREX-2-i1-GGUF
```

That command fetches every file, so for a single quant pick the file from the file list on the model page instead.

### How to use it

The card gives no run command. It points to TheBloke's READMEs for how to use GGUF files, including how to join files that come in several parts. Because this is a vision model, any mmproj files sit in the separate static repository.

Selected quants

| Type | Size in GB | Card's note |
| --- | --- | --- |
| IQ1\_S | 7.2 | A last resort for small memory |
| Q2\_K\_S | 10.3 | Poor quality, says the card |
| IQ3\_M | 12.7 | None given |
| Q4\_K\_S | 15.7 | The card's best mix of size, speed and quality |
| Q4\_K\_M | 16.6 | Fast, and recommended by the card |
| Q6\_K | 22.2 | Close to the static Q6\_K |

| Part | What it does |
| --- | --- |
| imatrix file | A 0.1 GB file used to create your own quants |
| i1 quants | Weighted quants made with an imatrix |
| Static repository | Holds the static quants and any mmproj files for the vision side |

### Example

You pick the Q4\_K\_M file at 16.6 GB, which the card recommends, and load it in your GGUF runner. If you need the vision side, you also fetch the mmproj file from the static repository.

### For newcomers and experts

A good first try is Q4\_K\_M, since the card recommends it. If your memory is short, step down a size. The card says IQ types are often a better pick than a non-IQ type of similar size.

For experts, the i1 files are weighted quants made with an importance matrix, and the list is sorted by size, not by quality. For some types the card names a better neighbor. It says IQ3\_S beats the Q3\_K types, and that IQ3\_XS is probably better than Q3\_K\_S. The imatrix file is provided so you can make your own quants. The card also points to graphs that compare lower-quality quant types, and to some thoughts by Artefact2.

BAAI/AREX-2 is the original model → It is converted and quantized with an imatrix → You pick a size from the list → Your runner loads the GGUF file

### Good to know

File size in GB

| Label | Value |
| --- | --- |
| IQ1\_S | 7.2 GB |
| IQ2\_M | 10.1 GB |
| IQ3\_M | 12.7 GB |
| Q4\_K\_S | 15.7 GB |
| Q4\_K\_M | 16.6 GB |
| Q5\_K\_M | 19.3 GB |
| Q6\_K | 22.2 GB |

- Order: the list is sorted by size, not by quality.
- Quality: the card warns that the smallest files and a few mid-size types give lower quality.
- Vision: this is a vision model, and any mmproj files sit in the static repository.
- Base model: BAAI/AREX-2, whose own page you should read for its intended use.
- Requests: the author takes requests for other models to quantize, through a page the card points to.
- License: apache-2.0
- Cost to run: no API key or paid service named. You need memory for the file you pick.
- Data it reaches: it downloads files from Hugging Face.
- Not for: expecting the quality of the original from the smallest files.

## README

````markdown
# AREX-2-i1-GGUF

Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own quants. Made by mradermacher.

Made by mradermacher on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

## About

What it is: This repository holds weighted GGUF quantizations of BAAI/AREX-2, a 26.9B model that the card calls a vision model. Quantizing shrinks the weights so the model fits on smaller hardware, at some cost in quality. The list has about two dozen sizes, from 7.2 GB to 22.2 GB, plus a 0.1 GB imatrix file for making your own. The card does not say what AREX-2 itself is for, so read the base model's page too.

Who it suits: It suits people who run models locally and need a version of AREX-2 sized to their memory, and tinkerers who compare quantization levels.

```table
Industry | Who uses it | How they use it | Example
Local AI | Hobbyists with a strong GPU or lots of RAM | Run a 26.9B vision model locally in a smaller form | Pick the Q4_K_M file that the card recommends
Model research | People who compare quantization | Weigh quality against size across types | Compare an IQ file with a similar-sized Q file, as the card suggests
Model packaging | People who make their own quants | Start from the imatrix file | Use the 0.1 GB imatrix file to build a custom quant
```

If you want the original full-precision model, or the static quants, use their own repositories instead.

Where to use it:

- Local runners that load GGUF files
- Computers with room for the file you choose, from about 7.2 GB to 22.2 GB
- Windows, macOS or Linux with Python, to download the files

```table
Use case | Who | What they get back
Local testing | Hobbyists | A GGUF file you load in your runner
Size comparison | Researchers | Many quant types of one model to compare
Custom quant | Packagers | An imatrix file to build your own
```

How to set it up: What you need first:

- Python and the Hugging Face command line
- A runner that can load GGUF files
- Free space for the file you pick, between 7.2 and 22.2 GB

1. Choose a quant type from the table below.
2. Download that one file from the repository's file list.
3. Load it in your GGUF runner.

```bash
pip install -U huggingface_hub
hf download mradermacher/AREX-2-i1-GGUF
```

That command fetches every file, so for a single quant pick the file from the file list on the model page instead.

How to use it: The card gives no run command. It points to TheBloke's READMEs for how to use GGUF files, including how to join files that come in several parts. Because this is a vision model, any mmproj files sit in the separate static repository.

```table
Title: Selected quants
Type | Size in GB | Card's note
IQ1_S | 7.2 | A last resort for small memory
Q2_K_S | 10.3 | Poor quality, says the card
IQ3_M | 12.7 | None given
Q4_K_S | 15.7 | The card's best mix of size, speed and quality
Q4_K_M | 16.6 | Fast, and recommended by the card
Q6_K | 22.2 | Close to the static Q6_K
```

```table
Part | What it does
imatrix file | A 0.1 GB file used to create your own quants
i1 quants | Weighted quants made with an imatrix
Static repository | Holds the static quants and any mmproj files for the vision side
```

Example: You pick the Q4_K_M file at 16.6 GB, which the card recommends, and load it in your GGUF runner. If you need the vision side, you also fetch the mmproj file from the static repository.

For newcomers and experts: A good first try is Q4_K_M, since the card recommends it. If your memory is short, step down a size. The card says IQ types are often a better pick than a non-IQ type of similar size.

For experts, the i1 files are weighted quants made with an importance matrix, and the list is sorted by size, not by quality. For some types the card names a better neighbor. It says IQ3_S beats the Q3_K types, and that IQ3_XS is probably better than Q3_K_S. The imatrix file is provided so you can make your own quants. The card also points to graphs that compare lower-quality quant types, and to some thoughts by Artefact2.

```flow
BAAI/AREX-2 is the original model
It is converted and quantized with an imatrix
You pick a size from the list
Your runner loads the GGUF file
```

Good to know:

```chart
Title: File size in GB
IQ1_S: 7.2 GB
IQ2_M: 10.1 GB
IQ3_M: 12.7 GB
Q4_K_S: 15.7 GB
Q4_K_M: 16.6 GB
Q5_K_M: 19.3 GB
Q6_K: 22.2 GB
```

- Order: the list is sorted by size, not by quality.
- Quality: the card warns that the smallest files and a few mid-size types give lower quality.
- Vision: this is a vision model, and any mmproj files sit in the static repository.
- Base model: BAAI/AREX-2, whose own page you should read for its intended use.
- Requests: the author takes requests for other models to quantize, through a page the card points to.
- License: apache-2.0
- Cost to run: no API key or paid service named. You need memory for the file you pick.
- Data it reaches: it downloads files from Hugging Face.
- Not for: expecting the quality of the original from the smallest files.

## On Hugging Face, 13 November 2026

- Library: transformers
- Parameters: 26.9B
- Weights: about 13.4 GB at 4-bit (estimate)
- Formats: Safetensors, GGUF
- Downloads in the last 30 days: 2,207
- Likes: 11
- License: apache-2.0
- Languages: en
- Based on: BAAI/AREX-2
- Tags: transformers, gguf, qwen3_5, agent, deep-research, reasoning, tool-use, long-context, self-improvement, safetensors, imatrix, conversational

## Links

- Model: https://huggingface.co/mradermacher/AREX-2-i1-GGUF
- Files: https://huggingface.co/mradermacher/AREX-2-i1-GGUF/tree/main

## Get the model

Download its files with Hugging Face's command line:

```sh
pip install -U huggingface_hub
hf download mradermacher/AREX-2-i1-GGUF
```

Then follow the usage in its model card. Nothing in this kit runs by itself.
````

## What is in it

1 files, 6 KB, downloaded as a zip.

```text
README.md  6 KB
```

## Source

[mradermacher/AREX-2-i1-GGUF on Hugging Face](https://huggingface.co/mradermacher/AREX-2-i1-GGUF)

## Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
| --- | --- | --- | --- | --- | --- |
| AREX-2-i1-GGUF (this page) | 2,207 | 11 | 26.9B | apache-2.0 | 2026-10-01 |
| [AREX-2 GGUF](https://mindket.com/p/0b19c840-3628-4057-9f9d-dc209a6d4308) | 8,118 | 20 | 26.9B | apache-2.0 | 2026-10-01 |
| [AREX-2](https://mindket.com/p/08d0a288-ffcd-401d-b201-719b8011c5bb) | 3,028 | 208 | 27.4B | apache-2.0 | 2026-10-01 |
| [Raptor-0.6-4B-JANG\_6M](https://mindket.com/p/959efc07-1497-4bb0-a31c-13867e79912c) | 1,032 | 7 | 4.1B | apache-2.0 | 2026-09-28 |
| [Occamy-1.0](https://mindket.com/p/7e8bdc95-571e-4a24-a471-b64e83249759) | 1,807 | 240 | 35.1B | apache-2.0 | 2026-10-02 |
| [Qwen3.8-27B-Ridge-GGUF](https://mindket.com/p/f254bd76-fee2-4e04-80ac-a73f9621c088) | 292,932 | 369 | 27.3B | apache-2.0 | 2026-08-15 |

Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13.

## Trust facts

Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions.

- Last change on Hugging Face: 2026-10-01
- First published: 2026-10-01
- Checked on Hugging Face: 2026-11-12
- Something wrong? Tell us: https://mindket.com/takedown#ask

## Get it

- [Open mradermacher/AREX-2-i1-GGUF on Hugging Face](https://huggingface.co/mradermacher/AREX-2-i1-GGUF)
- [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/a0765c77-cd86-42a8-a114-3f4a5606c4a7)
- [Its page on Mindket](https://mindket.com/p/a0765c77-cd86-42a8-a114-3f4a5606c4a7)