Qwen2.5-7B-Instruct-GGUF by Qwen
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
bartowski · Kit
Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…
z-lab · Kit
A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…
XHToken · Kit
A compact 1.7B language model for on-device use in English and Chinese, with gains in coding, agent tasks and long context, and three adjustable thinking level…
unsloth · Kit
Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…
unsloth · Kit
Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-120b, a 117B model with 5.1B active parameters, from GGUF files by Unsloth that carry its fixes. Built for reasoning, agent t…
unsloth · Kit
Answers questions about text and images with Google's Gemma 3 27B instruction-tuned model, in GGUF files made by Unsloth for running on your own computer. It h…
trevest · Kit
Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…
summerAIO · Kit
Summarizes, answers questions about and continues book-length text with a fine-tuned 27B model that uses Gated DeltaNet layers, in English and Japanese. For pe…
Shockem · Kit
Cuts the length of Qwen3.8-27B's reasoning on coding tasks so answers arrive sooner, as a small LoRA adapter. For people who run the base model on their own ha…
rapid-mlx · Kit
A 27B vision-language model compressed to 3.5 bits per weight for Apple Silicon Macs with 24 GB of memory, served locally through Rapid-MLX. Suits Mac users an…
RadixArk · Kit
A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…
Qwen · Kit
Completes and generates code as a 7.6B base language model that developers can run, fine-tune or use for fill in the middle tasks. Built for people making codi…
Qwen · Kit
A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…
Qwen · Kit
Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…
QUASAR-QAT · Kit
Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…
prism-ml · Kit
FP16 safetensors copy of the 1-bit Bonsai-1.7B model, for running it in standard Hugging Face tools. The card advises the native 1-bit releases instead, which…
perplexity-ai · Kit
Picks the best option for a decision from text and images, such as which team should handle a request, with a probability for each choice, for developers who b…
NexaAI · Kit
Runs Qwen2-Audio locally to chat by voice and analyze audio, including speech translation, transcription and sound detection. GGUF copies for Nexa-SDK, for peo…
mukaddamzaid · Kit
Answers typed questions about a case, given as text, JSON or a photo, in one pass with a probability for each allowed answer. A 27B decision model that writes…
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
mlx-community · Kit
Runs an 8-bit MLX copy of VulnLLM-R-7B for text generation through mlx-lm. Meant for developers who want to try the model locally. The card does not say what i…
mistralai · Kit
Generates and continues text as a 7B pretrained base model, for researchers and developers who want a starting point to test, tune or build on.
mistralai · Kit
A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…
microsoft · Kit
Turns text in many languages into embedding vectors for search, clustering, similarity, classification and reranking. Made for developers who run semantic sear…
lmstudio-community · Kit
Runs a 27B model that reads images and text in an 8-bit MLX build for Apple Silicon Macs. It suits people who want picture questions answered locally.
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
Jundot · Kit
Runs the 27B Qwen3.8 vision-language model on MLX in about 17.5 GB, reading text, images and video with a 262,144-token context. A mixed-precision quantization…
JoyIndustrial · Kit
Answers multiple-choice style questions about images and text with option probabilities, using a Qwen3.8-27B decision system with built-in OCR. For developers…
Joakimpalm-Zen · Kit
Shrinks Qwen3.8-27B to a 3-bit IQ3_S GGUF with retrained scales. A research file for people who study quantization, not a faithful stand-in for the original mo…
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…
IFM · Kit
GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…
humain-ai · Kit
Answers questions and follows instructions in Arabic and English. A 7B model trained from scratch by the National Center for Artificial Intelligence at SDAIA,…
HuggingFaceH4 · Kit
Chats as a helpful assistant, built by tuning Mistral-7B with direct preference optimization. For developers and hobbyists who want a small open chat model the…
HiDream-ai · Kit
Generates images from text prompts with a 17B-parameter open model that scores at the top of the card's prompt-following tables. For designers, marketers and d…
FINAL-Bench · Kit
Reads a situation and a set of typed questions, then returns a probability for every option in one forward pass, with no text generated. For builders adding ca…
Egzakta · Kit
Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…
Egzakta · Kit
Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…
dmeight · Kit
Runs Qwen3.8-27B at 8-bit through the Splash runtime in LM Studio on Apple silicon. An unofficial package that keeps the model closer to the original than the…
datalab-to · Kit
Pulls structured data out of PDFs and images. You supply a JSON schema, and it returns an object that matches it. A 9.7B vision-language model from Datalab for…
cstr · Kit
Turns speech, singing and songs into text, or into English, with quantized GGUF files of Qwen3-ASR-1.7B for CrispASR. For people who want local transcription a…
continuedev · Kit
Predicts the next edit you are likely to make in your code. A 7.6B model from Continue, fine-tuned from Qwen2.5-Coder-7B, for developers who want to run it on…
ByteDance-Seed · Kit
An open multimodal agent model that reads screenshots and decides what to do in apps, browsers, phones and games. For developers building computer-use and GUI…
BSC-LT · Kit
A 7.8B translation model for 40 languages and 3 varieties, covering sentence, paragraph and document translation plus HTML or XML text. For developers and rese…
barozp · Kit
A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…
baidu · Kit
Reads images and text and reasons about them, with about 3B of its 29.7B parameters active at a time. Covers chart reading, STEM problems from photos, visual g…
autotrust · Kit
Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…
arcinstitute · Kit
A 7B language model for DNA that reads sequences up to 1 million letters long, from the Arc Institute's Evo 2 family. Made for researchers who work with genome…