AI projects from Hugging Face

Qwen3.8-27B-Quark-AWQ-MXFP4

amd · Kit

Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…

AMALIA-9B-0626-DPO

amalia-llm · Kit

Writes and answers in European Portuguese as an open 9B chat model from Portuguese universities, tuned with supervised fine-tuning and DPO. Made for developers…

Olmo-3.1-32B-Think

allenai · Kit

Reasons step by step in English before it answers, which helps with math and coding questions. A 32B open model from allenai with published code, checkpoints a…

Surya 2.5 GGUF

datalab-to · Kit

Reads text, tables and layout from document images and returns it as text. GGUF builds of the Surya 2.5 OCR model for llama.cpp, for people who run document OC…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

Hy-MT2-7B-GGUF

tencent · Kit

Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…

Hy-MT2-1.8B-GGUF

tencent · Kit

Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…

Qwen2.5-0.5B-Instruct

Qwen · Kit

Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…

MinerU2.5-Pro

opendatalab · Kit

Reads document page images and returns text, as a 1.2B-parameter model built for document parsing in Chinese and English. It suits teams that turn scanned page…

K2-Horizon-3.7B

IFM · Kit

Handles coding, reasoning and agent-style tasks as a small open model with a 512K token context window. Built by IFM for people who want public training data,…

DialFork Leaderboard

DialFork · Kit

Lists how different methods score on DialFork, a benchmark for procedural hallucination in conversational AI agents, on one static page. It suits researchers w…

Molmo2-8B

allenai · Kit

Answers questions about images, video and several images at once, and can point to things it finds. Made for developers who want an open 8B vision-language mod…

BaronLLM Offensive Security LLM Q6_K GGUF

AlicanKiraz0 · Kit

Answers security questions and helps plan authorized red-team exercises, as a Q6_K GGUF fine-tune of Llama 3.1 8B. For security researchers working on systems…

GigaChat3.5-432B-A28B

ai-sage · Kit

Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…

GigaChat3.1-10B-A1.8B-GGUF

ai-sage · Kit

Chats in Russian and English, writes code and calls functions, as a compact mixture of experts model in GGUF files. For people who run assistants on their own…

Ara-JEV

AhmedReda25300 · Kit

Picks the best answer label from a short Arabic situation, a question and optional choices. Made for developers who route or decide Arabic tasks with a small 0…

Qwen3.8-27B Agention Precision GGUF

agentionai · Kit

Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…

Occamy-1.0

Accio-Lab · Kit

An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.

GLM-5.3-Flash EXL3 Spark

0xSero · Kit

Runs GLM-5.3-Flash with a 256k-token context and image input on one DGX Spark, using a mixed 2.31 bits-per-weight EXL3 build. For people hosting a large model…

Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF

0xKitkat · Kit

Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…

Tessera-27B-B-CJK-RL

ZelligeAI · Kit

Runs coding-agent loops with a 27B model that thinks in a compressed English and Chinese shorthand, so it spends fewer thinking tokens per turn. For developers…

AgentForesight-7B

ZBox008003 · Kit

Audits a multi-agent run while it unfolds and flags the earliest decisive error, naming the step, the agent and a short reason. For developers who build and de…

Strata-Sage-A1.5-GGUF

ykarout · Kit

A Q4_K_M GGUF of the 35B Sage-A1.5 model made for the Strata inference engine, fitting a full 262K context on a 16 GB graphics card plus 64 GB of RAM. For peop…

OpenBonsai Qwen3.5-9B Ternary

webbrain-one · Kit

Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…

Qwen3.6-27B-MTP-GGUF

unsloth · Kit

Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…

Qwen3.5-0.8B-MTP-GGUF

unsloth · Kit

Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…

Muse Glimmer 30B GGUF

unsloth · Kit

Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…

granite-4.1-8b-GGUF

unsloth · Kit

Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

NeoHorse-1-9B

TokenRhythm · Kit

A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…

MNN-Pocket-0.3B-Base

taobao-mnn · Kit

A pre-trained base language model of about 300M parameters for Chinese and English, designed with the MNN inference engine for on-device use, as a start for fu…

Beam-1.0-501B-A23B-NVFP4

reflection · Kit

Reads and writes text with a 1M-token context, built for coding, agent tool use and math reasoning, as a 501B-parameter mixture-of-experts model in NVFP4 form.…

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3Guard-Gen-0.6B

Qwen · Kit

A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Qwen3-1.7B-Base

Qwen · Kit

Continues text and code as a 1.7B base language model pre-trained on 119 languages. For developers who want a small model to fine-tune or test.

Qwen3-1.7B

Qwen · Kit

A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…

Qwen2.5-VL-7B-Instruct

Qwen · Kit

A vision-language model that reads images, documents and video together with a text question and answers in text. Suits developers who build apps around charts…

Qwen2.5-Coder-14B-Instruct

Qwen · Kit

A 14.8B code model tuned to follow instructions. It writes, explains and fixes code from plain requests, and runs through the transformers library. Suits devel…

Qwen2.5-7B-Instruct

Qwen · Kit

Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…

Qwen2 0.5B Instruct

Qwen · Kit

A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…

1-bit Bonsai 27B (MLX)

prism-ml · Kit

Runs a 27B-class reasoning model packed to 1 bit per weight, about 3.9 GB, on Apple MLX, with 262K-token context. For developers who want a large model on a ph…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Laguna XS 2.1

poolside · Kit

Writes code and works through long coding tasks with tool calls, using a 33B mixture-of-experts model that activates 3B parameters per token. For developers wh…

Qwen3.8-27B-QSA-GSQ-RCO-GGUF

pentacoxian-dev · Kit

Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…

Ornith-1.0-9B-GGUF

ornith-ai · Kit

GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…

gpt-oss-safeguard-20b

openai · Kit

Classifies text against a safety policy you write and shows its reasoning. For trust and safety teams filtering model inputs and outputs, labeling content onli…

gpt-oss-safeguard-120b

openai · Kit

Sorts text against a safety policy that you write, and shows its reasoning for each decision. It suits trust and safety teams that filter or label content.

OneJev1.6-4B

OmniJev · Kit

Reads a screenshot, photo, video or text with a few typed questions and returns a probability for each answer option in one pass. Built for developers of scree…