AI projects from Hugging Face

Qwen3.8-27B-NVFP4 Deployment Edition

IteraCompute · Kit

Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…

Qwen3.6-35B-A3B-2Bit-GSQ

ISTA-DASLab · Kit

A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…

Agents-A1

InternScience · Kit

Runs multi-step agent work: planning, search, tool calling and scientific reasoning, as a 35B open-weight language model. Built for developers who wire a model…

K2-Horizon-3.7B-GGUF

IFM · Kit

GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…

K2-Horizon-0.9B

IFM · Kit

Answers maths, coding and science questions as a compact open reasoning model that reads up to 128K tokens at once. Built by IFM for people who want a small mo…

ibnsina-1.5b

ibnsina-llm · Kit

A small Persian language model for writing, summarizing, translating and chatting offline, trained from scratch mostly on Persian text. Runs through ollama, LM…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

Granite-4.2-3B (GGUF)

ibm-granite · Kit

Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…

Granite-4.0-H-350M

ibm-granite · Kit

Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…

ALLaM-7B-Instruct-preview

humain-ai · Kit

Answers questions and follows instructions in Arabic and English. A 7B model trained from scratch by the National Center for Artificial Intelligence at SDAIA,…

SmolVLM2-2.2B-Instruct

HuggingFaceTB · Kit

Answers questions about videos, images and text together, with a 2.2B model that needs about 5.2 GB of GPU memory for video. For developers building visual ass…

zephyr-7b-beta

HuggingFaceH4 · Kit

Chats as a helpful assistant, built by tuning Mistral-7B with direct preference optimization. For developers and hobbyists who want a small open chat model the…

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

hesamation · Kit

Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…

H2O-Lightning-4B

h2oai · Kit

Answers typed decision questions about a document, ticket, policy or conversation, and about its images, giving each option a probability. For teams that want…

Tev-320B

gordonhu · Kit

A 320B mixture-of-experts agent model that works through long terminal tasks with a single bash tool. Trained with reinforcement learning on 1,170 environments…

gemma-4-31B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

Clef-GGUF

ggml-org · Kit

GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…

KVARK Sparkle 1.0 (27B) FP8

Egzakta · Kit

Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…

Kvark-Sparkle-1.0-27B

Egzakta · Kit

Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…