AI projects from Hugging Face

Ornith-1.5-122B-GGUF by unsloth

unsloth · Kit

Runs the Ornith-1.5-122B text model on your own machine, as GGUF files made by unsloth. A 122B mixture-of-experts model aimed at coding and agent work on a sin…

Qwen3.5-9B-MTP-GGUF

unsloth · Kit

GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…

Qwen3.5-0.8B-GGUF

unsloth · Kit

Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-0.8B by unsloth. Meant for local prototyping, fine-tuning and research.

gpt-oss-20b-GGUF

unsloth · Kit

Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…

Qwen2.5-VL-7B-Instruct-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…

gemma-4-E4B-it-GGUF

unsloth · Kit

A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.

gemma-4-12b-it-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.

embeddinggemma-2-GGUF

unsloth · Kit

Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by…

gemma-4-12B-it-qat-GGUF

unsloth · Kit

Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…

Qwen3.8-27B-NVFP4

unsloth · Kit

A 4-bit NVFP4 copy of the Qwen3.8 27B vision-language model made by Unsloth, for serving with vLLM. For developers who want a dense model that reads images and…

gemma-4-31B-it-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…

Qwen3.5-4B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.

GLM-5.3-Flash-GGUF

unsloth · Kit

Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…

Qwen3.6-35B-A3B-MTP-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…

flint-GGUF

unsloth · Kit

Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…

Qwen3.5-9B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.

Qwen3.8-27B-QSA-GGUF

higa2515 · Kit

Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…

Qwen3.6-35B-A3B-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…

DeepSeek-V4.1-Flash-1017-GGUF

unsloth · Kit

Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…