AI skills and agents for developers

SmolLM3-3B-GGUF

unsloth · Kit

Chats and reasons with SmolLM3, a fully open 3B model that can think step by step or answer directly, in GGUF files by Unsloth with chat template fixes. Handle…

Qwen3.6-35B-A3B-NVFP4-Fast

unsloth · Kit

Serves Qwen3.6 35B A3B in a fast NVFP4 build by Unsloth for vLLM on NVIDIA GPUs. The card says it has 1.79x the throughput of other NVFP4 builds and fits a 32…

Qwen3.6-27B-GGUF

unsloth · Kit

Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…

Qwen3.5-4B-MTP-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Qwen3-14B-GGUF

unsloth · Kit

Gives you Qwen3 14B, a text generation model that can think through hard questions or answer fast, as GGUF files for your own computer. Packaged by unsloth for…

Qwen2.5-Coder-7B-Instruct-GGUF by unsloth

unsloth · Kit

Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…

Olmo-3-32B-Think-GGUF

unsloth · Kit

Gives you Olmo 3 32B Think, a 32.2B-parameter reasoning model, as GGUF files that run on your own computer. Packaged by unsloth for people who want a local mod…

Llama-3.2-3B-Instruct-GGUF by unsloth

unsloth · Kit

Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…

gpt-oss-120b-GGUF

unsloth · Kit

Runs OpenAI's open-weight gpt-oss-120b, a 117B model with 5.1B active parameters, from GGUF files by Unsloth that carry its fixes. Built for reasoning, agent t…

gemma-3-27b-it-GGUF

unsloth · Kit

Answers questions about text and images with Google's Gemma 3 27B instruction-tuned model, in GGUF files made by Unsloth for running on your own computer. It h…

ERNIE-4.5-21B-A3B-Thinking-GGUF

unsloth · Kit

Works through logic, math, science and coding problems with a 21B mixture-of-experts model that activates 3B parameters per token, in GGUF files by Unsloth. Su…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

Z-Image-Turbo-GGUF by unsloth

unsloth · Kit

Unsloth's GGUF files of Z-Image-Turbo, a fast distilled text-to-image model that the authors say fits on a 16 GB consumer GPU. For people who generate images l…

Qwen3.6-27B-MTP-GGUF

unsloth · Kit

Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…

Qwen3.5-0.8B-MTP-GGUF

unsloth · Kit

Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…

Muse Glimmer 30B GGUF

unsloth · Kit

Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…

granite-4.1-8b-GGUF

unsloth · Kit

Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

Forge-1-Gemma-4-E2B

YoSaNoo · Kit

A small coding-minded text model fine-tuned from Google's gemma-4-E2B and shared as GGUF files, so you can run it on your own laptop in Ollama, LM Studio, Unsl…

Llama-3.2-1B-Instruct-GGUF

unsloth · Kit

Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…

gemma-4-E2B-it-GGUF

unsloth · Kit

Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…

gemma-3-4b-it-GGUF

unsloth · Kit

Answers questions about text and images on your own computer, as a GGUF copy of Google's Gemma 3 4B instruction model packaged by Unsloth. For developers and u…

Qwen3.5-2B-GGUF

unsloth · Kit

Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-2B by unsloth. Meant for local prototyping, fine-tuning and research.

Ornith-1.5-122B-GGUF by unsloth

unsloth · Kit

Runs the Ornith-1.5-122B text model on your own machine, as GGUF files made by unsloth. A 122B mixture-of-experts model aimed at coding and agent work on a sin…

Qwen3.5-0.8B-GGUF

unsloth · Kit

Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-0.8B by unsloth. Meant for local prototyping, fine-tuning and research.

gpt-oss-20b-GGUF

unsloth · Kit

Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…

Qwen2.5-VL-7B-Instruct-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…

gemma-4-E4B-it-GGUF

unsloth · Kit

A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.

gemma-4-12b-it-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.

embeddinggemma-2-GGUF

unsloth · Kit

Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by…

Qwen3.8-27B-NVFP4

unsloth · Kit

A 4-bit NVFP4 copy of the Qwen3.8 27B vision-language model made by Unsloth, for serving with vLLM. For developers who want a dense model that reads images and…

gemma-4-31B-it-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…

Qwen3.5-4B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.

GLM-5.3-Flash-GGUF

unsloth · Kit

Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…

Qwen3.6-35B-A3B-MTP-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…

flint-GGUF

unsloth · Kit

Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…

Qwen3.5-9B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.

Qwen3.8-27B-QSA-GGUF

higa2515 · Kit

Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…

Qwen3.6-35B-A3B-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…

DeepSeek-V4.1-Flash-1017-GGUF

unsloth · Kit

Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…