Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Phi-4-mini-instruct
microsoft · Kit
A 3.8B open instruction model from Microsoft with a 128K token context, built for reasoning, math and logic in tight memory or latency budgets. It suits develo…
New
LocalAlign_llama3.1_8B
yuyangGong · Kit
A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…
New
Qwen2.5-Coder-7B-Instruct-GGUF by unsloth
unsloth · Kit
Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…
New
Llama-3.2-3B-Instruct-GGUF by unsloth
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
New
gemma-3-27b-it-GGUF
unsloth · Kit
Answers questions about text and images with Google's Gemma 3 27B instruction-tuned model, in GGUF files made by Unsloth for running on your own computer. It h…
New
gemma-3-270m-it-GGUF
unsloth · Kit
Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…
New
gemma-3-12b-it-GGUF
unsloth · Kit
Answers questions and summarizes text, and reads images, from GGUF files of Google's Gemma 3 12B instruction model. It suits people who want to run it on their…
New
MAI-UI-8B
Tongyi-MAI · Kit
Reads a screenshot and an instruction to decide what to tap or type on a phone or computer screen. An 8B model from the MAI-UI family of GUI agents, for develo…
New
AuK
tencent · Kit
A 1.5B speech model from Tencent that generates speech from text, edits recordings, and also cleans up audio and separates sources, all through plain-language…
New
Qwen2.5-Coder-32B-Instruct-GGUF
Qwen · Kit
GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…
New
Qwen2.5-Coder-0.5B-Instruct
Qwen · Kit
Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…
New
Qwen2.5-7B-Instruct-AWQ
Qwen · Kit
A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…
New
Qwen2.5-14B-Instruct
Qwen · Kit
Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…
New
MOSS-Music-8B-Instruct
OpenMOSS-Team · Kit
Listens to a song and answers questions about it: lyrics with timestamps, mood and genre, key, tempo and chords, and song structure. For developers and researc…
New
Luciole-8B-Instruct-1.1-GGUF
OpenLLM-France · Kit
Quantized GGUF copy of Luciole-8B-Instruct-1.1, an 8B text generation model for French and English, for running on your own computer. From LINAGORA's work in t…
New
Mistral-7B-Instruct-v0.1
mistralai · Kit
A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…
New
Phi-4-multimodal-instruct
microsoft · Kit
Compact 5.6B model that takes text, images and audio and replies in text, with a 128K token context. For developers who want speech, vision and text in one sma…
New
Granite-4.0-H-350M
ibm-granite · Kit
Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…
New
ALLaM-7B-Instruct-preview
humain-ai · Kit
Answers questions and follows instructions in Arabic and English. A 7B model trained from scratch by the National Center for Artificial Intelligence at SDAIA,…
New
SmolVLM2-2.2B-Instruct
HuggingFaceTB · Kit
Answers questions about videos, images and text together, with a 2.2B model that needs about 5.2 GB of GPU memory for video. For developers building visual ass…
New
gemma-4-31B-it-qat-q4_0-gguf
google · Kit
Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…
New
SalamandraTA-7b-instruct
BSC-LT · Kit
A 7.8B translation model for 40 languages and 3 varieties, covering sentence, paragraph and document translation plus HTML or XML text. For developers and rese…
New
Llama-3.2-1B-Instruct GGUF
bartowski · Kit
GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.
New
google_gemma-4-31B-it-GGUF
bartowski · Kit
Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…
New
G4-MeroMero-v2-31B
zerofata · Kit
A 31.3B model by zerofata built on Gemma 4 31B instruct, for people who want to try this tune or compare it with its base. The card text says little about its…
New
Qwen-Video-Edit by yunpeng1998
yunpeng1998 · Kit
Edits video from written instructions by reusing an image editing model on video latents, with light trainable projections. For video creators and researchers…
New
Hy-MT2-7B-GGUF
tencent · Kit
Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…
New
Hy-MT2-1.8B-GGUF
tencent · Kit
Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…
New
Qwen2.5-0.5B-Instruct
Qwen · Kit
Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…
New
Unity Coder 7B
vishnuOI · Kit
Answers Unity game development questions and writes C# scripts, XR code and editor tools, as a fine-tune of Qwen2.5-Coder-7B-Instruct. For Unity developers who…
New
granite-4.1-8b-GGUF
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
New
gemma-4-31B-it-qat-GGUF
unsloth · Kit
Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…
New
NeoHorse-1-9B
TokenRhythm · Kit
A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…
New
UltraBERT-150M-clairic-extraction
tasksource · Kit
Pulls answers out of a text for fields you describe in short instructions, such as invoice numbers or company names, and returns the matching spans. One 150M m…
New
Bielik-11B-v3.1-DFlash2
speakleash · Kit
Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.
New
Bielik-11B-v3.1-DFlash
speakleash · Kit
Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…
New
Qwen2.5-VL-7B-Instruct
Qwen · Kit
A vision-language model that reads images, documents and video together with a text question and answers in text. Suits developers who build apps around charts…
New
Qwen2.5-Coder-14B-Instruct
Qwen · Kit
A 14.8B code model tuned to follow instructions. It writes, explains and fixes code from plain requests, and runs through the transformers library. Suits devel…
New
Qwen2.5-7B-Instruct
Qwen · Kit
Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…
New
Qwen2 0.5B Instruct
Qwen · Kit
A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…
New
Hermes-3-Llama-3.2-3B
NousResearch · Kit
A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…
New
Spark-X2.6-4B-AgentFast
JamieBradfield · Kit
Calls tools and follows instructions with almost no thinking delay, as a 4.1B fine-tune of Spark-X2.6-4B. Made for people building fast local agents that need…
New
SmolLM2-360M-Instruct
HuggingFaceTB · Kit
Answers chat-style questions and handles rewriting and summaries with a 362M-parameter instruction-tuned model that runs on modest hardware. For developers who…
New
Qwen3.8 Flash Next Turbo Brilliance 50x GGUF
DavidAU · Kit
A GGUF build of Qwen3.8-Flash-Next by DavidAU with 27 reasoning modes, 27 instruct modes and 15 AI personas you switch on from the prompt. For people with larg…
New
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
gemma-4-E2B-it-GGUF
unsloth · Kit
Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…
New