Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
PedroMarinhoDev · Kit
Edits an image, or combines up to four, from a text instruction, using a ComfyUI-ready version of the Moss-Image-Edit LoRA. For ComfyUI users working with the…
microsoft · Kit
A 3.8B open instruction model from Microsoft with a 128K token context, built for reasoning, math and logic in tight memory or latency budgets. It suits develo…
yuyangGong · Kit
A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…
unsloth · Kit
Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
unsloth · Kit
Answers questions about text and images with Google's Gemma 3 27B instruction-tuned model, in GGUF files made by Unsloth for running on your own computer. It h…
unsloth · Kit
Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…
unsloth · Kit
Answers questions and summarizes text, and reads images, from GGUF files of Google's Gemma 3 12B instruction model. It suits people who want to run it on their…
Tongyi-MAI · Kit
Reads a screenshot and an instruction to decide what to tap or type on a phone or computer screen. An 8B model from the MAI-UI family of GUI agents, for develo…
tencent · Kit
A 1.5B speech model from Tencent that generates speech from text, edits recordings, and also cleans up audio and separates sources, all through plain-language…
Qwen · Kit
GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…
Qwen · Kit
Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…
Qwen · Kit
A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…
Qwen · Kit
Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…
OpenMOSS-Team · Kit
Listens to a song and answers questions about it: lyrics with timestamps, mood and genre, key, tempo and chords, and song structure. For developers and researc…
OpenLLM-France · Kit
Quantized GGUF copy of Luciole-8B-Instruct-1.1, an 8B text generation model for French and English, for running on your own computer. From LINAGORA's work in t…
NousResearch · Kit
A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…
mistralai · Kit
A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…
microsoft · Kit
Compact 5.6B model that takes text, images and audio and replies in text, with a 128K token context. For developers who want speech, vision and text in one sma…
inclusionAI · Kit
Listens to audio with a text instruction and answers in text, with optional spoken replies. A compact audio-language model from inclusionAI for speech recognit…
ibm-granite · Kit
Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…
humain-ai · Kit
Answers questions and follows instructions in Arabic and English. A 7B model trained from scratch by the National Center for Artificial Intelligence at SDAIA,…
HuggingFaceTB · Kit
Answers questions about videos, images and text together, with a 2.2B model that needs about 5.2 GB of GPU memory for video. For developers building visual ass…
google · Kit
Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…
Equall · Kit
A language model tuned for legal text, trained on US and European legal sources. A research release for people who study or adapt legal AI. Its answers are inf…
DavidAU · Kit
Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…
BSC-LT · Kit
A 7.8B translation model for 40 languages and 3 varieties, covering sentence, paragraph and document translation plus HTML or XML text. For developers and rese…
bartowski · Kit
GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.
bartowski · Kit
Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…
zerofata · Kit
A 31.3B model by zerofata built on Gemma 4 31B instruct, for people who want to try this tune or compare it with its base. The card text says little about its…
yunpeng1998 · Kit
Edits video from written instructions by reusing an image editing model on video latents, with light trainable projections. For video creators and researchers…
tencent · Kit
Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…
tencent · Kit
Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…
Qwen · Kit
Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…
ai-sage · Kit
Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…
ai-sage · Kit
Chats in Russian and English, writes code and calls functions, as a compact mixture of experts model in GGUF files. For people who run assistants on their own…
vishnuOI · Kit
Answers Unity game development questions and writes C# scripts, XR code and editor tools, as a fine-tune of Qwen2.5-Coder-7B-Instruct. For Unity developers who…
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
unsloth · Kit
Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…
TokenRhythm · Kit
A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…
tasksource · Kit
Pulls answers out of a text for fields you describe in short instructions, such as invoice numbers or company names, and returns the matching spans. One 150M m…
speakleash · Kit
Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.
speakleash · Kit
Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…
Qwen · Kit
A vision-language model that reads images, documents and video together with a text question and answers in text. Suits developers who build apps around charts…
Qwen · Kit
A 14.8B code model tuned to follow instructions. It writes, explains and fixes code from plain requests, and runs through the transformers library. Suits devel…
Qwen · Kit
Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…
Qwen · Kit
A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…
NousResearch · Kit
A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…
JamieBradfield · Kit
Calls tools and follows instructions with almost no thinking delay, as a 4.1B fine-tune of Spark-X2.6-4B. Made for people building fast local agents that need…