granite-4.1-8b-GGUF
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
tahamajs · Kit
Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a hierarchical block attention operator, then distills it on WikiText-2. A research checkpoint for stud…
tahamajs · Kit
Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a mixture-of-experts attention block, then distills it on WikiText-2. A research checkpoint for studyin…
Qwen · Kit
Checks text for safety token by token while a language model is still writing, rating each part safe, controversial or unsafe in 119 languages and dialects. Su…
Qwen · Kit
A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…
Qwen · Kit
Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…
Qwen · Kit
A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…
Qwen · Kit
Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…
Qwen · Kit
A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…
NousResearch · Kit
A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…
microsoft · Kit
A small text generation model that answers questions, continues chat dialogue and completes code. Made for researchers and developers who want a compact open m…
incoai · Kit
Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…
ibm-granite · Kit
Reasons step by step before it answers, with tool calling, code generation and multilingual chat, in a compact 3B model from IBM. Supports a 128K context nativ…
HuggingFaceTB · Kit
Answers chat-style questions and handles rewriting and summaries with a 362M-parameter instruction-tuned model that runs on modest hardware. For developers who…
HuggingFaceBio · Kit
Reads raw DNA inside a chat and answers in English, judging whether variants look benign or pathogenic, for researchers who want a DNA language model on their…
hiwaifu-research · Kit
A role-play chat model post-trained from Gemma 4 31B-IT that replies in the user's language, whether Russian, Spanish, English or Portuguese, and stays in it.…
deepseek-ai · Kit
A 685B open reasoning model from DeepSeek with sparse attention for long context and a chat template that lets it think while it calls tools. For teams that ru…
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
xtools-at · Kit
Writes and explains code and works through reasoning problems, from a weighted merge of three Qwen3.8-27B fine-tunes. For developers who want one general-purpo…