JevK5-chat-mlx-4bit
mlx-community · Kit
A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
mlx-community · Kit
A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…
mlx-community · Kit
A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…
mistralai · Kit
A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…
microsoft · Kit
A 14B open language model from Microsoft Research, tuned for reasoning and chat in English with limited compute. It suits developers who add text features to a…
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
CYFRAGOVPL · Kit
A Polish-language chat model from the PLLuM family, tuned to human preferences for dialogue, question answering and summarization, with an eye on Polish public…
bartowski · Kit
Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…
Qwen · Kit
Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…
ai-sage · Kit
Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
Qwen · Kit
Checks text for safety token by token while a language model is still writing, rating each part safe, controversial or unsafe in 119 languages and dialects. Su…
Qwen · Kit
A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…
Qwen · Kit
Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…
Qwen · Kit
A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…
Qwen · Kit
Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…
Qwen · Kit
A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…
NousResearch · Kit
A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…
microsoft · Kit
A small text generation model that answers questions, continues chat dialogue and completes code. Made for researchers and developers who want a compact open m…
incoai · Kit
Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…