DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000
diffbot · Kit
Serves a 3-bit compressed copy of DeepSeek-V4.1-Flash-1017 on two 96 GB RTX PRO 6000 Blackwell cards with vLLM, for developers who host a large coding and agen…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
diffbot · Kit
Serves a 3-bit compressed copy of DeepSeek-V4.1-Flash-1017 on two 96 GB RTX PRO 6000 Blackwell cards with vLLM, for developers who host a large coding and agen…
XHToken · Kit
Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…
prithivMLmods · Kit
A repacked copy of ccore's Qwen3.5-4B-3D-Coder, a small model tuned to write coding answers and Three.js 3D scenes, with GGUF files that support multi-token pr…
lapadatbogdan · Kit
Runs a pruned GLM-5.3-Flash coding and agent model on a home PC, as GGUF files in five quant sizes. It keeps 152 of 288 experts per layer, cutting a 321B model…
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
sabicap · Kit
A 27B agentic text model built on Qwen3.8-27B with open-source RL environments, reporting higher terminal and coding-agent scores, for developers building codi…
yuxinlu1 · Kit
A GGUF fine-tune of Google's Gemma 4 12B instruction model for coding and tool-using agent work, sized to run offline on a machine with about 4.5 GB of free me…
thinkingmachines · Kit
Reads text, images and audio and writes text, as a huge open multimodal model for coding assistants, agents and chatbots. For developers with multi-GPU servers…
unsloth · Kit
Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…
DeepHat · Kit
A 7B coding model tuned for cybersecurity and DevOps work, fine-tuned from Qwen2.5-Coder-7B. For security and operations engineers who want a small local model…
Apexintelligence-AI · Kit
A text model for coding, tool use, question answering, search and research tasks, built on Qwen3.6-35B-A3B with about 3B parameters used per token. For develop…
unsloth · Kit
Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…
unsloth · Kit
Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…
reflection · Kit
An open instruction-tuned text model from Reflection with 501B parameters, 23B active at a time and a 1M-token context, aimed at coding, tool use and reasoning…
Jackrong · Kit
Helps with coding and tool-using agent work as a GGUF fine-tune of Qwen3.8-27B, trained on about 200,000 code, agent and reasoning examples. For developers who…
XiaomiMiMo · Kit
Works with text, images, video and audio in one 1.02T-parameter model that has a 1M token context. The flagship of Xiaomi's MiMo-V2.6 series, trained with larg…
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
openbmb · Kit
Generates text with a dense 2B-class model made for on-device and local use, covering coding, math, long context, tool use and agent tasks in English and Chine…
openai · Kit
OpenAI's faster Whisper model for speech recognition and speech translation, with 809M parameters and only 4 decoding layers. For developers and anyone who tra…
XiaomiMiMo · Kit
A 9B agentic model from Xiaomi MiMo, fine-tuned from Qwen3.5-9B for coding, agent tasks, visual coding and cybersecurity, released as a starting point for rese…