Ornith-1.5-35B-A3B-NVFP4
ornith-ai · Kit
Writes code and handles terminal agent tasks, a mixture-of-experts model using about 3B parameters per token, packaged as an NVFP4 copy. For developers hosting…
ornith-ai · Kit
Writes code and handles terminal agent tasks, a mixture-of-experts model using about 3B parameters per token, packaged as an NVFP4 copy. For developers hosting…
XHToken · Kit
Compact 4.1B-parameter text model in FP8 form for on-device use, with three thinking levels (none, low, high) and English and Chinese support. Aimed at coding…
XHToken · Kit
A compact 1.7B language model for on-device use in English and Chinese, with gains in coding, agent tasks and long context, and three adjustable thinking level…
XHToken · Kit
A compact 4.1B general-purpose language model with a native 1M-token context, over 200 languages and a hybrid attention design, tuned for coding and agent use.…
lvwerra · Kit
Runs coding agents such as Claude Code, Codex and Gemini CLI from one private browser workspace, so you can follow several tasks side by side and continue from…
unsloth · Kit
Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…
unsloth · Kit
Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…
unsloth · Kit
Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…
unsloth · Kit
Works through logic, math, science and coding problems with a 21B mixture-of-experts model that activates 3B parameters per token, in GGUF files by Unsloth. Su…
Shockem · Kit
Cuts the length of Qwen3.8-27B's reasoning on coding tasks so answers arrive sooner, as a small LoRA adapter. For people who run the base model on their own ha…
Sherlock-Comms · Kit
Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…
sainez · Kit
Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.
RecursiveSI · Kit
A 4-bit MLX copy of Recursive Flint for local use on Apple Silicon, about 22.6 GB, launched through Rec with pi or OpenCode. Suits Mac users and developers who…
Qwen · Kit
Reads images and text together and answers in text, as a mixture-of-experts model with 122B total and 10B active parameters. Suits teams with big GPU servers w…
Qwen · Kit
Completes and generates code as a 7.6B base language model that developers can run, fine-tune or use for fill in the middle tasks. Built for people making codi…
Qwen · Kit
Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…
QuantumNous · Kit
Finds personal information and credentials in Chinese, English and mixed text, code, logs and AI coding assistant requests, locally in ONNX. For developers who…
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…
Nanbeige · Kit
INT4 quantized version of Nanbeige4.3-33B, a 33B model for coding and professional agent tasks, made with quantization-aware training. For developers who want…
Nanbeige · Kit
Compact looped-transformer model of 4.2B parameters for agent work such as tool use, office tasks and coding, in English and Chinese. For developers who want a…
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
mlx-community · Kit
A community MLX build of Recursive's 40B Flint coding model that shrinks the experts to 3 bits, so it fits a 24 GB or 32 GB Apple Silicon Mac. Made for develop…
meta-models · Kit
GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…
kaushikvira · Kit
Runs the 763.2B-parameter DeepSeek V4.1 Flash as a 153 GiB mixed-precision build tuned for agentic and coding work on the strata engine. For people with a larg…
IsValorum · Kit
An English-only coding model in GGUF, a 42.6B mixture-of-experts quant of about 21.8 GB, for code completion, refactoring and agentic tool calls in llama.cpp o…
ISTA-DASLab · Kit
A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…
incoai · Kit
A 403M-parameter draft model that speeds up serving of the Flint language model with speculative decoding in SGLang, without changing its output. It is not a s…
IFM · Kit
Answers maths, coding and science questions as a compact open reasoning model that reads up to 128K tokens at once. Built by IFM for people who want a small mo…
harshatheg · Kit
Extracts structured fields, routes decisions and classifies text on Apple Silicon with MLX, scoring every schema field at once. Cuts latency 5.6x to 7.0x on an…
crucible-labs · Kit
Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…
CohereLabs · Kit
An open-weights research model from Cohere for writing code, agentic software engineering and terminal tasks. A 30B model with 3B active, 256K context. For dev…
byteshape · Kit
GGUF copies of the North-Mini-Code-1.0 coding model, compressed with ByteShape's ShapeLearn for GPU use in llama.cpp. Four sizes from 12.1 GB to 21.5 GB, for d…
autotrust · Kit
Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…
allenai · Kit
Reasons step by step in English before it answers, which helps with math and coding questions. A 32B open model from allenai with published code, checkpoints a…
tencent · Kit
Drafts several tokens at once for speculative decoding with Qwen3-8B, so a model server can check them in one pass. For inference engineers and speculative dec…
IFM · Kit
Handles coding, reasoning and agent-style tasks as a small open model with a 512K token context window. Built by IFM for people who want public training data,…
Accio-Lab · Kit
An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.
ZelligeAI · Kit
Runs coding-agent loops with a 27B model that thinks in a compressed English and Chinese shorthand, so it spends fewer thinking tokens per turn. For developers…
vishnuOI · Kit
Answers Unity game development questions and writes C# scripts, XR code and editor tools, as a fine-tune of Qwen2.5-Coder-7B-Instruct. For Unity developers who…
unsloth · Kit
Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…
unsloth · Kit
Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…
unsloth · Kit
Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…
TokenRhythm · Kit
A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…
speakleash · Kit
Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.
speakleash · Kit
Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…
reflection · Kit
Reads and writes text with a 1M-token context, built for coding, agent tool use and math reasoning, as a 501B-parameter mixture-of-experts model in NVFP4 form.…
ProCreations · Kit
Decides whether a coding agent's proposed tool call should run, answering approve or deny from the call, the request and the history. The smallest Auto model,…
poolside · Kit
Writes code and works through long coding tasks with tool calls, using a 33B mixture-of-experts model that activates 3B parameters per token. For developers wh…
ornith-ai · Kit
GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…
NousResearch · Kit
Writes code for competitive programming problems, a Qwen3-14B model trained further with reinforcement learning on 24k problems with checkable answers. For dev…
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
moolvylabs · Kit
A 7.6B coding model from moolvylabs in GGUF form, released as a beta for testing and feedback. The card is short and gives no run steps, benchmarks or training…
migtissera · Kit
GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…
microsoft · Kit
A compact coding agent model that works through a repository, finds bugs, edits files and runs tests with a five-tool framework called Leaf. Made for developer…
meituan-longcat · Kit
Mixture-of-experts text model with 69B parameters, about 3B active per token, sparse attention and a 1M-token context. For teams hosting long-context models fo…
maylore-ai · Kit
Rust coding model of 4.2B parameters, built on Qwen3.5-4B, that answers requests in Russian and English. For Rust developers who want a small model for functio…
lododoai · Kit
Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…
Kwaipilot · Kit
An open-weight coding model from Kwaipilot, a mixture-of-experts with 35B total and 3B active parameters, tuned for agentic coding and fewer tool-call glitches…
khazarai · Kit
Debugs and reviews code by checking real files before it proposes a fix, a Qwen3.8-27B fine-tune trained on 195M tokens of reasoning traces. For developers who…
kakoka · Kit
Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL develo…
Jackrong · Kit
Writes code, calls tools and works through software tasks as a coding agent. A 27.8B fine-tune of Qwen3.8-27B by Jackrong, trained on about 200,000 code and re…
ErtasAI · Kit
Serves a medical-domain language model, a compressed Gemma 4 31B, on vLLM and NVIDIA Blackwell GPUs. Built for medical AI products that need fast, low-cost ans…
Egzakta · Kit
Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…
Egzakta · Kit
GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…
byteshape · Kit
Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…
bartowski · Kit
Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…
AQ-MedAI · Kit
A small draft model that speeds up Ling-3.1-Flash with speculative decoding in SGLang, drafting 5 or 7 tokens at a time. For teams serving Ling-3.1-Flash on NV…
zai-org · Kit
A 753B-parameter open text model from zai-org for long, multi-step work such as coding and agent tasks, with a 1M-token context and an MIT license. For teams w…
YoSaNoo · Kit
A small coding-minded text model fine-tuned from Google's gemma-4-E2B and shared as GGUF files, so you can run it on your own laptop in Ollama, LM Studio, Unsl…
xtools-at · Kit
Writes and explains code and works through reasoning problems, from a weighted merge of three Qwen3.8-27B fine-tunes. For developers who want one general-purpo…
XHToken · Kit
A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…
thinkingmachines · Kit
The NVFP4 copy of Inkling-Small, a multimodal mixture-of-experts model that takes text, images and audio and writes text. For developers building agents, codin…
Qwen · Kit
Writes, explains and fixes code as the largest instruction-tuned model in the Qwen2.5-Coder family, at 32B parameters. For developers who run a strong open cod…
Qwen · Kit
Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…
Qwen · Kit
Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…
ornith-ai · Kit
Handles coding and terminal tasks as a 9B dense language model sized for a single GPU. For developers who want a small open model for software work, with a mob…
ornith-ai · Kit
Gives you an NVFP4 quantized copy of Ornith-1.5-122B, a 122B mixture-of-experts text model meant for single-GPU use and strong in coding tests. For developers…
NaiveAI · Kit
Open-weight mixture-of-experts model with 309B parameters, 15.5B active and a native 1M token context, built for coding and AI research. For teams running larg…
anik-jha · Kit
Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
XHToken · Kit
A 4.1B language model for on-device use, tuned for coding, agent tasks, long context and reasoning in English and Chinese, with three thinking levels. For deve…
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
unsloth · Kit
Runs the Ornith-1.5-122B text model on your own machine, as GGUF files made by unsloth. A 122B mixture-of-experts model aimed at coding and agent work on a sin…
Qwen · Kit
Reads text and images and writes text, as an FP8 copy of Qwen3.6-35B-A3B with 3B active parameters. For developers who run coding agents and want a smaller dow…
Qwen · Kit
A 27B Qwen model that reads text and images and replies in text, tuned for coding agents and repository-level work, for developers who run it with the transfor…
Qwen · Kit
Works as a coding agent model with 80B total and 3B active parameters and a 256K context. For developers who run agents in CLI and IDE tools and want to host t…
Qwen · Kit
Answers chat prompts with a 4B model that skips visible thinking and reads up to 256K tokens of context. For developers who want a small open assistant for rea…
Qwen · Kit
Writes, explains and fixes code as a 7B instruction-tuned member of the Qwen2.5-Coder family. For developers who want a capable open coding model that fits on…
PCL-RSI-lab · Kit
Fixes software bugs with a self-improving coding agent that learns reusable reasoning patterns from its own successful runs, for developers and researchers wor…
openbmb · Kit
Gives you MiniCPM5-2B, a small dense text model for English and Chinese, as GGUF files for on-device and local use. Suits people who want a compact model for c…
google · Kit
Reads text and images and writes text, for developers who want an open-weights Google DeepMind model for coding, reasoning and image questions on their own GPU…
errrinn · Kit
Chats in a quirky chat-speak voice after a ban on word pairs common in Simple Wikipedia. A 4.3B-parameter Gemma 3 experiment for people curious about constrain…
dglhf · Kit
Helps with agentic coding, with two models trained on PostgreSQL engine tasks. Slonik-27B and Slonik-9B come from Postgres Professional, for developers who wor…
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
peculiar-ragdoll · Kit
Compressed GGUF copies of the 4B Spark-X2.5 coding model, tuned for long context on GPUs with about 6 GB of memory. Made for developers who want a local coder…
peculiar-ragdoll · Kit
Replaces the chat template of Qwen3.5, 3.6 and 3.8 models so they think less before answering and write tighter replies. For people running Qwen locally for co…
JetBrains · Kit
A 12B mixture-of-experts thinking model with 2.5B active parameters, trained with reinforcement learning on real repositories for coding agents, math and hard…
inclusionAI · Kit
Handles complex agent, search, office and coding work with 560B total and 25B active parameters and a 1M-token context. Serving examples use SGLang on multi-GP…
Grawnch · Kit
Runs a heavily compressed copy of the 2.8T-parameter Kimi-K3.1-Pro, tuned for coding and math. Made by Grawnch with a three-tier mixed-bit scheme, for people w…