Ornith-1.5-35B-A3B-NVFP4
ornith-ai · Kit
Writes code and handles terminal agent tasks, a mixture-of-experts model using about 3B parameters per token, packaged as an NVFP4 copy. For developers hosting…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
ornith-ai · Kit
Writes code and handles terminal agent tasks, a mixture-of-experts model using about 3B parameters per token, packaged as an NVFP4 copy. For developers hosting…
unsloth · Kit
Serves Qwen3.6 35B A3B in a fast NVFP4 build by Unsloth for vLLM on NVIDIA GPUs. The card says it has 1.79x the throughput of other NVFP4 builds and fits a 32…
Sherlock-Comms · Kit
Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…
RadixArk · Kit
A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…
QUASAR-QAT · Kit
Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…
nvidia · Kit
Reads text and images and writes text, as a smaller NVFP4 copy of DeepSeek-V4.1-Flash made by NVIDIA. For developers deploying agents, chatbots and retrieval s…
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…
autotrust · Kit
Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…
amd · Kit
Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…
primitive-ai · Kit
Serves Xiaomi's MiMo-V2.6-Flash-RL as an NVFP4 build for Blackwell GPUs, with the release's exact expert values and more throughput on two 96 GB cards. For peo…
Accio-Lab · Kit
An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.
reflection · Kit
Reads and writes text with a 1M-token context, built for coding, agent tool use and math reasoning, as a 501B-parameter mixture-of-experts model in NVFP4 form.…
RecursiveSI · Kit
A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…
deep-principle · Kit
A 4-bit NVFP4 build of Hydrogen-1.0, a 381B science and research assistant model from Deep Principle, based on GLM-5.3. It needs a multi-GPU NVIDIA Blackwell s…
cdiamond · Kit
A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…
thinkingmachines · Kit
The NVFP4 copy of Inkling-Small, a multimodal mixture-of-experts model that takes text, images and audio and writes text. For developers building agents, codin…
ornith-ai · Kit
Gives you an NVFP4 quantized copy of Ornith-1.5-122B, a 122B mixture-of-experts text model meant for single-GPU use and strong in coding tests. For developers…
flechin · Kit
A 27B reasoning model tuned to answer plainly instead of hedging, quantized to MXFP4 so vLLM can serve it on a single 32 GB GPU, for developers who run local r…
nvidia · Kit
NVIDIA's NVFP4 quantized copy of DeepSeek AI's DeepSeek-V4.1-Flash-1017, a huge multimodal mixture-of-experts model for NVIDIA Blackwell GPUs.
nvidia · Kit
A pre-quantized NVFP4 copy of Alibaba's Qwen3.6-35B-A3B, made by NVIDIA with Model Optimizer. It takes text, images and video, and runs on vLLM with Hopper or…