DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000
diffbot · Kit
Serves a 3-bit compressed copy of DeepSeek-V4.1-Flash-1017 on two 96 GB RTX PRO 6000 Blackwell cards with vLLM, for developers who host a large coding and agen…
diffbot · Kit
Serves a 3-bit compressed copy of DeepSeek-V4.1-Flash-1017 on two 96 GB RTX PRO 6000 Blackwell cards with vLLM, for developers who host a large coding and agen…
ATH-MaaS · Kit
Reads document images and returns text, structured JSON, Markdown with formulas and tables, key fields and figure captions from one 0.8B model. For developers…
unsloth · Kit
A 4-bit NVFP4 copy of the Qwen3.8 27B vision-language model made by Unsloth, for serving with vLLM. For developers who want a dense model that reads images and…
openjev · Kit
Answers typed decisions about text, web pages and screenshots, picking a choice, a yes-or-no probability or a score from your own labels in one forward pass. F…
hindsight-ai · Kit
Answers typed questions about a text state with a probability for every option in one pass, with no generated text, in eight languages. A 0.8B decision model f…
Jackrong · Kit
Helps with coding and tool-using agent work as a GGUF fine-tune of Qwen3.8-27B, trained on about 200,000 code, agent and reasoning examples. For developers who…
openai · Kit
An open-weight OpenAI language model with 117B parameters, adjustable reasoning effort, visible chain of thought and tool use. Runs on one 80 GB GPU and ships…
froggeric · Kit
Swaps Qwen's official chat templates for one drop-in Jinja file that fixes rendering errors, cache invalidation, wasted tokens and agent stalls. For people who…
Qwen · Kit
Handles text, images and video with FP8-quantized weights of Qwen3.8-27B, a 27B dense model with adjustable thinking. For developers serving it with transforme…
openai · Kit
Writes, reasons and calls tools from text prompts, in an open-weight 21B model from OpenAI that runs within 16 GB of memory. For developers who want a local or…
Qwen · Kit
Handles text and image input with a 4B hybrid model that supports 201 languages and dialects and a 262,144-token context. For developers running small open wei…
rayline-ai · Kit
Reads an agent's conversation and predicts which model will succeed, how many tokens it will use and how much reasoning to spend, so apps can route requests by…
Qwen · Kit
Helps with coding, repository-level reasoning and image-plus-text input using a 35B mixture-of-experts model that activates 3B parameters. For developers runni…
Axion1-0 · Kit
A reproduction checkpoint of Axion 1.0-35B, a 35B mixture of experts model for scientific reasoning, information seeking and tool using problem solving, served…
maritaca-ai · Kit
Maritaca AI's small Portuguese and English model built on Qwen3.5-4B, with Think and Instruct modes and strong tool use, in BF16 for vLLM and SGLang. Suits dev…
prajwalpujari16 · Kit
A browser studio that simulates GPU PagedAttention block allocation, prefix caching, speculative decoding checks and KV-cache sizing. For engineers and student…
donaldJJ · Kit
Estimates how much GPU memory a Hugging Face model needs at any quantization and context length, split into weights, KV cache and overhead, and shows which GPU…