DeepSeek-V4.1-Flash-1017-EXL3-franken-v100
philbert440 · Kit
Runs DeepSeek V4.1 Flash at its full 1M-token context on eight Tesla V100 32 GB cards, using an EXL3 expert pack and an SM70 vLLM build. For owners of such ser…
New
AI projects from Hugging Face
Categories and filters
Listings
DeepSeek-V4.1-Flash-NVFP4
nvidia · Kit
Reads text and images and writes text, as a smaller NVFP4 copy of DeepSeek-V4.1-Flash made by NVIDIA. For developers deploying agents, chatbots and retrieval s…
New
DeepSeek-V4.1-Flash-1017-oQ4e-ngram-mtp
mlx-community · Kit
A mixed-precision MLX copy of DeepSeek-V4.1-Flash-1017 that keeps the Engram tables at FP8. Made for people with hundreds of GB of memory who want to run the m…
New
DeepSeek-V4.1-Flash-1017-GSQ-agentic-strata
kaushikvira · Kit
Runs the 763.2B-parameter DeepSeek V4.1 Flash as a 153 GiB mixed-precision build tuned for agentic and coding work on the strata engine. For people with a larg…
New
DeepSeek-V4.1-Flash-1017-oQ4e-mtp
mlx-community · Kit
A mixed-precision MLX copy of DeepSeek-V4.1-Flash-1017, a huge multimodal mixture-of-experts model. Made for people with hundreds of GB of memory who want to r…
New
Runs a pruned, 2-bit DeepSeek-V4.1-Flash on a 128 GB Mac through mlx-serve, keeping 192 of 384 experts and a 1M-token context. Strongest on code, reasoning and…
New
DeepSeek-V4.1-Flash-1017 TrellisMX K2 Mix
brandonmusic · Kit
A compressed copy of DeepSeek-V4.1-Flash-1017 sized for two 96 GB GPUs, with a few experts stored at higher precision. A research build for people who serve la…
New
DeepSeek-V4.1-Flash-1017-NVFP4
nvidia · Kit
NVIDIA's NVFP4 quantized copy of DeepSeek AI's DeepSeek-V4.1-Flash-1017, a huge multimodal mixture-of-experts model for NVIDIA Blackwell GPUs.
New
DeepSeek-V4.1-Flash-1017 EXL3 EAQ v1 2.9 bpw
Mia-AiLab · Kit
A 2.9 bits-per-weight EXL3 quantization of DeepSeek-V4.1-Flash-1017 that reads text and images. It cuts the model to about 210 GB for exllamav3 runtimes, and t…
New
DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000
diffbot · Kit
Serves a 3-bit compressed copy of DeepSeek-V4.1-Flash-1017 on two 96 GB RTX PRO 6000 Blackwell cards with vLLM, for developers who host a large coding and agen…
New
DeepSeek-V4.1-Flash-1017-Sushi-STQ-1.75bpw
beamster · Kit
Runs a 261B DeepSeek V4.1 Flash model packed to about 1.75 bits per weight for the sushi engine on Apple Silicon Macs, with image input and up to 1,048,576 tok…
New
DeepSeek-V4.1-Flash-1017-GGUF
unsloth · Kit
Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…
New
DeepSeek-V4.1-Flash
deepseek-ai · Kit
DeepSeek's multimodal mixture of experts model with a 552B backbone and a one million token context, built to cut KV cache cost for long input agent work. Suit…
New
DeepSeek-V4.1-Flash-1017
deepseek-ai · Kit
An image and text model for reasoning, coding and agent tasks with a 1M-token context window, updated from DeepSeek-V4.1-Flash. Made for developers who build a…
New