Needle 3
Cactus-Compute · Kit
A small on-device model from Cactus Compute for tool calling, structured extraction and text embeddings, used through the cactus Python package. For developers…
New
AI projects from Hugging Face
Categories and filters
Listings
Qwen2.5-Coder-7B-Instruct-GGUF
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
New
Whistle
Cactus-Compute · Kit
Transcribes speech in seven languages with word timestamps and speech embeddings, in a model only 16.9 MB in size. Runs from a short Python script, for develop…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of DeepSeek-V4.1-Flash-1017 at three small sizes, with each tensor quantized at its own precision. For people running a huge mixture-of-experts m…
New
DeepSeek-V4.1-Flash-1017-GGUF
unsloth · Kit
Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…
New
Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…
New
Qwen3.8-Flash-Next-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of Qwen3.8-Flash-Next at four sizes, with each tensor quantized at its own precision and a vision projector for image input. For people running a…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…
New
Qwen3.8-27B-GSQ-RCO-GGUF
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
New
QuantBench
prajwalpujari16 · Kit
A browser studio for exploring LLM quantization below one byte per weight, with a Pareto frontier explorer, BitNet 1.58b bit-packing registers and a layer sens…
New
GPT-X3-150M ONNX
ahmadw · Kit
Lets you run GPT-X3-150M on ONNX Runtime at five precision levels and compare their output and speed, with streaming tokens on a CPU. For developers weighing m…
New
Weightprint
tardellirs · Kit
Measures what a fine-tune changed in a model by comparing its weights with its declared parent, in a static page. For people who want to check what a Hub model…
New
LLM VRAM Calculator
donaldJJ · Kit
Estimates how much GPU memory a Hugging Face model needs at any quantization and context length, split into weights, KV cache and overhead, and shows which GPU…
New
MLX Model Explorer
mlx-community · Kit
Helps Mac users find an MLX model and a quantization that suit their machine, in a static page that opens in any browser with nothing to install.
New