Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Flint INT4
RecursiveSI · Kit
A 4-bit MLX copy of Recursive Flint for local use on Apple Silicon, about 22.6 GB, launched through Rec with pi or OpenCode. Suits Mac users and developers who…
New
Nanbeige4.3-33B-INT4
Nanbeige · Kit
INT4 quantized version of Nanbeige4.3-33B, a 33B model for coding and professional agent tasks, made with quantization-aware training. For developers who want…
New
Qwen3.8-27B-AWQ-INT4
cyankiwi · Kit
A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…
New