Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
Serveurperso · Kit
Speaks text in several languages with named speakers and Mandarin dialects, and can clone a voice from a short clip, through the qwentts.cpp C++ runtime on CPU…
meta-models · Kit
GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…
facebook · Kit
A Mixture-of-Experts vision encoder from Meta that matches images to text labels with no extra training, here the L/16 model at 384px. Licensed for non-commerc…
prism-ml · Kit
Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…
facebook · Kit
Turns videos and images into embeddings for video classification, retrieval, or as the video encoder of a vision-language model. Built by FAIR at Meta for deve…
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
antirez · Kit
Gives Mac users calibrated 2-bit and 4-bit GGUF files of DeepSeek V4.1 Flash, plus a separate vision encoder, for DwarfStar's Metal engine with SSD streaming.…
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
dsx-ai-factory · Kit
Lets platform teams offer Kubernetes clusters to their customers, built on their own bare-metal NVIDIA GPU machines, with a separate control plane for each clu…
ibelick · Skill
Julien Thibeaut’s CLI and MCP server that hand Claude the right UI skill on demand, plus nine skills of his own. They cover a quick UI cleanup, accessibility,…
NVIDIA · Kit
Builds and manages semantic, graph-based knowledge layers from enterprise metadata to ensure reliable AI agent interactions. It features automated schema disco…