Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
New
Kits of AI agent skills, rules and prompts
Categories and filters
Listings
LocalAlign_llama3.1_8B
yuyangGong · Kit
A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…
New
Llama-3.2-3B-Instruct-GGUF by unsloth
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
New
Llama-3.1-8B-Stheno-v3.4
Sao10K · Kit
Writes stories and plays characters in multi-turn chat. An 8B Llama 3.1 fine-tune for creative writing and roleplay, aimed at hobbyists who run models on their…
New
Llama-3.2-1B-Instruct GGUF
bartowski · Kit
GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.
New
Hermes-3-Llama-3.2-3B
NousResearch · Kit
A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
Hermes 3 Llama-3.1 8B
NousResearch · Kit
An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…
New
Llama-V-JEPA-LM-Llama3.2-3B
kkt94 · Kit
Answers questions about video clips with a 4.2B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-3B-Instruct, for people who need video understa…
New
Llama-V-JEPA-LM-Llama3.2-1B
kkt94 · Kit
Answers questions about video clips with a small 1.5B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-1B-Instruct, for people who need video un…
New
Llama-V-JEPA-LM-Llama3.1-8B
kkt94 · Kit
Answers questions about video clips by joining a frozen V-JEPA 2.1 video encoder to Llama-3.1-8B-Instruct, made for people working on video understanding.
New
KVPress Leaderboard
nvidia · Kit
Shows a leaderboard that benchmarks KV cache compression methods for language models, using Llama-3.1-8B-Instruct and Qwen3-8B. It suits researchers and engine…
New