Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
LocalAlign_llama3.1_8B
yuyangGong · Kit
A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…
New
Llama-3.2-3B-Instruct-GGUF by unsloth
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
New
Llama-3.2-1B-Instruct GGUF
bartowski · Kit
GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.
New
Hermes-3-Llama-3.2-3B
NousResearch · Kit
A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
Hermes 3 Llama-3.1 8B
NousResearch · Kit
An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…
New
Llama-V-JEPA-LM-Llama3.2-3B
kkt94 · Kit
Answers questions about video clips with a 4.2B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-3B-Instruct, for people who need video understa…
New
Llama-V-JEPA-LM-Llama3.2-1B
kkt94 · Kit
Answers questions about video clips with a small 1.5B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-1B-Instruct, for people who need video un…
New
Llama-V-JEPA-LM-Llama3.1-8B
kkt94 · Kit
Answers questions about video clips by joining a frozen V-JEPA 2.1 video encoder to Llama-3.1-8B-Instruct, made for people working on video understanding.
New