Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
LocalAlign_llama3.1_8B
yuyangGong · Kit
A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
Hermes 3 Llama-3.1 8B
NousResearch · Kit
An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…
New
Llama-V-JEPA-LM-Llama3.1-8B
kkt94 · Kit
Answers questions about video clips by joining a frozen V-JEPA 2.1 video encoder to Llama-3.1-8B-Instruct, made for people working on video understanding.
New