AI projects from Hugging Face

Meta-Llama-3.1-8B-Instruct-AWQ-INT4

hugging-quants · Kit

Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…

LocalAlign_llama3.1_8B

yuyangGong · Kit

A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…

Llama-3.1-8B-Stheno-v3.4

Sao10K · Kit

Writes stories and plays characters in multi-turn chat. An 8B Llama 3.1 fine-tune for creative writing and roleplay, aimed at hobbyists who run models on their…

Meta-Llama-3.1-8B-Instruct-GGUF

bartowski · Kit

Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…

Hermes-3-Llama-3.1-8B-GGUF

NousResearch · Kit

Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…

Hermes 3 Llama-3.1 8B

NousResearch · Kit

An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…

Llama-V-JEPA-LM-Llama3.1-8B

kkt94 · Kit

Answers questions about video clips by joining a frozen V-JEPA 2.1 video encoder to Llama-3.1-8B-Instruct, made for people working on video understanding.

KVPress Leaderboard

nvidia · Kit

Shows a leaderboard that benchmarks KV cache compression methods for language models, using Llama-3.1-8B-Instruct and Qwen3-8B. It suits researchers and engine…