Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
microsoft · Kit
A 3.8B open instruction model from Microsoft with a 128K token context, built for reasoning, math and logic in tight memory or latency budgets. It suits develo…
AtomicChat · Kit
GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…
tencent · Kit
Writes an assistant's long-term memory, choosing what to keep and how to update it inside Mem0, MemOS or Hy-Memory, with about 3B active parameters. For develo…
Sherlock-Comms · Kit
Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…
sarvamai · Kit
The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…
ResembleAI · Kit
Speaks English text aloud on a plain CPU with a 110M-parameter model, and adds laughs and coughs through tags in the text. Suits developers who need fast on-de…
rapid-mlx · Kit
A 27B vision-language model compressed to 3.5 bits per weight for Apple Silicon Macs with 24 GB of memory, served locally through Rapid-MLX. Suits Mac users an…
Qwen · Kit
A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…
Nanbeige · Kit
INT4 quantized version of Nanbeige4.3-33B, a 33B model for coding and professional agent tasks, made with quantization-aware training. For developers who want…
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
mlx-community · Kit
A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…
mlx-community · Kit
A mixed-precision MLX copy of DeepSeek-V4.1-Flash-1017 that keeps the Engram tables at FP8. Made for people with hundreds of GB of memory who want to run the m…
Jundot · Kit
Runs the 27B Qwen3.8 vision-language model on MLX in about 17.5 GB, reading text, images and video with a 262,144-token context. A mixed-precision quantization…
ISTA-DASLab · Kit
A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…
HuggingFaceTB · Kit
Answers questions about videos, images and text together, with a 2.2B model that needs about 5.2 GB of GPU memory for video. For developers building visual ass…
Hooshaai · Kit
Classifies English text, such as SST-2 sentiment, with a RoBERTa Base model whose attention is made sparse by AdaSplash, trading some accuracy for lower latenc…
Hooshaai · Kit
Classifies English text with a RoBERTa Base model shrunk to about 82M parameters by Fisher-weighted SVD at rank 32, trading some accuracy for lower latency and…
Hooshaai · Kit
A RoBERTa Base sentiment classifier whose attention is swapped for a sparse AdaSplash version, which zeroes out 40% of attention weights to cut time and memory…
hindsight-ai · Kit
Scores how well each document answers a query, in eight languages and for inputs up to 8,192 tokens, so a search or memory system can put the best matches firs…
crucible-labs · Kit
Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…
calcuis · Kit
A small GGUF VAE in the pig architecture for image and video workflows, with a loader in the gguf-node package. Aimed at faster runs and lower memory use on ol…
ProCreations · Kit
Decides whether a coding agent's proposed tool call should run, answering approve or deny from the call, the request and the history. The smallest Auto model,…
madebyollin · Kit
Previews FLUX.2 image generation in real time with a tiny autoencoder that shares the FLUX.2 VAE's latent format. For image app developers and people with limi…
ggml-org · Kit
GGUF files of DeepSeek's 748B V4.1 Flash 1017 model, converted by ggml-org with a vision file for images, for people with big-memory machines who run models th…
Comfy-Org · Kit
Repackaged FLUX.1-schnell checkpoints for ComfyUI that turn a text prompt into an image, with an FP8 file that runs faster and uses less memory. For ComfyUI us…
ResembleAI · Kit
Speaks English text aloud with a 350M-parameter model built for low-latency voice agents, and adds laughs and coughs through tags in the text. Suits developers…
Qwen · Kit
Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
molbal · Kit
GGUF quantized copies of Kromoss, a 1024 px text-to-image model fine-tuned from MOSS-Image-Base, for ComfyUI. For artists who want to generate images on a GPU…
mlx-community · Kit
A mixed-precision MLX copy of DeepSeek-V4.1-Flash-1017, a huge multimodal mixture-of-experts model. Made for people with hundreds of GB of memory who want to r…
anik-jha · Kit
Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…
turboderp · Kit
Runs a compressed DeepSeek-V4.1-Flash-1017 in ExLlamaV3 at 1.68, 2.25 or 2.68 bits per weight. For people who run large models on their own hardware and want l…
MemTensor · Kit
Language model with a built-in memory state of fixed size, built on Qwen3.6-35B-A3B, that keeps past context without re-reading it. For researchers and develop…
turboderp · Kit
EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…
peculiar-ragdoll · Kit
Compressed GGUF copies of the 4B Spark-X2.5 coding model, tuned for long context on GPUs with about 6 GB of memory. Made for developers who want a local coder…
TinyLlama · Kit
Chats in plain text as a small 1.1B language model that runs with little memory. For developers and researchers who want a compact chat model built on a Llama-…
yuxinlu1 · Kit
A GGUF fine-tune of Google's Gemma 4 12B instruction model for coding and tool-using agent work, sized to run offline on a machine with about 4.5 GB of free me…
unsloth · Kit
Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…
peculiar-ragdoll · Kit
Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…
openai · Kit
Writes, reasons and calls tools from text prompts, in an open-weight 21B model from OpenAI that runs within 16 GB of memory. For developers who want a local or…
ISTA-DASLab · Kit
An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…
prajwalpujari16 · Kit
A browser tool that estimates the GPU memory an LLM needs, compares GPUs, sizes speculative decoding latency and estimates cloud cost per million tokens, befor…
abdulrahmanmaslmany · Kit
Estimates the GPU memory a language model needs: weights, KV cache and total VRAM. For people who run models on their own graphics card and want to check the f…
DavidAU · Kit
Estimates how much video memory a GGUF model needs, in a static page that runs in your browser. Suits people choosing a quantized model that fits their graphic…
donaldJJ · Kit
Estimates how much GPU memory a Hugging Face model needs at any quantization and context length, split into weights, KV cache and overhead, and shows which GPU…
fastgpu · Kit
Estimates how much GPU memory a Hugging Face model needs to run or fine-tune, and shows the cheapest GPU setups with live rental prices. For people planning to…
An n8n workflow that gives a Telegram bot a memory for each person. It opens an OpenAI conversation for each new person, saves its id in a Supabase table and c…
An n8n canvas with four ways to reach DeepSeek: a local R1 model on Ollama that answers the chat, two direct API calls with thinking on and off, and an agent w…
garrytan · Kit
Gives the AI agent you already use a memory you control, storing facts with their sources and allowing corrections and withdrawal. It starts keyless with keywo…
cloudflare · Skill
Cloudflare’s own 22 skills for coding agents that build on Cloudflare: Workers, Durable Objects, the Agents SDK, the cf and Wrangler tools, Turnstile and Cloud…
ruvnet · Kit
ruvnet’s free, MIT-licensed layer that adds agent swarms, shared memory, a console and an MCP server to Claude Code and Codex. It was called Claude Flow. The s…
NousResearch · Kit
Nous Research’s open source agent that you run in a terminal, in a desktop app or from a chat app. It keeps memory, writes skills from experience, runs schedul…
affaan-m · Skill
Affaan Mustafa’s plugin of agents, skills, commands and hooks that gives Claude Code, Codex and other coding agents a routine of planning, test-first work, fre…
thedotmack · Kit
Alex Newman’s memory plugin for Claude Code and other coding agents. It records what the agent does in each session, turns that into short searchable notes and…