Qwen2.5-Coder-7B-Instruct-GGUF
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
maritaca-ai · Kit
Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…
taobao-mnn · Kit
Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…
qvac · Kit
GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.
KRAFTON · Kit
Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
An n8n chat that sends each message to Llama 3.2 on your own Ollama server. The model answers as a JSON object, and the chat shows your prompt, the response an…
An n8n canvas with four ways to reach DeepSeek: a local R1 model on Ollama that answers the chat, two direct API calls with thinking on and off, and an agent w…
An n8n workflow with two nodes that asks a model running on your own computer through Ollama to write a short welcome message. It is the smallest way to test t…
An n8n workflow you start by hand: it reads a Markdown prompt from a GitHub repo and fills its double brace placeholders with values you set. An AI agent on Ol…
n8n workflow
An n8n workflow with a chat window. Each message goes through a Basic LLM Chain to a model served by Ollama on your own machine, and the answer comes back in t…
OpenBMB · Kit
OpenBMB’s open multimodal models: MiniCPM-V 4.7 reads images, documents and video, and MiniCPM-o 4.5 also hears and speaks. The setup notes cover Transformers,…
microsoft · Kit
Microsoft’s official inference framework for 1-bit LLMs, built on llama.cpp. It runs ternary models such as BitNet b1.58 on x86 and ARM CPUs, and has a GPU ker…
ollama · Kit
Ollama’s MIT-licensed app and command line for running open models on your own computer, or in Ollama’s cloud once you sign in. The setup notes cover macOS, Wi…
Shubhamsaboo · Kit
Shubham Saboo’s open source collection of AI agents, agent skills and RAG apps, most in a folder of their own with a README. Setup notes cover the skills for C…