MiniCPM-OCR 1.0 GGUF
openbmb · Kit
Reads English and Chinese documents, including PDFs, into text, tables and formulas, in GGUF files for llama.cpp. For people who run MiniCPM-OCR 1.0 on their o…
openbmb · Kit
Reads English and Chinese documents, including PDFs, into text, tables and formulas, in GGUF files for llama.cpp. For people who run MiniCPM-OCR 1.0 on their o…
OliviaRossi · Kit
Runs a 26.9B parameter SenseNova-6.8-Code2Video model as a mixed precision GGUF file, in a terminal chat or a local server. For people who want that model on t…
off-grid-ai · Kit
Generates pictures from text on your own computer using GGUF copies of RealVisXL V5.0 with stable-diffusion.cpp. For people who want local image generation wit…
off-grid-ai · Kit
Generates pictures from text on your own computer using GGUF copies of Juggernaut XL v9 with stable-diffusion.cpp. For people who want local image generation w…
NousResearch · Kit
A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…
nomic-ai · Kit
Turns sentences into vectors on your own machine through llama.cpp, using compact GGUF files, for search and RAG questions. For developers who want local text…
NexaAI · Kit
Runs Qwen2-Audio locally to chat by voice and analyze audio, including speech translation, transcription and sound detection. GGUF copies for Nexa-SDK, for peo…
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
mradermacher · Kit
Quantized GGUF copies of OneJev1.6-4B, from about 2 GB to 8.5 GB, for running the model on your own computer. The card does not say what the base model is for.
mradermacher · Kit
Static GGUF files of Sao10K's Stheno 8B model in sizes from 3.3 GB to 16.2 GB. For people who run an 8B model on their own computer, under a non-commercial lic…
mradermacher · Kit
Static GGUF files of PelaAI's KnowLine 4B model in sizes from 2.1 GB to 8.8 GB, with English and Chinese listed. For people who run a small model on their own…
meta-models · Kit
GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…
manuelgscom · Kit
Turns a Spanish or English request into one Linux bash command, returned as a small JSON object. For terminal users and developers who want a local command hel…
manuelgscom · Kit
Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…
leejet · Kit
Generates images from text on modest GPUs, using quantized Z-Image-Turbo files made for stable-diffusion.cpp. For people who run image models on their own comp…
Joakimpalm-Zen · Kit
Shrinks Qwen3.8-27B to a 3-bit IQ3_S GGUF with retrained scales. A research file for people who study quantization, not a faithful stand-in for the original mo…
jialinyyzz · Kit
Rewrites AI-written drafts in English and Chinese so they read like a person wrote them, keeping numbers, dates, names and quotes. A 12B model in GGUF files fo…
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…