Qwen2.5-7B-Instruct-GGUF by Qwen
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
unsloth · Kit
Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…
SparkAudio · Kit
Speaks Chinese and English from text with a Qwen2.5-based model, including zero-shot voice cloning and virtual voices set by gender, pitch and speaking rate. F…
Qwen · Kit
Completes and generates code as a 7.6B base language model that developers can run, fine-tune or use for fill in the middle tasks. Built for people making codi…
Qwen · Kit
GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…
Qwen · Kit
Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…
Qwen · Kit
A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…
Qwen · Kit
Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…
Qwen · Kit
The smallest base model in Qwen2.5, about 494M parameters with a 32,768-token context, meant for further training on your own data. For developers who want a t…
ggml-org · Kit
Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…
continuedev · Kit
Predicts the next edit you are likely to make in your code. A 7.6B model from Continue, fine-tuned from Qwen2.5-Coder-7B, for developers who want to run it on…
Qwen · Kit
Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…
vishnuOI · Kit
Answers Unity game development questions and writes C# scripts, XR code and editor tools, as a fine-tune of Qwen2.5-Coder-7B-Instruct. For Unity developers who…
tahamajs · Kit
Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a hierarchical block attention operator, then distills it on WikiText-2. A research checkpoint for stud…
tahamajs · Kit
Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a mixture-of-experts attention block, then distills it on WikiText-2. A research checkpoint for studyin…
Qwen · Kit
A vision-language model that reads images, documents and video together with a text question and answers in text. Suits developers who build apps around charts…
Qwen · Kit
A 14.8B code model tuned to follow instructions. It writes, explains and fixes code from plain requests, and runs through the transformers library. Suits devel…
Qwen · Kit
Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…
Qwen · Kit
Writes, explains and fixes code as the largest instruction-tuned model in the Qwen2.5-Coder family, at 32B parameters. For developers who run a strong open cod…
Qwen · Kit
Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…
Qwen · Kit
Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…
Qwen · Kit
Writes, explains and fixes code as a 7B instruction-tuned member of the Qwen2.5-Coder family. For developers who want a capable open coding model that fits on…
Qwen · Kit
Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…
Qwen · Kit
A small 1.5B chat model from Qwen that follows instructions, writes code and math, returns structured output such as JSON and handles over 29 languages. For de…
unsloth · Kit
Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…
DeepHat · Kit
A 7B coding model tuned for cybersecurity and DevOps work, fine-tuned from Qwen2.5-Coder-7B. For security and operations engineers who want a small local model…
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
shambhuraje · Kit
A Gradio demo for a small fine-tuned Qwen2.5 0.5B instruct model in GGUF form. Lets developers and learners try the compact model in a browser without installi…
Osstral · Kit
A small Gradio demo from Osstral that serves the Qwen2.5-0.5B-Instruct model, for people who want to try a tiny instruction-tuned model in a browser or on thei…
ansh-anuragi · Kit
A small Gradio app whose name points to a Qwen2.5 Coder model offered through an API. The README gives no description, so read app.py to confirm what it runs.