anaksor-ocr
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…
A browser studio for exploring LLM quantization below one byte per weight, with a Pareto frontier explorer, BitNet 1.58b bit-packing registers and a layer sensitivity simulator. For engineers and students.
QuantBench is a kit in the Education category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download prajwalpujari16/quantbench --repo-type space --local-dir quantbench cd quantbench
QuantBench is a browser studio for exploring LLM quantization below one byte per weight. It offers analytical exploration before you quantize anything, bit-packing registers for BitNet 1.58b ternary weights, and a simulator for how sensitive each layer is. It is a static page, so nothing runs on a server.
It suits people who want to see what happens to a model's quality and size when its weights use fewer bits.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| ML engineering | Engineers | Weigh compression against quality before quantizing | Explore the frontier of size against signal quality |
| Education | Students | Learn how low-bit weights are packed | Watch ternary values fill a register |
| AI research | Researchers | Reason about which layers tolerate compression | Try the layer sensitivity simulator |
If you need to quantize a real model file, you can skip it, since this is an analytical explorer.
You can use it online or open its files on your own computer.
| Use case | Who | What they get back |
|---|---|---|
| Find a compression trade-off | Engineers | A frontier that plots compression against SQNR |
| Learn bit packing | Students | Live registers for BitNet 1.58b, INT4 and 2:4 sparsity |
| Spot fragile layers | Researchers | A simulation of per-layer sensitivity |
The hosted page needs nothing. To get the files you need Python and pip.
pip install -U huggingface_hub hf download prajwalpujari16/quantbench --repo-type space --local-dir quantbench cd quantbench
The readme also names a PyPI package, which installs with this command.
pip install quantbench
Open the Space online, or open index.html from your downloaded folder. Then try the three interactive tools, starting with the frontier explorer.
| Tool | What it does |
|---|---|
| SQNR against compression Pareto frontier explorer | Shows the trade-off between signal quality and compression |
| Bit-packing registers | Show BitNet 1.58b, INT4 and 2:4 sparsity packing live |
| Transformer layer sensitivity simulator | Simulates how sensitive each layer is to quantization |
You open the Pareto frontier explorer and look at how signal quality drops as compression rises. Then you open the bit-packing registers to see how BitNet 1.58b ternary values are packed together.
If you are new to this, remember that quantization stores weights in fewer bits to save memory. Start with the frontier explorer and move along it slowly.
If you know the field, the page pairs an SQNR against compression frontier with live packing registers and a per-layer sensitivity simulator. It names Qwen2.5 0.5B Instruct and Llama 3.1 8B, and a Pareto dataset of its own.
The exploration is analytical, so it does not touch a real model file.
A browser studio for exploring LLM quantization below one byte per weight, with a Pareto frontier explorer, BitNet 1.58b bit-packing registers and a layer sensitivity simulator. For engineers and students.
Made by prajwalpujari16 on Hugging Face. These notes are Mindket's, written from its Space page and README; the app's own files and license are on Hugging Face.
What it is: QuantBench is a browser studio for exploring LLM quantization below one byte per weight. It offers analytical exploration before you quantize anything, bit-packing registers for BitNet 1.58b ternary weights, and a simulator for how sensitive each layer is. It is a static page, so nothing runs on a server.
Who it suits: It suits people who want to see what happens to a model's quality and size when its weights use fewer bits.
Title: Who might use this studio
Industry | Who uses it | How they use it | Example
ML engineering | Engineers | Weigh compression against quality before quantizing | Explore the frontier of size against signal quality
Education | Students | Learn how low-bit weights are packed | Watch ternary values fill a register
AI research | Researchers | Reason about which layers tolerate compression | Try the layer sensitivity simulator
If you need to quantize a real model file, you can skip it, since this is an analytical explorer.
Where to use it: You can use it online or open its files on your own computer.
Title: What the studio is good for
Use case | Who | What they get back
Find a compression trade-off | Engineers | A frontier that plots compression against SQNR
Learn bit packing | Students | Live registers for BitNet 1.58b, INT4 and 2:4 sparsity
Spot fragile layers | Researchers | A simulation of per-layer sensitivity
How to set it up: The hosted page needs nothing. To get the files you need Python and pip.
pip install -U huggingface_hub
hf download prajwalpujari16/quantbench --repo-type space --local-dir quantbench
cd quantbench
The readme also names a PyPI package, which installs with this command.
pip install quantbench
How to use it: Open the Space online, or open index.html from your downloaded folder. Then try the three interactive tools, starting with the frontier explorer.
Title: The interactive tools
Tool | What it does
SQNR against compression Pareto frontier explorer | Shows the trade-off between signal quality and compression
Bit-packing registers | Show BitNet 1.58b, INT4 and 2:4 sparsity packing live
Transformer layer sensitivity simulator | Simulates how sensitive each layer is to quantization
Example: You open the Pareto frontier explorer and look at how signal quality drops as compression rises. Then you open the bit-packing registers to see how BitNet 1.58b ternary values are packed together.
For newcomers and experts: If you are new to this, remember that quantization stores weights in fewer bits to save memory. Start with the frontier explorer and move along it slowly.
If you know the field, the page pairs an SQNR against compression frontier with live packing registers and a per-layer sensitivity simulator. It names Qwen2.5 0.5B Instruct and Llama 3.1 8B, and a Pareto dataset of its own.
Open the studio
Pick a tool to explore
Adjust bits, layers or settings
Read the trade-off it shows
Good to know: The exploration is analytical, so it does not touch a real model file.
Open the Space in your browser, or copy it to your own Hugging Face account from its page. Nothing in this kit runs by itself.
README.md 4 KB
Listed Hugging Face Spaces in the same category that share the most tags with this one.
| Product | Likes | Built with | License | Last change |
|---|---|---|---|---|
| QuantBench This page | 1 | static | apache-2.0 | |
| The Ultra-Scale PlaybookShares static | 4,131 | static | apache-2.0 | |
| LLM训练终极指南 | The Ultra-Scale PlaybookShares static | 281 | static | apache-2.0 | |
| Attention VisualizationShares static | 200 | static | apache-2.0 | |
| Number Tokenization BlogShares static | 127 | static | mit | |
| Train the agent slidesShares static | 20 | static | apache-2.0 |
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
ACE-Step · Kit
Generates music from text with a 4B diffusion decoder, 50 steps and guidance control, aiming for higher audio quality than the base. For creators with a GPU of…
prathoshap · Kit
Reads classical Sanskrit verses aloud in a chant style, using one trained voice and a reference clip that sets the rhythm. For people who study, recite or need…
paradigma-inc · Kit
Solves hard math problems with a 1B-parameter model trained from scratch for fast, high-volume reasoning. It suits developers who run math workloads on an NVID…
murai-labs · Kit
Chats in Tamil script, romanized Tamil and English, and translates between Tamil and English. A 2.5B model built from scratch by Murai Labs, for Tamil speakers…