Meditor WebGPU Chat

Meditor WebGPU Chat

A chat page that runs the Meditor language models inside your browser on your own GPU through WebGPU, with local caching and live speed readouts. For people who want a private chat with no cloud GPU.

Made by Yo-Purple on Hugging Face. These notes are Mindket's, written from its Space page and README; the app's own files and license are on Hugging Face.

About

What it is: Meditor WebGPU Chat is a static web page that runs the Meditor language models in your browser. The model weights download to your machine and run on your own GPU through WebGPU. No cloud GPU is involved, and the author states that your prompts and replies stay on your computer.

Who it suits: People who want a private local chat with a small model, and developers who want a working example of WebGPU inference with local caching.

Industry | Who uses it | How they use it | Example
Privacy-minded work | Everyday users | Chat without sending text to a cloud service | Open the Space and ask a short question
AI development | Developers | Study in-browser inference with cached weights | Read index.html and the wllama files
Hardware testing | Enthusiasts | Check how a laptop GPU handles a small model | Watch the speed readouts while chatting

People whose browser lacks WebGPU can skip it, since the page depends on it.

Where to use it:

• A browser with WebGPU: the Space runs on Hugging Face with nothing to install
• Windows, macOS or Linux: open the downloaded index.html in a supported browser

Use case | Who | What they get back
Local chat | Everyday users | Replies generated on your own GPU
Model comparison | Developers | A feel for the small and larger Meditor models
Speed check | Enthusiasts | Tokens per second and time to first token

How to set it up:

• A browser with WebGPU, such as a recent Chrome, Chromium, Edge, Brave or Safari, or Firefox with a flag turned on
• Python with pip, only to download the files for a local copy
• Room in the browser's storage for the model weights

1. Install the Hugging Face hub package.
2. Download the Space's files into a folder.
3. Move into that folder.
4. Open index.html with a supported browser.

pip install -U huggingface_hub
hf download Yo-Purple/meditor-webgpu --repo-type space --local-dir meditor-webgpu
cd meditor-webgpu

Firefox needs WebGPU switched on in its advanced settings first, as this setting.

dom.webgpu.enabled = true

How to use it: Open the Space page or the local index.html, pick a model and start chatting. The page keeps the weights in the browser's private file storage, so later visits start without a new download. It also shows live speed figures, token counts and details of your GPU. The page offers these models.

• Meditor-1 Universal: a 500M dense model in 4-bit, 8-bit and 16-bit versions, with the 4-bit one recommended
• Meditor-2 Universal: a 3.4B mixture of experts model in 3-bit, 4-bit and 5-bit versions
• Custom model: any GGUF file you load from a Hugging Face repository

Example: You open the page, choose the 4-bit Meditor-1 Universal model and let it download once. You then ask a short question and watch the tokens per second readout while the reply appears.

For newcomers and experts: If you are new, start with the recommended small model, since it downloads fastest. After the first load it starts quickly from the browser cache.

For experts, the page runs the weights on the GPU through WGSL shaders and reports time to first token and token counts. The Meditor-2 model is a mixture of experts design with 3.4B total and 1.8B active parameters.

You pick a model
The weights download into browser storage
WebGPU runs them on your GPU
The reply streams into the page

Good to know:

• License: apache-2
• Cost to run: none named, and no cloud GPU is used
• Data it reaches: model weights fetched from Hugging Face, and the author says prompts and replies stay on your computer
• Not for: browsers without WebGPU support

On Hugging Face, 13 November 2026

• Likes: 1
• Built with: static
• License: apache-2.0

Links

• Space: https://huggingface.co/spaces/Yo-Purple/meditor-webgpu
• Files: https://huggingface.co/spaces/Yo-Purple/meditor-webgpu/tree/main

Try it

Open the Space in your browser, or copy it to your own Hugging Face account from its page. Nothing in this kit runs by itself.