Parallel Constrained Decoding for Apple Silicon
harshatheg · Kit
Extracts structured fields, routes decisions and classifies text on Apple Silicon with MLX, scoring every schema field at once. Cuts latency 5.6x to 7.0x on an…
New
harshatheg · Kit
Extracts structured fields, routes decisions and classifies text on Apple Silicon with MLX, scoring every schema field at once. Cuts latency 5.6x to 7.0x on an…
errrinn · Kit
Chats in a quirky chat-speak voice after a ban on word pairs common in Simple Wikipedia. A 4.3B-parameter Gemma 3 experiment for people curious about constrain…