Parallel Constrained Decoding for Apple Silicon
harshatheg · Kit
Extracts structured fields, routes decisions and classifies text on Apple Silicon with MLX, scoring every schema field at once. Cuts latency 5.6x to 7.0x on an…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
harshatheg · Kit
Extracts structured fields, routes decisions and classifies text on Apple Silicon with MLX, scoring every schema field at once. Cuts latency 5.6x to 7.0x on an…
ai-forever · Kit
Makes structured decisions over Russian text in one pass: pick an option, rate on a scale, answer yes or no, or rank candidates. Made for developers who classi…
abacusai · Kit
Answers a typed question about audio, an image or text with a probability for each option, in one pass and with no generated text. A 4B decision model fine-tun…
Poindexter-Labs · Kit
Returns structured decisions from plain-language context: pick one option, judge a yes or no claim, or score an item against a rubric. For developers building…
OmniJev · Kit
Answers typed questions about a screenshot, photo, video or text with a probability for each option. It suits developers who need fast decisions in an agent lo…
ggml-org · Kit
Makes decisions through the /v1/systemone API of a llama server, from a GGUF copy of a 4.2B model. For developers who want a small local decision model.
mrm8488 · Kit
A 272M model, fine-tuned from EmbeddingGemma 2, that reads the state of a workflow and a schema of questions and returns a typed answer with a calibrated confi…
akhilaaa3 · Kit
Answers a question about text, an image, audio or video by giving a probability for each option you list, instead of writing an explanation. A 12B classifier b…
fastino · Kit
Classifies English text against any label set you pass in, such as intent, routing, sentiment or urgency, in one pass with no prompt template. A small speciali…
StrandsAgents · Kit
Makes fast decisions for agent workflows by picking among options and rating things on a scale, with a calibrated confidence for every answer. For developers w…
openjev · Kit
Answers typed decisions about text, web pages and screenshots, picking a choice, a yes-or-no probability or a score from your own labels in one forward pass. F…
Cloudflare · Kit
Turns a state and a set of typed questions into decisions, returning a probability for every option of every question in one pass, with no free text. A 9B mult…
sarvamai · Kit
Scores every answer option for questions about a text, with a probability for each, in one forward pass. For teams that need fixed-choice decisions, such as ti…
inclusionAI · Kit
Makes typed decisions from a text state and named questions, returning probabilities for choices, yes or no answers and ordinal scores, with no generated text.…
jmc0 · Kit
Lets you talk to three game characters in a small town, played by a 4B model that downloads once and runs in your browser, with the model's decisions shown und…
adventists-ai · Kit
Reads one speech clip and returns ten decisions about it, such as turn state, barge-in and emotion, in a single pass with no transcription. For voice agent dev…