mini-infer
prajwalpujari16 · Kit
A browser studio that simulates GPU PagedAttention block allocation, prefix caching, speculative decoding checks and KV-cache sizing. For engineers and student…
New
AI projects from Hugging Face
Categories and filters
Listings
infersize
prajwalpujari16 · Kit
A browser tool that estimates the GPU memory an LLM needs, compares GPUs, sizes speculative decoding latency and estimates cloud cost per million tokens, befor…
New
LLM VRAM Calculator
donaldJJ · Kit
Estimates how much GPU memory a Hugging Face model needs at any quantization and context length, split into weights, KV cache and overhead, and shows which GPU…
New