sched-sim
prajwalpujari16 · Kit
A browser simulator for LLM serving schedulers with an animated Gantt chart that compares continuous batching, chunked prefill, shortest-job-first and disaggre…
New
AI projects from Hugging Face
Categories and filters
Listings
RunsOnMine
prajwalpujari16 · Kit
A browser registry of LLM serving benchmarks measured on consumer GPUs, dual Tesla T4 and an RTX 3050 laptop, with concurrency scaling curves and a way to subm…
New