infersize
prajwalpujari16 · Kit
A browser tool that estimates the GPU memory an LLM needs, compares GPUs, sizes speculative decoding latency and estimates cloud cost per million tokens, befor…
New
prajwalpujari16 · Kit
A browser tool that estimates the GPU memory an LLM needs, compares GPUs, sizes speculative decoding latency and estimates cloud cost per million tokens, befor…