Chris Messina

15d ago

SelfHostLLM - Calculate the GPU memory you need for LLM inference

Calculate GPU memory requirements and max concurrent requests for self-hosted LLM inference. Support for Llama, Qwen, DeepSeek, Mistral and more. Plan your AI infrastructure efficiently.