... building LLM apps and running into bottlenecks with tools like LiteLLM, Bifrost might be worth a look. It s fully self-hosted, adds only ~11 s mean overhead at 5K RPS , and supports providers like OpenAI, Anthropic, Mistral, Groq, Bedrock, and more. It also comes with built-in monitoring, real-time configuration, governance, MCP support, and a clean web UI to manage it all. We designed it to act like true infrastructure, minimal overhead, built for production, and easy ...