liteLLM

liteLLM

One library to standardize all LLM APIs

5.0
•11 reviews•

102 followers

Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models

liteLLM gallery image
liteLLM gallery image
liteLLM gallery image
Free
Launch tags:
API•Open Source•Developer Tools
Launch Team

What do you think? …

Ishaan Jaffer
Hi Producthunt, @krrish_dholakia and I are super excited to be launching šŸš… liteLLM An Open Source Python library to standardize LLM Inputs/Outputs for 50+ models (OpenAI, Anthropic, Cohere etc) :https://github.com/BerriAI/litellm 🚨Why did we build liteLLM We needed simplicity Our code started to get extremely complicated managing & translating calls between Azure, OpenAI, Cohere, Anthropic, Replicate LLM APIs. šŸš€How does it work liteLLM is a Python package that enables calling 50+ LLM API models using a consistent input/output interface - in the chatGPT format here’s an example of how liteLLM works response = completion(model="gpt-3.5-turbo", messages=messages) response = completion("claude-2", messages) response = completion("command-nightly", messages) šŸ“ž Interested in using liteLLM? You can try out liteLLM today for free: https://github.com/BerriAI/litellm/ If you're interested in liteLLM you can meet with me https://calendly.com/d/4mp-gd3-k... or reach me on Twitter: https://twitter.com/ishaan_jaff
kaushik srinivasan
Congrats on the launch! Litellm is really useful for reliably and easily calling LLM APIs.
Ishaan Jaffer
@kaushik_s Thank you !
Yi Ding
LFG
Ishaan Jaffer
@yi_ding Thanks for the supportā¤ļø
Cyril Gupta
The product looks good, will check it out
Ishaan Jaffer
@cyriljeet Thank you !

Do you use liteLLM?

Ā© 2025 Product Hunt