Weekly digestOne email a week: top 5 new tools + trending stars. Unsubscribe anytime.

LiteLLM

BerriAI/litellm
Open source (free)
Official cloud The vendor offers a hosted version: sign up and use it without deploying anything. Free tier or trial depends on the vendor.

For developers building AI agents: route 100+ LLM APIs through one OpenAI-format gateway with cost tracking, guardrails, and logging. The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Model gatewayAI agentSelf-hostable
LiteLLM website screenshot

Pricing

Open source (free)

Update history

Last updated 2026-11-21;Listed 2026-09-23

Author

BerriAI

Trust info

Listed on 2026-09-23; Last updated 2026-11-21; Data synced on 2026-11-21

Trial feedback

Like it? Vote to help it rank higher.

From the README

LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.

Stars
★ 63.6k
Category rank
#112
Language
Python
License
MIT
Last updated
2026-11-21
Category
AI assistants & agents
Section
General