LiteLLM
For developers building AI agents: route 100+ LLM APIs through one OpenAI-format gateway with cost tracking, guardrails, and logging. The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Pricing
Open source (free)
Update history
Last updated 2026-11-21;Listed 2026-09-23
Author
BerriAI
Trust info
Listed on 2026-09-23; Last updated 2026-11-21; Data synced on 2026-11-21
Trial feedback
Like it? Vote to help it rank higher.
From the README
LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.
- Stars
- ★ 63.6k
- Category rank
- #112
- Language
- Python
- License
- MIT
- Last updated
- 2026-11-21
- Category
- AI assistants & agents
- Section
- General











