BerriAI
LiteLLM is an AI Gateway designed to simplify the integration and management of Large Language Models (LLMs) for developers and platform teams.
Our verdict
Who it's for
AI Gateway for unified LLM access, cost tracking, and fallbacks across 100+ models.
Pros
- +Simplifies access to a wide range of LLMs with a single API.
- +Provides robust cost tracking and management features.
- +Enables quick adoption of new LLM models.
- +Reduces operational complexity for platform teams.
- +Offers both cloud and self-hosted deployment options.
Key features
- ✓100+ LLM Provider Integrations (OpenAI, Azure, Gemini, Bedrock, Anthropic, etc.)
- ✓OpenAI-Compatible API format
- ✓Automatic Spend Tracking (across providers, tag-based, s3/gcs logging)
- ✓Budgets & Rate Limits (RPM/TPM limits)
- ✓LLM Fallbacks
- ✓Virtual Keys, Budgets, Teams
- ✓LLM Guardrails
- ✓LLM Observability (integrations with Langfuse, Arize Phoenix, Langsmith, OTEL Logging)
Pricing
| Plan | Price | Billing | Notes |
|---|---|---|---|
| Open Source | $0 | month | Free; 100+ LLM Provider Integrations; Langfuse, Arize Phoenix, Langsmith, OTEL Logging |
| Enterprise | — | month | Cloud or Self-Hosted; For giving LLM access to a large number of developers and projects.; Everything in OSS |