LiteLLM
Open-source LLM gateway/proxy providing a unified OpenAI-compatible API to 100+ model providers, free to self-host forever.
Last verified:
LiteLLM is an open-source AI gateway (Rust core, Python SDK) that lets teams call 100+ LLM APIs (OpenAI, Anthropic, Azure, Bedrock, VertexAI, Ollama, and more) through a single OpenAI-compatible interface, with cost tracking, guardrails, load balancing, and logging. The proxy is free to self-host indefinitely, with a paid Enterprise tier adding SSO/SCIM, audit logs, and dedicated support sold via custom quote. Built by BerriAI (YC W23), it has become one of the most widely adopted open-source LLM gateways, with 50k+ GitHub stars.
Pricing
| Tier | Price | Key features |
|---|---|---|
| Open Source | $0 | 100+ providers, unified OpenAI-format API, Virtual keys, users, teams, Spend tracking, budgets, rate limits, Fallbacks & load balancing, Request/response logging, Prometheus metrics |
| Enterprise | Custom | SSO & SCIM, OIDC/JWT auth, Audit logs, Secret manager integration with key rotation, Org/team admin controls, Multi-region control plane, 24/7 support with SLAs, Air-gapped deployment |
Source: https://www.litellm.ai/pricing
Agent-readiness
- Discoverability
- 65/100
- Machine-readable content
- 85/100
- Programmatic access
- 95/100
- MCP / agent support
- 85/100
- Self-serve transactability
- 70/100
- Transparency
- 80/100
Security & compliance
- SSO / SAML
- Yes
- Encryption at rest
- Yes
- Encryption in transit
- Yes
- Audit log
- Yes
- Pentest report
- Not publicly documented
"Not publicly documented" means Crail found no public evidence either way — not a confirmed absence. See our methodology. Trust center: https://trust.litellm.ai.
FAQ
Does LiteLLM have a free tier?
Yes, LiteLLM offers a free tier or free trial.
Can you buy LiteLLM without talking to sales?
No — LiteLLM requires a sales call to purchase.
Does LiteLLM have an official MCP (Model Context Protocol) server?
Yes, LiteLLM publishes an official MCP server (https://github.com/BerriAI/litellm).
What people are saying on Reddit & Hacker News
Real, publicly-posted discussion — not a Crail-verified review. Always linked back to the original post so you can read it in context.
“pretty horrifying. I only use it as lightweight wrapper and will most likely move away from it entirely. Not worth the risk”
View original post →
“The idea of an LLM proxy is super compelling. There's a lot of powerful ideas baked into the proxy form factor – I think you've listed out quite a few of them. It reminds me a bit of what Cloudflare did for the web: both making it faster and safer/easier.”
View original post →
Reviews
No reviews yet for LiteLLM. Be the first to submit a verified review.
Methodology & disclosure
Data verified via agent crawled, last checked 2026-07-26. Agent-readiness methodology version crail-ar-v0.1. No vendor payment influences these scores — see our methodology page.