LiteLLM

★ 4/5 · API Aggregator

LiteLLM is an open-source proxy and SDK that gives developers one OpenAI-compatible interface to 100+ LLM providers, with cost tracking, key management and fallbacks.

Pros

Unified API proxy for 100+ LLM providers (OpenAI, Anthropic, Azure, Bedrock, etc.)
built-in cost tracking, rate limiting, and logging
switch LLM providers without code changes

Cons

Configuration complexity for multi-provider setups
requires understanding provider-specific rate limits and quirks
proxy adds minor latency overhead

Cost

Free, open source (MIT); optional LLM Proxy managed service available from vendor

Verdict

Critical for teams avoiding vendor lock-in and needing cost visibility across multiple LLM providers.

Visit LiteLLM