LiteLLM
LLM Gateway to manage auth, loadbalancing, and spend tracking across 100+ LLMs
LiteLLM is an LLM gateway that acts as an OpenAI-compatible proxy, enabling teams to manage authentication, load balancing, and spend tracking across 100+ large language models. It provides a unified API in the OpenAI format, abstracting away the differences between providers like Azure, Gemini, Bedrock, and OpenAI. It is designed to give developers centralized access and control over multiple LLM providers.
LiteLLM acts as a proxy gateway that standardizes all LLM provider APIs into the OpenAI format, handling auth, routing, and spend tracking centrally.
developers and engineering teams working with multiple LLM providers
Background.
- Status
- launched
- Business model
- freemium
Similar projects.
Editorial take on the space this project sits in — momentum signals, adjacent moves, our call on whether the wedge is real. Get pinged when we publish a new read or when the landscape shifts.
Have a take on this space?
Tell us what you’d build differently, where you think the incumbents miss, or what we’ve gotten wrong about this project. Comments + reactions are coming soon.