About LiteLLM
AI gateway and LLM proxy: one OpenAI-compatible key for 140+ providers, with spend tracking, caps and routing. Self-hostable.
Model Gateways
Alternatives to LiteLLM
7 model gateways tools you can use instead of LiteLLM, 2 of them open source. Summaries come from each vendor's own site. Links checked Oct 23, 2026.
At a glance
LiteLLM alternatives compared
| Tool | What it does | Open source | Head to head |
|---|---|---|---|
| Cloudflare AI Gateway | Analytics, caching, rate limiting and model fallback in front of your AI provider calls. | No | LiteLLM vs Cloudflare AI Gateway |
| Kong AI Gateway | Security, routing, observability and cost control for LLM and MCP traffic, from the Kong API gateway team. | Yes | LiteLLM vs Kong AI Gateway |
| OpenRouter | One API for many models from many providers, with model and price comparison. | No | LiteLLM vs OpenRouter |
| Portkey | AI gateway and production stack for teams shipping generative AI apps, with an open-source gateway. | Yes | LiteLLM vs Portkey |
| Requesty | OpenAI-compatible LLM router for 600+ models with smart routing, caching, failover and EU data residency. | No | LiteLLM vs Requesty |
| SeedRouter | One API key for image, video, language and audio models, billed per request. Failed requests cost nothing. | No | LiteLLM vs SeedRouter |
| Vercel AI Gateway | Use 400+ AI models through one endpoint without managing rate limits and API keys per provider. | No | LiteLLM vs Vercel AI Gateway |
Model Gateways
All 7 alternatives
-
Cloudflare AI Gateway
developers.cloudflare.comAnalytics, caching, rate limiting and model fallback in front of your AI provider calls.
-
Kong AI Gateway
konghq.comSecurity, routing, observability and cost control for LLM and MCP traffic, from the Kong API gateway team.
-
OpenRouter
openrouter.aiOne API for many models from many providers, with model and price comparison.
-
Portkey
portkey.aiAI gateway and production stack for teams shipping generative AI apps, with an open-source gateway.
-
Requesty
requesty.aiOpenAI-compatible LLM router for 600+ models with smart routing, caching, failover and EU data residency.
-
SeedRouter
seedrouter.aiOne API key for image, video, language and audio models, billed per request. Failed requests cost nothing.
-
Vercel AI Gateway
vercel.comUse 400+ AI models through one endpoint without managing rate limits and API keys per provider.
FAQ
Questions
What are the alternatives to LiteLLM?
Agent Stack Directory lists 7 other model gateways tools: Cloudflare AI Gateway, Kong AI Gateway, OpenRouter, Portkey, Requesty, SeedRouter, Vercel AI Gateway.
Is there an open-source alternative to LiteLLM?
Yes. Among the alternatives we list, these are marked open source: Kong AI Gateway, Portkey.
What does LiteLLM do?
AI gateway and LLM proxy: one OpenAI-compatible key for 140+ providers, with spend tracking, caps and routing. Self-hostable. (Summary based on litellm.ai, link checked 2026-10-23.)