Open Source AI Gateway
Talk to multiple LLMs thru a unified API
Vorgestellt
5 Stimmen
Beschreibung
A configurable API gateway for multiple LLM providers (OpenAI, Anthropic, Gemini, Ollama, Mistral and Cohere) with built-in analytics, guardrails, rate limiting, caching and administrative controls. HTTP and gRPC interfaces