AI Gateway providers
The core of AI Gateway is the ability to route AI requests to various providers exposed via a provider-agnostic API. This normalized API layer affords developers and organizations multiple benefits:
- Client applications are shielded from AI provider API specifics, promoting code reusability
- Centralized AI provider credential management
- The AI Gateway gives developers and organizations a central point of governance and observability over AI data and usage
- Request routing can be dynamic, allowing AI usage to be optimized based on various metrics
- AI services can be used by other Kong Gateway plugins to augment non-AI API traffic
Supported providers
The following providers are supported by the AI Proxy and AI Proxy Advanced plugins. Note that some providers may not be available depending on your Kong Gateway version, and some providers don’t support all route types. See the plugins documentation for more details.