Kong AI Gateway cookbooks

A collection of production-ready recipes to build with Kong AI Gateway: LLM routing, guardrails, semantic caching, cost optimization, governance, and MCP integration.

Featured

Claude Code SSO

Authenticate Claude Code requests via Okta SSO with consumer-group-based model routing and per-tier rate limiting.

Access control
View recipe →

Model-Based Routing

Dynamically route requests across OpenAI and AWS Bedrock based on prompt complexity analysis.

LLM routing
View recipe →
ModelContextProtocol

Secure External MCP Gateway

Proxy third-party MCP servers (GitHub, Konnect) through Kong Gateway with centralized access control, observability, and tool-level ACLs.

MCP
View recipe →

All recipes

Basic LLM Routing

Route requests to any supported LLM provider through Kong AI Gateway with Consumer authentication and per-request model selection.
LLM View recipe →

Claude Code SSO

Authenticate Claude Code requests via Okta SSO with consumer-group-based model routing and per-tier rate limiting.
Access control View recipe →

GitHub Copilot BYOK Custom Endpoint

Route GitHub Copilot Chat and agent traffic through Kong Gateway via Copilot's Bring Your Own Key Custom Endpoint, with per-Consumer attribution, request normalization, and token rate limiting.
LLM View recipe →

LLM Cost Optimization

Reduce LLM infrastructure costs using semantic routing, caching, prompt compression, and tiered cost-based rate limiting.
Cost optimization View recipe →

Model-Based Routing

Dynamically route requests across OpenAI and AWS Bedrock based on prompt complexity analysis.
LLM routing View recipe →
ModelContextProtocol

Secure External MCP Gateway

Proxy third-party MCP servers (GitHub, Konnect) through Kong Gateway with centralized access control, observability, and tool-level ACLs.
MCP View recipe →
ModelContextProtocol

Secure Internal MCP Gateway

Aggregate multiple internal APIs into a single MCP server with OAuth 2.1 authentication and tool-level access control via consumer-group ACLs.
MCP View recipe →

Voice AI Pipeline Observability

Observe and govern a cascading voice AI pipeline (STT, LLM, TTS) with per-hop telemetry and conversation-level tracing through Langfuse.
Observability View recipe →
Something wrong?
Report an Issue | Edit this Page
View all Kong documentation

Help us make these docs great!

Kong Developer docs are open source. If you find these useful and want to make them better, contribute today!
Contribute

Still need help?

Ask in our Slack Community
Contact Support