What is AI Manager?
AI Manager in Konnect provides a unified control plane to create, manage, and monitor LLMs using the Konnect platform.
Key features include:
- Routing and load balancing: Assign Gateway Services and define how traffic is distributed across models.
- Streaming and authentication: Enable streaming responses and manage authentication through the AI Gateway.
- Access control: Create and apply access tiers to control how clients interact with LLMs.
- Usage analytics: Monitor request and token volumes, track error rates, and measure average latency with historical comparisons.
- Visual traffic maps: Explore interactive maps that show how requests flow between clients and models in real time.
