AI Prompt Decorator Policy

Related Documentation
Made by
Kong Inc.
Priority
772
Minimum Version
AI Gateway - 2.0
Tags
#ai
Previous Versions of this page

The AI Prompt Decorator Policy adds an array of llm/v1/chat messages to either the start or end of an LLM consumer’s chat history. This allows you to pre-engineer complex prompts, and manipulate prompts so that they aren’t visible to users.

You can use this Policy to pre-set a system prompt, set up specific prompt history, add words and phrases, or otherwise have more control over how an LLM service is used when called via AI Gateway.

Looking for on-prem configuration? Convert the kongctl configuration to a decK yaml file and use deck file ai2kong. See Configure Kong AI Gateway on-prem for more information.

Help us make these docs great!

Kong Developer docs are open source. If you find these useful and want to make them better, contribute today!