The AI Prompt Decorator plugin adds an array of llm/v1/chat messages to either the start or end of an LLM consumer’s chat history.
This allows you to pre-engineer complex prompts, or steer (and guard) prompts so that they aren’t visible to users.
You can use this plugin to pre-set a system prompt, set up specific prompt history, add words and phrases, or otherwise have more control over how an LLM service is used when called via Kong Gateway.
This plugin extends the functionality of the AI Proxy plugin, and requires AI Proxy to be configured first. To set up AI Proxy quickly, see Get started with AI Gateway.