Release date 2026/07/02
Emitted the documented X-AI-RateLimit-* headers on 429 responses from policies that partition by provider or model.
Fixed an issue with token counters being decremented on AI Semantic Cache hits.
Fixed an issue where model or provider matchers without partition_by were skipped, causing rate limits to be missed.
Fixed policy integration with ai-proxy
for single-target and multi-target AI proxy routes.
Release date 2026/06/23
Emitted the documented X-AI-RateLimit-* headers on 429 responses from policies that partition by provider or model.
Fixed policy integration with ai-proxy
for single-target and multi-target AI proxy routes.
Release date 2026/04/07
Removed the parse-request shared filter and deprecated the llm_format configuration field.
Added a policy-based rate limiting mode with multi-dimensional match conditions and request counting strategy.
Added prompt token estimation for prompt_tokens, total_tokens, and cost strategies in policies mode, enabling early request rejection before the upstream responds.
Fixed an issue where the plugin did not validate whether the configured dictionary_name exists before use, which could lead to runtime errors.
Extended deferred rate limiting callback to support model-partitioned policies and cost strategy.
Release date 2025/12/18
added support to count cost for routes with dynamic AI models.
Fixed an issue where the plugin decreased requests by whole numbers when using Redis. This is an opt-in fix and can be enabled by setting decrease_by_fractions_in_redis to true in the plugin configuration.
Release date 2025/11/18
Fixed an issue where the plugin decreased requests by whole numbers when using Redis. This is an opt-in fix and can be enabled by setting decrease_by_fractions_in_redis to true in the plugin configuration.
Release date 2025/10/23
Fixed an issue where the plugin decreased requests by whole numbers when using Redis. This is an opt-in fix and can be enabled by setting decrease_by_fractions_in_redis to true in the plugin configuration.
Release date 2025/07/16
Fixed an issue where the llm license migration could fail if the license counter contained more than one week of data.
Release date 2025/07/03
Added support for the namespace field in the AI Rate Limiting Advanced plugin. This allows users to specify a ratelimiting namespace for the plugin, Similar to the existing namespace field in the rate-limiting-advanced plugin.
Fixed an issue where some of ai metrics was missed in analytics
Fixed an issue where AI rate limiting advanced plugin might panic when use redis strategy and sync_rate is set to 0.
Fixed an issue where the rate limiting plugins can’t handle decimal numbers when using Redis strategy.
If any AI Gateway plugin has been enabled in a self-managed Kong Gateway deployment for more than a week, upgrades from 3.10 versions to 3.11.0.0 will fail due to a license migration issue. This does not affect Konnect deployments.
A fix will be provided in 3.11.0.1.
See breaking changes in 3.11 for a temporary workaround.
Release date 2025/12/09
Fixed an issue where the plugin decreased requests by whole numbers when using Redis. This is an opt-in fix and can be enabled by setting decrease_by_fractions_in_redis to true in the plugin configuration.
Release date 2025/08/07
Fixed an issue where AI rate limiting advanced plugin might panic when use redis strategy and sync_rate is set to 0.
Release date 2025/03/27
window_size and limit now require an array of numbers instead of a single number.
If you configured the plugin before 3.10 and use kong migrations to upgrade to 3.10, it will be automatically migrated to use the array.
Added support for allowing multiple rate limits for the same providers.
Release date 2024/12/12
Added support for Huggingface provider to the AI Rate Limiting Advanced plugin.
Updated the error message for rate limit exceeded to include AI-related information.
Fixed an issue where the plugin yielded an error when incrementing the rate limit counters in non-yieldable phases.
Fixed an issue where the plugin may fail to authenticate to Redis correctly with vault-referenced redis configuration.
Release date 2024/11/04
Fixed an issue where the plugin yielded an error when incrementing the rate limit counters in non-yieldable phases.
Release date 2024/09/11
Switched to sentinel_nodes and cluster_nodes for redis configuration.
Deprecated timeout config field in redis config in favor of connect_/send_/read_timeout (timeout field will be removed in 4.0).
allow AI plugin to read request from buffered file
Add the cost strategy to AI rate Limiting plugin.
Added the bedrock and gemini providers to the providers list in
the ai-rate-limiting-advanced plugin.
Add the stats when reaching limit and exiting AI rate Limiting plugin.
Added Redis cluster_max_redirections configuration option.
Edit the logic for the window ajustement and fix missing passing window to shm