Kafka Upstream

Release date 2025/12/18

Feature

• added new config option ssl_verify to support verifying server certificates. Added support for the tls_certificate_verify global option. When this option is enabled, the plugin’s ssl_verify setting cannot be disabled.

Bugfix

• Fixed issue where Kafka producer cached TLS certificates, causing failures when certificates were updated. Now, the plugin properly reloads updated certificates.

• Fixed an issue where the kafka-upstream plugin fails to connect certain Kafka clusters using SCRAM-SHA-256 or SCRAM-SHA-512

Release date 2025/10/01

Bugfix

• Fixed an issue where forward_body dropped request bodies larger than Nginx’s default buffer size (16 KB). It now reads up to 1 MB and returns an error if the body can’t be fully read.

Release date 2025/07/03

Feature

• Added support for sending messages with dynamic keys to determine partitions.

Release date 2025/03/27

Feature

• Added support for sending messages to multiple topics with topics_query_arg, and enabled topic allowlisting with allowed_topics.

• Added support for message manipulation with the new configuration field message_by_lua_functions.

Release date 2023/08/09

Bugfix

• Fixed an issue where the plugin could lose connection to a broker when the broker leadership changed.

Release date 2022/09/09

Feature

• Added support for the SCRAM-SHA-512 authentication mechanism.

Release date 2022/11/21

Bugfix

• Fixed the Bad Gateway error that would occur when using the Kafka Upstream plugin with the configuration producer_async=false.

Release date 2022/05/27

Feature

• Added support for the SCRAM-SHA-512 authentication mechanism.

Release date 2022/03/02

Feature

• Added the ability to identify a Kafka cluster using the cluster_name configuration parameter. By default, this field generates a random string. You can also set your own custom cluster identifier.

• Beta feature: The authentication.user and authentication.password configuration fields are now marked as referenceable, which means they can be securely stored assecretsin a vault. References must follow a specific format.