[syslog-ng] librdkafka config property error on startup

[Peter Kokai (pkokai)]

Hello,

This property is hard coded into the syslog-ng's kafka module.
As far as I can see the latest kafka version is 2.8: https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan

Could you please share the following with us:
* the version of syslog-ng
* the version of librdkafka library
* the version of your kafka server

--
Kokan

________________________________________
From: syslog-ng <syslog-ng-bounces at lists.balabit.hu> on behalf of Sanjay Patel <skp at smarthive.io>
Sent: 02 September 2021 08:57
To: syslog-ng at lists.balabit.hu
Subject: [syslog-ng] librdkafka config property error on startup

CAUTION: This email originated from outside of the organization. Do not follow guidance, click links, or open attachments unless you recognize the sender and know the content is safe.

I am trying to use Kafka-c with Syslog-ng. I have version Kafka 3.31 of Kafka installed, and I have syslog-ng-mod-rdkafka installed. When I start Syslog-ng, I get the following error. I can't figure out where it is getting this setting from. Syslog starts, but it does not send any logs to Kafka.

kafka: error setting librdkafka config property; name='topic.partitioner', value='murmur2_random', error='No such configuration property:

My Kafka config looks as follows:

@include "scl.conf"
destination d_kafka {
  kafka-c(
    bootstrap-servers("10.254.164.15:9092")
    topic("incoming")
  );
};
log {
  source(s_network);
  destination(d_kafka);
};

Any help will be deeply appreciated.

SKP