What does hard coded mean? What parameters need to be passed during startup?

* the version of syslog-ng 
3.31

* the version of librdkafka library  
librdkafka1/bionic,now 0.11.3-1build1 amd64
librdkafka-dev/bionic 0.11.3-1build1 amd64
librdkafka++1/bionic 0.11.3-1build1 amd64

* the version of your kafka server

kafka_2.12-2.8.0:


Thank you for all your help,

SKP

-----Original Message-----
From: syslog-ng <syslog-ng-bounces@lists.balabit.hu> On Behalf Of Peter Kokai (pkokai)
Sent: Thursday, September 2, 2021 3:09 AM
To: Syslog-ng users' and developers' mailing list <syslog-ng@lists.balabit.hu>
Subject: [External] Re: [syslog-ng] librdkafka config property error on startup

Hello,

This property is hard coded into the syslog-ng's kafka module.
As far as I can see the latest kafka version is 2.8: https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan

Could you please share the following with us:
* the version of syslog-ng
* the version of librdkafka library
* the version of your kafka server

--
Kokan

________________________________________
From: syslog-ng <syslog-ng-bounces@lists.balabit.hu> on behalf of Sanjay Patel <skp@smarthive.io>
Sent: 02 September 2021 08:57
To: syslog-ng@lists.balabit.hu
Subject: [syslog-ng] librdkafka config property error on startup

CAUTION: This email originated from outside of the organization. Do not follow guidance, click links, or open attachments unless you recognize the sender and know the content is safe.

I am trying to use Kafka-c with Syslog-ng. I have version Kafka 3.31 of Kafka installed, and I have syslog-ng-mod-rdkafka installed. When I start Syslog-ng, I get the following error. I can't figure out where it is getting this setting from. Syslog starts, but it does not send any logs to Kafka.

kafka: error setting librdkafka config property; name='topic.partitioner', value='murmur2_random', error='No such configuration property:

My Kafka config looks as follows:

@include "scl.conf"
destination d_kafka {
  kafka-c(
    bootstrap-servers("10.254.164.15:9092")
    topic("incoming")
  );
};
log {
  source(s_network);
  destination(d_kafka);
};

Any help will be deeply appreciated.

SKP


______________________________________________________________________________
Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng
FAQ: http://www.balabit.com/wiki/syslog-ng-faq