[syslog-ng] [External] Re: librdkafka config property error on startup

[Sanjay Patel]

What does hard coded mean? What parameters need to be passed during startup?

* the version of syslog-ng 
3.31

* the version of librdkafka library  
librdkafka1/bionic,now 0.11.3-1build1 amd64
librdkafka-dev/bionic 0.11.3-1build1 amd64
librdkafka++1/bionic 0.11.3-1build1 amd64

* the version of your kafka server

kafka_2.12-2.8.0:


Thank you for all your help,

SKP

-----Original Message-----
From: syslog-ng <syslog-ng-bounces at lists.balabit.hu> On Behalf Of Peter
Kokai (pkokai)
Sent: Thursday, September 2, 2021 3:09 AM
To: Syslog-ng users' and developers' mailing list
<syslog-ng at lists.balabit.hu>
Subject: [External] Re: [syslog-ng] librdkafka config property error on
startup

Hello,

This property is hard coded into the syslog-ng's kafka module.
As far as I can see the latest kafka version is 2.8:
https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan

Could you please share the following with us:
* the version of syslog-ng
* the version of librdkafka library
* the version of your kafka server

--
Kokan

________________________________________
From: syslog-ng <syslog-ng-bounces at lists.balabit.hu> on behalf of Sanjay
Patel <skp at smarthive.io>
Sent: 02 September 2021 08:57
To: syslog-ng at lists.balabit.hu
Subject: [syslog-ng] librdkafka config property error on startup

CAUTION: This email originated from outside of the organization. Do not
follow guidance, click links, or open attachments unless you recognize the
sender and know the content is safe.

I am trying to use Kafka-c with Syslog-ng. I have version Kafka 3.31 of
Kafka installed, and I have syslog-ng-mod-rdkafka installed. When I start
Syslog-ng, I get the following error. I can't figure out where it is getting
this setting from. Syslog starts, but it does not send any logs to Kafka.

kafka: error setting librdkafka config property; name='topic.partitioner',
value='murmur2_random', error='No such configuration property:

My Kafka config looks as follows:

@include "scl.conf"
destination d_kafka {
  kafka-c(
    bootstrap-servers("10.254.164.15:9092")
    topic("incoming")
  );
};
log {
  source(s_network);
  destination(d_kafka);
};

Any help will be deeply appreciated.

SKP


____________________________________________________________________________
__
Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
Documentation:
http://www.balabit.com/support/documentation/?product=syslog-ng
FAQ: http://www.balabit.com/wiki/syslog-ng-faq



 
<https://t.sidekickopen07.com/s3t/o/5/f18dQhb0S7n28cFBYDW5xwfpz2zGCvGW40Fv_6
2SXRqbW4NBnl23Lrg1WW5vbH2n1cd60nf197v5Y04?si=7000000000968799&pi=b41d241b-87
42-4f48-bc6a-41864afdfdce> 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.balabit.hu/pipermail/syslog-ng/attachments/20210902/6318fa4e/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4432 bytes
Desc: not available
URL: <http://lists.balabit.hu/pipermail/syslog-ng/attachments/20210902/6318fa4e/attachment.bin>