<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); display: inline !important;">Hi SKP,</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<div style="margin: 0px; color: rgb(0, 0, 0);"><br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">I assume you have obtained syslog-ng-mod-rdkafka from<span> </span><a href="https://download.opensuse.org/repositories/home:/laszlo_budai:/syslog-ng/xUbuntu_18.04/amd64/" style="margin:0px">https://download.opensuse.org/repositories/home:/laszlo_budai:/syslog-ng/xUbuntu_18.04/amd64/</a></div>
<div style="margin: 0px; color: rgb(0, 0, 0);">Can you please confirm that? If it is true, then unfortunately it will not work.<br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);"><br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">tl;dr: You have to obtain librdkafka version at least 1.0.0 (if using syslog-ng 3.31.2) from other sources. Building it from git source might be an option:<span> </span><a href="https://github.com/edenhill/librdkafka" style="margin:0px">https://github.com/edenhill/librdkafka</a></div>
<div class="_Entity _EType_OWALinkPreview _EId_OWALinkPreview _EReadonly_1" style="margin: 0px; color: rgb(0, 0, 0);">
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">Alternatively, you can use a more recent platform, like Ubuntu 20.04, which provides librdkafka 1.2.1.<br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);"><br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">In more details:</div>
<div style="margin: 0px; color: rgb(0, 0, 0);"><br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">The above mentioned OBS repository was a personal project, and it has been discontinued.</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">The syslog-ng-mod-rdkafka is available for Ubuntu 18.04 from the OBS repository, but the necessary librdkafka package is not available there.</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">The OBS repository have provided librdkafka in the past, but this does not seem to be the case anymore.</div>
<div style="margin: 0px; color: rgb(0, 0, 0);"><br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">We are actively working on providing a syslog-ng APT repository with stable releases and nightly packages that will be maintained by the syslog-ng development team. The first steps for this have been merged (#3763),
we will post to this mailing list announcing this new repository when we are ready.</div>
<div style="margin: 0px; color: rgb(0, 0, 0);"><br>
</div>
<div style="margin: 0px; color: rgb(0, 0, 0);">Cheers,</div>
<span style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); display: inline !important;">Attila</span><br>
</div>
<div id="appendonsend"></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size: 11pt;"><b>From:</b> syslog-ng <syslog-ng-bounces@lists.balabit.hu> on behalf of Sanjay Patel <skp@smarthive.io><br>
<b>Sent:</b> Thursday, September 2, 2021 5:32 PM<br>
<b>To:</b> Syslog-ng users' and developers' mailing list <syslog-ng@lists.balabit.hu><br>
<b>Subject:</b> Re: [syslog-ng] [External] Re: librdkafka config property error on startup</font>
<div> </div>
</div>
<div>
<div style="background-color: rgb(255, 235, 156); width: 100%; border-style: solid; border-color: rgb(156, 101, 0); border-width: 1pt; padding: 2pt; font-size: 10pt; line-height: 12pt; font-family: Calibri; color: black; text-align: left;">
<span style="color: rgb(156, 101, 0); font-weight: bold;">CAUTION:</span> This email originated from outside of the organization. Do not follow guidance, click links, or open attachments unless you recognize the sender and know the content is safe.</div>
<br>
<div>
<p><font size="2">What does hard coded mean? What parameters need to be passed during startup?<br>
<br>
* the version of syslog-ng <br>
3.31<br>
<br>
* the version of librdkafka library <br>
librdkafka1/bionic,now 0.11.3-1build1 amd64<br>
librdkafka-dev/bionic 0.11.3-1build1 amd64<br>
librdkafka++1/bionic 0.11.3-1build1 amd64<br>
<br>
* the version of your kafka server<br>
<br>
kafka_2.12-2.8.0:<br>
<br>
<br>
Thank you for all your help,<br>
<br>
SKP<br>
<br>
-----Original Message-----<br>
From: syslog-ng <syslog-ng-bounces@lists.balabit.hu> On Behalf Of Peter Kokai (pkokai)<br>
Sent: Thursday, September 2, 2021 3:09 AM<br>
To: Syslog-ng users' and developers' mailing list <syslog-ng@lists.balabit.hu><br>
Subject: [External] Re: [syslog-ng] librdkafka config property error on startup<br>
<br>
Hello,<br>
<br>
This property is hard coded into the syslog-ng's kafka module.<br>
As far as I can see the latest kafka version is 2.8: <a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FKAFKA%2FFuture%2Brelease%2Bplan&data=04%7C01%7Cattila.szakacs%40balabit.com%7C0a0bc6f318584b40455608d96e26ee48%7C91c369b51c9e439c989c1867ec606603%7C0%7C1%7C637661935776168028%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=qJWnZK2PQDzF1rEvxJHShGrsxEN7mqSYLHDa8PKdHDE%3D&reserved=0" originalsrc="https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan" shash="U9XQYLVNMKrH+n3gbah9UHkPvHWNMMWp3nEoDaB2l5e632k+QW1WB09/b0IPMGLPrb6EFALdeD4uitva76VAa1bLu+wcL7difDQR1NzRpyA6ugNFEOGA9SUPJHKLtXRt5AZRdQMEr1HElhlIOe+RMrpoEP7Y1O/l0NJy3RntWrw=">
https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan</a><br>
<br>
Could you please share the following with us:<br>
* the version of syslog-ng<br>
* the version of librdkafka library<br>
* the version of your kafka server<br>
<br>
--<br>
Kokan<br>
<br>
________________________________________<br>
From: syslog-ng <syslog-ng-bounces@lists.balabit.hu> on behalf of Sanjay Patel <skp@smarthive.io><br>
Sent: 02 September 2021 08:57<br>
To: syslog-ng@lists.balabit.hu<br>
Subject: [syslog-ng] librdkafka config property error on startup<br>
<br>
CAUTION: This email originated from outside of the organization. Do not follow guidance, click links, or open attachments unless you recognize the sender and know the content is safe.<br>
<br>
I am trying to use Kafka-c with Syslog-ng. I have version Kafka 3.31 of Kafka installed, and I have syslog-ng-mod-rdkafka installed. When I start Syslog-ng, I get the following error. I can't figure out where it is getting this setting from. Syslog starts,
but it does not send any logs to Kafka.<br>
<br>
kafka: error setting librdkafka config property; name='topic.partitioner', value='murmur2_random', error='No such configuration property:<br>
<br>
My Kafka config looks as follows:<br>
<br>
@include "scl.conf"<br>
destination d_kafka {<br>
kafka-c(<br>
bootstrap-servers("10.254.164.15:9092")<br>
topic("incoming")<br>
);<br>
};<br>
log {<br>
source(s_network);<br>
destination(d_kafka);<br>
};<br>
<br>
Any help will be deeply appreciated.<br>
<br>
SKP<br>
<br>
<br>
______________________________________________________________________________<br>
Member info: <a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.balabit.hu%2Fmailman%2Flistinfo%2Fsyslog-ng&data=04%7C01%7Cattila.szakacs%40balabit.com%7C0a0bc6f318584b40455608d96e26ee48%7C91c369b51c9e439c989c1867ec606603%7C0%7C1%7C637661935776178023%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=AH3%2FBiatgNTXolCPzRAfFKaOyTFuX6d%2F92h%2BLpQzECs%3D&reserved=0" originalsrc="https://lists.balabit.hu/mailman/listinfo/syslog-ng" shash="wFF0/ijXIXZ5EaNP8u5yKKcq2cdO1Zspsb+TGilPSAyqFtWEEOGgpzeTuOHy7V4+dVWeTFtmKa1zVC2hXfk95E4OVUNHI3+waRrkpRzkMjDciBHm7bf2qb9nTbNX6eZFhWkdw6cg6fHYD3GCDh/t1hYeTMpi+HU7ZpfGLSfOsoc=">
https://lists.balabit.hu/mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.balabit.com%2Fsupport%2Fdocumentation%2F%3Fproduct%3Dsyslog-ng&data=04%7C01%7Cattila.szakacs%40balabit.com%7C0a0bc6f318584b40455608d96e26ee48%7C91c369b51c9e439c989c1867ec606603%7C0%7C1%7C637661935776178023%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=ye8s%2B3RkO3z14wcvw2mGr03qsFwyxMbidZJkzfMDkZM%3D&reserved=0" originalsrc="http://www.balabit.com/support/documentation/?product=syslog-ng" shash="GY+/U1IieSYh/D0cdGbYd8E//2P9XfqtiKB+OaRvcQqPhzPwH2JvdemBgP4T1tuf1v/TqDWb+OrQJM2PTwLDTXOaNqd15cblAgxlvRwjYcwaGjN001m97X/C3sx7yGP9C2vx4ctfYKMbYlrD/fqireOtCaZJ9Hm4CZzZYjFYpwY=">
http://www.balabit.com/support/documentation/?product=syslog-ng</a><br>
FAQ: <a href="https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.balabit.com%2Fwiki%2Fsyslog-ng-faq&data=04%7C01%7Cattila.szakacs%40balabit.com%7C0a0bc6f318584b40455608d96e26ee48%7C91c369b51c9e439c989c1867ec606603%7C0%7C1%7C637661935776188018%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=96scYzgR7J9ZcW8niXWL0ELlqKXQv5tCgxENkM2drwU%3D&reserved=0" originalsrc="http://www.balabit.com/wiki/syslog-ng-faq" shash="C0aQqtphhUqSm2eR2/B0iXjoyNF3iW0oaXewJ739Vb3POQYyu+7h7mtnoBjcuw/1zELOkU8dAHh1/WFRWw9ST4BS3RpQEnLLKTxPyNrXIXvfA5MB/QPCXva+gBfu7vJzjReg/sGOVdiZM9L96JwyLiers9JsTTITrBKWJN2bcNo=">
http://www.balabit.com/wiki/syslog-ng-faq</a><br>
<br>
</font></p>
<img width="1" height="1" style="display:none!important" src="https://t.sidekickopen07.com/s3t/o/5/f18dQhb0S7n28cFBYDW5xwfpz2zGCvGW40Fv_62SXRqbW4NBnl23Lrg1WW5vbH2n1cd60nf197v5Y04?si=7000000000968799&pi=b41d241b-8742-4f48-bc6a-41864afdfdce">
</div>
</div>
</body>
</html>