[syslog-ng] Disk-buffer in kafka-destinations

Peter Kokai (pkokai) Peter.Kokai at oneidentity.com
Fri Jan 10 07:08:21 UTC 2020


Hello,

Every destination has a queue by default memory, and it is possible to replace with disk based buffer. If that does not work that is probably a bug.
Could you please write the version of syslog-ng you are using ?
Do you use the java or the C based kafka destination ?

Please include the config and error.

--
Kokan

On Thu, Jan 09, 2020 at 03:07:44PM -0600, Ronald Fenner wrote:
> CAUTION: This email originated from outside of the organization. Do not follow guidance, click links, or open attachments unless you recognize the sender and know the content is safe.
> 
> I can't see to me get syslog-ng to start if I add the disk-buffer to the destination.
> From the docs page it looks like it should be added to the kafka section but it doesn't work and doesn't work if I put it with in the destination block.
> 
> Is this tied to a specific destination type?
> 
> We are trying to make out messages going to kafka more reliable when the cluster is unavailable.
> 
> Ronald Fenner
> Network Architect
> Game Circus LLC.
> 
> rfenner at gamecircus.com<mailto:rfenner at gamecircus.com>
> 

> ______________________________________________________________________________
> Member info: https://nam05.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.balabit.hu%2Fmailman%2Flistinfo%2Fsyslog-ng&data=02%7C01%7CPeter.Kokai%40oneidentity.com%7Cb72a9458366446f63e9908d79547fcd2%7C91c369b51c9e439c989c1867ec606603%7C0%7C0%7C637142008740844164&sdata=rsTQvFjkAJPdawx18O7jSuHbbcKTZFiR8qTbUBbgEH4%3D&reserved=0
> Documentation: https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.balabit.com%2Fsupport%2Fdocumentation%2F%3Fproduct%3Dsyslog-ng&data=02%7C01%7CPeter.Kokai%40oneidentity.com%7Cb72a9458366446f63e9908d79547fcd2%7C91c369b51c9e439c989c1867ec606603%7C0%7C0%7C637142008740854159&sdata=13KCnq80UC9fGKLIDzLkFt%2FiGeo6KBNthfbqaT9UQiQ%3D&reserved=0
> FAQ: https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.balabit.com%2Fwiki%2Fsyslog-ng-faq&data=02%7C01%7CPeter.Kokai%40oneidentity.com%7Cb72a9458366446f63e9908d79547fcd2%7C91c369b51c9e439c989c1867ec606603%7C0%7C0%7C637142008740854159&sdata=yeie8XJtlm1czeAefxbz%2FFXsmrf%2BxFZe4xHkpbrt1t8%3D&reserved=0
> 


More information about the syslog-ng mailing list