I would like to source log messages from kafka with syslog-ng so that I can leverage some message parsing components. I may place the post parsed messages back into a kafka pipe but I am having problems determining a good way to get messages from kafka to syslog-ng. Any recommendations? -- Evan
Not sure if you could do it directly in config file but one way write a consumer to pull the messages from Kafka then have syslog-ng listening to a socket source and pipe the Kafka messages into it and go from there with syslog-ng. I'm using Kafka but I'm pushing to it with syslog-ng. Ronald Fenner Programmer Game Circus LLC. rfenner@gamecircus.com
On Jan 8, 2018, at 11:19 AM, Evan Rempel <erempel@uvic.ca> wrote:
I would like to source log messages from kafka with syslog-ng so that I can leverage some message parsing components.
I may place the post parsed messages back into a kafka pipe but I am having problems determining a good way to get messages from kafka to syslog-ng.
Any recommendations?
-- Evan
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
Hi, As far as I can remember, there was a related Google Summer of Code project, but I don't know how far it got. Bye, Peter Czanik (CzP) <peter.czanik@balabit.com> Balabit / syslog-ng upstream https://www.balabit.com/blog/author/peterczanik/ https://twitter.com/PCzanik On Mon, Jan 8, 2018 at 6:19 PM, Evan Rempel <erempel@uvic.ca> wrote:
I would like to source log messages from kafka with syslog-ng so that I can leverage some message parsing components.
I may place the post parsed messages back into a kafka pipe but I am having problems determining a good way to get messages from kafka to syslog-ng.
Any recommendations?
-- Evan
____________________________________________________________ __________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product= syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
participants (3)
-
Czanik, Péter
-
Evan Rempel
-
Ronald Fenner