[syslog-ng] Finding feature owner for Kafka source project

Vincent Bernat bernat at luffy.cx
Sat May 21 19:38:37 CEST 2016


 ❦ 21 mai 2016 20:33 +0530, Vithulan MV <vithulanmv.12 at cse.mrt.ac.lk> :

> A simple abstract idea of this project is, 
> The syslog-ng application can read messages from the sources. It
> processes them with filters, rewrite rules, parsers and finally sends
> messages to their destinations. The syslog-ng application already has
> a Kafka destination that is implemented in Java. The Kafka source will
> allow syslog-ng to read messages from Kafka, for an example this can
> be used for example as a queue between several syslog-ng instances.

It's a bit annoying that so many interesting features have to go through
Java. One of the major point of syslog-ng is its light
footprint. librdkafka has support for both source and destination and is
officially supported by Confluent. Its development matches Kafka one and
it supports every feature in Kafka 0.9, including SSL and the new
consumer.

It's a bit late to complain, notably if you chose this project because
you were comfortable with Java (and your mentor is obviously interested
in doing that in Java too). However, this has already been pointed
out in March without much response from Balabit. It's not just a matter
of proposing code since such code is likely to get stuck in the
incubator forever.
-- 
Make sure special cases are truly special.
            - The Elements of Programming Style (Kernighan & Plauger)


More information about the syslog-ng mailing list