[syslog-ng] Insider 2016-02: syslog-ng 3.8; Hadoop; Rust; Scale

[Czanik, Péter]

Dear syslog-ng users,

This is the 47th issue of the syslog-ng Insider, a monthly newsletter
that brings you syslog-ng-related news.



NEWS



3.8 news: disk buffer, performance and more

-------------------------------------------

While syslog-ng 3.8 is still in alpha phase, it already has a nice
list of new features merged or waiting to be merged. It will feature
disk based buffering, performance improvements, MongoDB support
rewritten, and many more. Packages from git HEAD are planned to become
available in the coming weeks and will be announced on the mailing
list. For details, browse commit history or download sources from
https://github.com/balabit/syslog-ng



The Hadoop (HDFS) destination

-----------------------------

Petabytes of data are now collected into huge data lakes around the
world. Hadoop is the technology enabling this. While syslog-ng was
able write logs to Hadoop using some workarounds for quite some time,
the new Java-based HDFS destination driver provides both better
performance and more reliability. The syslog-ng HDFS driver is
Hortonworks HDP certified.

https://czanik.blogs.balabit.com/2016/02/filling-your-data-lake-with-log-messages-the-syslog-ng-hadoop-hdfs-destination/



Rust: simple and efficient parsers

----------------------------------

If you want to create high quality, efficient parsers easily, writing
them in Rust is worth considering. This post explaines the steps to
use the experimental Rust language bindings for syslog-ng. There is
even some sample code to help you get started on github. Read more at
https://syslog-ng.org/syslog-ng-and-rust/



Scale 14x

---------

Balabit, and thus syslog-ng participated the Southern California Linux
Expo this year again. The most frequent topic at the booth was ESK
(Elasticsearch syslog-ng Kibana). We had some very good discussions at
the syslog-ng BoF and after my presentation about syslog-ng and Big
Data:

https://czanik.blogs.balabit.com/2016/02/czp-scale-14x-esk-bof-drm/



Your feedback and news tips about the next issue is welcome at
documentation at balabit.com . To read this newsletter on-line, visit:
http://insider.blogs.balabit.com/


Peter Czanik (CzP) <peter.czanik at balabit.com>
Balabit / syslog-ng upstream
http://czanik.blogs.balabit.com/
https://twitter.com/PCzanik