[syslog-ng] syslog-ng-3.30.1

[Laszlo Budai]

3.30.1
Highlights

  *   filter template function
  *   support proxy-protocol<https://www.haproxy.org/download/1.8/doc/proxy-protocol.txt>

Features

  *   kafka (C implementation):

     *   Added template support to topic().
     *   Added fallback-topic() option, which will be used, if the templated topic() yields an invalid topic name.
(#3372<https://github.com/syslog-ng/syslog-ng/pull/3372>)
  *   transport: add proxy-protocol support

http://www.haproxy.org/download/1.8/doc/proxy-protocol.txt

Example config, click to expand! ([#3437<https://github.com/syslog-ng/syslog-ng/pull/3437>](https://github.com//pull/3437<https://github.com/syslog-ng/syslog-ng/pull/3437>))
  *   filter: new template function

The new introduced filter template function will allow filtering lists based on a filter expression.

For example this snippet removes odd numbers

log {
  source { example-msg-generator(num(1) values(INPUT => "0,1,2,3")); };
  destination {
     file("/dev/stdout"
           template("$(filter ('$(% $_ 2)' eq '0') $INPUT)\n)")
     );
  };
};


(#3426<https://github.com/syslog-ng/syslog-ng/pull/3426>)

  *   file, network, program destinations: : new truncate_size option introduced to truncate an output message to a specified max size. default value is -1 (disabled).

network("127.0.0.1" truncate_size(100));


new stats counters:

dst.network;d_local#0;udp,127.0.0.1:1111;a;truncated_count;1
dst.network;d_local#0;udp,127.0.0.1:1111;a;truncated_bytes;1


(#3474<https://github.com/syslog-ng/syslog-ng/pull/3474>)

  *   network: add FreeBSD support for the so_reuseport(yes) the same as in linux SO_REUSEPORT (FreeBSD uses SO_REUSEPORT_LB flag).
(#3438<https://github.com/syslog-ng/syslog-ng/pull/3438>)

  *   date-parser: %z accepts local timezone std format as well
(#3453<https://github.com/syslog-ng/syslog-ng/pull/3453>)

  *   syslog-format: accepting longer sdata keys

Triggered by #3197<https://github.com/syslog-ng/syslog-ng/issues/3197>
At the end of the discussion in the mentioned issue, we decided
to change the parser and accept longer than 32 character ID's.
(#3244<https://github.com/syslog-ng/syslog-ng/pull/3244>)

  *   systemd-journal: add namespace() option
This option accepts a string which is identical to the --namespace option of journalctl.
For systems defining this option with a systemd version older than v245 a warning is issued.
(#3358<https://github.com/syslog-ng/syslog-ng/pull/3358>)

Bugfixes

  *   date-parse: %Z should parse the same timezones as %z not just local and gmt
(#3453<https://github.com/syslog-ng/syslog-ng/pull/3453>)

  *   python: printing the exception instead of None (if compiled with clang)
(#3405<https://github.com/syslog-ng/syslog-ng/pull/3405>)

  *   network/udp: message was lost (not sent) if it was too large, and a time reopen amount of time needed to expire to send the next message lowering the thoughtput. now it is truncated at 65507.
(#3474<https://github.com/syslog-ng/syslog-ng/pull/3474>)

  *   tlscontext: support IPv6 X509v3 Subject Alternative Name

Fixes #3465<https://github.com/syslog-ng/syslog-ng/issues/3465>
(#3466<https://github.com/syslog-ng/syslog-ng/pull/3466>)

  *   map: pass $_ to if correctly.

Prior this patchset, if did not receive $_ correctly.

After this change, these configurations will work:

log {
  source { example-msg-generator(num(1) values(INPUT => "0,1,2,3")); };
  destination {
     file("/dev/stdout"
           template("$(map $(if ('$(% $_ 2)' eq '0') 'even' 'odd') $INPUT)'\n)")
     );
  };
};


(#3426<https://github.com/syslog-ng/syslog-ng/pull/3426>)

  *   systemd-journal: add namespace to the persist name
(#3407<https://github.com/syslog-ng/syslog-ng/pull/3407>)

  *   syslog-ng: fixed numerous spelling mistakes in messages generated by syslog-ng
(#3398<https://github.com/syslog-ng/syslog-ng/pull/3398>)

  *   network: fix TLS certificate hostname verification when using failover() servers

For TLS certificate hostname verification, the certificate's hostname needs to be compared to the configured hostname
of the primary and each failover server. syslog-ng used always the primary server's name incorrectly.
(#3447<https://github.com/syslog-ng/syslog-ng/pull/3447>)

  *   afsocket: syslog-ng fails to bind() after config revert

When having a program source or destination and a network destination in the
config, if we reload with an invalid config, syslog-ng crashes, as it cannot init
the old network source, because its address is in use.
(#3416<https://github.com/syslog-ng/syslog-ng/pull/3416>)

  *   syslog-ng-ctl: when syslog-ng gets stuck on executing a heavy stats-ctl command, should be
able to do a graceful shutdown when it is requested.
(#3349<https://github.com/syslog-ng/syslog-ng/pull/3349>)

  *   json-parser: fix parsing 64 bit numbers (currently 32 bit was a limit)
(#3403<https://github.com/syslog-ng/syslog-ng/pull/3403>)

  *   usertty(): on each tty open error an error mesage and a 10 minutes long disabling of the usertty() destination has been added.
Until now, the usertty() destination were only disabled for blocking write() calls.
(#3473<https://github.com/syslog-ng/syslog-ng/pull/3473>)

Notes to developers

  *   Proxy protocol support added to loggen.

Four new options added to loggen to suppport the proxy protocol:

     *   --proxied : Generate PROXY protocol v1 header
     *   --proxy-src-ip : Set the source IP for the PROXY protocol v1 header. If not specified a random IP address generated (192.168.1.X).
     *   --proxy-dst-ip : Set the destination IP for the PROXY protocol v1 header. If not specified a random IP address generated (192.168.1.X).
     *   --proxy-src-port : Set the source port for the PROXY protocol v1 header. If not specified a random port generated in the range 5000-10000.
     *   --proxy-dst-port : Set the destination port for the PROXY protocol v1 header. If not specified the port number 514 will be used.
(#3462<https://github.com/syslog-ng/syslog-ng/pull/3462>)
  *   bison: Minimum required version is now 3.4.2.
You still only need bison, if you are building from git source or changing the grammar in the released source tarball.
(#2526<https://github.com/syslog-ng/syslog-ng/pull/2526>)

  *   Template evaluation related function signatures changed.

A new structure LogTemplateEvalOptions is introduced to group parameters together.
(#3426<https://github.com/syslog-ng/syslog-ng/pull/3426>)

Other changes

  *   json-parser: change every per message logs that was higher than debug to debug
(#3401<https://github.com/syslog-ng/syslog-ng/pull/3401>)

Credits

syslog-ng is developed as a community project, and as such it relies
on volunteers, to do the work necessarily to produce syslog-ng.

Reporting bugs, testing changes, writing code or simply providing
feedback are all important contributions, so please if you are a user
of syslog-ng, contribute.

We would like to thank the following people for their contribution:

Andras Mitzki, Antal Nemes, Attila Szakacs, Balazs Scheidler,
Boris Korzun, Gabor Nagy, Laszlo Budai, Laszlo Szemere, László Várady,
Norbert Takacs, Peter Kokai, Viktor Juhasz, Vivin Peris, Zoltan Pallagi,
bjoe2k4


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.balabit.hu/pipermail/syslog-ng/attachments/20201119/5e6acc92/attachment.html>