[syslog-ng] syslog-ng 3.3.1 quits at reload

[Michael Hocke]

-----BEGIN PGP SIGNED MESSAGE-----


Hi there,

I am having a problem with syslog-ng 3.3.1. Once in a while syslog-ng quits with a QUIT signal after it was asked to reload the configuration through a HUP signal. I have two instances of it running in separate Solaris 10 zones. Both are extremely busy and both crashed once within the last two weeks. By looking at the code in lib/mainloop.c I found the place where syslog-ng quits. It is within main_loop_reload_config_apply caused by a corrupt old configuration. Here is the backtrace with dbx:

- ------< SNIP >-------
(dbx) where      
current thread: t at 1
=>[1] _kill(0x347f, 0x3, 0x0, 0xfef557d2, 0x80ef41c, 0xfed6217c), at 0xfeb7af85 
  [2] main_loop_reload_config_apply(0x8047920, 0xfefad000, 0x8047908, 0xfef707f9, 0x80ef368, 0xfef92934, 0x0, 0x0, 0xfef706c9), at 0xfef70595 
  [3] main_loop_io_worker_sync_call(0x0, 0x8047920, 0x0, 0x0, 0x0, 0x0), at 0xfef70742 
  [4] iv_signal_event(0xfefad000, 0x8047960, 0x400, 0x796c746e, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0), at 0xfef8d958 
  [5] iv_event_raw_got_event(0xfefad018, 0x8047db0, 0xfe9, 0xfefaa468, 0x2, 0x1), at 0xfef8d54a 
  [6] iv_main(0xfefad180, 0xfef9291e, 0x804c2e8, 0x0, 0x804c7b0, 0x8047e1c), at 0xfef8ac82 
  [7] main_loop_run(0x8049cd7, 0x8047e44, 0x8047e48, 0x8047e2c, 0x8047e30, 0x8049390), at 0xfef71259 
  [8] main(0x1, 0x8047e60, 0x8047e70), at 0x80490fa 
- ------< SNIP >-------

I used to run 3.0.6 before without a problem. The configuration of the server that crashed last night is pretty vanilla:

- ------< SNIP >-------
@version: 3.3
@include "scl.conf"

options { time_reopen (10);
          chain_hostnames (no);
          use_dns (no);
          use_fqdn (no);
          create_dirs (no);
          keep_hostname (yes);
          perm (0644);
        };

# syslog-ng internal logging
source s_local { internal (); };

# local syslogging only
source s_sys { system (); };
destination d_sysmsg    { file ("/dev/sysmsg"); };
destination d_local     { file ("/var/log/syslog-ng.log"); };
destination d_messages  { file ("/var/adm/messages"); };
destination d_mail      { file ("/var/log/mail.log"); };
destination d_daemon    { file ("/var/log/daemon.log"); };
destination d_auth      { file ("/var/log/auth.log"); };
destination d_cron      { file ("/var/log/cron.log"); };
destination d_user      { file ("/var/log/user.log"); };
destination d_lpr       { file ("/var/log/lpr.log"); };
destination d_news      { file ("/var/log/news.log"); };
destination d_uucp      { file ("/var/log/uucp.log"); };

destination d_local0    { file ("/var/log/ipfilter.log"); };
destination d_local1    { file ("/var/log/tcpwrapper.log"); };
destination d_local2    { file ("/var/log/tripwire.log"); };
destination d_local3    { file ("/var/log/local3.log"); };
destination d_local4    { file ("/var/log/local4.log"); };
destination d_local5    { file ("/var/log/local5.log"); };
destination d_local6    { file ("/var/log/local6.log"); };
destination d_local7    { file ("/var/log/local7.log"); };
destination d_snmptraps { file ("/usr/local/var/log/snmptrapd.${R_YEAR}${R_MONTH}${R_DAY}${R_HOUR}.log"
                          group ("snmptrap") perm (416)); };

# this syslog config send a copy of every message to a Splunk server
destination d_archive   { udp ("x.x.x.x"); };

filter f_sysmsg    { level (notice) and facility (kern); };
filter f_messages  { facility (kern); };
filter f_mail      { facility (mail); };
filter f_daemon    { facility (daemon); };
filter f_auth      { facility (auth); };
filter f_cron      { facility (cron); };
filter f_user      { facility (user); };
filter f_lpr       { facility (lpr); };
filter f_news      { facility (news); };
filter f_uucp      { facility (uucp); };
filter f_local0    { facility (local0); };
filter f_local1    { facility (local1); };
filter f_local2    { facility (local2); };
filter f_local3    { facility (local3); };
filter f_local4    { facility (local4); };
filter f_local5    { facility (local5); };
filter f_local6    { facility (local6); };
filter f_local7    { facility (local7); };

log { source (s_local); destination (d_local); };
log { source (s_sys); filter (f_sysmsg); destination (d_sysmsg); destination (d_archive); };
log { source (s_sys); filter (f_messages); destination (d_messages); destination (d_archive); };
log { source (s_sys); filter (f_mail); destination (d_mail); destination (d_archive); };
log { source (s_sys); filter (f_daemon); destination (d_daemon); destination (d_archive); };
log { source (s_sys); filter (f_auth); destination (d_auth); destination (d_archive); };
log { source (s_sys); filter (f_cron); destination (d_cron); destination (d_archive); };
log { source (s_sys); filter (f_user); destination (d_snmptraps); };
log { source (s_sys); filter (f_lpr); destination (d_lpr); destination (d_archive); };
log { source (s_sys); filter (f_news); destination (d_news); destination (d_archive); };
log { source (s_sys); filter (f_uucp); destination (d_uucp); destination (d_archive); };

log { source (s_sys); filter (f_user); destination (d_snmptraps); };
log { source (s_sys); filter (f_lpr); destination (d_lpr); destination (d_archive); };
log { source (s_sys); filter (f_news); destination (d_news); destination (d_archive); };
log { source (s_sys); filter (f_uucp); destination (d_uucp); destination (d_archive); };
log { source (s_sys); filter (f_local0); destination (d_local0); destination (d_archive); };
log { source (s_sys); filter (f_local1); destination (d_local1); destination (d_archive); };
log { source (s_sys); filter (f_local2); destination (d_local2); destination (d_archive); };
log { source (s_sys); filter (f_local3); destination (d_local3); destination (d_archive); };
log { source (s_sys); filter (f_local4); destination (d_local4); destination (d_archive); };
log { source (s_sys); filter (f_local5); destination (d_local5); destination (d_archive); };
log { source (s_sys); filter (f_local6); destination (d_local6); destination (d_archive); };
log { source (s_sys); filter (f_local7); destination (d_local7); destination (d_archive); };
- ------< SNIP >-------

Anybody else having this problem? Any hope we can nail this down?

- - Michael


-----BEGIN PGP SIGNATURE-----
Version: PGP Desktop 10.0.3 (Build 1)
Charset: us-ascii

wsBVAwUBTrmaT5bfnpCg64TVAQE3JAf+KCFVzUL/MGWTgMqRLowtYRDhT8NtThnL
p4bRqDqggXjJR8eQhY8dRKyi7zSN+T59WnGunCA2WD98hX5+bUWtyR3yVs5GH4KK
XplVrpoPzJNOQFnPrjnrg0VGahO83XMO0nIcS5HdgId8hsGgKKknkWosDTFl97J+
IPxQeqoVuj92DT9MSm00z6SLrX9XtD4dK762zcQ2Tsvz9j9KW21jiWo9sUor6Lpe
Dh4Mle0V/dGJOBi7j7UiQOSQCRikl20zTZtId7wsFqsDVGSFlOKTvW+l3XLok0KU
ufVnI46N8mrnUWFqDU5SQ952gelIsIAdj6UUwKioZQMafeZvvRLwFA==
=9NxF
-----END PGP SIGNATURE-----