- syslog-ng - lists.balabit.hu

Fix for bug 162 in an official release yet?
by Mr. Jan Walter 26 Mar '12

26 Mar '12

We're running into the frame header issue a lot in our deployment environment, so I am wondering if the fix, committed the day before the 3.3.4 release, made it into 3.3.4. It's not in the changelog posted, but given the dates, it was worth the question. https://bugzilla.balabit.com/show_bug.cgi?id=162 Did it? Cheers, Jan

2 3

Installing syslog-ng 3.3.4 OSS on multiple Centos servers
by Srinivasan Subramanian 26 Mar '12

26 Mar '12

Hi I have a need to install syslog-ng 3.3.4 on multiple Centos servers. Unfortunately i am unable to find RPMs for the newer versions and only find the source downloads. 1. Any links to contributed repositories for Centos 5.x?2. Alternatively can anyone point me to Source RPMs for Centos 5.x so that I can at least make the RPMs myself? Even EPEL 6 I find only 3.2.x source RPMs RegardsSrini

6 5

RFC: Removing the 'dummy' module
by Gergely Nagy 23 Mar '12

23 Mar '12

Hi! syslog-ng comes with a 'dummy' module, that does nothing, but emit a notice whenever it receives a message. I doubt anyone uses it, because it is useless, and serves as an aid for module writers only, as a skeleton to build on. However, it is built AND installed by default, which is kinda awkward, in my opinion, and perhaps a bit confusing too: when I see a dummy module automatically installed, I start to wonder just what the heck it is good for and why it is there in the first place? Since it's completely useless, I'd like to propose either of the following: 1) Remove the module completely from the source code. The rationale behind this is that it's a very basic example, shows very little about how a destination driver should work, and is even a little bit stale here and there. For example, the grammar directly pokes the driver structure, which is a bad habit (accessors are a whole lot better!). Furthermore, when I wanted to write a driver, I looked at the dummy driver first, but after a couple of minutes, I concluded it has so very little information, that it's not enough for me as a starting point. So I started to look at other drivers, and learned from there. In that sense, it doesn't even succeed at being a reasonable skeleton, or starting point. A HOWTO document, or something similar about the architecture of the various drivers would be much much more useful, but this document is yet to be written. 2) Keep the module, but don't install it, ever. As a compromise, the module could be kept, but not installed. This way we still have a very small example, but it's not installed needlessly. I think it's obvious I'd rather go with the first option, but perhaps there's good reasons for keeping it, that I overlooked. The decision is in Bazsi's hand, anyway. -- |8]

2 1

[Bug 154] New: Processes forked via program() do not properly terminate
by bugzilla＠bugzilla.balabit.com 23 Mar '12

23 Mar '12

https://bugzilla.balabit.com/show_bug.cgi?id=154 Summary: Processes forked via program() do not properly terminate Product: syslog-ng Version: 3.2.x Platform: Other OS/Version: Solaris Status: NEW Severity: normal Priority: unspecified Component: syslog-ng AssignedTo: bazsi(a)balabit.hu ReportedBy: hendrik.volker(a)de.verizonbusiness.com Type of the Report: --- Estimated Hours: 0.0 I am using a SyslogNG 3.2.4 build for our company internal version of Solaris 10 on some SUN V245 SPARC servers. In a project I am using the following config: ---8<--- source s_whsvoipgwv2_ngrep_bge1 { program ( "/prod/tools/ngrep -d bge1 -t -q -W single SIP port 5060" flags (no-parse) tags ("IF1") ); }; parser p_whsvoipgwv2_ngrep { csv-parser ( columns ("NGREP.PROTO" "NGREP.DATE", "NGREP.TIME", "NGREP.SRCADDR", "NGREP.DUMMY", "NGREP.DSTADDR", "NGREP.MSG" ) flags (drop-invalid, escape-none, greedy, strip-whitespace) delimiters (" ") ); }; template t_whsvoipgwv2_ngrep { template ( "$MONTH_ABBREV $DAY ${NGREP.TIME} $HOST ${NGREP.PROTO} ${NGREP.SRCADDR} ${NGREP.DSTADDR} ${ NGREP.MSG}\n" ); }; destination d_whsvoipgwv2_sip_voipslp { file ("/var/home/voipslp/sip/sip.$YEAR$MONTH$DAY$HOUR.log" owner("voipslp") group("voipsl") perm(0644) template(t_whsvoipgwv2_ngrep) ); }; log { source(s_whsvoipgwv2_ngrep_bge1); parser(p_whsvoipgwv2_ngrep); destination(d_whsvoipgwv2_sip_voipslp); flags (final); }; ---8<--- With the log file rotation every hour it seems that SyslogNG is starting new instances of ngrep, while not terminating the old instances. This results in lots! of running but unused ngreps. -- Configure bugmail: https://bugzilla.balabit.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

2 11

[Bug 150] New: Possible memory leak for TLS connections
by bugzilla＠bugzilla.balabit.com 23 Mar '12

23 Mar '12

https://bugzilla.balabit.com/show_bug.cgi?id=150 Summary: Possible memory leak for TLS connections Product: syslog-ng Version: 3.3.x Platform: PC OS/Version: Linux Status: NEW Severity: normal Priority: unspecified Component: syslog-ng AssignedTo: bazsi(a)balabit.hu ReportedBy: eric(a)sevenscale.com Type of the Report: --- Estimated Hours: 0.0 I've noticed that memory usage seems to grow as clients using TLS connect and disconnect. I ran syslog-ng under valgrind while I caused a number of clients to connect and disconnect a few times and saved the leak summary from valgrind: https://gist.github.com/893a9687bf98dc53f0e7 -- Configure bugmail: https://bugzilla.balabit.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 6

json configure problem in 3.4
by Peter Czanik 23 Mar '12

23 Mar '12

Hello, First I ran into this on FreeBSD, but now also checked on Linux. If I run configure without arguments, then json is found by configure: JSON support (module) : parser=yes, formatter=yes (using json-c) On the other hand, if I run: ./configure --with-json=json-c Then it fails with: configure: error: Cannot find json-c version >= 0.9: is pkg-config in path? Also, there is no way to disable json support, which is a problem for packagers or the FreeBSD ports system. A "--with-json=none" could solve this. Bye, -- Peter Czanik (CzP)<czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

2 1

segfault in 3.4 alpha1
by Peter Czanik 23 Mar '12

23 Mar '12

Hello, I tried to compile and run alpha1 on openSUSE 12.1 and FreeBSD 8.1. I got a segfault on start on both. Here are the backtraces: fb81# gdb74 -c syslog-ng.core /usr/local/sbin/syslog-ng GNU gdb (GDB) 7.4 [GDB v7.4 for FreeBSD] Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd8.1". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/local/sbin/syslog-ng...(no debugging symbols found)...done. [New process 100055] [New Thread 8018041c0 (LWP 100055)] Core was generated by `syslog-ng'. Program terminated with signal 11, Segmentation fault. #0 file_perm_options_set_file_perm (self=0x0, file_perm=384) at file-perms.c:60 60 file-perms.c: No such file or directory. (gdb) backtrace #0 file_perm_options_set_file_perm (self=0x0, file_perm=384) at file-perms.c:60 #1 0x0000000801c0cda0 in afsocket_parse (lexer=0x80196b000, instance=0x7fffffffc788, arg=0x0) at afsocket-grammar.y:1186 #2 0x000000080068b4f3 in cfg_parser_parse (arg=<optimized out>, instance=<optimized out>, lexer=0x80196b000, self=0x801d16fc0) at cfg-parser.h:83 #3 plugin_parse_config (self=0x801d174b0, cfg=<optimized out>, yylloc=<optimized out>, arg=0x0) at plugin.c:211 #4 0x0000000800698730 in main_parse (lexer=0x80196b000, dummy=0x7fffffffec48, arg=0x0) at cfg-grammar.y:518 #5 0x0000000800669ef9 in cfg_parser_parse (arg=<optimized out>, instance=<optimized out>, lexer=<optimized out>, self=<optimized out>) at cfg-parser.h:83 #6 cfg_run_parser (self=0x801949180, lexer=0x80196b000, parser=0x8007c4140, result=0x7fffffffec48, arg=0x801c0f760) at cfg.c:316 #7 0x000000080066a006 in cfg_read_config (self=0x801949180, fname=0x8006ab16b "/usr/local/etc/syslog-ng.conf", syntax_only=<optimized out>, preprocess_into=0x0) at cfg.c:347 #8 0x0000000800685baa in main_loop_init () at mainloop.c:674 #9 0x000000000040171f in main () (gdb) And the same core file with gdb from the base system: fb81# gdb -c syslog-ng.core /usr/local/sbin/syslog-ng GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... Core was generated by `syslog-ng'. Program terminated with signal 11, Segmentation fault. Reading symbols from /usr/local/lib/libsyslog-ng-3.4.0alpha1.so...done. Loaded symbols for /usr/local/lib/libsyslog-ng-3.4.0alpha1.so Reading symbols from /usr/local/lib/libnet115/libnet.so.7...done. Loaded symbols for /usr/local/lib/libnet115/libnet.so.7 Reading symbols from /usr/lib/librt.so.1...done. Loaded symbols for /usr/lib/librt.so.1 Reading symbols from /usr/local/lib/libgmodule-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgmodule-2.0.so.0 Reading symbols from /usr/local/lib/libgthread-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgthread-2.0.so.0 Reading symbols from /usr/local/lib/libglib-2.0.so.0...done. Loaded symbols for /usr/local/lib/libglib-2.0.so.0 Reading symbols from /usr/local/lib/libintl.so.9...done. Loaded symbols for /usr/local/lib/libintl.so.9 Reading symbols from /usr/local/lib/libiconv.so.3...done. Loaded symbols for /usr/local/lib/libiconv.so.3 Reading symbols from /usr/local/lib/libevtlog.so.0...done. Loaded symbols for /usr/local/lib/libevtlog.so.0 Reading symbols from /usr/local/lib/libpcre.so.1...done. Loaded symbols for /usr/local/lib/libpcre.so.1 Reading symbols from /lib/libthr.so.3...done. Loaded symbols for /lib/libthr.so.3 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/syslog-ng/libconfgen.so...done. Loaded symbols for /usr/local/lib/syslog-ng/libconfgen.so Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /usr/local/lib/syslog-ng/libafsocket.so...done. Loaded symbols for /usr/local/lib/syslog-ng/libafsocket.so Reading symbols from /usr/local/lib/syslog-ng/libsyslog-ng-crypto.so...done. Loaded symbols for /usr/local/lib/syslog-ng/libsyslog-ng-crypto.so Reading symbols from /usr/local/lib/libcrypto.so.7...done. Loaded symbols for /usr/local/lib/libcrypto.so.7 Reading symbols from /usr/local/lib/libssl.so.7...done. Loaded symbols for /usr/local/lib/libssl.so.7 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 file_perm_options_set_file_perm (self=0x0, file_perm=384) at file-perms.c:60 60 file-perms.c: No such file or directory. in file-perms.c [New Thread 8018041c0 (LWP 100055)] (gdb) backtrace #0 file_perm_options_set_file_perm (self=0x0, file_perm=384) at file-perms.c:60 #1 0x0000000801c0cda0 in afsocket_parse (lexer=0x80196b000, instance=0x7fffffffc788, arg=0x0) at afsocket-grammar.y:1186 #2 0x000000080068b4f3 in plugin_parse_config (self=0x801d174b0, cfg=Variable "cfg" is not available. ) at cfg-parser.h:83 #3 0x0000000800698730 in main_parse (lexer=0x80196b000, dummy=0x7fffffffec48, arg=0x0) at cfg-grammar.y:518 #4 0x0000000800669ef9 in cfg_run_parser (self=0x801949180, lexer=0x80196b000, parser=0x8007c4140, result=0x7fffffffec48, arg=Variable "arg" is not available. ) at cfg-parser.h:83 #5 0x000000080066a006 in cfg_read_config (self=0x801949180, fname=0x8006ab16b "/usr/local/etc/syslog-ng.conf", syntax_only=Variable "syntax_only" is not available. ) at cfg.c:347 #6 0x0000000800685baa in main_loop_init () at mainloop.c:674 #7 0x000000000040171f in main () (gdb) This binary was compiled by copying sysutils/syslog-ng port to syslog-ng-devel, adding --enable-debug to configure args. I ran into one more interesting thing: with json-c enabled in "make config", configure failed with: configure: error: Cannot find json-c version >= 0.9: is pkg-config in path? When disabled json-c in "make config" it was found by configure and was built. The relevant part of "Makefile" is: .if defined(WITH_JSON_GLIB) LIB_DEPENDS+= json-glib-1.0.0:${PORTSDIR}/devel/json-glib CONFIGURE_ARGS+= --enable-json --with-json=json-glib PLIST_FILES+= lib/syslog-ng/libtfjson.la lib/syslog-ng/libtfjson.so .elif defined(WITH_JSON_C) LIB_DEPENDS+= json.0:${PORTSDIR}/devel/json-c CONFIGURE_ARGS+= --enable-json --with-json=json-c PLIST_FILES+= lib/syslog-ng/libtfjson.la lib/syslog-ng/libtfjson.so .else CONFIGURE_ARGS+= --disable-json .endif So, in theory json support was disabled... And another backtrace, this time from openSUSE: (gdb) backtrace #0 0xb7684e8d in cfg_tree_compile_node () from /lib/libsyslog-ng-3.4.0alpha1.so #1 0xb7684f60 in cfg_tree_compile_node () from /lib/libsyslog-ng-3.4.0alpha1.so #2 0xb7685557 in cfg_tree_compile_rule () from /lib/libsyslog-ng-3.4.0alpha1.so #3 0xb7685954 in cfg_tree_compile () from /lib/libsyslog-ng-3.4.0alpha1.so #4 0xb76859ee in cfg_tree_start () from /lib/libsyslog-ng-3.4.0alpha1.so #5 0xb76808c0 in cfg_init () from /lib/libsyslog-ng-3.4.0alpha1.so #6 0xb76a07ea in main_loop_init () from /lib/libsyslog-ng-3.4.0alpha1.so #7 0x080491a7 in main () (gdb) Bye, -- Peter Czanik (CzP)<czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

3 11

afsmtp packaging problems
by Peter Czanik 23 Mar '12

23 Mar '12

Hello, There are a couple of problem with smtp support. Tested on openSUSE and FreeBSD. Neither have libesmtp installed, at least not as default. So configure is right: SMTP support (module) : no On the other hand: - libafsmtp is built and installed - unlike the others, it is installed as a versioned library: linux-v3g3:~ # ls -l /lib/syslog-ng/ total 556 -rwxr-xr-x 1 root root 73212 Mar 21 09:14 libaffile.so -rwxr-xr-x 1 root root 48567 Mar 21 09:14 libafprog.so lrwxrwxrwx 1 root root 18 Mar 21 09:18 libafsmtp.so -> libafsmtp.so.0.0.0 lrwxrwxrwx 1 root root 18 Mar 21 09:18 libafsmtp.so.0 -> libafsmtp.so.0.0.0 -rwxr-xr-x 1 root root 6445 Mar 21 09:14 libafsmtp.so.0.0.0 -rwxr-xr-x 1 root root 118106 Mar 21 09:14 libafsocket.so -rwxr-xr-x 1 root root 34040 Mar 21 09:14 libafuser.so -rwxr-xr-x 1 root root 23092 Mar 21 09:14 libbasicfuncs.so -rwxr-xr-x 1 root root 11819 Mar 21 09:14 libconfgen.so -rwxr-xr-x 1 root root 38464 Mar 21 09:14 libcsvparser.so -rwxr-xr-x 1 root root 105045 Mar 21 09:14 libdbparser.so -rwxr-xr-x 1 root root 33668 Mar 21 09:14 libdummy.so -rwxr-xr-x 1 root root 21134 Mar 21 09:14 libsyslogformat.so -rwxr-xr-x 1 root root 28448 Mar 21 09:14 libsyslog-ng-crypto.so -rwxr-xr-x 1 root root 7339 Mar 21 09:14 libtfuuid.so ToDo: - option to disable smtp support - do not build/install it if build dependency is unavailable - do not install it as a versioned library Bye, -- Peter Czanik (CzP)<czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

2 1

Syslog-NG forwarding the messages to a Remote TCP port with more than one message in a single packet
by anji prassana 18 Mar '12

18 Mar '12

I am using syslog-ng *version * [root@Cypher-210 ~]# /usr/local/sbin/syslog-ng -V syslog-ng 3.3.3 Installer-Version: 3.3.3 Revision: ssh+git://bazsi@git.balabit //var/scm/git/syslog-ng/syslog-ng-ose--mainline--3.3#master#d199a1980be6b23fe24189e86a882812288e292c Compile-Date: Mar 6 2012 13:06:17 Default-Modules: affile,afprog,afsocket,afuser,basicfuncs,csvparser,parser,syslogformat Available-Modules: afprog,convertfuncs,affile,afsocket-tls,confgen,csvparser,syslogformat,dbparser,basicfuncs,afmongodb,dummy,afuser,afsocket Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: on Enable-Linux-Caps: on Enable-Pcre: on Problem: ------------ Syslog-ng is forwarding the TCP packets to a Remote TCP port with More than one message in a single TCP Packet.But, in between the messages inside a packet, It doesn't includes any delimiter like "\n" or some other.But, the receiving Program listens on TCP requires a newline as a delimiter b/w messages so as to parse the messages individually. But, As Syslog-ng doesn't includes a separator b/w messages in a packet, The Receiver simply considering whole messages in a packet as a single Message which leads to false and unacceptable parsing. Please look into the following messages exists in a single TCP packet.The one I colored red is a start of new message. root : tty=unknown ; pwd=/ ; user=root ; command=/bin/grep ^shutdown: /etc/shadow *<13>*mar 6 17:22:15 cypher-210 sudo: root : tty=unknown ; pwd=/ ; user=root ; command=/usr/bin/head -n 4 /etc/inittab *<13>*mar 6 17:22:15 cypher-210 sudo: root : tty=unknown ; pwd=/ ; user=root ; command=/usr/bin/tail -n 1 *<13>*mar 6 17:22:15 cypher-210 sshd[5583]: pam_unix(sshd:session): session opened for user root by (uid=0) *<13>*mar 6 17:22:15 cypher-210 sshd[5765]: accepted password for root from 10.0.15.218 port 44258 ssh2 <13>mar 6 17:22:15 cypher-210 sshd[5765]: pam_unix(sshd:session): session opened for user root by (uid=0) *<13>*mar 6 17:22:16 cypher-210 sshd[5278]: pam_unix(sshd:session): session closed for user root *<13>*mar 6 17:22:17 cypher-210 pam_timestamp_check: pam `/' permissions are lax <13>mar 6 17:22:17 cypher-210 sshd[5281]: pam_unix(sshd:session): session closed for user root *<13>*mar 6 17:22:17 cypher-210 sudo: root : tty=unknown ; pwd=/ ; user=root ; command=/bin/grep ^shutdown: /etc/shad These are the settings i made in the syslog-ng.conf file: source s_test { internal(); unix-stream("/dev/log"); udp(); file("/var/log/syslog-ng_local"); }; destination d_test { tcp("10.0.15.18" port(9500)); #My Program listening on tcp port 9500 requires newline as a separator for each message. }; log { source(s_test); destination(d_test); }; Can anyone kindly help me, 1. How can i limit one tcp packet to hold only one message? [or] 2. How can I add newline as a delimiter b/w each message before the packet(s) are forwarding to a destination so that it could parse properly? Your Help is really appreciate.. Thanks&Regards Anjaneyulu P

3 3

Packet fragmentation issue
by José Moreno 18 Mar '12

18 Mar '12

Hi all, I'm running syslog-ng 2.4.1, log sources send to a log server which beside keeping the original data as is in files, forwards them in real time to a SIEM, spoofing source IP. My problem comes after some logs are too long to fit in a single frame, log server fragments those packets when sending them to SIEM and spoofing is not performed for them. Enviado desde mi iPhone

4 5