- syslog-ng - lists.balabit.hu

syslog-ng-3.4.0alpha2 syslog-ng binary failure for server instance.
by anju.raveendrannair＠wipro.com 08 Jun '12

08 Jun '12

Hi, We are using syslog-ng-3.4.0alpha2 binary and trying to run the syslog-ng server configuration file, but its not starting the syslog ng server. We are getting the following error incase of f__nonconsole_access filter when we ran the syslog-ng binary in debug mode. Filter rule evaluation result; result='match', rule='f_nonconsole_access', location='/ne_data/conf/syslogng/syslog-ng_server.conf:58:29' ** ERROR:logmsg.c:535:log_msg_set_value_indirect: assertion failed: (!log_msg_is_write_protected(self)) Abort (core dumped) PFA the debug.log The server conf is having the following line for the above mentioned filter, template ltemgr_msg_template { template("$S_ISODATE $HOST $FACILITY_NUM/$LEVEL_NUM $MSG\n"); }; #To strip of the msg_id introduced by syslogd rewrite rw_msg{subst("\\[.*\\]", "", value("MESSAGE"));}; source s_LTEMGR_SYSLOG_CLIENTS{ tcp (ip (27.132.98.69) port(6515) max-connections(4) tls( key_file("/ne_data/conf/certificates/MOCM/MOCM_key.pem") cert_file("/ne_data/conf/certificates/MOCM/MOCM_SB_server.pem") ca_dir("/ne_data/conf/certificates/SYSLOGNG") cipher_suite("ALL:!aNULL:!ADH:!eNULL:!LOW:!EXP:RC4+RSA:+HIGH:+MEDIUM:!SSLv2") peer_verify(optional-untrusted) ) ); }; ....... destination d_ltemgr_nonconsoleaccess_log {file("/ne_data/syslog/ems" perm(0644) template(ltemgr_msg_template)); }; ...... filter f_nonconsole_access { level(info..notice) and facility(auth) and ( match("Accepted password for" value("MESSAGE")) or match("Failed password for" value("MESSAGE")) ); }; ..... log { source(s_LTEMGR_SYSLOG_CLIENTS); filter(f_nonconsole_access); rewrite(rw_msg); destination(d_ltemgr_nonconsoleaccess_log); }; Without debug mode, we were able to run the server but central logging is not happening when tried with logger command. Thanks, Anju Please do not print this email unless it is absolutely necessary. The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com

1 0

[Bug 182] New: Support utmpx in afuser, along with the legacy utmp
by bugzilla＠bugzilla.balabit.com 08 Jun '12

08 Jun '12

https://bugzilla.balabit.com/show_bug.cgi?id=182 Summary: Support utmpx in afuser, along with the legacy utmp Product: syslog-ng Version: 3.3.x Platform: PC OS/Version: FreeBSD Status: ASSIGNED Severity: normal Priority: unspecified Component: syslog-ng AssignedTo: algernon(a)balabit.hu ReportedBy: algernon(a)balabit.hu Type of the Report: --- Estimated Hours: 0.0 FreeBSD 9 had utmp support removed, so in the ports tree they were doing some sed magic to convert from utmp to utmpx. Instead of that, we should support both, and prefer utmpx if both are supported (like on Linux). A patch to implement this, based on the sed magic, and a patch by Alex Zimnitsky is available on the hotfix/3.3/fbsd9-utmpx branch of my git repo. Once tested, I will merge it to master. The commit in question is available at https://github.com/algernon/syslog-ng/commit/4b450a09da83bc8e27bd7c8adccea3… -- Configure bugmail: https://bugzilla.balabit.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 2

[PATCH] afuser: Use utmpx when available, instead of utmp
by Gergely Nagy 08 Jun '12

08 Jun '12

FreeBSD 9 removed support for utmp, and one must use the POSIX-specified utmpx instead. The same utmpx is available on Linux too (and it is the same as utmp there). The patch below converts afuser to use utmpx when available, utmp otherwise. It is based on the post-build sed magic applied to syslog-ng within the FreeBSD ports collection, with other bits based on a patch from Alex Zimnitsky. Signed-off-by: Gergely Nagy <algernon(a)balabit.hu> --- configure.in | 4 ++-- lib/utils.c | 4 +++- lib/utils.h | 7 ++++++- modules/afuser/afuser.c | 20 +++++++++++++++++++- 4 files changed, 30 insertions(+), 5 deletions(-) diff --git a/configure.in b/configure.in index aafb980..c76d7d9 100644 --- a/configure.in +++ b/configure.in @@ -383,7 +383,7 @@ dnl *************************************************************************** AC_HEADER_STDC AC_CHECK_HEADER(dmalloc.h) -AC_CHECK_HEADERS(strings.h getopt.h stropts.h sys/strlog.h door.h sys/capability.h sys/prctl.h) +AC_CHECK_HEADERS(strings.h getopt.h stropts.h sys/strlog.h door.h sys/capability.h sys/prctl.h utmpx.h) AC_CHECK_HEADERS(tcpd.h) @@ -479,7 +479,7 @@ if test "x$enable_linux_caps" = "xyes" -o "x$enable_linux_caps" = "xauto"; then AC_CHECK_LIB(cap, cap_set_proc, LIBCAP_LIBS="-lcap") fi -AC_CHECK_FUNCS(strdup strtol strtoll strtoimax inet_aton inet_ntoa getopt_long getaddrinfo getutent pread pwrite strcasestr memrchr localtime_r gmtime_r) +AC_CHECK_FUNCS(strdup strtol strtoll strtoimax inet_aton inet_ntoa getopt_long getaddrinfo getutent getutxent pread pwrite strcasestr memrchr localtime_r gmtime_r) old_LIBS=$LIBS LIBS=$BASE_LIBS AC_CHECK_FUNCS(clock_gettime) diff --git a/lib/utils.c b/lib/utils.c index 2b5c525..1f06e12 100644 --- a/lib/utils.c +++ b/lib/utils.c @@ -33,7 +33,9 @@ #include <netinet/in.h> #include <arpa/inet.h> #include <fcntl.h> +#if HAVE_UTMP_H #include <utmp.h> +#endif #include "utils.h" @@ -47,7 +49,7 @@ int inet_aton(const char *cp, struct in_addr *addr) } #endif -#ifndef HAVE_GETUTENT +#if !defined(HAVE_GETUTENT) && !defined(HAVE_GETUTXENT) && defined(HAVE_UTMP_H) static int utent_fd = -1; diff --git a/lib/utils.h b/lib/utils.h index 86e3a7f..a0f3dcc 100644 --- a/lib/utils.h +++ b/lib/utils.h @@ -28,13 +28,18 @@ #include <sys/types.h> #include <sys/socket.h> #include <netinet/in.h> + +#ifdef HAVE_UTMPX_H +#include <utmpx.h> +#else #include <utmp.h> +#endif #ifndef HAVE_INET_ATON int inet_aton(const char *cp, struct in_addr *addr); #endif -#ifndef HAVE_GETUTENT +#if !defined(HAVE_GETUTENT) && !defined(HAVE_GETUTXENT) struct utmp *getutent(void); void endutent(void); #endif diff --git a/modules/afuser/afuser.c b/modules/afuser/afuser.c index 8f170e5..7d082b2 100644 --- a/modules/afuser/afuser.c +++ b/modules/afuser/afuser.c @@ -25,7 +25,13 @@ #include "alarms.h" #include "messages.h" +#ifdef HAVE_UTMPX_H +#include <utmpx.h> +#define ut_name ut_user +#else #include <utmp.h> +#endif + #include <string.h> #include <fcntl.h> #include <unistd.h> @@ -46,7 +52,11 @@ afuser_dd_queue(LogPipe *s, LogMessage *msg, const LogPathOptions *path_options, { AFUserDestDriver *self = (AFUserDestDriver *) s; gchar buf[8192]; +#ifdef HAVE_UTMPX_H + struct utmpx *ut; +#else struct utmp *ut; +#endif GString *timestamp; time_t now; @@ -63,7 +73,11 @@ afuser_dd_queue(LogPipe *s, LogMessage *msg, const LogPathOptions *path_options, g_string_free(timestamp, TRUE); /* NOTE: there's a private implementations of getutent in utils.c on Systems which do not provide one. */ - while ((ut = getutent())) +#ifdef HAVE_GETUTXENT + while ((ut = getutxent())) +#else + while ((ut = getutent())) +#endif { #if HAVE_MODERN_UTMP if (ut->ut_type == USER_PROCESS && @@ -106,7 +120,11 @@ afuser_dd_queue(LogPipe *s, LogMessage *msg, const LogPathOptions *path_options, } } } +#if HAVE_UTMPX_H + endutxent(); +#else endutent(); +#endif finish: log_msg_ack(msg, path_options); log_msg_unref(msg); -- 1.7.9

1 0

pattern tags in syslog
by system＠ra-schaal.de 08 Jun '12

08 Jun '12

Hi all, i´ve a problem with pdbtool / using tags with syslog 3.3.5: If I tag a message inside a pattern containing a "-", the tags are not used within syslog and "pbtool match": <ruleset id='c5a92074c59aca552764af9037cd895b' name='mirror'> <pattern>clam-clientsync</pattern> <rules> <rule class='mirror' id='c5a92074c59aca552764af9037cd895b' provider='fs'> <patterns> <pattern>safebrowsing</pattern> <pattern>deleting</pattern> <pattern>main</pattern> <pattern>daily</pattern> <pattern>bytecode</pattern> <pattern>local_blacklist_apache</pattern> <pattern>timestamp</pattern> <pattern>sent @NUMBER::@ bytes</pattern> <pattern>total size is @NUMBER::@</pattern> </patterns> <tags> <tag>clamav-mirror</tag> </tags> </rule> </rules> </ruleset> # pdbtool match -p mirror.pdb -P clam-clientsync -M "safebrowsing" -D Pattern matching part: safebrowsing Matching part: safebrowsing Values: MESSAGE=safebrowsing PROGRAM=clam-clientsync .classifier.class=mirror .classifier.rule_id=c5a92074c59aca552764af9037cd895b TAGS= BTW: if I skip "-D" everything is fine. But in my syslog-ng.conf i can´t use clamav-mirror in the filter. Instead I must use clamavmirror: filter f_rsync_clamav { tags("clamavmirror"); }; tags("clamav-mirror") won´t work.

1 0

Writes garbled kernel messages to logs
by shih dane 08 Jun '12

08 Jun '12

Hi All Lately I've setup syslog server on Fedora 12 l want to get iscsi connection log but get some garbled kernel messages syslog-ng version : syslog-ng 3.3.1 syslog-ng.conf @version: 3.3 @include "scl.conf" options { stats_freq(0); create_dirs(yes); dir_perm(0777); perm(0644); }; source src { system(); internal(); udp(); }; destination information { file("/raid/syslog/information"); }; destination error { file("/raid/syslog/error"); }; destination warning { file("/raid/syslog/warning"); }; filter f_info { level(info); }; filter f_error { level(error); }; filter f_warning { level(warning); }; log { source(src); filter(f_info); destination(information); }; log { source(src); filter(f_error); destination(error); }; log { source(src); filter(f_warning); destination(warning); }; Thanks for any advice Best Regard Dane

1 0

Snare TAB characters converted to \011 are missing?
by Clayton Dukes 07 Jun '12

07 Jun '12

Hi All, I have a user receiving messages from Snare but, for some reason, syslog-ng doesn't appear to be converting the TAB characters properly. Snare sends messages as: HostName<TAB>MSWinEventLog<TAB>Criticality<TAB>EventLogSource<TAB>SnareCounter<TAB>SubmitTime<TAB>EventID<TAB>SourceName<TAB>UserName<TAB>SIDType<TAB>EventLogType<TAB>ComputerName<TAB>CategoryString<TAB>DataString<TAB>ExpandedString<TAB>MD5 checksum (optional) I have verified using a sniffer on the syslog-ng server that the message format is coming in correctly with the TABs, but somehow the messages are leaving syslog-ng as: ...snip (full message clipped for brevity) Tue Jun 05 11:09:27 2012592SecuritySYSTEMUserSuccess Audit ...snip In the example above, it should be: Tue Jun 05 11:09:27 2012\011592\011Security\011SYSTEM\011User\011Success Audit I've checked his syslog-ng.conf file and it is the normal one that comes with Ubuntu 12.4 LTS. Any idea what might be causing this? ______________________________________________________________ Clayton Dukes ______________________________________________________________

1 1

syslog-ng Insider - June 2012
by Peter Czanik 07 Jun '12

07 Jun '12

Dear syslog-ng users, This is the 14th issue of the syslog-ng Insider, a monthly newsletter that brings you syslog-ng related news. Your feedback and news tips about the next issue is welcome at documentation(a)balabit.com <mailto:documentation@balabit.com> FEATURED NEWS New features in syslog-ng 3.4 ----------------------------- The CEE/Lumberjack project might be very silent recently, but is still a good excuse to demonstrate some of the new features of syslog-ng 3.4. These make implementing structured logging (and this way CEE) possible by adding a JSON parser, marker detection, channels and junctions and a flexible use of blocks, so complex configurations can be combined in a block and easily reused in many configs. For details and examples check: http://bazsi.blogs.balabit.com/2012/05/cee-prototype-and-a-show-case-for-th… Version 3.4 also merges many features from syslog-ng PE, which can be followed in git commit messages. These include the SYSUPTIME macro, AM/PM related macros, test cases, support for Cisco sequence numbers, etc. Git commits: https://github.com/bazsi/syslog-ng-3.4/commits/master Message rate alerting in SSB ---------------------------- Even though syslog-ng Store Box neither is nor aims to be a full-blown SIEM solution, it can be and is indeed often used to detect anomalies, identify possible threats, and find problems within an organization's IT infrastructure. One important thing to note is that it is not only the contents of log messages that carry information about what happens in the network but their volume too. Read how message rate alerting works in SSB at http://gyp.blogs.balabit.com/2012/06/new-features-in-ssb-3-lts-message-rate… syslog-ng 3.3 has a new maintainer ---------------------------------- As Bazsi, lead developer of syslog-ng announced on the syslog-ng mailing list, the stable version has now a new maintainer. He is Gergely Nagy, or better known as Algernon, who coded some interesting new features for syslog-ng, including a MongoDB destination, and a JSON output and parser (for 3.4). This change will leave Bazsi more time for 3.4 developments and also speed up merging bugfixes to the 3.3 line. Announcement: https://lists.balabit.hu/pipermail/syslog-ng/2012-May/018885.html Algernon's plans: http://algernon.blogs.balabit.com/2012/05/hats-and-sticks/ syslog-ng community forum ------------------------- For those, who prefer to use web based forums instead of mailing lists, BalaBit provides now a community forum. Right now there are over forty users and their number is growing every day. If you want to read about interesting topics, or could help fellow users using a forum instead of the mailing list, please visit the forum at http://communities.balabit.com/balabit OTHER SHORT NEWS * Follow syslog-ng development on twitter: http://twitter.com/bazsi771 * FreeBSD users love syslog-ng: http://czanik.blogs.balabit.com/2012/06/freebsd-pfsense-and-syslog-ng/ NEW RELEASES: * SSB (syslog-ng store box) 3LTS: http://andrea.blogs.balabit.com/2012/05/balabit-announces-new-release-of-it… ARCHIVE http://insider.blogs.balabit.com/ -- Peter Czanik (CzP)<czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

1 0

[Bug 176] New: iv_event_raw module doesn't work on mips64el n32, missing include
by bugzilla＠bugzilla.balabit.com 05 Jun '12

05 Jun '12

https://bugzilla.balabit.com/show_bug.cgi?id=176 Summary: iv_event_raw module doesn't work on mips64el n32, missing include Product: syslog-ng Version: 3.3.x Platform: Other OS/Version: Linux Status: NEW Severity: normal Priority: unspecified Component: syslog-ng AssignedTo: bazsi(a)balabit.hu ReportedBy: mads(a)ab3.no Type of the Report: bug Estimated Hours: 0.0 Created an attachment (id=57) --> (https://bugzilla.balabit.com/attachment.cgi?id=57) iv_event_raw.c patch, missing include I have a Lemote Fuloong 2F mips64el (n32) machine running Gentoo, the uname looks like this: Linux Lemote 3.3.0 #5 PREEMPT Wed Apr 18 13:25:19 CEST 2012 mips64 ICT Loongson-2 V0.3 FPU V0.1 lemote-fuloong-2f-box GNU/Linux This machine doesn't get updated that often, so I didn't discover that syslog-ng didn't work before I updated syslog-ng to version 3.3.4 and then later 3.3.5 recently. Tested with glibc 2.14 and 2.15. Running syslog-ng -d: eventfd2: Invalid argument Trying to open module; module='affile', filename='/usr/lib32/syslog-ng/libaffile.so' Trying to open module; module='afprog', filename='/usr/lib32/syslog-ng/libafprog.so' Trying to open module; module='afsocket', filename='/usr/lib32/syslog-ng/libafsocket.so' Trying to open module; module='afuser', filename='/usr/lib32/syslog-ng/libafuser.so' Trying to open module; module='basicfuncs', filename='/usr/lib32/syslog-ng/libbasicfuncs.so' Trying to open module; module='csvparser', filename='/usr/lib32/syslog-ng/libcsvparser.so' Trying to open module; module='dbparser', filename='/usr/lib32/syslog-ng/libdbparser.so' Trying to open module; module='syslogformat', filename='/usr/lib32/syslog-ng/libsyslogformat.so' Running application hooks; hook='1' Running application hooks; hook='3' syslog-ng starting up; version='3.3.5' eventfd2: Invalid argument eventfd2: Invalid argument eventfd2: Invalid argument eventfd2: Invalid argument eventfd2: Invalid argument Segmentation fault I checked the file lib/ivykis/modules/iv_event_raw.c as it was the only file calling the eventfd2 syscall, and I noticed that it defines EFD_NONBLOCK and EFD_CLOEXEC if it's not already defined by the includes. I then noticed the values existed in <sys/eventfd.h>, and that the values in that file were other values that the ones defined in iv_event_raw.c. So I just included <sys/eventfd.h>, and that fixed the problem. Attaching a patch fixing the problem for me. -- Configure bugmail: https://bugzilla.balabit.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 8

tcp/udp driver not binding correctly
by N. Max Pierson 04 Jun '12

04 Jun '12

Hi List, I've searched the mailing lists for over a year back and couldn't find an answer to my question. I'm working with an older version of syslog-ng and most of the questions were about 3.x or newer, so here goes. I've setup a LVS cluster which is working perfectly. The problem I am having is when I have a logical interface ip (or no ip at all, interface is eth0:1) when using the tcp/udp driver, it does not seem to bind correctly and accept messages on the port specified. When using udp, I try a port scan with nmap and it shows the port on the logical interface a "closed". When I try tcp, it shows "filtered". The primary ip on interface eth0 accepts logs with no issues. Can syslog-ng bind to logical interfaces as described above and receive logs on multiple addresses?? A netstat -a shows *:syslog or when I outright specify the logical ip, it shows the logical ip, but as stated above ... it's either closed or filtered. I've searched all over, but it seems my google foo is not matching anything. Specifics .. RHEL v5.8 Syslog-ng v2.1.4 Regards, max

2 2

Problems for configure syslog structured as a source
by C. L. Martinez 04 Jun '12

04 Jun '12

Hi all, I am trying to configure syslog-ng to receive syslog messages as syslog structured (IETF). To accomplish I have configured: source s_ietfsyslog { syslog (port(20514) transport(tcp)); }; but not messages are processed by syslog-ng (but messages arrives from third devices). Any idea??

3 6