- syslog-ng - lists.balabit.hu

wu-ftpd
by Peter Czanik 07 Oct '10

07 Oct '10

Hello, I covered the three major ftpd implementations (proftpd/pureftpd/vuftpd) with login/logout/failure patterns, and as I used wu-ftpd for a long time, I also wanted to create a pattern for that one. No luck, I can't get it running, there are no messages in the logs and strace does not reveal anything :-( So, I'd like to ask, if anybody uses wu-ftpd here? Some logs or even better, patterns, would be very helpful. My latest blogs have some hints, how I collect logs and create rules ( http://czanik.blogs.balabit.com/2010/10/pattern-writing-tips-and-tricks/ and http://czanik.blogs.balabit.com/2010/10/pattern-writing-tips-and-tricks-ii/ ). For ftp I collected logs for the following situations: - anonymous ftp login - root login (actually a failure...) - invalid username - valid user, invalid password - valid user, successful login Anyone could help? Bye, -- Peter Czanik (CzP) <czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

1 0

error in syslog-ng 3.2alpha2: missing m4 macros directory
by Guillaume Rousse 06 Oct '10

06 Oct '10

Hello. configure.in has this macro: AC_CONFIG_MACRO_DIR([m4]) However, the m4 directory doesn't exist. As a consequence, running 'autoreconf' fails immediatly. I guess it's just missing, as previous release had it. -- BOFH excuse #312: incompatible bit-registration operators

2 1

syslog-ng issue
by anushri kannu 06 Oct '10

06 Oct '10

Hi Every one, I am new to concept of syslog-ng configuration. Already syslog-ng configured in linux server We have 6 syslog-ng server 4 location syslog-ng server receives logs from all the syslog client .. working fine 1 centralized syslog-ng (server receives log from 4 locations ....... working fine 1 we have tcim syslog-ng server receives logs from centralized syslog-ng server... it was working before for both solaris and linux . Now suddenly not collecting logs only for linux. No changes were made. Centalized syslog-ng configuration file options { log_fifo_size(8192); create_dirs(yes); group(sysgrp); dir_group(sysgrp); dir_perm(0750); perm(0440); chain_hostnames(no); keep_hostname(yes); stats(3600); use_fqdn(yes); use_time_recvd(yes); }; Standard filters # Level Filters filter f_emerg { level (emerg); }; filter f_alert { level (alert .. emerg); }; filter f_crit { level (crit .. emerg); }; filter f_err { level (err .. emerg); }; filter f_warning { level (warning .. emerg); }; filter f_notice { level (notice .. emerg); }; filter f_info { level (info .. emerg); }; filter f_debug { level (debug .. emerg); }; # Facility Filters filter f_kern { facility (kern); }; filter f_user { facility (user); }; filter f_mail { facility (mail); }; filter f_daemon { facility (daemon); }; filter f_auth { facility (auth); }; filter f_authpriv { facility (authpriv); }; filter f_syslog { facility (syslog); }; filter f_lpr { facility (lpr); }; filter f_news { facility (news); }; filter f_uucp { facility (uucp); }; filter f_os_unix { not program(EvntSLog) and not program(NetScreen) and not match ("NetScreen device_id") and not match ("%AAA-") and not match ("%AUTH-") and not match ("%AUTHPRIV-") and not match ("%CALLHOME-") and not match ("%CDP-") and not match ("%EARL-") and not match ("%FILESYS-") and not match ("%IMAGE_DNLD-SLOT") and not match ("%IP-") and not match ("%KERN-") and not match ("%LICMGR-") and not match ("%LINEPROTO-") and not match ("%LINK-") and not match ("%MCAST-") and not match ("%MODULE-") and not match ("%OSPF-") and not match ("%PLATFORM-") and not match ("%PRUNING-") and not match ("%PORT-") and not match ("%SPANTREE-") and not match ("%SYS-") and not match ("%UDLD-") and not match ("%VSHD-") source s_local { unix-stream("/dev/log"); udp(ip(0.0.0.0) port(514)); tcp(ip(0.0.0.0) port(5149) max-connections(333)); internal(); pipe("/proc/kmsg"); }; destination dl_hosts-unix { file("/var/log/syslog-ng/hosts-unix/$HOST/$YEAR/$MONTH/$DAY/$FACILITY.$LEVEL"); }; log { source(s_local); filter(f_os_unix); ###not filter(f_os_switch); destination(dl_hosts-unix); }; destination dl_tcim { udp("10.230.148.18" port(514) template("<$PRI> $DATE $HOST $MESSAGE\r\n")); }; log { source(s_local); destination(dl_tcim); }; tcim server configurarion file. options { sync (0); time_reopen (10); log_fifo_size (1000); long_hostnames (off); # use_dns (no); use_dns (yes); use_fqdn (no); create_dirs (no); keep_hostname (yes); }; source src { udp(); tcp(port(514) keep-alive(yes)); filter f_lnx_hosts { host("amex") or host("green") or host("sa") or host("yellow") or host("urinf01") or etc..; .. .. . }; destination d_lnx { file("/var/log/tcim/$HOST/syslog-$YEAR-$MONTH-$DAY.log" template("<$PRI>$DATE $HOST $MSG\n") create_dirs(yes) owner(svc-tcim) group(users) perm(0660) dir_owner(svc-tcim) dir_group(users) dir_perm(0770) ); }; log { source(src); filter(f_lnx_hosts); destination(d_lnx); }; I did try below command in TCIM server to check the comunication between centralized syslog-ng serer and tcim server tcpdump -nn -tp -port 514.. IP 10.180.40.83.59535 > 10.230.148.18.514: UDP, length 375 IP 10.180.40.83.59535 > 10.230.148.18.514: UDP, length 193 IP 10.180.40.83.59535 > 10.230.148.18.514: UDP, length 638 IP 10.180.40.83.59535 > 10.230.148.18.514: UDP, length 638 1740 packets captured 1740 packets received by filter 0 packets dropped by kernel Packets are getting from centralised log server. Do not know where the mistake is. Please help to resolve this issue.

2 2

syslog-ng3 host_override() issue and proposed fix.
by Nat Baldwin 05 Oct '10

05 Oct '10

Hi there, While trying to do something fairly specific with syslog-ng3, I ran into an error with an easy fix. I'm running syslog-ng3 3.1.1_1 on FreeBSD, installed from ports with SSL enabled and everything else default. What I was trying to do was to use the host_override() function on a unix-dgram() source. Time and again it was acting like the program_override() function instead; altering the program entry and not the host entry in the log. When I went and looked at the source code, I noticed this in logsource.c: 145 if (self->options->program_override) 146 { 147 if (self->options->program_override_len < 0) 148 self->options->program_override_len = strlen(self->options->program_override); 149 log_msg_set_value(msg, LM_V_PROGRAM, self->options->program_override, self->options->program_override_len); 150 } 151 if (self->options->host_override) 152 { 153 if (self->options->host_override_len < 0) 154 self->options->host_override_len = strlen(self->options->host_override); 155 log_msg_set_value(msg, LM_V_PROGRAM, self->options->host_override, self-> options->host_override_len); 156 } Taking a not-so-wild guess, I changed line 155 to read: log_msg_set_value(msg, LM_V_HOST,self->options->host_override, self-> options->host_override_len); (changing LM_V_PROGRAM to LM_V_HOST) and that fixed my problem. Is this something that can be fixed, or should I be bringing this issue to someone in particular's attention? thanks, -- Nat Baldwin Unix Systems Administrator Network Infrastructure, RSSP-IT UC Berkeley ----- End forwarded message ----- -- Nat Baldwin Unix Systems Administrator Network Infrastructure, RSSP-IT UC Berkeley

2 1

syslog-ng issue collecting logs
by anushri kannu 04 Oct '10

04 Oct '10

Hi Every one... As i am new to this concept,Kindly help on this All the syslog-ng client forward logs to centralized log server-- works fine. centralized log server forward logs to tcim server -- works fine for solaris server and other network device-- >From centralized log server to tcim server -- issue ( not collecting logs for linux servers in tcim server ) Centralized log server forward all the logs to tcim server, In Tcim server 4000 devices are configured to collect logs from centralized log server, However in TCIM sever option for log_fifo_size ( 1000) defined and did not mention any variable as max_conncection. Will this affect logs fails to collect from centralized log to tcim server. Below options defined in tcim server. options { sync (0); time_reopen (10); log_fifo_size (1000); long_hostnames (off); # use_dns (no); use_dns (yes); use_fqdn (no); create_dirs (no); keep_hostname (yes); }; source src { udp(); tcp(port(514) keep-alive(yes)); }; 1. If i increase the max-connection(4000 ). do we need to declare below variable like this...... (User requested me to define the below value. in tcim server.) Since i am new to this, Please advice. if i declare the below variable, will server get hangs. this is very critical server. log_fifo_size=4000000 log_iw_size=1000 max-connection(4000) Thanks in advance.

2 1

patterndb license?
by Balazs Scheidler 01 Oct '10

01 Oct '10

Hi, I was wondering what kind of license should be applied to patterndb patterns. GPL doesn't really apply as it is not software. I was thinking about Creating Commons Attribution-ShareAlike license, which: * allows redistributions of the work with proper attribution * allows changes as long as the changes are available under the same license * allows commercial usage (e.g. free even for commercial entities) Adding the "nc" e.g. non-commercial flag was considered and then dropped. We feel that most people trying to use patterndb would definitely use it in a commercial setting and we wouldn't like to limit our users to academia a private use. What do you think? -- Bazsi

3 2

QSTRING with @
by Peter Czanik 30 Sep '10

30 Sep '10

Hello, I'm trying to create a pattern, and ran into an interesting problem: I can't use @ with QSTRING as beginning character. Example: <patterns> <pattern>(?@QSTRING:usracct.device:@@)@ [INFO] Anonymous user logged in</pattern> </patterns> <examples> <example> <test_message program="pure-ftpd">(?(a)192.168.2.52) [INFO] Anonymous user logged in</test_message> <test_values> <test_value name="usracct.device">192.168.2.52</test_value> </test_values> </example> </examples> But when I test it, pdbtool says: Unknown parser type specified; type=')' Testing message program='pure-ftpd' message='(?(a)192.168.2.52) [INFO] Anonymous user logged in' Wrong match name='.classifier.rule_id', value='', expected='ef75e712-5e9e-4ca0-a614-5e1bf512286b' Wrong match name='usracct.device', value='', expected='192.168.2.52' I changed it to: <pattern>(?@@@ESTRING:usracct.device:)@ [INFO] Anonymous user logged in</pattern> Which works, but I'm still curious, if @ should work as a quotation character. Bye, -- Peter Czanik (CzP) <czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

2 3

pure-ftpd patterns
by Peter Czanik 30 Sep '10

30 Sep '10

Hello, Attached are the pure-ftpd login/logout/failure patterns and the sample file I used. Some notes: - logouts, where username is "?" are not tagged, as these just mark that a TCP/IP connection is teared down - PAM messages are not tagged, as that would create duplicate messages about the same event. The variable part of them is simply discarded with an @ANYSTRING@ - anonymous login/logout events are tagged, username is set to "anonymous" from "ftp" You can check the attached pure-ftpd.pdb with the following command: cat pure-ftpd.samples | grep -v CzP | pdbtool match -p pure-ftpd.pdb -f - CzP lines are comments... Please check it on your own pure-ftpd logs to see, if I missed anything! Thanks! Bye, -- Peter Czanik (CzP) <czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

2 1

anushri kannu wants to chat
by anushri kannu 30 Sep '10

30 Sep '10

----------------------------------------------------------------------- anushri kannu wants to stay in better touch using some of Google's coolest new products. If you already have Gmail or Google Talk, visit: http://mail.google.com/mail/b-959daaa790-1679f27bf6-M3ME9jASBxIBFvbiNyV6reO… You'll need to click this link to be able to chat with anushri kannu. To get Gmail - a free email account from Google with over 2,800 megabytes of storage - and chat with anushri kannu, visit: http://mail.google.com/mail/a-959daaa790-1679f27bf6-M3ME9jASBxIBFvbiNyV6reO… Gmail offers: - Instant messaging right inside Gmail - Powerful spam protection - Built-in search for finding your messages and a helpful way of organizing emails into "conversations" - No pop-up ads or untargeted banners - just text ads and related information that are relevant to the content of your messages All this, and its yours for free. But wait, there's more! By opening a Gmail account, you also get access to Google Talk, Google's instant messaging service: http://www.google.com/talk/ Google Talk offers: - Web-based chat that you can use anywhere, without a download - A contact list that's synchronized with your Gmail account - Free, high quality PC-to-PC voice calls when you download the Google Talk client We're working hard to add new features and make improvements, so we might also ask for your comments and suggestions periodically. We appreciate your help in making our products even better! Thanks, The Google Team To learn more about Gmail and Google Talk, visit: http://mail.google.com/mail/help/about.html http://www.google.com/talk/about.html (If clicking the URLs in this message does not work, copy and paste them into the address bar of your browser).

1 0

pure-ftpd
by Peter Czanik 30 Sep '10

30 Sep '10

Hello, I installed pure-ftpd and generated some logs. Here they are. They bring up many questions what are the best practices in some situations... Anonymous login: Sep 24 13:53:05 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] New connection from 192.168.2.142 Sep 24 13:53:08 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] Anonymous user logged in Sep 24 13:53:11 linux-6y8u pure-ftpd: (ftp(a)192.168.2.142) [INFO] Logout. Successful user login: Sep 24 13:54:15 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] New connection from 192.168.2.142 Sep 24 13:54:19 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] czanik is now logged in Sep 24 13:54:21 linux-6y8u pure-ftpd: (czanik(a)192.168.2.142) [INFO] Logout. Denied root login: Sep 24 13:54:22 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] New connection from 192.168.2.142 Sep 24 13:54:24 linux-6y8u pure-ftpd: pam_listfile(pure-ftpd:auth): Refused user root for service pure-ftpd Sep 24 13:54:27 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [WARNING] Authentication failed for user [root] Sep 24 13:54:30 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] Logout. Wrong user password: Sep 24 13:57:43 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] New connection from 192.168.2.142 Sep 24 13:57:51 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [WARNING] Authentication failed for user [czanik] Sep 24 13:57:52 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] Logout. Invalid user name: Sep 24 13:57:53 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] New connection from 192.168.2.142 Sep 24 13:57:55 linux-6y8u pure-ftpd: gkr-pam: error looking up user information for: asdf Sep 24 13:58:00 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [WARNING] Authentication failed for user [asdf] Sep 24 13:58:03 linux-6y8u pure-ftpd: (?(a)192.168.2.142) [INFO] Logout. Questions: - many times there is just a question mark instead of the username. Should it still be stored in a variable (useracct.username) or only for the Logout lines, where it actually might get a useful value? - the "New connection" line has the same info (the IP address) twice. How should it be handled? - how should Anonymous login be handled? @QSTRING:useracct.username: @ vs. <value name="usracct.username">Anonymous</value> -- Peter Czanik (CzP) <czanik(a)balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/

3 5