October 2005 - syslog-ng - lists.balabit.hu

patch for $PID support
by Jason Pepas 06 Oct '05

06 Oct '05

Hurray for insomnia! I have implemented $PID macro support in syslog-ng 1.6.8, and have tested it out on gentoo linux. http://www.ices.utexas.edu/~cell/gentoo/syslog-ng/ -jason pepas

2 1

Centralize different kind of logs ...
by CIKALA Frederic ROSI/DOSI 06 Oct '05

06 Oct '05

Hello, i haven't received my second mail for this ML, so i re send it I'm wondering if i'll use syslog-ng in order to centralize a lot of logs that are from different kind of machines. Actually i've to centralize logs that are from Active Directory, Exchange .... For example, those others machines have UNIX, Solaris, Windows and VMS for OS ... In fact, i don't know if it exists a tool that can do this thing for my several servers ... Thanks for help :) *********************************** Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et etablis a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite. Tout message electronique est susceptible d'alteration. Le Groupe France Telecom decline toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie. Si vous n'etes pas destinataire de ce message, merci de le detruire immediatement et d'avertir l'expediteur. *********************************** This message and any attachments (the "message") are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. Messages are susceptible to alteration. France Telecom Group shall not be liable for the message if altered, changed or falsified. If you are not receiver of this message, please cancel it immediately and inform the sender. ***********************************

1 0

syslog-ng sending to pipe
by shaun.hofer＠altcall.com 06 Oct '05

06 Oct '05

Hi all Syslog-ng is set to write to a pipe. Syslog-ng starts very early on in the boot process, nothing is reading from the pipe yet. Later on, mysql script starts reading from the pipe, but by that time, it seems as though syslog isn't bothering to write to the pipe anymore. 'ps axf' shows this for the mysql init script: '2023 /etc/init.d/sqlsyslogd start' The mysql init script thinks the pipe is blocked. If you restart syslog-ng at this point the mysql script starts reading from the pipe. Do you have any ideas as to how to get this working? Heres the script: case "$1" in start) # If the pipe does not exist, create it if [ ! -e /tmp/mysql.pipe ] ; then mkfifo /tmp/mysql.pipe fi mysql -u sys --password=xxxx syslog< /tmp/mysql.pipe & ;; stop ) if [ -e /tmp/mysql.pipe ]; then rm -f /tmp/mysql.pipe fi ;; *) echo "Usage: sqlsyslogd {start|stop}" exit 1; esac exit 0; >From the syslog-ng.conf: destination d_mysql { pipe("/tmp/mysql.pipe" template("INSERT INTO logs (host, facility, priority, level, tag, date, time, program, msg) VALUES ( '$HOST', '$FACILITY', '$PRIORITY', '$LEVEL','$TAG','$YEAR-$MONTH-$DAY', '$HOUR:$MIN:$SEC', '$PROGRAM', '$MSG' );\n") templ ate-escape(yes)); }; log { source(s_all); source(tcpgateway); destination(d_mysql); }; Thanks in advance Shaun

2 3

no $PID macro?
by Jason Pepas 05 Oct '05

05 Oct '05

Hi, The log format macro system is a great idea. However, I didn't see $PID as an option. Is there a reason for this? Should I wade through the source and create a patch, or is this an unsolveable problem? thanks, jason pepas

3 4

RE: [syslog-ng] Architecture Question'
by CIKALA Frederic ROSI/DOSI 05 Oct '05

05 Oct '05

Yes, i know it is not specific enough ... But nobody here can tell me exactly the frequency of the logs that will be sent :-/ One thing is sure : it wont be 1 message per server per day, but something like 500 /server /days ... Do you want to know something else ? -----Message d'origine----- De : syslog-ng-bounces(a)lists.balabit.hu [mailto:syslog-ng-bounces@lists.balabit.hu]De la part de kenneth.gullberg(a)foreningssparbanken.se Envoyé : mardi 4 octobre 2005 10:00 À : syslog-ng(a)lists.balabit.hu Objet : SV: [syslog-ng] Architecture Question' im afraid that the only answer you are going to get is: Depends on what kind of traffic you expect to be seeing.. 7000 machines logging 1 message every minute is nothing but if you are expected to receive 1 message / second / server then you need a different setup.. You need to be more specific! -----Ursprungligt meddelande----- Från: syslog-ng-bounces(a)lists.balabit.hu [mailto:syslog-ng-bounces@lists.balabit.hu] För CIKALA Frederic ROSI/DOSI Skickat: den 4 oktober 2005 09:34 Till: syslog-ng(a)lists.balabit.hu Ämne: [syslog-ng] Architecture Question' Hello everyone' I'm new to this mailing list and i do not know syslogNG yet Actually, i have to prepare a server that will centralize a lot of logs, from about 7000 other servers. I've read that syslogNG is a great tool that can do a lot of interresting things. Therefore, i chose this application for my project but i do not know if it needs big ressources to be launched ... In fact, i'm wondering about the hardware i'll have to buy in order to make this project Maybe someone of this list has got a greater opinion about what i'll have to buy for example "at least a 3gHz cpu, with 2 gig of ram ..." It could be usefull', thank you ^^ *********************************** Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et etablis a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite. Tout message electronique est susceptible d'alteration. Le Groupe France Telecom decline toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie. Si vous n'etes pas destinataire de ce message, merci de le detruire immediatement et d'avertir l'expediteur. *********************************** This message and any attachments (the "message") are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. Messages are susceptible to alteration. France Telecom Group shall not be liable for the message if altered, changed or falsified. If you are not receiver of this message, please cancel it immediately and inform the sender. *********************************** *********************************** Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et etablis a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite. Tout message electronique est susceptible d'alteration. Le Groupe France Telecom decline toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie. Si vous n'etes pas destinataire de ce message, merci de le detruire immediatement et d'avertir l'expediteur. *********************************** This message and any attachments (the "message") are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. Messages are susceptible to alteration. France Telecom Group shall not be liable for the message if altered, changed or falsified. If you are not receiver of this message, please cancel it immediately and inform the sender. ***********************************

3 2

message parsing help
by blenox＠gmx.net 05 Oct '05

05 Oct '05

Hello All, i have a few questions about syslog-ng message parsing is it possible to scan each syslog message for system-notification*(traffic) once this matches, to insert the values !splitted! into a database with the the following fields: device_id start_time duration policy_id service ip_proto src_zone dst_zone action sent rcvd src_ip dst_ip src_port dst_port src_xlated_ip dst_xlated_ip port session_id the whole message looks like this: Oct 3 15:35:32 172.10.0.10 NS50: NetScreen device_id=NS50 [No Name]system-notification-00257(traffic): start_time="2005-10-03 15:01:37" duration=21 policy_id=1 service=https proto=6 src zone=Trust dst zone=Untrust action=Permit sent=2454 rcvd=1601 src=172.18.12.10 dst=172.17.10.24 src_port=1458 dst_port=443 src-xlated ip=172.18.12.113 port=1458 session_id=63649 i was able to filter certain messages, but never to split up the real "message field". Any help with examples would be great im using syslog-ng 1.6.8 Cheers and thank's in advance Marco -- GMX DSL = Maximale Leistung zum minimalen Preis! 2000 MB nur 2,99, Flatrate ab 4,99 Euro/Monat: http://www.gmx.net/de/go/dsl

2 1

spoof_source not working
by Chance Ellis 04 Oct '05

04 Oct '05

I am running syslog-ng 1.6.8 on Solaris 9. I recompiled with the --enable-spoof-source configure option. Here is my config: destination d_squelch_acl { udp("10.159.234.52 <http://10.159.234.52>" port(514) spoof_source(yes)); }; filter f_squelch_acl { match("list squelch denied"); }; log { source(net); filter(f_squelch_acl); destination(d_squelch_acl);}; source net { udp(); }; If I start syslog-ng without spoof_source(yes) option, all messages matching are forwarded to the machine in the destination. If I change to spoof_source(yes) nothing gets forwarded at all. I do not get any errors when I start syslog-ng, like "spoof-source support not compiled in" which I get on other boxes I have not recompiled on yet. Any ideas? Chance

4 10

- Syslog not logging
by kevin_herald 04 Oct '05

04 Oct '05

Hello, I've installed syslog-ng-1.9.5 on Solaris 9 and it appears to startup and be running. root 430 1 0 14:17:46 ? 0:00 /usr/local/sbin/syslog-ng -f /etc/syslog-ng/syslog-ng.conf -p /etc/syslog-ng/sy However, I see no logging in any of the destination files. Is there some type of debugging switch to help determine why the logs are not being written to? Thanks for any help, Kevin ps. Here is a copy of my syslog-ng.conf file. # syslog-ng configuration file. # # This should behave pretty much like the original syslog on SunOS. But # it could be configured a lot smarter. # # See syslog-ng(8) and syslog-ng.conf(5) for more information. # # 20000925 gb(a)sysfive.com options { sync (0); time_reopen (10); log_fifo_size (1000); long_hostnames (off); use_dns (no); use_fqdn (no); create_dirs (no); keep_hostname (yes); }; source s_sys { sun-streams ("/dev/log" door("/etc/.syslog_door")); internal(); }; source s_remote { udp(ip(0.0.0.0) port(514)); internal(); }; destination syslog { file("/var/log/syslog"); }; destination messages { file("/var/adm/messages"); }; destination loghost { tcp("191.168.230.20" port (5140)); }; destination d_cons { file("/dev/console"); }; destination d_mesg { file("/var/adm/messages"); }; destination d_mail { file("/var/log/syslog"); }; destination d_auth { file("/var/log/authlog"); }; destination d_mlop { usertty("operator"); };filter f_filter1 { level(err) or (level(notice) and facility (auth, kern)); }; filter f_filter2 { level(err) or (facility(kern) and level(notice)) or (facility(daemon) and level(notice)) or (facility(mail) and level(crit)); }; filter f_filter3 { level(alert) or (facility(kern) and level(err)) or (facility(daemon) and level(err)); }; filter f_filter4 { level(alert); }; filter f_filter5 { level(emerg); }; filter f_filter6 { facility(kern) and level(notice); }; filter f_filter7 { facility(mail) and level(debug); }; filter f_filter8 { facility(user) and level(err); }; filter f_filter9 { facility(user) and level(alert); }; log { source(s_sys); filter(f_filter1); destination(d_cons); }; log { source(s_sys); filter(f_filter2); destination(d_mesg); }; log { source(s_sys); filter(f_filter3); destination(d_mlop); }; log { source(s_sys); filter(f_filter4); destination(d_mlrt); }; log { source(s_sys); filter(f_filter5); destination(d_mlal); }; log { source(s_sys); filter(f_filter6); destination(d_auth); }; log { source(s_sys); filter(f_filter7); destination(d_mail); }; log { source(s_sys); filter(f_filter8); destination(d_cons); destination(d_mesg); }; log { source(s_sys); filter(f_filter9); destination(d_mlop); destination(d_mlrt); }; destination d_mlrt { usertty("root"); }; destination d_mlal { usertty("*"); };

1 0

RE: [syslog-ng] Bugreport: Ver 1.9.5 problems with facility/level filtering
by Marvin.Nipper＠Stream.com 04 Oct '05

04 Oct '05

> > I tried the latest snapshot of syslog-ng, but it fails to > compile the > > initial module. I get: > > misc.c: In function `get_local_timezone_ofs': > > misc.c:83: error: structure has no member named `tm_gmtoff' > > Hmm, this is a BSD extension, and IIRC you are using a BSD system, > aren't you? Actually, this is a Solaris 8 system (with gcc 3.4.2). The (original) July 1.9.5 compiles just fine. I'm just uncertain what has changed since then, that is causing this issue. The time.h file on this system appears to have come as part of the SUNWhea package, and does not include the information shown above. Not sure if that helps(?). THANKS for your guidance. Marvin

3 2

Thomas X Hill/GIS/CSC is out of the office.
by Thomas X Hill 04 Oct '05

04 Oct '05

I will be out of the office starting 04.10.2005 and will not return until 07.10.2005. I will respond to your message when I return.

1 0