June 2007 - syslog-ng - lists.balabit.hu

Assistance compiling 1.6.12
by tim.brown＠juno.com 26 Jun '07

26 Jun '07

Hello, I apologize in advance for my lack of experience and knowledge in this area but I keep encountering the following when I attempt to "make" the 1.6.12 distribution on Solaris 9: Making install in src Making install in . gcc -g -O2 -Wall -I/opt/syslog-ng-1.6.12/libol-0.3.18/src -D_GNU_SOURCE -o syslog-ng main.o sources.o center.o filters.o destinations.o log.o cfgfile.o cfg-grammar.o cfg-lex.o affile.o afsocket.o afunix.o afinet.o afinter.o afuser.o afstreams.o afprogram.o afremctrl.o nscache.o utils.o syslog-names.o macros.o getopt.o getopt1.o -lpthread -lrt -lnsl -lsocket -ldoor -lresolv -Wl,-Bstatic /opt/syslog-ng-1.6.12/libol-0.3.18/src/.libs/libol.a -lsocket -lnsl -lxnet -lfl -lsocket -lnsl -lnet -Wl,-Bdynamic ld: fatal: library -lxnet: not found ld: fatal: File processing errors. No output written to syslog-ng collect2: ld returned 1 exit status *** Error code 1 make: Fatal error: Command failed for target `syslog-ng' Current working directory /opt/syslog-ng-1.6.12/src *** Error code 1 make: Fatal error: Command failed for target `install-recursive' Current working directory /opt/syslog-ng-1.6.12/src *** Error code 1 make: Fatal error: Command failed for target `install-recursive' I've scanned the net for references to "-lxnet" on Solaris and could only determine that is a library routine particular to Linux. I could not find how to provide this on a Solaris platform. Any assistance would be greatly appreciated. Tim _____________________________________________________________ Click here to find a massage therapy school near you. http://track.juno.com/s/lc?u=http://tagline.untd.us/fc/Ioyw6iieZBaNpvMSHkV5…

3 4

RE: syslog-ng 2.0.4 How can syslog-ng achieve this performance???
by Root Administrator 25 Jun '07

25 Jun '07

Geller, Sandor Balazs Scheidler Thanks 4 ur advise. Please pardon me for my short information. The scenario is this, ----- There is a network device which sends logs to syslog server over network at a pace of approx 4000 logs/sec. Syslog server has its own mission to handle them. In case, syslog server must write logs to local disk, the server in fact drops some logs in the local file. Consequently, I turned to think of tuning some tweak in syslog-ng parameter or kernel parameter. I have tuned kernel parameter by setting "udp_recv_hiwat" to its maximum value, and udp_max_buf to the value of 300 times of the default value. And, I have come up with this idea. 1. Increase "sync" parameter to buffer some logs and write logs , not at the pace of every second. I tried to increase sync as well as log_fifo_size. First, I set sync as 3000 , log_fifo_size as 10000. However, it was not liked, with the message " The value of flush_lines must be less than fifo_size; fifo_size='1000',flush_lines='3000' ". Syslog-ng is configured as follows; sync (3000); time_reopen (10); time_sleep(0); log_fifo_size (10000); long_hostnames (off); use_dns (no); use_fqdn (no); create_dirs (no); keep_hostname (yes); source s_test { udp(ip(0.0.0.0) port(514)); }; destination d_local4 { file("/var/log/local4"); }; filter f_local4_al { facility(local4) and level(info) and match("xxxxxx") and filter(test); }; filter test { match("10600[1267]") or match("10601[0-8]") or match ("10602[0124567]") or match("106100") or match("20900[345]") or match("500004"); }; log { source(s_test); filter(f_local4_al); destination(d_local4); }; Any advice about how sync works , and how log_fifo_size works will greatly help. Is there any other way than editing the logwriter.c file and re-compile it? Is there difference between setting sync and log_fifo_size in global option section and individual destination section in terms of its effect? 2. "fsync" parameter would be thouhgt as second chance to overcome this problem. However, no userful information cound not be found on web. I set fsync in destination section, but it was rejected when reloading the process. Any advice about how fsync works will greatly help. In addition, how can I get STATS information of syslog-ng? I have added "stats_freq (60);" in global option section, but I could not get any information in /var/adm/messages. Where does syslog-ng output the stats information? Thanks! Regards George ------------------------------ > > Message: 3 > Date: Wed, 20 Jun 2007 11:12:40 +0900 > From: "Root Administrator" <root.regist(a)gmail.com> > Subject: [syslog-ng] syslog-ng 2.0.4 How can syslog-ng achieve this > performance??? > To: syslog-ng(a)lists.balabit.hu > Message-ID: > <8ee7d730706191912l357ecabfgb137b7297c1bfbf0(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Hi All, > > NEED HELP!!!!! > > [Environment] > SunOS 5.9 Generic_122300-07 sun4u sparc SUNW > syslog-ng 2.0.4 > disk : single disk (no RAID) > syslog-ng conf (global option part) > sync (3000); > time_reopen (10); > time_sleep(0); > log_fifo_size (10000); > long_hostnames (off); > use_dns (no); > use_fqdn (no); > create_dirs (no); > keep_hostname (yes); > > [NEED] > I want syslog-ng to write logs to local disk at pace of about 4000 > lines per second without any lines losing. > However, lines were in fact lost in the local file. > I am trying to know the syslog-ng max performable point. > > [Consideration] > "log_fifo_size" in global option is set as 10000. > I tried to set sync() parameter, for instance 3000, in global option > section. > This did not succeed with this messages when reloading the process, > " The value of flush_lines must be less than fifo_size; fifo_size='1000', > flush_lines='3000' ". > The administration guide says "sync" is alias for "flush_lines". > > In addition, resource usage at 4000lines/s load was as below, > > result of vmstat > kthr memory page disk faults cpu > r b w swap free re mf pi po fr de sr s3 sd sd -- in sy cs us sy > id > 0 0 0 3954792 3895288 155 8 353 0 0 0 12 0 2 0 0 669 4368 857 4 3 > 93 > 0 0 0 3955248 3926424 3 8 0 0 0 0 0 0 2 0 0 4112 27017 5889 21 > 15 > 64 > 0 0 0 3955248 3925664 0 0 0 0 0 0 0 0 3 0 0 4120 27251 5653 16 > 19 > 64 > 0 0 0 3955248 3924528 0 0 0 0 0 0 0 0 1 0 0 4129 27251 5914 15 > 18 > 67 > 0 0 0 3955248 3923400 0 0 0 0 0 0 0 0 1 0 0 4113 27236 6052 17 > 15 > 68 > 0 0 0 3955176 3922568 0 0 0 0 0 0 0 0 32 0 0 4156 26028 5405 19 > 13 > 68 > 0 0 0 3955176 3921808 0 0 0 0 0 0 0 0 1 0 0 4161 27316 5757 16 > 18 > 66 > 0 0 0 3955176 3921056 0 0 0 0 0 0 0 0 1 0 0 4120 27254 6136 14 > 18 > 68 > 0 0 0 3955176 3920296 0 0 0 0 0 0 0 0 1 0 0 4110 27244 5648 18 > 17 > 65 > 0 0 0 3955176 3919544 0 0 0 0 0 0 0 0 1 0 0 4115 27253 6042 17 > 19 > 64 > 0 0 0 3955176 3918784 0 0 0 0 0 0 0 0 1 0 0 4108 27238 6469 18 > 16 > 65 > 0 0 0 3955176 3918032 0 0 0 0 0 0 0 0 1 0 0 4107 27235 6106 16 > 18 > 66 > 0 0 0 3955176 3917272 0 0 0 0 0 0 0 0 1 0 0 4139 27264 5850 17 > 18 > 65 > 0 0 0 3955176 3916520 0 0 0 0 0 0 0 0 1 0 0 4107 27259 5867 19 > 14 > 67 > > result of iostat > extended device statistics > r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device > 0.0 1.0 0.0 775.9 0.0 0.0 0.0 27.3 0 3 c1t0d0s3 > 1.0 2.0 8.0 744.1 0.0 0.0 0.0 11.4 0 3 c1t0d0s3 > 0.0 2.0 0.0 864.0 0.0 0.0 0.0 15.7 0 3 c1t0d0s3 > 0.0 4.0 0.0 856.0 0.0 0.1 0.0 17.3 0 3 c1t0d0s3 > 0.0 1.0 0.0 456.0 0.0 0.0 0.0 19.5 0 2 c1t0d0s3 > 0.0 1.0 0.0 856.1 0.0 0.0 0.0 28.1 0 3 c1t0d0s3 > 0.0 1.0 0.0 855.9 0.0 0.0 0.0 24.4 0 2 c1t0d0s3 > 0.0 1.0 0.0 856.1 0.0 0.0 0.0 27.3 0 3 c1t0d0s3 > 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t0d0s3 > 0.0 1.0 0.0 856.0 0.0 0.0 0.0 19.0 0 2 c1t0d0s3 > 0.0 1.0 0.0 856.0 0.0 0.0 0.0 26.9 0 3 c1t0d0s3 > 0.0 1.0 0.0 832.1 0.0 0.0 0.0 24.8 0 2 c1t0d0s3 > 0.0 1.0 0.0 735.9 0.0 0.0 0.0 26.4 0 3 c1t0d0s3 > 0.0 1.0 0.0 856.1 0.0 0.0 0.0 28.7 0 3 c1t0d0s3 > 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t0d0s3 > > [Question] > Question 1. > Does the "fifo_size" in above message mean "log_fifo_size" in global > option ? > Is the value "fifo_size='1000'" max value ? > Is it possible to set "log_fifo_size" far more than 1000 ? > Is it possible to set "sync" far more than 1000 ? > If possible, then how do I do it ? > > Question 2. > To achieve the NEED, I am considering the parameters below, > sync() > log_fifo_size() > . > Are there any other parameters I MUST consider for syslog-ng > configuration? > > Regards > > George >

2 1

Cisco Loadbalancer and Syslog-ng
by Ajay Chenampara 21 Jun '07

21 Jun '07

Hi everyone, Our syslog-ng server is logging all our cisco css (arrowpoint) syslogs into a file called "5". For all the other network devices, it is getting correctly logged under the host IP. Has anyone experienced this behavior ? Is there a workaround? -ajay --------------------------------- Be a better Globetrotter. Get better travel answers from someone who knows. Yahoo! Answers - Check it out.

2 1

Re: [syslog-ng] Feature Request for Macros
by aero1967＠fastmail.fm 20 Jun '07

20 Jun '07

Yes, you are correct. As per the feature I'm asking for, 1-6 would be the correct range as you showed in your example. Hope you don't mind that I've CC'ed the list for this clarification. Thanks, V. R. On Wed, 20 Jun 2007 19:31:51 +0000 (UTC), "Leonard Mills" <lenm(a)ops.corpnet.sel.sony.com> said: > You wrote: > > >So the range > >of values this parameter would take is 1 - 5. > > > Did you not mean 1-6? Take, for example, December of this year. With > Sat > or Sun being the last day of a week, that month has 6 weeks, if I > understand your request. > > Len -- aero1967(a)fastmail.fm -- http://www.fastmail.fm - Send your email first class

1 0

Feature Request for Macros
by aero1967＠fastmail.fm 20 Jun '07

20 Jun '07

Hello, I'd like to submit two feature requests for macros in syslog-ng. 1. Week of the month. The WEEK macro gives the absolute week within the year. What I would like to see is a new macro parameter for the week within the month. An algorithm for this might be: the first day of the month falls in the first week. Thereafter the week counter is incremented the same way as the standard WEEK parameter. So the range of values this parameter would take is 1 - 5. Example use: file("var/log/$YEAR/$MONTH/$MONTHWEEK/some.log") where I've called the new macro parameter "MONTHWEEK" 2. A macro parameter for month "name", i.e. the common abbreviation for each month, e.g. Jan, Feb, Mar, etc. Thanks, V. R. -- aero1967(a)fastmail.fm -- http://www.fastmail.fm - Accessible with your email software or over the web

1 0

syslog-ng 2.0.4 How can syslog-ng achieve this performance???
by Root Administrator 20 Jun '07

20 Jun '07

Hi All, NEED HELP!!!!! [Environment] SunOS 5.9 Generic_122300-07 sun4u sparc SUNW syslog-ng 2.0.4 disk : single disk (no RAID) syslog-ng conf (global option part) sync (3000); time_reopen (10); time_sleep(0); log_fifo_size (10000); long_hostnames (off); use_dns (no); use_fqdn (no); create_dirs (no); keep_hostname (yes); [NEED] I want syslog-ng to write logs to local disk at pace of about 4000 lines per second without any lines losing. However, lines were in fact lost in the local file. I am trying to know the syslog-ng max performable point. [Consideration] "log_fifo_size" in global option is set as 10000. I tried to set sync() parameter, for instance 3000, in global option section. This did not succeed with this messages when reloading the process, " The value of flush_lines must be less than fifo_size; fifo_size='1000', flush_lines='3000' ". The administration guide says "sync" is alias for "flush_lines". In addition, resource usage at 4000lines/s load was as below, result of vmstat kthr memory page disk faults cpu r b w swap free re mf pi po fr de sr s3 sd sd -- in sy cs us sy id 0 0 0 3954792 3895288 155 8 353 0 0 0 12 0 2 0 0 669 4368 857 4 3 93 0 0 0 3955248 3926424 3 8 0 0 0 0 0 0 2 0 0 4112 27017 5889 21 15 64 0 0 0 3955248 3925664 0 0 0 0 0 0 0 0 3 0 0 4120 27251 5653 16 19 64 0 0 0 3955248 3924528 0 0 0 0 0 0 0 0 1 0 0 4129 27251 5914 15 18 67 0 0 0 3955248 3923400 0 0 0 0 0 0 0 0 1 0 0 4113 27236 6052 17 15 68 0 0 0 3955176 3922568 0 0 0 0 0 0 0 0 32 0 0 4156 26028 5405 19 13 68 0 0 0 3955176 3921808 0 0 0 0 0 0 0 0 1 0 0 4161 27316 5757 16 18 66 0 0 0 3955176 3921056 0 0 0 0 0 0 0 0 1 0 0 4120 27254 6136 14 18 68 0 0 0 3955176 3920296 0 0 0 0 0 0 0 0 1 0 0 4110 27244 5648 18 17 65 0 0 0 3955176 3919544 0 0 0 0 0 0 0 0 1 0 0 4115 27253 6042 17 19 64 0 0 0 3955176 3918784 0 0 0 0 0 0 0 0 1 0 0 4108 27238 6469 18 16 65 0 0 0 3955176 3918032 0 0 0 0 0 0 0 0 1 0 0 4107 27235 6106 16 18 66 0 0 0 3955176 3917272 0 0 0 0 0 0 0 0 1 0 0 4139 27264 5850 17 18 65 0 0 0 3955176 3916520 0 0 0 0 0 0 0 0 1 0 0 4107 27259 5867 19 14 67 result of iostat extended device statistics r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 1.0 0.0 775.9 0.0 0.0 0.0 27.3 0 3 c1t0d0s3 1.0 2.0 8.0 744.1 0.0 0.0 0.0 11.4 0 3 c1t0d0s3 0.0 2.0 0.0 864.0 0.0 0.0 0.0 15.7 0 3 c1t0d0s3 0.0 4.0 0.0 856.0 0.0 0.1 0.0 17.3 0 3 c1t0d0s3 0.0 1.0 0.0 456.0 0.0 0.0 0.0 19.5 0 2 c1t0d0s3 0.0 1.0 0.0 856.1 0.0 0.0 0.0 28.1 0 3 c1t0d0s3 0.0 1.0 0.0 855.9 0.0 0.0 0.0 24.4 0 2 c1t0d0s3 0.0 1.0 0.0 856.1 0.0 0.0 0.0 27.3 0 3 c1t0d0s3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t0d0s3 0.0 1.0 0.0 856.0 0.0 0.0 0.0 19.0 0 2 c1t0d0s3 0.0 1.0 0.0 856.0 0.0 0.0 0.0 26.9 0 3 c1t0d0s3 0.0 1.0 0.0 832.1 0.0 0.0 0.0 24.8 0 2 c1t0d0s3 0.0 1.0 0.0 735.9 0.0 0.0 0.0 26.4 0 3 c1t0d0s3 0.0 1.0 0.0 856.1 0.0 0.0 0.0 28.7 0 3 c1t0d0s3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t0d0s3 [Question] Question 1. Does the "fifo_size" in above message mean "log_fifo_size" in global option ? Is the value "fifo_size='1000'" max value ? Is it possible to set "log_fifo_size" far more than 1000 ? Is it possible to set "sync" far more than 1000 ? If possible, then how do I do it ? Question 2. To achieve the NEED, I am considering the parameters below, sync() log_fifo_size() . Are there any other parameters I MUST consider for syslog-ng configuration? Regards George

3 4

syslog-ng as a relay
by Moxey, Joel, VF UK - Technology (TS) 19 Jun '07

19 Jun '07

Hi! I am trying to work out if syslog-ng can act as a relay without doing "noticeable" changes to the syslog message in terms of what the syslog server sees. The problem: 1) The device sends non-standard syslog messages 2) The syslog needs to go to 2 end systems, the device supports 1 3) One of the end devices needs to receive the syslog in exactly the same for as originally sent by the device So, I have been trying destinations as follows: destination d_remote { udp("X.X.X.X" port(514) spoof_source(yes) template("$MESSAGE\n")); udp("Y.Y.Y.Y" port(514) spoof_source(yes) template("$MESSAGE\n")); }; I have also tried various combinations having "template" and adding FACILITY and LEVEL, but I am current failing to reproduce the original packet. My results: Template Result ========================================== None Relayed message has standard date and hostname added which weren't in original package. $MESSAGE\n Syslog facility and priority headers are stripped away from relayed messages. Adding $FACILITY and $LEVEL/$PRIORITY doesn't seem to do what I need as they don't appear to go into the right fields, and syslog-ng appears to put KERN.EMERG in instead... The version I am running on is 2.0.4. If anyone has managed to get this working like this, I would be grateful of any pointers. Thanks, Joel

4 5

Subscribe
by liuruihong 17 Jun '07

17 Jun '07

http://www.balabit.com/downloads/files/syslog-ng/ I want to download the syslog-ng for free On this page ,there are two directories : sources <http://www.balabit.com/downloads/files/syslog-ng/sources/> and binaries <http://www.balabit.com/downloads/files/syslog-ng/binaries/> , which directories should I download the syslog-ng packages from? Where can I find the functions provided by the syslog-ng (open-source-edition <http://www.balabit.com/downloads/files/syslog-ng/binaries/open-source-editi on/> )? Thanks! 刘蕊红 sys 6758 ============================================================================ 百度在线网络技术（北京）有限公司

2 1

problems with Cisco WiFi controller syslog messages
by Poley, Jason 15 Jun '07

15 Jun '07

We have upgraded our Cisco WiFi controller and now its syslog messages contain milliseconds which syslog-ng does not know how to handle. I am running version 1.6.9 of syslog-ng on RedHat version 3. TCP dump of first 96 bytes... 06:57:07.584716 IP (tos 0x0, ttl 59, id 0, offset 0, flags [DF], proto 17, length: 248) 161.213.8.243.32768 > 161.213.4.226.syslog: UDP, length 220 0x0000: 4500 00f8 0000 4000 3b11 ed75 a1d5 08f3 E.....@.;..u.... 0x0010: a1d5 04e2 8000 0202 00e4 660c 3c31 3238 ..........f.<128 0x0020: 3e20 4a75 6e20 3133 2030 363a 3536 3a31 >.Jun.13.06:56:1 0x0030: 362e 3732 3820 6170 665f 726f 6775 655f 6.728.apf_rogue_ 0x0040: 6465 7465 6374 2e63 3a35 3735 2041 5046 detect.c:575.APF 0x0050: 2d31 -1 Is this behavior different in a later version of syslog-ng and should I upgrade? Cheers, JDP --------------------------------- Jason D Poley Network Tech GS ITS Network County of Santa Barbara 805.568.2680 jpoley(a)co.santa-barbara.ca.us

2 3

Syslog-ng in Solaris 8
by Maurice Manurung 13 Jun '07

13 Jun '07

Dear All, I already install Syslog-NG on solaris 8 using pkg-add from www.sunfreeware.com. The package are: syslogng-1.6.11-sol8-sparc-local.gz and libol-0.3.18-sol8-sparc-local.gz. I used the standard pkg-add command on Solaris 8 and install succesfully with no error. How to make sure the package running success and working normal? Please advice. Thanks. Maurice

2 1