[syslog-ng] syslog-ng performance tuning

[Siem Korteweg]

Remi,

just to make sure. Do your ulimit settings allow you to spawn the p (1000)
processes in paralel?

Considering your test. Did each instance of the test program write it's own
unique lines and can you see whether some processes did not make it to syslog
or that all processes produced partial logging?

regards,

Siem Korteweg

-----Oorspronkelijk bericht-----
Van: syslog-ng-bounces at lists.balabit.hu namens Rémi BUISSON
Verzonden: vr 12-2-2010 17:51
Aan: syslog-ng at lists.balabit.hu
Onderwerp: [syslog-ng] syslog-ng performance tuning
 
Hi everybody,

I'have an issue with syslog-ng configuration.
I would like to centralize my logs on one server.

I've a lot of logs to send. I don't know how many but I can estimate it 
to 500GB per day from decades of servers.
But, it writes only 25 GB per day.
For some reasons I work on a debian etchnhalf environnement.
So, I'm working with syslog-ng 2.0.0.

I wrote a perl program which spawn p "logger -p local5.info" processes
and send n lines of m characters.

I'have tested with:
p: 1 000
n: 1 000
m: 1 000

Instead of having 1 000 000 lines in my logs I have nearly 10 000 lines !
But my test was not revelant because normal logs where not stopped. So, 
maybe normal.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/ms-tnef
Size: 3213 bytes
Desc: not available
Url : http://lists.balabit.hu/pipermail/syslog-ng/attachments/20100212/95d087a8/attachment.bin