[syslog-ng] Performance issues

[Joe Shaw]

Hi,

On Thu, Dec 18, 2008 at 3:55 PM,  <farouk.s.khawaja at jpmorgan.com> wrote:
> I'm finding that my Syslog-NG 2.0.9 OSE is not able to send more than 19
> msgs/sec.
>
> source s_ldsol01_file {
>         file("/tmp/ldsol01-clog.log"
>              follow_freq(10)
>              flags(no-parse)
>              log_fetch_limit(1000)
>              log_iw_size(2000)
>         );
> };

You're polling the file every 10 seconds (follow_freq() is in seconds,
not milliseconds) and reading a maximum of 1000 messages per
iteration, so your maximum possible throughput is 100 msgs/sec.

That's still quite a bit higher than the 19 you're seeing, but you
might want to try dropping the value of follow_freq to 1 and see if
that shows an improvement.

Joe