[syslog-ng] losing msgs while writing to unix pipe

[Ramesh Uppuluri]

I was able to solve the problem by setting log_fifo_size to 1000.

ramesh

Ramesh Uppuluri wrote:
> I configured syslog-ng to use the template to generate mysql INSERT 
> statements and write to a
> unix pipe. I am using a shell script that reads from this pipe and 
> replays these messages to mysql.
> In normal load conditions all the messages are making it to the db. It 
> even worked fine when
> I pumped in 100msgs/sec. However when I sent a burst of 500msgs only 
> around 180msgs are
> making it through. When I try the same rate writing to a text file 
> (not using unix pipe), all the msgs
> make it through. so, it looks like the msgs are getting dropped due to 
> the pipe overflow. Did anybody
> encounter the same problem? If so, do you have any suggestions to 
> overcome this problem?
>
> When I replayed the INSERT commands using unix cat to the pipe and 
> write it to the db using the
> same script, I was able to write 2500rows/sec. I thing cat call 
> blocks. so, is the problem related to
> how syslong-ng writes to the pipe?
>
> thanks
> ramesh
>
> _______________________________________________
> syslog-ng maillist  -  syslog-ng at lists.balabit.hu
> https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Frequently asked questions at http://www.campin.net/syslog-ng/faq.html
>
>