I was able to solve the problem by setting log_fifo_size to 1000. ramesh Ramesh Uppuluri wrote:
I configured syslog-ng to use the template to generate mysql INSERT statements and write to a unix pipe. I am using a shell script that reads from this pipe and replays these messages to mysql. In normal load conditions all the messages are making it to the db. It even worked fine when I pumped in 100msgs/sec. However when I sent a burst of 500msgs only around 180msgs are making it through. When I try the same rate writing to a text file (not using unix pipe), all the msgs make it through. so, it looks like the msgs are getting dropped due to the pipe overflow. Did anybody encounter the same problem? If so, do you have any suggestions to overcome this problem?
When I replayed the INSERT commands using unix cat to the pipe and write it to the db using the same script, I was able to write 2500rows/sec. I thing cat call blocks. so, is the problem related to how syslong-ng writes to the pipe?
thanks ramesh
_______________________________________________ syslog-ng maillist - syslog-ng@lists.balabit.hu https://lists.balabit.hu/mailman/listinfo/syslog-ng Frequently asked questions at http://www.campin.net/syslog-ng/faq.html