<div dir="ltr">Hi folks,<div><br></div><div>It would be really helpful if any of you are able to help with the below query. </div><div><br></div><div>Thanks!</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, Jun 5, 2021 at 12:56 AM Pradeep Gotaparthi <<a href="mailto:pradeep.gp@gmail.com">pradeep.gp@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi Balazs,</div><div><br></div><div>Sorry, couldnt get back to you earlier. Below is a sample of config</div><div><br></div><div>destination d_msg_04 {<br> tcp(<br> "172.49.20.136"<br> port(2193)<br> # log-fifo-size should be atleast max-connections * log-fetch-limit<br> # 500 * 10 (default value of log-fetch-limit)<br> log-fifo-size(5000)<br> # throttle to max 5k logs<br> throttle(5000)<br> disk-buffer(<br> # number of bytes to store in memory<br> mem-buf-size(10000)<br> # number of bytes to store on disk<br> disk-buf-size(134217728000) # 100GB<br><br> reliable(yes)<br> # directory location to persist messages<br> dir("/data/store")<br> )<br> persist-name(d_msg_04)<br> );<br>};<br></div><div><br></div><div>The throttle value as you can see is set to 5000. Throttling is an important part of using syslog-ng for us here and it does a good job of it. The exception is when there is a backlog built up on syslog-ng (it received a lot more logs than it could push out honoring the throttle limit), and we stop or restart syslog-ng. At that time, it appears to be "flushing out" whatever messages it has in its buffer and disregard the throttle limit at this time. This is causing issues for us.</div><div><br></div><div>So, wanted to understand if there is a way to prevent this. Tried tinkering with the log-fifo-size thinking it may prevent too many messages in the buffer and there by help with this problem but it didnt help.</div><div><br></div><div>It would be great if you could help us with this.</div><div><br></div><div><br></div><div>Thanks !</div><div><br></div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Apr 21, 2021 at 10:29 AM Balazs Scheidler <<a href="mailto:bazsi77@gmail.com" target="_blank">bazsi77@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Hi,<div dir="auto"><br></div><div dir="auto">I am not sure I understand your problem. Can you elaborate it a bit? Configuration, the problem as you see it and your expectations would help a lot to respond to your question.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Apr 21, 2021, 02:50 Pradeep Gotaparthi <<a href="mailto:pradeep.gp@gmail.com" target="_blank">pradeep.gp@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi,</div><div><br></div><div>Could anybody help us out with the below query?</div><div><br></div><div><br></div><div>Thanks.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Mar 26, 2021 at 12:06 AM Pradeep Gotaparthi <<a href="mailto:pradeep.gp@gmail.com" rel="noreferrer" target="_blank">pradeep.gp@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>We have been using syslog-ng for over a year now and it is working great, thanks!</div><div><br></div><div>One issue we face is that when we stop the process when there is some buffer, the threshold is ignored and a bunch of logs get pushed out (as much as 10 times the threshold value). This is causing problems on the receiving end as it can't handle the load. We thought the log-fifo-size parameter can help as syslog uses this parameter to store logs in memory but it is not helping. </div><div><br></div><div>It would be great if you can guide us.</div><div><br></div><div><br></div><div>Thanks.</div></div>
</blockquote></div></div>
______________________________________________________________________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" rel="noreferrer noreferrer" target="_blank">https://lists.balabit.hu/mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" rel="noreferrer noreferrer" target="_blank">http://www.balabit.com/support/documentation/?product=syslog-ng</a><br>
FAQ: <a href="http://www.balabit.com/wiki/syslog-ng-faq" rel="noreferrer noreferrer" target="_blank">http://www.balabit.com/wiki/syslog-ng-faq</a><br>
<br>
</blockquote></div>
______________________________________________________________________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" rel="noreferrer" target="_blank">https://lists.balabit.hu/mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" rel="noreferrer" target="_blank">http://www.balabit.com/support/documentation/?product=syslog-ng</a><br>
FAQ: <a href="http://www.balabit.com/wiki/syslog-ng-faq" rel="noreferrer" target="_blank">http://www.balabit.com/wiki/syslog-ng-faq</a><br>
<br>
</blockquote></div>
</blockquote></div>