<div dir="ltr">Hello Sebastian,<div> discussed with others, this error message most probably happens if the log source sends a TCP RST message.</div><div> an example for this: Firewall terminates a connection due to inactivity, and syslog-ng tries to read from the connection.</div><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> If <span lang="EN-GB" style="background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;font-size:10pt;font-family:Arial,sans-serif;color:black">I understand correctly I can't use this option ‘flow-control’ with destination<span> </span></span><span lang="EN-GB" style="font-size:12.8px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">d_SIEM_</span></blockquote><div><br></div><div>Technically you can use the flow-control option with the d_SIEM destination included (it will be still valid and applied for the d_BOX destination), but since UDP is a connection less protocol, syslog-ng can not detect if the destination has a congestion or not.</div><div><br></div><div>If the destination can not process the incoming UDP messages in time, the incoming buffer will be filled up, and new messages will be dropped.</div><div><br></div><div>Br,</div><div>Laci</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Aug 21, 2018 at 2:34 PM, <span dir="ltr"><<a href="mailto:swald.ext@orange.com" target="_blank">swald.ext@orange.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="FR" link="blue" vlink="purple">
<div class="m_6693643160306445889WordSection1">
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black">Thanks a lot for this response Laci.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black">The file descriptor corresponds to a connection with the source of log applications…
<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black">If I understand correctly I can't use this option ‘flow-control’ with destination
</span><span lang="EN-GB">d_SIEM_... Maybe that's what's causing me trouble.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Best regards. Sebastian.</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"><u></u><u></u></span></p><div><div class="h5">
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-GB">Hello Sebastian,<u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-GB"> </span>the copied error message indicates that there was a problem with your TCP source (s_remote_tcp). But unfortunately I can not reproduce the exact same error.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Just to be sure, please check what connection was associated with the mentioned fd (in this case fd='32') when the error message occur.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"> Undependent from the connection problem. You mentioned: "<span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">We lose some logs."</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> Please notice, that the flow-control option is not interpreted in case of UDP connections (in both directions) so it is possible to loose messages
with this configuration by design.</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">Best regards,</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">Laci</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Tue, Aug 21, 2018 at 11:46 AM, <<a href="mailto:swald.ext@orange.com" target="_blank">swald.ext@orange.com</a>> wrote:<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">Hello,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">We are a syslog-ng configuration with multiple destinations :
</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">source s_remote_udp {</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> udp(ip(0.0.0.0) port(514));</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">};</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">source s_remote_tcp {</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> tcp(ip(0.0.0.0) port(514) max-connections(1000) so_keepalive(yes));</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">};</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal">destination d_SIEM_ { udp("10.0.1.145" port(514)); };<u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">destination d_BOX_ { file("/var/log/box/FLOW_$R_<wbr>MONTH$R_DAY$R_HOUR$R_MIN.log" create_dirs(yes) dir_perm(0755) dir_owner(root) dir_group(root) owner(root) group(root));
};</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">filter f_SIEM_ { match("FLOW:"); };</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">log { source(s_remote_udp); source(s_remote_tcp); filter(f_SIEM_); destination(d_BOX_); destination(d_SIEM_);flags(<wbr>flow-control,final); };</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">We can see kind of errors :</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black">/var/log/syslog-ng.log : Aug 4 23:34:39 host1 syslog-ng[16290]: I/O error occurred while
reading; fd='32', error='Connection reset by peer (104)'</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black">We lose some logs. We have a syslog-ng version 3.2.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black">Can you help please please ?</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black">How can I diagnose the problem? How do I get to the root of the problem? Maybe debugging
syslog-ng?</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Thanks in advance.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Best regards. Sebastian.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB"> </span><u></u><u></u></p>
</div>
<pre>______________________________<wbr>______________________________<wbr>______________________________<wbr>______________________________<wbr>_<u></u><u></u></pre>
<pre><u></u> <u></u></pre>
<pre>Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc<u></u><u></u></pre>
<pre>pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler<u></u><u></u></pre>
<pre>a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,<u></u><u></u></pre>
<pre>Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.<u></u><u></u></pre>
<pre><u></u> <u></u></pre>
<pre>This message and its attachments may contain confidential or privileged information that may be protected by law;<u></u><u></u></pre>
<pre>they should not be distributed, used or copied without authorisation.<u></u><u></u></pre>
<pre>If you have received this email in error, please notify the sender and delete this message and its attachments.<u></u><u></u></pre>
<pre>As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.<u></u><u></u></pre>
<pre>Thank you.<u></u><u></u></pre>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
______________________________<wbr>______________________________<wbr>__________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" target="_blank">
https://lists.balabit.hu/<wbr>mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" target="_blank">
http://www.balabit.com/<wbr>support/documentation/?<wbr>product=syslog-ng</a><br>
FAQ: <a href="http://www.balabit.com/wiki/syslog-ng-faq" target="_blank">http://www.balabit.com/wiki/<wbr>syslog-ng-faq</a><br>
<br>
<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div><div><div class="h5">
<pre>______________________________<wbr>______________________________<wbr>______________________________<wbr>______________________________<wbr>_
Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.
</pre></div></div></div>
<br>______________________________<wbr>______________________________<wbr>__________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" rel="noreferrer" target="_blank">https://lists.balabit.hu/<wbr>mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" rel="noreferrer" target="_blank">http://www.balabit.com/<wbr>support/documentation/?<wbr>product=syslog-ng</a><br>
FAQ: <a href="http://www.balabit.com/wiki/syslog-ng-faq" rel="noreferrer" target="_blank">http://www.balabit.com/wiki/<wbr>syslog-ng-faq</a><br>
<br>
<br></blockquote></div><br></div>