<p dir="ltr">Well, changing syslog-ng to use the bulk loading API for various databases would probably increase performance a lot.</p>
<p dir="ltr">But that's a nontrivial code change, and would probably not work through libdbi.</p>
<div class="gmail_quote">On Oct 27, 2014 5:39 PM, "Davide Alberani" <<a href="mailto:davide.alberani@gmail.com">davide.alberani@gmail.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Wed, Oct 15, 2014 at 10:56 AM, Balazs Scheidler <<a href="mailto:bazsi77@gmail.com">bazsi77@gmail.com</a>> wrote:<br>
><br>
> It immediately runs the query, flush_lines() controls the transaction size,<br>
> which can be enabled using<br>
> flags(explicit-commits).<br>
<br>
Ok, I see and I can confirm noticeable improvements on a system<br>
under heavy I/O and CPU load using explicit-commits (or better: I see<br>
it gets a lot worse disabling it, since I already had it on ;))<br>
<br>
Plus, I'm seeing minor improvements with session_statements set<br>
to "PRAGMA synchronous=OFF; PRAGMA count_changes=OFF;"<br>
<br>
Beside this, has anyone found other ways to improve writing performances<br>
using syslog-ng with sqlite?<br>
<br>
On (physical) systems with high load, I've noticed that the system is much more<br>
responsive if the elevator is set to noop or deadline instead of cfq.<br>
But I guess this is highly dependent on the specific circumstances of<br>
the system.<br>
<br>
<br>
Thanks!<br>
<br>
--<br>
Davide Alberani <<a href="mailto:davide.alberani@gmail.com">davide.alberani@gmail.com</a>> [PGP KeyID: 0x465BFD47]<br>
<a href="http://www.mimante.net/" target="_blank">http://www.mimante.net/</a><br>
______________________________________________________________________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" target="_blank">https://lists.balabit.hu/mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" target="_blank">http://www.balabit.com/support/documentation/?product=syslog-ng</a><br>
FAQ: <a href="http://www.balabit.com/wiki/syslog-ng-faq" target="_blank">http://www.balabit.com/wiki/syslog-ng-faq</a><br>
<br>
</blockquote></div>