[syslog-ng] improving SQLite writing performances (WAS: Re: inserts into a sqlite3 database are not delayed)
bazsi77 at gmail.com
Mon Oct 27 21:03:11 CET 2014
Well, changing syslog-ng to use the bulk loading API for various databases
would probably increase performance a lot.
But that's a nontrivial code change, and would probably not work through
On Oct 27, 2014 5:39 PM, "Davide Alberani" <davide.alberani at gmail.com>
> On Wed, Oct 15, 2014 at 10:56 AM, Balazs Scheidler <bazsi77 at gmail.com>
> > It immediately runs the query, flush_lines() controls the transaction
> > which can be enabled using
> > flags(explicit-commits).
> Ok, I see and I can confirm noticeable improvements on a system
> under heavy I/O and CPU load using explicit-commits (or better: I see
> it gets a lot worse disabling it, since I already had it on ;))
> Plus, I'm seeing minor improvements with session_statements set
> to "PRAGMA synchronous=OFF; PRAGMA count_changes=OFF;"
> Beside this, has anyone found other ways to improve writing performances
> using syslog-ng with sqlite?
> On (physical) systems with high load, I've noticed that the system is much
> responsive if the elevator is set to noop or deadline instead of cfq.
> But I guess this is highly dependent on the specific circumstances of
> the system.
> Davide Alberani <davide.alberani at gmail.com> [PGP KeyID: 0x465BFD47]
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the syslog-ng