[syslog-ng] [RFC]: MongoDB destination, with inserts!

Gergely Nagy algernon at balabit.hu
Thu Aug 23 14:03:53 CEST 2012


Gergely Nagy <algernon at balabit.hu> writes:

> The work done on this branch also paves way for major changes within the
> MongoDB destination driver: moving away from upserts to inserts, and
> then on to batch inserts, from which I expect a significant performance
> boost.

The feature/3.4/value-pairs/walk branch[1] has now been changed so that
the mongodb destination will use inserts over updates (and still
maintain a possibly nested structure in the db).

The performance right now is probably quite poor, there's a lot of
things that can - and will - be improved, but not using upserts should
already result in lower load on busy sites. I would appreciate any
feedback on this, mostly about performance, or any possible bugs.

No changes are necessary in the config, just plug 3.4 in, and it should
Do The Right Thing(tm).

 [1]: https://github.com/algernon/syslog-ng/commits/feature/3.4/value-pairs/walk

-- 
|8]



More information about the syslog-ng mailing list