[syslog-ng] how to archive logs efficiently

[Martin Holste]

You might try my ELSA project (
enterprise-log-search-and-archive.googlecode.com) which can be run in
archive-only mode.  It uses MySQL's archive storage engine for compression
which gives you a 20:1 compression ratio and should be able to handle 50k
events/sec, including proper rotation.


On Mon, Feb 18, 2013 at 9:20 AM, C. L. Martinez <carlopmart at gmail.com>wrote:

> Better than brtfs, maybe FreeBSD/ZFS is best option ... IMO.
>
>
> On Mon, Feb 18, 2013 at 3:14 PM, Gergely Nagy <algernon at balabit.hu> wrote:
> > Daniel Neubacher <daniel.neubacher at xing.com> writes:
> >
> >> Thanks for your detailed responses. The external compression was my
> >> last resolution but now I've maybe found my final solution. I've
> >> installed Kernel 3.2 & Btrfs with zlib compression. The fs isn't
> >> marked as stable yet but I've heard some positive responses from
> >> fellow admins. Right now I've got a real time compression rate of 84%
> >> without any cpu problems. I hope my long term test is running fine but
> >> right now I'm pretty happy.
> >
> > That's an interesting solution aswell, thanks for sharing it! I was
> > already considering BTRFS for the next experimental servers I'll be
> > bringing up, this adds one more point in its favour. :)
> >
> > --
> > |8]
> >
> >
> ______________________________________________________________________________
> > Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> > Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> > FAQ: http://www.balabit.com/wiki/syslog-ng-faq
> >
>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.balabit.hu/pipermail/syslog-ng/attachments/20130220/20c2ed2f/attachment.htm