You might try my ELSA project (enterprise-log-search-and-archive.googlecode.com) which can be run in archive-only mode.  It uses MySQL's archive storage engine for compression which gives you a 20:1 compression ratio and should be able to handle 50k events/sec, including proper rotation.


On Mon, Feb 18, 2013 at 9:20 AM, C. L. Martinez <carlopmart@gmail.com> wrote:
Better than brtfs, maybe FreeBSD/ZFS is best option ... IMO.


On Mon, Feb 18, 2013 at 3:14 PM, Gergely Nagy <algernon@balabit.hu> wrote:
> Daniel Neubacher <daniel.neubacher@xing.com> writes:
>
>> Thanks for your detailed responses. The external compression was my
>> last resolution but now I've maybe found my final solution. I've
>> installed Kernel 3.2 & Btrfs with zlib compression. The fs isn't
>> marked as stable yet but I've heard some positive responses from
>> fellow admins. Right now I've got a real time compression rate of 84%
>> without any cpu problems. I hope my long term test is running fine but
>> right now I'm pretty happy.
>
> That's an interesting solution aswell, thanks for sharing it! I was
> already considering BTRFS for the next experimental servers I'll be
> bringing up, this adds one more point in its favour. :)
>
> --
> |8]
>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
______________________________________________________________________________
Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng
FAQ: http://www.balabit.com/wiki/syslog-ng-faq