We're doing ~1.5GB/day with absolutely no performance problems at all. In fact the CPUs are around 80-90% idle when processing this amount of log data. I'm using a FIFO to to direct the log data into splunk. I found that the tailing processor and the directory monitor were both much slower than the FIFO at handling steady streams of log data. Paul Krizak 5900 E. Ben White Blvd. MS 625 Advanced Micro Devices Austin, TX 78741 Linux/Unix Systems Engineering Phone: (512) 602-8775 Microprocessor Solutions Sector sawall wrote:
I tried splunk too, but had major time issues with it importing my data. I have 5+ GB of syslogs a day.
It's wonderful for the data that's in there and being able to search on it. I just need a better way to get it into the database more efficiently.
Thoughts?
Chris
On 4/7/06, *Paul Krizak* <paul.krizak@amd.com <mailto:paul.krizak@amd.com>> wrote:
Yeah it's very very nice. It's still kinda buggy since it's a very new piece of software, but the support folks are fantastic and they're actively working to make things better.
The licenses are a bit expensive, though.
Paul Krizak 5900 E. Ben White Blvd. MS 625 Advanced Micro Devices Austin, TX 78741 Linux/Unix Systems Engineering Phone: (512) 602-8775 Microprocessor Solutions Sector Cell: (512) 791-0686
Heigl Florian - Munich-MR - external wrote: >> We're using Splunk ( http://www.splunk.com) as a visual >> front-end to our >> syslog data. > > Wow, compared to php-syslog this seems like ferrari and fiat. > Are You still happy with it? I played around in their demo > site and am really amazed by it. > > Florian > _______________________________________________ > syslog-ng maillist - syslog-ng@lists.balabit.hu <mailto:syslog-ng@lists.balabit.hu> > https://lists.balabit.hu/mailman/listinfo/syslog-ng > Frequently asked questions at http://www.campin.net/syslog-ng/faq.html <http://www.campin.net/syslog-ng/faq.html> > >
_______________________________________________ syslog-ng maillist - syslog-ng@lists.balabit.hu <mailto:syslog-ng@lists.balabit.hu> https://lists.balabit.hu/mailman/listinfo/syslog-ng Frequently asked questions at http://www.campin.net/syslog-ng/faq.html
------------------------------------------------------------------------
_______________________________________________ syslog-ng maillist - syslog-ng@lists.balabit.hu https://lists.balabit.hu/mailman/listinfo/syslog-ng Frequently asked questions at http://www.campin.net/syslog-ng/faq.html