getting syslog stats without syslog-ng-ctl?
Hello there, we are plotting and monitoring lot of data and for this I'm using a little bash script which does sum up the output of syslog-ng-ctl. But this is kind of slow with 17k lines to parse :P Is there a way to get the stats directly without syslog-ng-ctl? My goal is to write a ruby script which only parse the stats i'm needing. I'm no developer so please answer admin friendly :)
Hi, it is quite easy, all that syslog-ng-ctl does is that it writes "STATS\n" into the syslog-ng control socket and displays the result. I'm not familiar with ruby, but I assume that basic Unix domain socket read/write is not that hard to do with it. With the use of netcat you can check that root@lyra:~# nc -U /var/lib/syslog-ng/syslog-ng.ctl STATS SourceName;SourceId;SourceInstance;State;Type;Number center;;received;a;processed;0 destination;d_messages;;a;processed;751 src.internal;s_src#2;;a;processed;9 src.internal;s_src#2;;a;stamp;1357639178 destination;d_console_all;;a;processed;553 center;;queued;a;processed;0 destination;d_console;;a;processed;56 destination;d_xconsole;;a;processed;553 global;payload_reallocs;;a;processed;424 global;sdata_updates;;a;processed;0 global;msg_clones;;a;processed;0 source;s_src;;a;processed;7666 . ^C Balint
Hello there, we are plotting and monitoring lot of data and for this I'm using a little bash script which does sum up the output of syslog-ng-ctl. But this is kind of slow with 17k lines to parse :P Is there a way to get the stats directly without syslog-ng-ctl? My goal is to write a ruby script which only parse the stats i'm needing.
I'm no developer so please answer admin friendly :)
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
Thanks for the answer. Thats what i needed to know. And now I now that the nc of the server is too old, no -U option :P ________________________________ Von: syslog-ng-bounces@lists.balabit.hu [syslog-ng-bounces@lists.balabit.hu]" im Auftrag von "Balint Kovacs [balint.kovacs@balabit.com] Gesendet: Dienstag, 8. Januar 2013 11:09 An: syslog-ng@lists.balabit.hu Betreff: Re: [syslog-ng] getting syslog stats without syslog-ng-ctl? Hi, it is quite easy, all that syslog-ng-ctl does is that it writes "STATS\n" into the syslog-ng control socket and displays the result. I'm not familiar with ruby, but I assume that basic Unix domain socket read/write is not that hard to do with it. With the use of netcat you can check that root@lyra:~# nc -U /var/lib/syslog-ng/syslog-ng.ctl STATS SourceName;SourceId;SourceInstance;State;Type;Number center;;received;a;processed;0 destination;d_messages;;a;processed;751 src.internal;s_src#2;;a;processed;9 src.internal;s_src#2;;a;stamp;1357639178 destination;d_console_all;;a;processed;553 center;;queued;a;processed;0 destination;d_console;;a;processed;56 destination;d_xconsole;;a;processed;553 global;payload_reallocs;;a;processed;424 global;sdata_updates;;a;processed;0 global;msg_clones;;a;processed;0 source;s_src;;a;processed;7666 . ^C Balint Hello there, we are plotting and monitoring lot of data and for this I'm using a little bash script which does sum up the output of syslog-ng-ctl. But this is kind of slow with 17k lines to parse :P Is there a way to get the stats directly without syslog-ng-ctl? My goal is to write a ruby script which only parse the stats i'm needing. I'm no developer so please answer admin friendly :) ______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
Daniel: can you share what are you using stats for? Maybe some interesting aggregations? On Tue, Jan 8, 2013 at 2:20 PM, Daniel Neubacher <daniel.neubacher@xing.com>wrote:
Thanks for the answer. Thats what i needed to know. And now I now that the nc of the server is too old, no -U option :P
------------------------------ *Von:* syslog-ng-bounces@lists.balabit.hu [ syslog-ng-bounces@lists.balabit.hu]" im Auftrag von "Balint Kovacs [ balint.kovacs@balabit.com] *Gesendet:* Dienstag, 8. Januar 2013 11:09 *An:* syslog-ng@lists.balabit.hu *Betreff:* Re: [syslog-ng] getting syslog stats without syslog-ng-ctl?
Hi,
it is quite easy, all that syslog-ng-ctl does is that it writes "STATS\n" into the syslog-ng control socket and displays the result. I'm not familiar with ruby, but I assume that basic Unix domain socket read/write is not that hard to do with it. With the use of netcat you can check that
root@lyra:~# nc -U /var/lib/syslog-ng/syslog-ng.ctl STATS SourceName;SourceId;SourceInstance;State;Type;Number center;;received;a;processed;0 destination;d_messages;;a;processed;751 src.internal;s_src#2;;a;processed;9 src.internal;s_src#2;;a;stamp;1357639178 destination;d_console_all;;a;processed;553 center;;queued;a;processed;0 destination;d_console;;a;processed;56 destination;d_xconsole;;a;processed;553 global;payload_reallocs;;a;processed;424 global;sdata_updates;;a;processed;0 global;msg_clones;;a;processed;0 source;s_src;;a;processed;7666 . ^C
Balint
Hello there, we are plotting and monitoring lot of data and for this I'm using a little bash script which does sum up the output of syslog-ng-ctl. But this is kind of slow with 17k lines to parse :P Is there a way to get the stats directly without syslog-ng-ctl? My goal is to write a ruby script which only parse the stats i'm needing.
I'm no developer so please answer admin friendly :)
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
-- Best regards, Koldaev Anton
Our most important stats right now are simply the logs per second. Our logstash setup is pretty new and we don't know how it scales with our logs yet. So this is a good indicator. And I'm using it to play around with syslog-ng performance options and to see if it is running at all. On the client side the drop rate is of course nice but only for nagios. Nothing special. If you have any other ideas what to monitor or graph I'm pretty interessted. We love graphs :) ________________________________ Von: syslog-ng-bounces@lists.balabit.hu [syslog-ng-bounces@lists.balabit.hu]" im Auftrag von "Anton Koldaev [koldaevav@gmail.com] Gesendet: Dienstag, 8. Januar 2013 11:53 An: Syslog-ng users' and developers' mailing list Betreff: Re: [syslog-ng] getting syslog stats without syslog-ng-ctl? Daniel: can you share what are you using stats for? Maybe some interesting aggregations? On Tue, Jan 8, 2013 at 2:20 PM, Daniel Neubacher <daniel.neubacher@xing.com<mailto:daniel.neubacher@xing.com>> wrote: Thanks for the answer. Thats what i needed to know. And now I now that the nc of the server is too old, no -U option :P ________________________________ Von: syslog-ng-bounces@lists.balabit.hu<mailto:syslog-ng-bounces@lists.balabit.hu> [syslog-ng-bounces@lists.balabit.hu<mailto:syslog-ng-bounces@lists.balabit.hu>]" im Auftrag von "Balint Kovacs [balint.kovacs@balabit.com<mailto:balint.kovacs@balabit.com>] Gesendet: Dienstag, 8. Januar 2013 11:09 An: syslog-ng@lists.balabit.hu<mailto:syslog-ng@lists.balabit.hu> Betreff: Re: [syslog-ng] getting syslog stats without syslog-ng-ctl? Hi, it is quite easy, all that syslog-ng-ctl does is that it writes "STATS\n" into the syslog-ng control socket and displays the result. I'm not familiar with ruby, but I assume that basic Unix domain socket read/write is not that hard to do with it. With the use of netcat you can check that root@lyra:~# nc -U /var/lib/syslog-ng/syslog-ng.ctl STATS SourceName;SourceId;SourceInstance;State;Type;Number center;;received;a;processed;0 destination;d_messages;;a;processed;751 src.internal;s_src#2;;a;processed;9 src.internal;s_src#2;;a;stamp;1357639178 destination;d_console_all;;a;processed;553 center;;queued;a;processed;0 destination;d_console;;a;processed;56 destination;d_xconsole;;a;processed;553 global;payload_reallocs;;a;processed;424 global;sdata_updates;;a;processed;0 global;msg_clones;;a;processed;0 source;s_src;;a;processed;7666 . ^C Balint Hello there, we are plotting and monitoring lot of data and for this I'm using a little bash script which does sum up the output of syslog-ng-ctl. But this is kind of slow with 17k lines to parse :P Is there a way to get the stats directly without syslog-ng-ctl? My goal is to write a ruby script which only parse the stats i'm needing. I'm no developer so please answer admin friendly :) ______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq ______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq -- Best regards, Koldaev Anton
participants (3)
-
Anton Koldaev
-
Balint Kovacs
-
Daniel Neubacher