<div dir="ltr">Thanks for all of those alternatives.<br>Allow me to rephrase my question (any idea): Does anyone have any idea as to why I am getting the broken pipe?<br>The script I am using now is for the sake of simplifying things so I can pin point where troubles begin.<br>
We are not going to use such a script in production.<br>The original java program that was supposed to be the destination is much more complicated, although in a sense it still reads the log messages off of std in, just like the script. (it is the handling of the logs afterwards that is complex).<br>
I shall investigate into using one of the alternatives, however - I will still be happy to know what might have went wrong.<br><br>Thanks.<br><br><div class="gmail_quote">On Wed, Aug 20, 2008 at 12:55 AM, <span dir="ltr"><<a href="mailto:prmarino1@gmail.com">prmarino1@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">well the script on the surface sounds like a good simple idea, the simple way is not always the best or most relyable way. There are several better options open to you that should work better and shouldn't be too hard to impliment. The first is to write to a log file then use something like a "tail -f" in your script. Another option open to you is if you know how to write unix network program's in any languages (I use perl for this kind of thing my self) it wouldn't be difficult to write a simple application read from a socket, or even udp syslog on an alternitive port on the loopback address. Syslog is a relitivly simple protocal to write a listener for and there are several perl modules that can do most of the work for you.<br>
-----------------------<br>
Sent from my Treo(r) smartphone<br>
<div><div></div><div class="Wj3C7c"><br>
-----Original Message-----<br>
From: "midnight codder" <<a href="mailto:midnight.codder@gmail.com">midnight.codder@gmail.com</a>><br>
Date: Tuesday, Aug 19, 2008 5:08 pm<br>
Subject: [syslog-ng] destination program is killed due to broken pipe<br>
To: syslog-ng@lists.balabit.huReply-To: Syslog-ng users' and developers' mailing list <<a href="mailto:syslog-ng@lists.balabit.hu">syslog-ng@lists.balabit.hu</a>><br>
<br>
I am trying to redirect all log messages to a destination program (written in java).<br>
This did not do much so I redirected all messages to a single catch-all log file AND also to a bash shell script that runs an endless loop, reads a line and spit it out to a text file.<br>
The shell script is killed by syslog-ng after the 5th message. The catch-all file, however, keeps getting all of the messages (that's how I know who is killing who).<br>
<br>
Here is the config file for syslog-ng:<br>
<br>
options {<br>
ts_format(iso);<br>
frac_digits(3);<br>
};<br>
<br>
template bds_template{<br>
template('<pri=$PRI> <date=$ISODATE> <host=$HOST> <msg=$MSG>\n');<br>
template_escape(no);<br>
};<br>
<br>
source src{<br>
internal();<br>
unix_stream('/dev/log');<br>
unix-dgram('/dev/log');<br>
file('/proc/kmsg' log_prefix('kernel:'));<br>
udp();<br>
tcp();<br>
};<br>
<br>
<br>
destination test_adapter{<br>
program('bash /usr/local/bds/logger/syslogAdapterTest.sh' template(bds_template));<br>
};<br>
<br>
log { source(src); destination(test_adapter); };<br>
<br>
destination catchAll{<br>
file('/var/log/syslog-ng-catch-all.log', template(bds_template));<br>
};<br>
<br>
log { source(src); destination(catchAll); };<br>
<br>
Here is the bash script:<br>
<br>
#!/bin/bash<br>
<br>
file='/root/syslogAdapterTest'<br>
counter=1<br>
limit=3<br>
<br>
<br>
while true<br>
do<br>
read line<br>
echo '$line' > $file.$counter<br>
((counter++))<br>
done<br>
<br>
and finally the content of the catch-all file, in blue are the log messages that the shell script still captures and spits to text files, in red are the messages are the messages the shell does not get:<br>
<br>
</div></div> <priE> <date 08-08-19T15:13:56.191-05:00> <host=oracle-test> <msg=syslog-ng[27971]: Server license found, starting in server mode; customer='University of Illinois', serial='49544f30-573e-11dd-9892-0007e9195011', limit='25'><br>
<priF> <date 08-08-19T15:13:56.191-05:00> <host=oracle-test> <msg=syslog-ng[27971]: Starting destination program; cmdline='bash /usr/local/bds/logger/syslogAdapterTest.sh'><br>
<priE> <date 08-08-19T15:13:56.193-05:00> <host=oracle-test> <msg=syslog-ng[27971]: syslog-ng starting up; version='2.1.11a'><br>
<priF> <date 08-08-19T15:13:56.193-05:00> <host=oracle-test> <msg=syslog-ng[27971]: Initializing destination file writer; template='/var/log/syslog-ng-catch-all.log', filename='/var/log/syslog-ng-catch-all.log'><br>
<priE> <date 08-08-19T15:13:56.193-05:00> <host=oracle-test> <msg=syslog-ng[27971]: License validity expires in one week, logging service will terminate at that point; error='License outside the validity period (option=syslog-ng, not-before 08/07/21, not-after 08/08/21)'><br>
<priC> <date 08-08-19T15:13:56.198-05:00> <host=oracle-test> <msg=syslog-ng[27971]: I/O error occurred while writing; fd='11', error='Broken pipe (32)'><br>
<priF> <date 08-08-19T15:13:56.198-05:00> <host=oracle-test> <msg=syslog-ng[27971]: Sending child a TERM signal; child_pid='27972'><br>
<br>
Any idea?<br>
<br>
<br>
______________________________________________________________________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" target="_blank">https://lists.balabit.hu/mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" target="_blank">http://www.balabit.com/support/documentation/?product=syslog-ng</a><br>
FAQ: <a href="http://www.campin.net/syslog-ng/faq.html" target="_blank">http://www.campin.net/syslog-ng/faq.html</a><br>
<br>
</blockquote></div><br></div>