<div dir="ltr"><div>Hi,</div><div><br></div><div>As <a href="https://copr.fedorainfracloud.org/coprs/czanik/syslog-ng314/">https://copr.fedorainfracloud.org/coprs/czanik/syslog-ng314/</a> also writes: "Java is enabled, but JAR dependencies are not provided in package, except for Elasticsearch http mode." The syslog-ng-java-deps.noarch contains build time dependencies. Probably I should rename the package to syslog-ng-java-build-deps...</div><div><br></div><div>Check the documentation at <a href="https://www.syslog-ng.com/technical-documents/doc/syslog-ng-open-source-edition/3.16/administration-guide/33#TOPIC-956506">https://www.syslog-ng.com/technical-documents/doc/syslog-ng-open-source-edition/3.16/administration-guide/33#TOPIC-956506</a> on how to download and configure HDFS related JAR dependencies.</div><div><br></div><div>Bye,<br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>Peter Czanik (CzP) <<a href="mailto:peter.czanik@balabit.com" target="_blank">peter.czanik@balabit.com</a>><br>Balabit / syslog-ng upstream<br><a href="https://syslog-ng.com/community/" target="_blank">https://syslog-ng.com/community/</a><br><a href="https://twitter.com/PCzanik" target="_blank">https://twitter.com/PCzanik</a></div></div></div></div></div></div></div></div>
<br><div class="gmail_quote">On Fri, Aug 17, 2018 at 10:22 AM, Lee Keng Ket <span dir="ltr"><<a href="mailto:kengket@gmail.com" target="_blank">kengket@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>Hi,<br><br></div>I'm trying to connect syslog-ng 3.14.1 to HDFS to store the syslog messages. The syslog-ng can start without error, and it's able to write into local file. However, the log is not written to the HDFS. As there is no single error, I'm not sure how I should troubleshoot on this.<br><br></div><div>I have installed the syslog-ng from this repo, <a href="https://copr.fedorainfracloud.org/coprs/czanik/syslog-ng314/repo/epel-7/czanik-syslog-ng314-epel-7.repo" target="_blank">https://copr.fedorainfracloud.<wbr>org/coprs/czanik/syslog-ng314/<wbr>repo/epel-7/czanik-syslog-<wbr>ng314-epel-7.repo</a><br><br>Installed Packages<br>syslog-ng.x86_64              <wbr>                              <wbr>                            3.14.1-4.el7.centos           <wbr>                              <wbr>                     @czanik-syslog-ng314<br>syslog-ng-java.x86_64         <wbr>                              <wbr>                            3.14.1-4.el7.centos           <wbr>                              <wbr>                     @czanik-syslog-ng314<br>syslog-ng-java-deps.noarch    <wbr>                              <wbr>                            1.0-2                         <wbr>                              <wbr>                     @czanik-syslog-ng314<br></div><div><br></div>This is the message from /var/log/message:<br>Log statistics; processed='src.internal(s_sys#<wbr>0)=1', stamp='src.internal(s_sys#0)=<wbr>1534491834', processed='destination(d_spol)<wbr>=0', processed='destination(d_mlal)<wbr>=0', processed='center(received)=2'<wbr>, processed='destination(d_mesg)<wbr>=1', processed='destination(d_mail)<wbr>=0', processed='destination(d_auth)<wbr>=0', processed='destination(d_cron)<wbr>=0', processed='destination(d_hdfs)<wbr>=1', processed='center(queued)=3', queued='global(scratch_<wbr>buffers_count)=0', processed='source(remote_log)=<wbr>1', dropped='dst.java(d_hdfs#0,<wbr>java_dst,hdfs,hdfs://x.x.x.x:<wbr>25000,/user/syslog/$HOST-$DAY-<wbr>$MONTH-$YEAR.log)=0', processed='dst.java(d_hdfs#0,<wbr>java_dst,hdfs,hdfs://x.x.x.x:<wbr>25000,/user/syslog/$HOST-$DAY-<wbr>$MONTH-$YEAR.log)=1', queued='dst.java(d_hdfs#0,<wbr>java_dst,hdfs,hdfs://x.x.x.x:<wbr>25000,/user/syslog/$HOST-$DAY-<wbr>$MONTH-$YEAR.log)=1', processed='global(payload_<wbr>reallocs)=0', processed='src.journald(<wbr>journal)=0', stamp='src.journald(journal)=<wbr>0', processed='global(sdata_<wbr>updates)=0', queued='global(scratch_<wbr>buffers_bytes)=0', processed='destination(d_boot)<wbr>=0', processed='destination(d_kern)<wbr>=0', processed='source(s_sys)=1', processed='destination(remote)<wbr>=1', processed='global(internal_<wbr>queue_length)=0', processed='global(msg_clones)=<wbr>0'<br><br></div>Anyone has any idea how should I proceed the troubleshooting?<br></div>
<br>______________________________<wbr>______________________________<wbr>__________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" rel="noreferrer" target="_blank">https://lists.balabit.hu/<wbr>mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" rel="noreferrer" target="_blank">http://www.balabit.com/<wbr>support/documentation/?<wbr>product=syslog-ng</a><br>
FAQ: <a href="http://www.balabit.com/wiki/syslog-ng-faq" rel="noreferrer" target="_blank">http://www.balabit.com/wiki/<wbr>syslog-ng-faq</a><br>
<br>
<br></blockquote></div><br></div>