unable to start syslog-ng.
Hello All, Hope you are all doing great. I am unable to start syslog-ng service Here is some information: *OS Version: Cent OS 7.3* *I compiled it from a tar ball..* [root@xxxxx system]# syslog-ng -V syslog-ng 3.9.1 Installer-Version: 3.9.1 Revision: Module-Directory: /usr/local/lib/syslog-ng Module-Path: /usr/local/lib/syslog-ng Available-Modules: kvformat,cef,disk-buffer,add-contextual-data,syslogformat,afsocket,affile,afprog,afuser,afamqp,afmongodb,csvparser,confgen,system-source,linux-kmsg-format,basicfuncs,cryptofuncs,dbparser,afstomp,pseudofile,graphite,sdjournal,date Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: off Enable-Linux-Caps: off *I manually added this file, this didn't come with install...* [root@xxxxx system]# cat syslog-ng.service [Unit] Description=System Logger Daemon Documentation=man:syslog-ng(8) [Service] Type=notify Sockets=syslog.socket ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 ExecReload=/bin/kill -HUP $MAINPID StandardOutput=null Restart=on-failure [Install] WantedBy=multi-user.target Alias=syslog.service [root@sl-sz3-splunk01 system]# pwd /lib/systemd/system *Had parser errors:* [root@xxxxxx ~]# syslog-ng -s Error parsing config, Error compiling template (Unknown template function "format-json") in /usr/local/share/syslog-ng/include/scl/cim/template.conf at line 23, column 32: included from /usr/local/etc/scl.conf line 29, column 1 included from /usr/local/etc/syslog-ng.conf line 8, column 1 template-function "format-cim" "$(format-json --pair @timestamp='${R_ISODATE}' --pair @message='${MSG}' --key .cim.* --shift 5 --key _* --key .* --replace-prefix .=_ --key *.*)\n"; ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ syslog-ng documentation: http://www.balabit.com/support/documentation/?product=syslog-ng mailing list: https://lists.balabit.hu/mailman/listinfo/syslog-ng *Moved /usr/local/share/syslog-ng/include/scl/cim and no parser errors.* *But still unable to start.* [root@xxxxx system]# systemctl status syslog-ng.service ● syslog-ng.service - System Logger Daemon Loaded: loaded (/usr/lib/systemd/system/syslog-ng.service; disabled; vendor preset: enabled) Active: failed (Result: start-limit) since Mon 2017-05-01 10:46:58 PDT; 7s ago Docs: man:syslog-ng(8) Process: 2170 ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 (code=exited, status=203/EXEC) Main PID: 2170 (code=exited, status=203/EXEC) May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service: main process exited, code=exited, status=203/EXEC May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service holdoff time over, scheduling restart. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: start request repeated too quickly for syslog-ng.service May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed. What I am I missing? Any help is appreciated. Thank you. -- Thanks, Vijay Amrut.
Hi Vijay I don't see json-plugin under Available-Modules section in the output of # syslog-ng -V I have also compiled syslog-ng from source (3.6.4), and it shows json-plugin in the output of syslog-ng -V You may need to pass enable-json flag while compiling it from source. # syslog-ng -V syslog-ng 3.6.4 Installer-Version: 3.6.4 Revision: Compile-Date: Dec 18 2016 15:02:59 Available-Modules: pseudofile,graphite,sdjournal,afsocket,syslogformat,afsocket-notls,afsocket-tls,affile,afprog,afuser,afamqp,afmongodb,csvparser,confgen,system-source,linux-kmsg-format,basicfuncs,cryptofuncs,dbparser,json-plugin,tfgeoip,afstomp Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: off Enable-Linux-Caps: off Since you are using the version 3.9.1, i am not 100% sure that, this is the issue. Also, you can try this link. https://lists.balabit.hu/pipermail/syslog-ng/2016-February/022667.html Regards On Tue, May 2, 2017 at 12:00 AM, vijay amruth <vijayamruth@gmail.com> wrote:
Hello All, Hope you are all doing great. I am unable to start syslog-ng service
Here is some information:
*OS Version: Cent OS 7.3*
*I compiled it from a tar ball..*
[root@xxxxx system]# syslog-ng -V syslog-ng 3.9.1 Installer-Version: 3.9.1 Revision: Module-Directory: /usr/local/lib/syslog-ng Module-Path: /usr/local/lib/syslog-ng Available-Modules: kvformat,cef,disk-buffer,add- contextual-data,syslogformat,afsocket,affile,afprog,afuser, afamqp,afmongodb,csvparser,confgen,system-source,linux- kmsg-format,basicfuncs,cryptofuncs,dbparser,afstomp, pseudofile,graphite,sdjournal,date Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: off Enable-Linux-Caps: off
*I manually added this file, this didn't come with install...*
[root@xxxxx system]# cat syslog-ng.service [Unit] Description=System Logger Daemon Documentation=man:syslog-ng(8)
[Service] Type=notify Sockets=syslog.socket ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 ExecReload=/bin/kill -HUP $MAINPID StandardOutput=null Restart=on-failure
[Install] WantedBy=multi-user.target Alias=syslog.service [root@sl-sz3-splunk01 system]# pwd /lib/systemd/system
*Had parser errors:*
[root@xxxxxx ~]# syslog-ng -s Error parsing config, Error compiling template (Unknown template function "format-json") in /usr/local/share/syslog-ng/include/scl/cim/template.conf at line 23, column 32:
included from /usr/local/etc/scl.conf line 29, column 1
included from /usr/local/etc/syslog-ng.conf line 8, column 1
template-function "format-cim" "$(format-json --pair @timestamp='${R_ISODATE}' --pair @message='${MSG}' --key .cim.* --shift 5 --key _* --key .* --replace-prefix .=_ --key *.*)\n"; ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
syslog-ng documentation: http://www.balabit.com/support/documentation/? product=syslog-ng mailing list: https://lists.balabit.hu/mailman/listinfo/syslog-ng
*Moved /usr/local/share/syslog-ng/include/scl/cim and no parser errors.* *But still unable to start.*
[root@xxxxx system]# systemctl status syslog-ng.service ● syslog-ng.service - System Logger Daemon Loaded: loaded (/usr/lib/systemd/system/syslog-ng.service; disabled; vendor preset: enabled) Active: failed (Result: start-limit) since Mon 2017-05-01 10:46:58 PDT; 7s ago Docs: man:syslog-ng(8) Process: 2170 ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 (code=exited, status=203/EXEC) Main PID: 2170 (code=exited, status=203/EXEC)
May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service: main process exited, code=exited, status=203/EXEC May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service holdoff time over, scheduling restart. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: start request repeated too quickly for syslog-ng.service May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed.
What I am I missing? Any help is appreciated. Thank you.
-- Thanks, Vijay Amrut.
____________________________________________________________ __________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/? product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
Hi, The first problem is the lack of the JSON module. For the second one there is not enough information to see, if it is a syslog-ng or a systemd service file problem. Can you start syslog-ng from the command line? I mean using the following command line to catch any problems on the terminal: syslog-ng -Fvde Bye, Peter Czanik (CzP) <peter.czanik@balabit.com> Balabit / syslog-ng upstream https://www.balabit.com/blog/author/peterczanik/ https://twitter.com/PCzanik On Mon, May 1, 2017 at 9:11 PM, Dwijadas Dey <dwijad@gmail.com> wrote:
Hi Vijay I don't see json-plugin under Available-Modules section in the output of # syslog-ng -V
I have also compiled syslog-ng from source (3.6.4), and it shows json-plugin in the output of syslog-ng -V You may need to pass enable-json flag while compiling it from source.
# syslog-ng -V syslog-ng 3.6.4 Installer-Version: 3.6.4 Revision: Compile-Date: Dec 18 2016 15:02:59 Available-Modules: pseudofile,graphite,sdjournal,afsocket,syslogformat, afsocket-notls,afsocket-tls,affile,afprog,afuser,afamqp, afmongodb,csvparser,confgen,system-source,linux-kmsg- format,basicfuncs,cryptofuncs,dbparser,json-plugin,tfgeoip,afstomp Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: off Enable-Linux-Caps: off
Since you are using the version 3.9.1, i am not 100% sure that, this is the issue.
Also, you can try this link. https://lists.balabit.hu/pipermail/syslog-ng/2016-February/022667.html
Regards
On Tue, May 2, 2017 at 12:00 AM, vijay amruth <vijayamruth@gmail.com> wrote:
Hello All, Hope you are all doing great. I am unable to start syslog-ng service
Here is some information:
*OS Version: Cent OS 7.3*
*I compiled it from a tar ball..*
[root@xxxxx system]# syslog-ng -V syslog-ng 3.9.1 Installer-Version: 3.9.1 Revision: Module-Directory: /usr/local/lib/syslog-ng Module-Path: /usr/local/lib/syslog-ng Available-Modules: kvformat,cef,disk-buffer,add-c ontextual-data,syslogformat,afsocket,affile,afprog,afuser,af amqp,afmongodb,csvparser,confgen,system-source,linux-kmsg- format,basicfuncs,cryptofuncs,dbparser,afstomp,pseudofile, graphite,sdjournal,date Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: off Enable-Linux-Caps: off
*I manually added this file, this didn't come with install...*
[root@xxxxx system]# cat syslog-ng.service [Unit] Description=System Logger Daemon Documentation=man:syslog-ng(8)
[Service] Type=notify Sockets=syslog.socket ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 ExecReload=/bin/kill -HUP $MAINPID StandardOutput=null Restart=on-failure
[Install] WantedBy=multi-user.target Alias=syslog.service [root@sl-sz3-splunk01 system]# pwd /lib/systemd/system
*Had parser errors:*
[root@xxxxxx ~]# syslog-ng -s Error parsing config, Error compiling template (Unknown template function "format-json") in /usr/local/share/syslog-ng/include/scl/cim/template.conf at line 23, column 32:
included from /usr/local/etc/scl.conf line 29, column 1
included from /usr/local/etc/syslog-ng.conf line 8, column 1
template-function "format-cim" "$(format-json --pair @timestamp='${R_ISODATE}' --pair @message='${MSG}' --key .cim.* --shift 5 --key _* --key .* --replace-prefix .=_ --key *.*)\n"; ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
syslog-ng documentation: http://www.balabit.com/support /documentation/?product=syslog-ng mailing list: https://lists.balabit.hu/mailman/listinfo/syslog-ng
*Moved /usr/local/share/syslog-ng/include/scl/cim and no parser errors.* *But still unable to start.*
[root@xxxxx system]# systemctl status syslog-ng.service ● syslog-ng.service - System Logger Daemon Loaded: loaded (/usr/lib/systemd/system/syslog-ng.service; disabled; vendor preset: enabled) Active: failed (Result: start-limit) since Mon 2017-05-01 10:46:58 PDT; 7s ago Docs: man:syslog-ng(8) Process: 2170 ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 (code=exited, status=203/EXEC) Main PID: 2170 (code=exited, status=203/EXEC)
May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service: main process exited, code=exited, status=203/EXEC May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service holdoff time over, scheduling restart. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: start request repeated too quickly for syslog-ng.service May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed.
What I am I missing? Any help is appreciated. Thank you.
-- Thanks, Vijay Amrut.
____________________________________________________________ __________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product= syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
____________________________________________________________ __________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/? product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
Hello Peter, thank you for your time, here is the output of the command, it seems like its missing JSON module, I moved this file /usr/local/share/syslog-ng/include/scl/cim is that the issue? [root@xxxxx system]# syslog-ng -Fvde [2017-05-01T12:15:43.678222] Starting to read include file; filename='/usr/local/etc/scl.conf', depth='1' [2017-05-01T12:15:43.678517] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/apache/apache.conf', depth='2' [2017-05-01T12:15:43.678527] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/elasticsearch/plugin.conf', depth='2' [2017-05-01T12:15:43.678533] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/graphite/plugin.conf', depth='2' [2017-05-01T12:15:43.678538] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/hdfs/plugin.conf', depth='2' [2017-05-01T12:15:43.678543] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/kafka/plugin.conf', depth='2' [2017-05-01T12:15:43.678549] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/loggly/loggly.conf', depth='2' [2017-05-01T12:15:43.678554] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/logmatic/logmatic.conf', depth='2' [2017-05-01T12:15:43.678559] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/mbox/mbox.conf', depth='2' [2017-05-01T12:15:43.678563] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/nodejs/plugin.conf', depth='2' [2017-05-01T12:15:43.678568] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/pacct/plugin.conf', depth='2' [2017-05-01T12:15:43.678573] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/rewrite/cc-mask.conf', depth='2' [2017-05-01T12:15:43.678579] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/solaris/plugin.conf', depth='2' [2017-05-01T12:15:43.678584] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/syslogconf/plugin.conf', depth='2' [2017-05-01T12:15:43.678588] Adding include file; filename='/usr/local/share/syslog-ng/include/scl/system/plugin.conf', depth='2' [2017-05-01T12:15:43.678600] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/apache/apache.conf', depth='2' [2017-05-01T12:15:43.678662] Reading path for candidate modules; path='/usr/local/lib/syslog-ng' [2017-05-01T12:15:43.678698] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='kvformat.so', module='kvformat' [2017-05-01T12:15:43.678944] Registering candidate plugin; module='kvformat', context='parser', name='kv-parser', preference='0' [2017-05-01T12:15:43.678956] Registering candidate plugin; module='kvformat', context='parser', name='linux-audit-parser', preference='0' [2017-05-01T12:15:43.678962] Registering candidate plugin; module='kvformat', context='template-func', name='format-welf', preference='0' [2017-05-01T12:15:43.678994] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='cef.so', module='cef' [2017-05-01T12:15:43.679107] Registering candidate plugin; module='cef', context='template-func', name='format-cef-extension', preference='0' [2017-05-01T12:15:43.679132] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='disk-buffer.so', module='disk-buffer' [2017-05-01T12:15:43.679257] Registering candidate plugin; module='disk-buffer', context='inner-dest', name='disk_buffer', preference='0' [2017-05-01T12:15:43.679286] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='add-contextual-data.so', module='add-contextual-data' [2017-05-01T12:15:43.679408] Registering candidate plugin; module='add-contextual-data', context='parser', name='add_contextual_data', preference='0' [2017-05-01T12:15:43.679438] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='syslogformat.so', module='syslogformat' [2017-05-01T12:15:43.679554] Registering candidate plugin; module='syslogformat', context='format', name='syslog', preference='0' [2017-05-01T12:15:43.679564] Registering candidate plugin; module='syslogformat', context='parser', name='syslog-parser', preference='0' [2017-05-01T12:15:43.679584] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afsocket.so', module='afsocket' [2017-05-01T12:15:43.679731] Registering candidate plugin; module='afsocket', context='source', name='unix-stream', preference='100' [2017-05-01T12:15:43.679740] Registering candidate plugin; module='afsocket', context='destination', name='unix-stream', preference='100' [2017-05-01T12:15:43.679746] Registering candidate plugin; module='afsocket', context='source', name='unix-dgram', preference='100' [2017-05-01T12:15:43.679780] Registering candidate plugin; module='afsocket', context='destination', name='unix-dgram', preference='100' [2017-05-01T12:15:43.679786] Registering candidate plugin; module='afsocket', context='source', name='tcp', preference='100' [2017-05-01T12:15:43.679792] Registering candidate plugin; module='afsocket', context='destination', name='tcp', preference='100' [2017-05-01T12:15:43.679799] Registering candidate plugin; module='afsocket', context='source', name='tcp6', preference='100' [2017-05-01T12:15:43.679804] Registering candidate plugin; module='afsocket', context='destination', name='tcp6', preference='100' [2017-05-01T12:15:43.679809] Registering candidate plugin; module='afsocket', context='source', name='udp', preference='100' [2017-05-01T12:15:43.679814] Registering candidate plugin; module='afsocket', context='destination', name='udp', preference='100' [2017-05-01T12:15:43.679819] Registering candidate plugin; module='afsocket', context='source', name='udp6', preference='100' [2017-05-01T12:15:43.679824] Registering candidate plugin; module='afsocket', context='destination', name='udp6', preference='100' [2017-05-01T12:15:43.679829] Registering candidate plugin; module='afsocket', context='source', name='syslog', preference='100' [2017-05-01T12:15:43.679834] Registering candidate plugin; module='afsocket', context='destination', name='syslog', preference='100' [2017-05-01T12:15:43.679840] Registering candidate plugin; module='afsocket', context='source', name='network', preference='100' [2017-05-01T12:15:43.679861] Registering candidate plugin; module='afsocket', context='destination', name='network', preference='100' [2017-05-01T12:15:43.679867] Registering candidate plugin; module='afsocket', context='source', name='systemd-syslog', preference='100' [2017-05-01T12:15:43.679894] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='affile.so', module='affile' [2017-05-01T12:15:43.680092] Registering candidate plugin; module='affile', context='source', name='file', preference='0' [2017-05-01T12:15:43.680106] Registering candidate plugin; module='affile', context='source', name='pipe', preference='0' [2017-05-01T12:15:43.680113] Registering candidate plugin; module='affile', context='destination', name='file', preference='0' [2017-05-01T12:15:43.680118] Registering candidate plugin; module='affile', context='destination', name='pipe', preference='0' [2017-05-01T12:15:43.680143] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afprog.so', module='afprog' [2017-05-01T12:15:43.680261] Registering candidate plugin; module='afprog', context='source', name='program', preference='0' [2017-05-01T12:15:43.680270] Registering candidate plugin; module='afprog', context='destination', name='program', preference='0' [2017-05-01T12:15:43.680290] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afuser.so', module='afuser' [2017-05-01T12:15:43.680397] Registering candidate plugin; module='afuser', context='destination', name='usertty', preference='0' [2017-05-01T12:15:43.680426] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afamqp.so', module='afamqp' [2017-05-01T12:15:43.680547] Registering candidate plugin; module='afamqp', context='destination', name='amqp', preference='0' [2017-05-01T12:15:43.680572] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afmongodb.so', module='afmongodb' [2017-05-01T12:15:43.681138] Registering candidate plugin; module='afmongodb', context='destination', name='mongodb', preference='0' [2017-05-01T12:15:43.681177] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='csvparser.so', module='csvparser' [2017-05-01T12:15:43.681292] Registering candidate plugin; module='csvparser', context='parser', name='csv-parser', preference='0' [2017-05-01T12:15:43.681317] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='confgen.so', module='confgen' [2017-05-01T12:15:43.681435] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='system-source.so', module='system-source' [2017-05-01T12:15:43.681548] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='linux-kmsg-format.so', module='linux-kmsg-format' [2017-05-01T12:15:43.681772] Registering candidate plugin; module='linux-kmsg-format', context='format', name='linux-kmsg', preference='0' [2017-05-01T12:15:43.681798] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='basicfuncs.so', module='basicfuncs' [2017-05-01T12:15:43.681937] Registering candidate plugin; module='basicfuncs', context='template-func', name='grep', preference='0' [2017-05-01T12:15:43.681946] Registering candidate plugin; module='basicfuncs', context='template-func', name='if', preference='0' [2017-05-01T12:15:43.681952] Registering candidate plugin; module='basicfuncs', context='template-func', name='or', preference='0' [2017-05-01T12:15:43.681957] Registering candidate plugin; module='basicfuncs', context='template-func', name='echo', preference='0' [2017-05-01T12:15:43.681963] Registering candidate plugin; module='basicfuncs', context='template-func', name='length', preference='0' [2017-05-01T12:15:43.681968] Registering candidate plugin; module='basicfuncs', context='template-func', name='substr', preference='0' [2017-05-01T12:15:43.681974] Registering candidate plugin; module='basicfuncs', context='template-func', name='strip', preference='0' [2017-05-01T12:15:43.681979] Registering candidate plugin; module='basicfuncs', context='template-func', name='sanitize', preference='0' [2017-05-01T12:15:43.681984] Registering candidate plugin; module='basicfuncs', context='template-func', name='lowercase', preference='0' [2017-05-01T12:15:43.681989] Registering candidate plugin; module='basicfuncs', context='template-func', name='uppercase', preference='0' [2017-05-01T12:15:43.681994] Registering candidate plugin; module='basicfuncs', context='template-func', name='replace-delimiter', preference='0' [2017-05-01T12:15:43.682000] Registering candidate plugin; module='basicfuncs', context='template-func', name='padding', preference='0' [2017-05-01T12:15:43.682005] Registering candidate plugin; module='basicfuncs', context='template-func', name='+', preference='0' [2017-05-01T12:15:43.682010] Registering candidate plugin; module='basicfuncs', context='template-func', name='-', preference='0' [2017-05-01T12:15:43.682015] Registering candidate plugin; module='basicfuncs', context='template-func', name='*', preference='0' [2017-05-01T12:15:43.682020] Registering candidate plugin; module='basicfuncs', context='template-func', name='/', preference='0' [2017-05-01T12:15:43.682025] Registering candidate plugin; module='basicfuncs', context='template-func', name='%', preference='0' [2017-05-01T12:15:43.682031] Registering candidate plugin; module='basicfuncs', context='template-func', name='sum', preference='0' [2017-05-01T12:15:43.682036] Registering candidate plugin; module='basicfuncs', context='template-func', name='min', preference='0' [2017-05-01T12:15:43.682041] Registering candidate plugin; module='basicfuncs', context='template-func', name='max', preference='0' [2017-05-01T12:15:43.682046] Registering candidate plugin; module='basicfuncs', context='template-func', name='average', preference='0' [2017-05-01T12:15:43.682051] Registering candidate plugin; module='basicfuncs', context='template-func', name='ipv4-to-int', preference='0' [2017-05-01T12:15:43.682056] Registering candidate plugin; module='basicfuncs', context='template-func', name='indent-multi-line', preference='0' [2017-05-01T12:15:43.682061] Registering candidate plugin; module='basicfuncs', context='template-func', name='context-length', preference='0' [2017-05-01T12:15:43.682067] Registering candidate plugin; module='basicfuncs', context='template-func', name='env', preference='0' [2017-05-01T12:15:43.682072] Registering candidate plugin; module='basicfuncs', context='template-func', name='template', preference='0' [2017-05-01T12:15:43.682095] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='cryptofuncs.so', module='cryptofuncs' [2017-05-01T12:15:43.682201] Registering candidate plugin; module='cryptofuncs', context='template-func', name='uuid', preference='0' [2017-05-01T12:15:43.682210] Registering candidate plugin; module='cryptofuncs', context='template-func', name='hash', preference='0' [2017-05-01T12:15:43.682240] Registering candidate plugin; module='cryptofuncs', context='template-func', name='sha1', preference='0' [2017-05-01T12:15:43.682247] Registering candidate plugin; module='cryptofuncs', context='template-func', name='sha256', preference='0' [2017-05-01T12:15:43.682253] Registering candidate plugin; module='cryptofuncs', context='template-func', name='sha512', preference='0' [2017-05-01T12:15:43.682258] Registering candidate plugin; module='cryptofuncs', context='template-func', name='md4', preference='0' [2017-05-01T12:15:43.682263] Registering candidate plugin; module='cryptofuncs', context='template-func', name='md5', preference='0' [2017-05-01T12:15:43.682284] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='dbparser.so', module='dbparser' [2017-05-01T12:15:43.682440] Registering candidate plugin; module='dbparser', context='parser', name='db-parser', preference='0' [2017-05-01T12:15:43.682449] Registering candidate plugin; module='dbparser', context='parser', name='grouping-by', preference='0' [2017-05-01T12:15:43.682473] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afstomp.so', module='afstomp' [2017-05-01T12:15:43.682594] Registering candidate plugin; module='afstomp', context='destination', name='stomp', preference='0' [2017-05-01T12:15:43.682621] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='pseudofile.so', module='pseudofile' [2017-05-01T12:15:43.682730] Registering candidate plugin; module='pseudofile', context='destination', name='pseudofile', preference='0' [2017-05-01T12:15:43.682752] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='graphite.so', module='graphite' [2017-05-01T12:15:43.682870] Registering candidate plugin; module='graphite', context='template-func', name='graphite_output', preference='0' [2017-05-01T12:15:43.682894] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='sdjournal.so', module='sdjournal' [2017-05-01T12:15:43.683010] Registering candidate plugin; module='sdjournal', context='source', name='systemd-journal', preference='0' [2017-05-01T12:15:43.683034] Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='date.so', module='date' [2017-05-01T12:15:43.683150] Registering candidate plugin; module='date', context='parser', name='date-parser', preference='0' [2017-05-01T12:15:43.683309] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/apache/apache.conf', depth='2' [2017-05-01T12:15:43.683336] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/elasticsearch/plugin.conf', depth='2' [2017-05-01T12:15:43.683544] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/elasticsearch/plugin.conf', depth='2' [2017-05-01T12:15:43.683564] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/graphite/plugin.conf', depth='2' [2017-05-01T12:15:43.683654] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/graphite/plugin.conf', depth='2' [2017-05-01T12:15:43.683672] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/hdfs/plugin.conf', depth='2' [2017-05-01T12:15:43.683776] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/hdfs/plugin.conf', depth='2' [2017-05-01T12:15:43.683794] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/kafka/plugin.conf', depth='2' [2017-05-01T12:15:43.683924] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/kafka/plugin.conf', depth='2' [2017-05-01T12:15:43.683944] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/loggly/loggly.conf', depth='2' [2017-05-01T12:15:43.684108] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/loggly/loggly.conf', depth='2' [2017-05-01T12:15:43.684127] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/logmatic/logmatic.conf', depth='2' [2017-05-01T12:15:43.684286] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/logmatic/logmatic.conf', depth='2' [2017-05-01T12:15:43.684387] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/mbox/mbox.conf', depth='2' [2017-05-01T12:15:43.684476] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/mbox/mbox.conf', depth='2' [2017-05-01T12:15:43.684497] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/nodejs/plugin.conf', depth='2' [2017-05-01T12:15:43.684598] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/nodejs/plugin.conf', depth='2' [2017-05-01T12:15:43.684618] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/pacct/plugin.conf', depth='2' [2017-05-01T12:15:43.684697] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/pacct/plugin.conf', depth='2' [2017-05-01T12:15:43.684714] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/rewrite/cc-mask.conf', depth='2' [2017-05-01T12:15:43.684823] Global value changed; define='balabit.credit-card-regexp', value='(?P<1>:4[0-9]{12}(?:[0-9]{3})?|5[1-5][0-9]{14}|6(?:011|5[0-9][0-9])[0-9]{12}|3[47][0-9]{13}|3(?:0[0-5]|[68][0-9])[0-9]{11}|(?:2131|1800|35d{3})d{11})' [2017-05-01T12:15:43.684890] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/rewrite/cc-mask.conf', depth='2' [2017-05-01T12:15:43.684914] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/solaris/plugin.conf', depth='2' [2017-05-01T12:15:43.685007] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/solaris/plugin.conf', depth='2' [2017-05-01T12:15:43.685024] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/syslogconf/plugin.conf', depth='2' [2017-05-01T12:15:43.685251] Module loaded and initialized successfully; module='confgen' [2017-05-01T12:15:43.685265] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/syslogconf/plugin.conf', depth='2' [2017-05-01T12:15:43.685285] Starting to read include file; filename='/usr/local/share/syslog-ng/include/scl/system/plugin.conf', depth='2' [2017-05-01T12:15:43.685503] Module loaded and initialized successfully; module='system-source' [2017-05-01T12:15:43.685516] Finishing include; filename='/usr/local/share/syslog-ng/include/scl/system/plugin.conf', depth='2' [2017-05-01T12:15:43.685530] Finishing include; filename='/usr/local/etc/scl.conf', depth='1' [2017-05-01T12:15:43.686464] system(): json-parser() is missing, skipping the automatic JSON parsing of messages submitted via syslog(3), *Please install the json module;* [2017-05-01T12:15:43.686634] Module loaded and initialized successfully; module='afsocket' [2017-05-01T12:15:43.686930] Module loaded and initialized successfully; module='affile' [2017-05-01T12:15:43.687027] Finishing include; content='source confgen system', depth='1' [2017-05-01T12:15:43.687365] Compiling #unnamed sequence [log] at [/usr/local/etc/syslog-ng.conf:23:2] [2017-05-01T12:15:43.687373] Compiling s_local reference [source] at [/usr/local/etc/syslog-ng.conf:23:2] [2017-05-01T12:15:43.687378] Compiling s_local sequence [source] at [/usr/local/etc/syslog-ng.conf:9:1] [2017-05-01T12:15:43.687382] Compiling #unnamed junction [log] at [/usr/local/etc/syslog-ng.conf:9:17] [2017-05-01T12:15:43.687386] Compiling #unnamed sequence [log] at [source confgen system:2:5] [2017-05-01T12:15:43.687390] Compiling #unnamed sequence [source] at [source confgen system:2:5] [2017-05-01T12:15:43.687393] Compiling #unnamed junction [log] at [source confgen system:2:13] [2017-05-01T12:15:43.687396] Compiling #unnamed sequence [log] at [source confgen system:4:5] [2017-05-01T12:15:43.687400] Compiling #unnamed sequence [source] at [source confgen system:4:5] [2017-05-01T12:15:43.687403] Compiling #unnamed junction [log] at [source confgen system:4:13] [2017-05-01T12:15:43.687407] Compiling #unnamed single [log] at [source confgen system:4:14] [2017-05-01T12:15:43.687413] Compiling #unnamed sequence [rewrite] at [source confgen system:6:5] [2017-05-01T12:15:43.687417] Compiling #unnamed single [log] at [source confgen system:6:15] [2017-05-01T12:15:43.687421] Compiling #unnamed single [log] at [source confgen system:8:1] [2017-05-01T12:15:43.687425] Compiling #unnamed single [log] at [/usr/local/etc/syslog-ng.conf:11:2] [2017-05-01T12:15:43.687439] Compiling d_local reference [destination] at [/usr/local/etc/syslog-ng.conf:27:2] [2017-05-01T12:15:43.687444] Compiling d_local sequence [destination] at [/usr/local/etc/syslog-ng.conf:18:1] [2017-05-01T12:15:43.687447] Compiling #unnamed junction [log] at [/usr/local/etc/syslog-ng.conf:18:22] [2017-05-01T12:15:43.687451] Compiling #unnamed single [log] at [/usr/local/etc/syslog-ng.conf:19:2] [2017-05-01T12:15:43.687599] Module loaded and initialized successfully; module='syslogformat' [2017-05-01T12:15:43.688008] Module loaded and initialized successfully; module='linux-kmsg-format' [2017-05-01T12:15:43.688243] Running application hooks; hook='1' [2017-05-01T12:15:43.688252] Running application hooks; hook='3' [2017-05-01T12:15:43.688295] syslog-ng starting up; version='3.9.1' On Mon, May 1, 2017 at 12:14 PM, Czanik, Péter <peter.czanik@balabit.com> wrote:
Hi,
The first problem is the lack of the JSON module. For the second one there is not enough information to see, if it is a syslog-ng or a systemd service file problem. Can you start syslog-ng from the command line? I mean using the following command line to catch any problems on the terminal:
syslog-ng -Fvde
Bye,
Peter Czanik (CzP) <peter.czanik@balabit.com> Balabit / syslog-ng upstream https://www.balabit.com/blog/author/peterczanik/ https://twitter.com/PCzanik
On Mon, May 1, 2017 at 9:11 PM, Dwijadas Dey <dwijad@gmail.com> wrote:
Hi Vijay I don't see json-plugin under Available-Modules section in the output of # syslog-ng -V
I have also compiled syslog-ng from source (3.6.4), and it shows json-plugin in the output of syslog-ng -V You may need to pass enable-json flag while compiling it from source.
# syslog-ng -V syslog-ng 3.6.4 Installer-Version: 3.6.4 Revision: Compile-Date: Dec 18 2016 15:02:59 Available-Modules: pseudofile,graphite,sdjournal, afsocket,syslogformat,afsocket-notls,afsocket-tls,affile, afprog,afuser,afamqp,afmongodb,csvparser,confgen,system- source,linux-kmsg-format,basicfuncs,cryptofuncs,dbparse r,json-plugin,tfgeoip,afstomp Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: off Enable-Linux-Caps: off
Since you are using the version 3.9.1, i am not 100% sure that, this is the issue.
Also, you can try this link. https://lists.balabit.hu/pipermail/syslog-ng/2016-February/022667.html
Regards
On Tue, May 2, 2017 at 12:00 AM, vijay amruth <vijayamruth@gmail.com> wrote:
Hello All, Hope you are all doing great. I am unable to start syslog-ng service
Here is some information:
*OS Version: Cent OS 7.3*
*I compiled it from a tar ball..*
[root@xxxxx system]# syslog-ng -V syslog-ng 3.9.1 Installer-Version: 3.9.1 Revision: Module-Directory: /usr/local/lib/syslog-ng Module-Path: /usr/local/lib/syslog-ng Available-Modules: kvformat,cef,disk-buffer,add-c ontextual-data,syslogformat,afsocket,affile,afprog,afuser,af amqp,afmongodb,csvparser,confgen,system-source,linux-kmsg-fo rmat,basicfuncs,cryptofuncs,dbparser,afstomp,pseudofile,grap hite,sdjournal,date Enable-Debug: off Enable-GProf: off Enable-Memtrace: off Enable-IPv6: on Enable-Spoof-Source: off Enable-TCP-Wrapper: off Enable-Linux-Caps: off
*I manually added this file, this didn't come with install...*
[root@xxxxx system]# cat syslog-ng.service [Unit] Description=System Logger Daemon Documentation=man:syslog-ng(8)
[Service] Type=notify Sockets=syslog.socket ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 ExecReload=/bin/kill -HUP $MAINPID StandardOutput=null Restart=on-failure
[Install] WantedBy=multi-user.target Alias=syslog.service [root@sl-sz3-splunk01 system]# pwd /lib/systemd/system
*Had parser errors:*
[root@xxxxxx ~]# syslog-ng -s Error parsing config, Error compiling template (Unknown template function "format-json") in /usr/local/share/syslog-ng/include/scl/cim/template.conf at line 23, column 32:
included from /usr/local/etc/scl.conf line 29, column 1
included from /usr/local/etc/syslog-ng.conf line 8, column 1
template-function "format-cim" "$(format-json --pair @timestamp='${R_ISODATE}' --pair @message='${MSG}' --key .cim.* --shift 5 --key _* --key .* --replace-prefix .=_ --key *.*)\n"; ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
syslog-ng documentation: http://www.balabit.com/support /documentation/?product=syslog-ng mailing list: https://lists.balabit.hu/mailman/listinfo/syslog-ng
*Moved /usr/local/share/syslog-ng/include/scl/cim and no parser errors.* *But still unable to start.*
[root@xxxxx system]# systemctl status syslog-ng.service ● syslog-ng.service - System Logger Daemon Loaded: loaded (/usr/lib/systemd/system/syslog-ng.service; disabled; vendor preset: enabled) Active: failed (Result: start-limit) since Mon 2017-05-01 10:46:58 PDT; 7s ago Docs: man:syslog-ng(8) Process: 2170 ExecStart=/usr/sbin/syslog-ng -F -p /var/run/syslogd-ng.pid --fd-limit 50000 (code=exited, status=203/EXEC) Main PID: 2170 (code=exited, status=203/EXEC)
May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service: main process exited, code=exited, status=203/EXEC May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service holdoff time over, scheduling restart. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: start request repeated too quickly for syslog-ng.service May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Failed to start System Logger Daemon. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: Unit syslog-ng.service entered failed state. May 01 10:46:58 sl-sz3-splunk01.slc.ebay.com systemd[1]: syslog-ng.service failed.
What I am I missing? Any help is appreciated. Thank you.
-- Thanks, Vijay Amrut.
____________________________________________________________ __________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support /documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
____________________________________________________________ __________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product= syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
____________________________________________________________ __________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/? product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
-- Thanks, Vijay Amrut.
participants (3)
-
Czanik, Péter
-
Dwijadas Dey
-
vijay amruth