<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Tue, Sep 24, 2013 at 9:57 PM, Alexandre Biancalana <span dir="ltr"><<a href="mailto:biancalana@gmail.com" target="_blank">biancalana@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div class="h5"><br><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Sep 19, 2013 at 11:28 AM, Alexandre Biancalana <span dir="ltr"><<a href="mailto:biancalana@gmail.com" target="_blank">biancalana@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><br><div class="gmail_quote"><div>On Thu, Sep 19, 2013 at 11:22 AM, Gergely Nagy <span dir="ltr"><<a href="mailto:algernon@balabit.hu" target="_blank">algernon@balabit.hu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>Alexandre Biancalana <<a href="mailto:biancalana@gmail.com" target="_blank">biancalana@gmail.com</a>> writes:<br>
<br>
> Any idea of why this is happening ? Do you need anything else ?<br>
<br>
</div>I have a few ideas, will try to reproduce the problem. At the moment, I<br>
don't need anything else. Although, if you could send your config (in<br>
private works too), that may help me a bit.<br>
<div><div></div></div></blockquote></div><div><br><br><div>I forgot to mention that I'm using amqp destination.<br><br></div><div>Going forward with the troubleshooting
I've done some tests changing configuration and isolated that the core
dump occur only when destination is amqp, even when I don't use
patterndb the problem still occur.<br><br></div><div>The config to reproduce the problem is very simple:<br><br></div>@version:3.4<br><br>options { chain_hostnames(off); flush_lines(0); threaded(yes); };<br><br>#<br># sources<br>
#<br>source src_local { unix-dgram("/var/run/log");<br> unix-dgram("/var/run/logpriv" perm(0600));<br> internal();<br> file("/dev/klog"); };<br><br>
<br>destination d_amqp {<br> amqp(<br> vhost("/")<br> host("127.0.0.1")<br> port(5672)<br> username("guest") # required option, no default<br> password("guest") # required option, no default<br>
exchange("syslog")<br> exchange_type("header")<br> routing_key("")<br> body("")<br> persistent(yes)<br> value-pairs(<br> scope("selected-macros" "nv-pairs" "sdata")<br>
)<br> );<br>};<br><br>log { source(src_local); destination(d_amqp); }; <br><br></div></div><br></div></div>
</blockquote></div><br><br></div></div></div><div class="gmail_extra">I've made some tests and can't reproduce this "bug" using linux (centos 6.3) <br></div></div>
</blockquote></div><br><br></div><div class="gmail_extra">applying the initial config with my patterndb and amqp destination it core dumped on linux too.<br><br><br><br>[root@br.c1.sf05 logs]# gdb /usr/local/sbin/syslog-ng<br>
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6)<br>Copyright (C) 2010 Free Software Foundation, Inc.<br>License GPLv3+: GNU GPL version 3 or later <<a href="http://gnu.org/licenses/gpl.html">http://gnu.org/licenses/gpl.html</a>><br>
This is free software: you are free to change and redistribute it.<br>There is NO WARRANTY, to the extent permitted by law. Type "show copying"<br>and "show warranty" for details.<br>This GDB was configured as "x86_64-redhat-linux-gnu".<br>
For bug reporting instructions, please see:<br><<a href="http://www.gnu.org/software/gdb/bugs/">http://www.gnu.org/software/gdb/bugs/</a>>...<br>Reading symbols from /usr/local/sbin/syslog-ng...(no debugging symbols found)...done.<br>
(gdb) -f /usr/local/etc/syslog-ng.conf -d<br>Undefined command: "-f". Try "help".<br>(gdb) run -f /usr/local/etc/syslog-ng.conf -d<br>Starting program: /usr/local/sbin/syslog-ng -f /usr/local/etc/syslog-ng.conf -d<br>
[Thread debugging using libthread_db enabled]<br>Reading path for candidate modules; path='/usr/local/lib/syslog-ng'<br>Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='confgen.so', module='confgen'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='dbparser.so', module='dbparser'<br>Registering candidate plugin; module='dbparser', context='parser', name='db-parser', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afamqp.so', module='afamqp'<br>Registering candidate plugin; module='afamqp', context='destination', name='amqp', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='cryptofuncs.so', module='cryptofuncs'<br>Registering candidate plugin; module='cryptofuncs', context='template-func', name='uuid', preference='0'<br>
Registering candidate plugin; module='cryptofuncs', context='template-func', name='hash', preference='0'<br>Registering candidate plugin; module='cryptofuncs', context='template-func', name='sha1', preference='0'<br>
Registering candidate plugin; module='cryptofuncs', context='template-func', name='sha256', preference='0'<br>Registering candidate plugin; module='cryptofuncs', context='template-func', name='sha512', preference='0'<br>
Registering candidate plugin; module='cryptofuncs', context='template-func', name='md4', preference='0'<br>Registering candidate plugin; module='cryptofuncs', context='template-func', name='md5', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='basicfuncs.so', module='basicfuncs'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='grep', preference='0'<br>
Registering candidate plugin; module='basicfuncs', context='template-func', name='if', preference='0'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='echo', preference='0'<br>
Registering candidate plugin; module='basicfuncs', context='template-func', name='length', preference='0'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='substr', preference='0'<br>
Registering candidate plugin; module='basicfuncs', context='template-func', name='strip', preference='0'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='sanitize', preference='0'<br>
Registering candidate plugin; module='basicfuncs', context='template-func', name='+', preference='0'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='-', preference='0'<br>
Registering candidate plugin; module='basicfuncs', context='template-func', name='*', preference='0'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='/', preference='0'<br>
Registering candidate plugin; module='basicfuncs', context='template-func', name='%', preference='0'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='ipv4-to-int', preference='0'<br>
Registering candidate plugin; module='basicfuncs', context='template-func', name='indent-multi-line', preference='0'<br>Registering candidate plugin; module='basicfuncs', context='template-func', name='context-length', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afuser.so', module='afuser'<br>Registering candidate plugin; module='afuser', context='destination', name='usertty', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afsocket-notls.so', module='afsocket-notls'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='unix-stream', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='unix-stream', preference='0'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='unix-dgram', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='unix-dgram', preference='0'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='tcp', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='tcp', preference='0'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='tcp6', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='tcp6', preference='0'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='udp', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='udp', preference='0'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='udp6', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='udp6', preference='0'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='syslog', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='syslog', preference='0'<br>Registering candidate plugin; module='afsocket-notls', context='source', name='network', preference='0'<br>
Registering candidate plugin; module='afsocket-notls', context='destination', name='network', preference='0'<br>Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afsocket.so', module='afsocket'<br>
Registering candidate plugin; module='afsocket', context='source', name='unix-stream', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='unix-stream', preference='100'<br>
Registering candidate plugin; module='afsocket', context='source', name='unix-dgram', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='unix-dgram', preference='100'<br>
Registering candidate plugin; module='afsocket', context='source', name='tcp', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='tcp', preference='100'<br>
Registering candidate plugin; module='afsocket', context='source', name='tcp6', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='tcp6', preference='100'<br>
Registering candidate plugin; module='afsocket', context='source', name='udp', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='udp', preference='100'<br>
Registering candidate plugin; module='afsocket', context='source', name='udp6', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='udp6', preference='100'<br>
Registering candidate plugin; module='afsocket', context='source', name='syslog', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='syslog', preference='100'<br>
Registering candidate plugin; module='afsocket', context='source', name='network', preference='100'<br>Registering candidate plugin; module='afsocket', context='destination', name='network', preference='100'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='affile.so', module='affile'<br>Registering candidate plugin; module='affile', context='source', name='file', preference='0'<br>
Registering candidate plugin; module='affile', context='source', name='pipe', preference='0'<br>Registering candidate plugin; module='affile', context='destination', name='file', preference='0'<br>
Registering candidate plugin; module='affile', context='destination', name='pipe', preference='0'<br>Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='csvparser.so', module='csvparser'<br>
Registering candidate plugin; module='csvparser', context='parser', name='csv-parser', preference='0'<br>Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afprog.so', module='afprog'<br>
Registering candidate plugin; module='afprog', context='source', name='program', preference='0'<br>Registering candidate plugin; module='afprog', context='destination', name='program', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='syslog-ng-crypto.so', module='syslog-ng-crypto'<br>Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='syslogformat.so', module='syslogformat'<br>
Registering candidate plugin; module='syslogformat', context='format', name='syslog', preference='0'<br>Registering candidate plugin; module='syslogformat', context='parser', name='syslog-parser', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afmongodb.so', module='afmongodb'<br>Registering candidate plugin; module='afmongodb', context='destination', name='mongodb', preference='0'<br>
Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='system-source.so', module='system-source'<br>Reading shared object for a candidate module; path='/usr/local/lib/syslog-ng', fname='afsocket-tls.so', module='afsocket-tls'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='unix-stream', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='unix-stream', preference='100'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='unix-dgram', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='unix-dgram', preference='100'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='tcp', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='tcp', preference='100'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='tcp6', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='tcp6', preference='100'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='udp', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='udp', preference='100'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='udp6', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='udp6', preference='100'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='syslog', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='syslog', preference='100'<br>
Registering candidate plugin; module='afsocket-tls', context='source', name='network', preference='100'<br>Registering candidate plugin; module='afsocket-tls', context='destination', name='network', preference='100'<br>
Compiling #unnamed sequence [log] at [/usr/local/etc/syslog-ng.conf:4]<br> Compiling httpd_error_log reference [source] at [/usr/local/etc/syslog-ng.conf:4]<br> Compiling httpd_error_log sequence [source] at [/usr/local/etc/syslog-ng.conf:1]<br>
Compiling #unnamed junction [log] at [/usr/local/etc/syslog-ng.conf:1]<br> Compiling #unnamed single [log] at [/usr/local/etc/syslog-ng.conf:1]<br> Compiling pattern_db reference [parser] at [/usr/local/etc/syslog-ng.conf:4]<br>
Compiling pattern_db sequence [parser] at [/usr/local/etc/syslog-ng.conf:1]<br> Compiling #unnamed single [log] at [/usr/local/etc/syslog-ng.conf:1]<br> Compiling d_amqp reference [destination] at [/usr/local/etc/syslog-ng.conf:4]<br>
Compiling d_amqp sequence [destination] at [/usr/local/etc/syslog-ng.conf:2]<br> Compiling #unnamed junction [log] at [/usr/local/etc/syslog-ng.conf:2]<br> Compiling #unnamed single [log] at [/usr/local/etc/syslog-ng.conf:2]<br>
Log pattern database reloaded; file='/home/ale/httpd.xml', version='3', pub_date='2013-09-12'<br>[New Thread 0x7ffff7fe3700 (LWP 11172)]<br>Running application hooks; hook='1'<br>Running application hooks; hook='3'<br>
syslog-ng starting up; version='3.4.3'<br>Worker thread started; driver='d_amqp#0'<br>Connecting to AMQP succeeded; driver='d_amqp#0'<br>Incoming log entry; line='[2013-09-01 03:49:03.051560] [core:notice] [pid 17230:tid 139776559662848] AH00094: Command line: \'/opt/apps/httpd/sbin/httpd -D NO_DETACH\''<br>
patterndb rule matches; rule_id='52a31c61-1bff-11e3-919d-ca66d2f45ab4'<br>Advancing patterndb current time because of an incoming message; utc='1380159639'<br>Message parsing complete; result='1'<br>
<br>Program received signal SIGSEGV, Segmentation fault.<br>[Switching to Thread 0x7ffff7fe3700 (LWP 11172)]<br>0x00007ffff7b903d5 in ?? () from /usr/local/lib/<a href="http://libsyslog-ng-3.4.3.so">libsyslog-ng-3.4.3.so</a><br>
Missing separate debuginfos, use: debuginfo-install syslog-ng-3.4.3-1.x86_64<br>(gdb) bt<br>#0 0x00007ffff7b903d5 in ?? () from /usr/local/lib/<a href="http://libsyslog-ng-3.4.3.so">libsyslog-ng-3.4.3.so</a><br>#1 0x00007ffff7b8f868 in nv_table_foreach_entry () from /usr/local/lib/<a href="http://libsyslog-ng-3.4.3.so">libsyslog-ng-3.4.3.so</a><br>
#2 0x00007ffff7b8f926 in nv_table_foreach () from /usr/local/lib/<a href="http://libsyslog-ng-3.4.3.so">libsyslog-ng-3.4.3.so</a><br>#3 0x00007ffff7b9af3f in value_pairs_foreach_sorted () from /usr/local/lib/<a href="http://libsyslog-ng-3.4.3.so">libsyslog-ng-3.4.3.so</a><br>
#4 0x00007ffff4069e6a in ?? () from /usr/local/lib/syslog-ng/libafamqp.so<br>#5 0x00007ffff406a9a2 in ?? () from /usr/local/lib/syslog-ng/libafamqp.so<br>#6 0x00007ffff7b8e63b in ?? () from /usr/local/lib/<a href="http://libsyslog-ng-3.4.3.so">libsyslog-ng-3.4.3.so</a><br>
#7 0x00007ffff70a3004 in ?? () from /lib64/libglib-2.0.so.0<br>#8 0x00007ffff6a23851 in start_thread () from /lib64/libpthread.so.0<br>#9 0x00007ffff677190d in clone () from /lib64/libc.so.6<br><br><br></div><div class="gmail_extra">
Any ideas ?<br></div></div>