Hi, Having finally been able to finish the network() source and destination drivers I declare 3.4 as feature complete, and plan to publish 3.4beta1 fairly soon. Let's say, before the winter holiday. In hindsight, this took much longer than it should have, 3.4 has grown a lot of interesting functionality: - junctions and more complicated log processing paths - amqp destination - smtp destination - json output and parser plugins - key rewriting in destination drivers (add, remove prefixes) - a number of new template functions (uuid, hash functions, etc) - a number of new parsers in db-parser (set, pcre, ...) - allow 32 bit message and nvpair sizes - improved systemd support - demand loaded plugins - plugin support for log transport protocols and the network driver to be able to use them easily And other things I've probably forgot. I have just merged Algernon's accumulated merge queue, and will probably cherry-pick stuff before the final release and merge in the fixes from 3.3 before the beta release. If you have stuff that you want to see in the beta, please speak up now. Testing _before_ the beta would also be appreciated, so that the beta is actually usable by laymen. Thanks :) As always, the latest code is in git, Algernon builds daily snapshots. Thanks -- Bazsi
Balazs Scheidler <bazsi@balabit.hu> writes:
Hi,
Having finally been able to finish the network() source and destination drivers I declare 3.4 as feature complete, and plan to publish 3.4beta1 fairly soon. Let's say, before the winter holiday.
One thing I'd love to push through before that, is an improvement on the recent network() stuff: better support for ipv6, a way to express I want a destination that goes over ipv6, and is framed. As far as I see, this is not possible with the current implementation, but the changes needed may not be too hard. I'll try to send a patch.
I have just merged Algernon's accumulated merge queue, and will probably cherry-pick stuff before the final release and merge in the fixes from 3.3 before the beta release.
I think I cherry-picked everything relevant to merge-queue/3.4 (which you just merged in), so if everything went well, there should be nothing left on the 3.3 branch that needs to be picked over.
As always, the latest code is in git, Algernon builds daily snapshots.
I triggered today's build earlier, so the snapshots[1] are up to date by now. [1]: http://packages.madhouse-project.org/syslog-ng/3.4/ -- |8]
On 12/07/2012 11:16 AM, Gergely Nagy wrote:
As always, the latest code is in git, Algernon builds daily snapshots. I triggered today's build earlier, so the snapshots[1] are up to date by now.
While trying to compile from this tgz I ran into a problem. Most likely a .h did not find its way to the tgz... [ 116s] libtool: compile: gcc -std=gnu99 -DHAVE_CONFIG_H -I. -I../.. -I../../lib -I../../lib -pthread -I/usr/include/glib-2.0 -I/usr/lib/glib-2.0/include -I/usr/include/eventlog -D_BSD_SOURCE -D__BSD_SOURCE -D__FAVOR_BSD -DHAVE_NET_ETHERNET_H -I/usr/include -I../../lib/ivykis/lib/include -I../../lib/ivykis/lib/include -I../../lib/ivykis/modules/include -D_GNU_SOURCE -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -fomit-frame-pointer -fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -Wall -pthread -c syslog-format-plugin.c -fPIC -DPIC -o .libs/libsyslogformat_la-syslog-format-plugin.o [ 116s] syslog-parser-parser.c:24:27: fatal error: syslog-parser.h: No such file or directory [ 116s] compilation terminated. [ 116s] make[3]: *** [libsyslogformat_la-syslog-parser-parser.lo] Error 1 [ 116s] make[3]: *** Waiting for unfinished jobs.... [ 116s] syslog-parser-grammar.y:32:27: fatal error: syslog-parser.h: No such file or directory [ 116s] compilation terminated. [ 116s] make[3]: *** [libsyslogformat_la-syslog-parser-grammar.lo] Error 1 [ 116s] make[3]: Leaving directory `/home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/modules/syslogformat' [ 116s] make[2]: *** [all-recursive] Error 1 [ 116s] make[2]: Leaving directory `/home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/modules' [ 116s] make[1]: *** [all-recursive] Error 1 [ 116s] make[1]: Leaving directory `/home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3' [ 116s] make: *** [all] Error 2 Bye, -- Peter Czanik (CzP) <czanik@balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/
Peter Czanik <czanik@balabit.hu> writes:
On 12/07/2012 11:16 AM, Gergely Nagy wrote:
As always, the latest code is in git, Algernon builds daily snapshots. I triggered today's build earlier, so the snapshots[1] are up to date by now.
While trying to compile from this tgz I ran into a problem. Most likely a .h did not find its way to the tgz...
Yep, that was it, fix is available on the merge-queue/3.4 branch of mine[1]. [1]: https://github.com/algernon/syslog-ng/commit/d2df2e1eadffaff884ed95fb0337236... I'm very tempted to run make distcheck as part of CI. -- |8]
On 12/07/2012 12:52 PM, Gergely Nagy wrote:
Peter Czanik <czanik@balabit.hu> writes:
On 12/07/2012 11:16 AM, Gergely Nagy wrote:
As always, the latest code is in git, Algernon builds daily snapshots. I triggered today's build earlier, so the snapshots[1] are up to date by now.
While trying to compile from this tgz I ran into a problem. Most likely a .h did not find its way to the tgz... Yep, that was it, fix is available on the merge-queue/3.4 branch of mine[1].
[1]: https://github.com/algernon/syslog-ng/commit/d2df2e1eadffaff884ed95fb0337236...
I'm very tempted to run make distcheck as part of CI.
OK, here is my next catch: [ 132s] libtool: install: warning: relinking `libafamqp.la' [ 132s] libtool: install: (cd /home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/modules/afamqp; /bin/sh /home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/libtool --tag CC --mode=relink gcc -std=gnu99 -I./rabbitmq-c/librabbitmq -I./rabbitmq-c/librabbitmq -fomit-frame-pointer -fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -Wall -pthread -avoid-version -module -no-undefined -o libafamqp.la -rpath /usr/lib/syslog-ng libafamqp_la-afamqp-grammar.lo libafamqp_la-afamqp.lo libafamqp_la-afamqp-parser.lo ../../lib/libsyslog-ng.la -L./rabbitmq-c/librabbitmq -lrabbitmq -inst-prefix-dir /home/abuild/rpmbuild/BUILDROOT/syslog-ng-3.4.0alpha3-0.i386) [ 132s] libtool: relink: gcc -std=gnu99 -shared -fPIC -DPIC .libs/libafamqp_la-afamqp-grammar.o .libs/libafamqp_la-afamqp.o .libs/libafamqp_la-afamqp-parser.o -L/home/abuild/rpmbuild/BUILDROOT/syslog-ng-3.4.0alpha3-0.i386/usr/lib -L/usr/lib -lsyslog-ng -L/lib -L../lib/ivykis -lnsl -lgmodule-2.0 -lgthread-2.0 -lglib-2.0 -levtlog -lcap -lpcre -ldl -lpthread -lrt -L./rabbitmq-c/librabbitmq -lrabbitmq -O2 -pthread -pthread -Wl,-soname -Wl,libafamqp.so -o .libs/libafamqp.so [ 132s] /usr/lib/gcc/i586-suse-linux/4.7/../../../../i586-suse-linux/bin/ld: cannot find -lrabbitmq [ 132s] collect2: error: ld returned 1 exit status [ 132s] libtool: install: error: relink `libafamqp.la' with the above command before installing it [ 132s] make[4]: *** [install-moduleLTLIBRARIES] Error 1 [ 132s] make[4]: Leaving directory `/home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/modules/afamqp' [ 132s] make[3]: *** [install-am] Error 2 [ 132s] make[3]: Leaving directory `/home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/modules/afamqp' [ 132s] make[2]: *** [install] Error 2 [ 132s] make[2]: Leaving directory `/home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/modules/afamqp' [ 132s] make[1]: *** [install-recursive] Error 1 [ 132s] make[1]: Leaving directory `/home/abuild/rpmbuild/BUILD/syslog-ng-3.4.0alpha3/modules' [ 132s] make: *** [install-recursive] Error 1 With --disable-amqp I can compile syslog-ng. Bye, -- Peter Czanik (CzP) <czanik@balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/
Hello, On 12/07/2012 06:40 AM, Balazs Scheidler wrote:
As always, the latest code is in git, Algernon builds daily snapshots.
And CzP as openSUSE maniac, he already has some packages: https://build.opensuse.org/package/show?package=syslog-ng&project=home%3Acza... As with 3.3 packages, support for older distros is dropped, support for SLES with latest service pack is added. These packages are completely untested, other than that they can be installed and started, so use at your own risk. Next week I'll prepare an update for the FreeBSD ports. Bye, -- Peter Czanik (CzP) <czanik@balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/
thanks guys. ----- Original message -----
Hello,
On 12/07/2012 06:40 AM, Balazs Scheidler wrote:
As always, the latest code is in git, Algernon builds daily snapshots.
And CzP as openSUSE maniac, he already has some packages:
https://build.opensuse.org/package/show?package=syslog-ng&project=home%3Acza...
As with 3.3 packages, support for older distros is dropped, support for SLES with latest service pack is added. These packages are completely untested, other than that they can be installed and started, so use at your own risk.
Next week I'll prepare an update for the FreeBSD ports.
Bye,
-- Peter Czanik (CzP) <czanik@balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
Hi, I've just merged all fixes from Algernon's merge-queue, so building from a make dist snapshot should work again. I've also merged the ip-protocol option. On Fri, Dec 7, 2012 at 9:42 PM, Balazs Scheidler <bazsi77@gmail.com> wrote:
**
thanks guys.
----- Original message -----
Hello,
On 12/07/2012 06:40 AM, Balazs Scheidler wrote:
As always, the latest code is in git, Algernon builds daily snapshots.
And CzP as openSUSE maniac, he already has some packages:
https://build.opensuse.org/package/show?package=syslog-ng&project=home%3Acza...
As with 3.3 packages, support for older distros is dropped, support for SLES with latest service pack is added. These packages are completely untested, other than that they can be installed and started, so use at your own risk.
Next week I'll prepare an update for the FreeBSD ports.
Bye,
-- Peter Czanik (CzP) <czanik@balabit.hu> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/
______________________________________________________________________________
Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
-- Bazsi
Hi, there are still 2 small problems in pdbtool that I would like to address, patches will follow shortly. Balint . On 12/09/2012 03:35 PM, Balazs Scheidler wrote:
Hi,
I've just merged all fixes from Algernon's merge-queue, so building from a make dist snapshot should work again.
I've also merged the ip-protocol option.
On Fri, Dec 7, 2012 at 9:42 PM, Balazs Scheidler <bazsi77@gmail.com <mailto:bazsi77@gmail.com>> wrote:
thanks guys.
----- Original message ----- > Hello, > > On 12/07/2012 06:40 AM, Balazs Scheidler wrote: > > As always, the latest code is in git, Algernon builds daily snapshots. > > > And CzP as openSUSE maniac, he already has some packages: > > https://build.opensuse.org/package/show?package=syslog-ng&project=home%3Acza...
> > As with 3.3 packages, support for older distros is dropped, support for > SLES with latest service pack is added. These packages are completely > untested, other than that they can be installed and started, so use at > your own risk. > > Next week I'll prepare an update for the FreeBSD ports. > > Bye, > > -- > Peter Czanik (CzP) <czanik@balabit.hu <mailto:czanik@balabit.hu>> > BalaBit IT Security / syslog-ng upstream > http://czanik.blogs.balabit.com/ > > > ______________________________________________________________________________ > Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng > Documentation: > http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: > http://www.balabit.com/wiki/syslog-ng-faq >
-- Bazsi
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
Balint Kovacs <balint.kovacs@balabit.com> writes:
there are still 2 small problems in pdbtool that I would like to address, patches will follow shortly.
Both looked OK to me, merged them to merge-queue/3.4, thanks! -- |8]
participants (5)
-
Balazs Scheidler
-
Balazs Scheidler
-
Balint Kovacs
-
Gergely Nagy
-
Peter Czanik