[syslog-ng] pdbtool patternize update and my syslog-ng 3.2 branch

[Peter Gyongyosi]

Hello,

As the patterndb project is starting to gain some momentum I thought 
it'd be the right time to port my patternize tool to the new, 
plugin-based 3.2 codebase as the first step towards getting it 
integrated --- and to be able to use the fancy new pdbtool features 
along with patternize. To those who are unfamiliar with it, patternize 
is an addition to pdbtool that makes it possible to automatically 
generate a pattern database from raw logs using statistical data 
clustering methods: you can read more about it in this blog post: 
http://gyp.blogs.balabit.com/2010/01/introducing-pdbtool-patternize/

Besides the port to the new codebase, it's received some fixes and new 
features since my original post:

  * multiple small internal bugfixes to get rid of weird errors
  * added the option "/--named-parsers/" that names the found @ESTRING at s 
like "/.dict.string0,1,2,3.../"
  * Balint Kovacs has sent three contributions: added support for 
reading the logfile from the standard input, escaping special characters 
in the output and putting examples in the XML that can be used for 
self-testing.

It can be found in my public syslog-ng 3.2 tree: 
http://git.balabit.hu/?p=gyp/syslog-ng-3.2.git;a=summary

If you're already using it (I've received some feedback so I guess some 
of you do), please note that most probably this 3.2-based branch will 
get the fixes and new features from now on.

It's only received a basic sanity check and the unit tests do pass, so 
as usual, handle it with care and all feedback is welcome.

greets,
Peter

ps.: the branch also contains a patch that fixes a wrong section name in 
pdbtool's man page and I'll try to update the whole manpage a bit when 
adding a section for patternize soon -- Bazsi, you might want to pull 
those to the mainline.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.balabit.hu/pipermail/syslog-ng/attachments/20100924/d1547581/attachment.htm