[syslog-ng] [ANN]: balabit.logstore - Open Source LogStore reader API

[Gergely Nagy]

---------------------------------------------------------------
PACKAGE   : com.balabit/logstore
VERSION   : 0.0.1
SUMMARY   : First alpha release
DATE      : 2012 April 24
HOMEPAGE  : http://algernon.github.com/balabit.logstore
---------------------------------------------------------------

DESCRIPTION:

  The balabit.logstore project is a library written in Clojure, that
  tries to provide a convenient API to read syslog-ng PE LogStore files.

  The reason behind the implementation is to have an independent, open
  source reader for the LogStore file format, so that one is not tied to
  syslog-ng to read one's logs stored in this format. An open
  implementation makes it possible to read these logs on systems where
  syslog-ng is not installed, or where the lgstool program is not
  available.

  LogStore itself is a storage format for log messages, supporting
  encryption, compression, secure timestamps, serialized messages (think
  name-value pairs as opposed to just a plain, formatted string) and a
  lot more. This format is being opened, and this library is meant to
  provide an implenetation for a LogStore reader, that will eventually
  support reading all kinds of LogStore files.

EXAMPLE:

  (ns example
    (:require [balabit.logstore :as logstore]))

  (defn lgstool-cat
    ([] (lgstool-cat "resources/logstores/short.compressed.store"))
    ([filename]
       (logstore/with-file filename
         (let [indexed-records (zipmap (range (count (logstore/records)))
                                       (logstore/records))
               chunk-records (keys (filter #(= :chunk (:type (val %)))
                                           indexed-records))
               print-msgs (fn [index]
                            (dorun (map println (:messages (logstore/nth-record index)))))]
           (dorun (map print-msgs chunk-records))))))

  (lgstool-cat "/path/to/logstore/messages.store")

  More examples can be found bundled with the sources, and as part of
  the documentation:
    http://algernon.github.com/balabit.logstore/#balabit.logstore.examples

FEATURES:

  The library - being in very early alpha stage - can already read some
  LogStore files, and transparently decompress them, collect meta-data
  about both the logstore, and the information stored within.

  It comes with an extensive test suite and a lot of examples.

FUTURE DIRECTION:

  We are working on making the library able to deserialize name-value
  pairs, to make it support decrypting logstores, and paralell to that,
  we're working on a Java API, so that it can be used from a more
  familiar language, and still provide a convenient, easy to use API.

  In the future, we also plan to publish ready to use JAR files that one
  can easily use from any Java or Clojure project.

DOWNLOADS:

  The source is available from the git repository at github:
    git://github.com/algernon/balabit.logstore.git

  Documentation and more information about the library is available on
  its homepage at http://algernon.github.com/balabit.logstore/. People
  interested in the development of the library can also look at the
  developer docs at:
    http://algernon.github.com/balabit.logstore/developer-api.html

-- 
|8]