- syslog-ng - lists.balabit.hu

[GSoC - 2015 Proposal] - Project: syslog-ng server monitoring with mobile app
by krish k 22 Mar '15

22 Mar '15

Hi all, I would like to propose a project. Mobile applications for server monitoring starting with Android and extending it to windows and iOS.I would like to discuss about the project with the mentor and would like to take this forward. Can someone kindly guide me in a correct direction to take this project forward. I am graduate student doing my Master of Computing at National University of Singapore - School of Computing. I have experience in Java, C, C#, Python. I have developed many android applications and published it in Google Play Store. Currently published apps can be found here https://play.google.com/store/apps/developer?id=Spaghetti%20Stack&hl=en I have worked with Verizon Inc before joining my masters, there I was working on a tablet application. I am very much thrilled about the idea of working with Syslog-ng community and be an active member. Looking forward to work on this project. Regards,Krishna.

1 0

GSoC 2015 WebSocket for syslog-ng
by Roland Lukács 22 Mar '15

22 Mar '15

Hello, My name is Roland Lukács and I am a third-year Computer Engineering student at Budapest University of Technology and Economics. I have experience in C, C++, Python programming languages. I'm system administrator in Schönherz dorm so I use often syslog-ng. I heard about GSoC from my friend who was part of it last year. I am interested in Websocket for syslog-ng project. I have already talked to László Mészáros, who told me about the project. Best regards, Roland Lukács

1 0

GSoC 2015: syslog-ng as a command line tool
by Máté Eckl 20 Mar '15

20 Mar '15

Hello, I'm Máté Eckl and I study IT engineering at the BME (I'm in my second semester). I studied C in the first semester, but I had prior experience with it. I also have experience on different programming languages, basics of networking (eg.: building a secondary DNS server for the college this spring), I use Linux (Ubuntu and Arch) and I'm familiar with getopt and the mechanism of command-line arguments. Earlier this semester I needed to prepare a basic syslog-ng configuration on a logging server, so I have slight knowledge about the system, but in the college I have great opportunity to get deeper inside it until the end of the semester. I'm really interested in this project, but the functionality is not really clear for me. What should the log messages be transformed to? Do you mean it to be a sort of debug session, where you can test the rules you want to apply in the config files? Or something else? Could you describe it to me a bit more precisely? Best regards, Máté Eckl

1 0

GSoC 2015 Python Language Binding
by Botond Borsits 19 Mar '15

19 Mar '15

Hello, My name is Botond Borsits and I am studying at Budapest University of Technology and Economics. I heard about the GSoC from my friend, who is a syslog-ng open source contributor. I am familiar with C and Python, so I would like to apply to the syslog-ng Python language binding project. Best regards, Botond Borsits

1 0

How to use @EMAIL@ parser in patterndb
by C. L. Martinez 19 Mar '15

19 Mar '15

Hi all, I have a situation like described in syslog-ng's docs (http://www.balabit.com/sites/default/files/documents/syslog-ng-ose-3.7-guid…) about email addresses. I have tried to use "@EMAIL:email:"[<]>@ " in my patterndb to catch all possible email address combinations like <user(a)example.com>, [user(a)example.com] "user(a)example.com", as described in docs, but without luck. Every time that I check some log with pdbtool returns me errors about " [<]>" characters. I have tried to subsitute <> with < and >, for example, but nothing .... Any sample about how to use @EMAIL@ parser inside patterndb? I am using syslog-ng 3.5.x. Thanks.

2 1

insider 2015-03: GsoC; Hadoop; 3.7 documentation; kafka; grok;
by Czanik, Péter 19 Mar '15

19 Mar '15

Dear syslog-ng users, This is the 40th issue of the syslog-ng Insider, a monthly newsletter that brings you syslog-ng-related news. NEWS syslog-ng in Google Summer of Code 2015 --------------------------------------- This year we participate in GSoC again, with a focus on making the life of our users and contributors easier. Our main projects for this year include: * Python and Java language bindings to make code contribution easier * Develop a Qt-based graphical configuration editor to help new users to get started * A data-flow visualization tool to help in debugging If you are a student and willing to spend the summer coding syslog-ng, or know someone who could participate, check our detailed project and idea list at https://github.com/balabit/ You can reach mentors by direct e-mail, by IRC on channel #syslog-ng on FreeNode, or on our mailing list at https://lists.balabit.hu/ syslog-ng Hadoop support ------------------------ With the release of syslog-ng PE 5F3 support for Hadoop arrived. It will also be part of the upcoming syslog-ng OSE 3.7 release. This enables syslog-ng to write log messages to HDFS. https://jluby.blogs.balabit.com/2015/03/10/syslog-ng-and-big-data-streaming… syslog-ng 3.7 beta is coming ---------------------------- The first beta of syslog-ng OSE 3.7 is expected to arrive in the coming weeks. It has many smaller and larger changes, like the Java destination is migrated from incubator to syslog-ng core. Documentation for most of the new features is already available making it easier to get started: http://www.balabit.com/sites/default/files/documents/syslog-ng-ose-3.7-guid… Changes: http://www.balabit.com/sites/default/files/documents/syslog-ng-ose-3.7-guid… Conferences in February ----------------------- February was a very busy month in terms of conferences. It started with FOSDEM in Brussels. Next weekend an introductory presentation about syslog-ng in Brno, at the Fedora / Red Hat developers conference. Finally talking to hundreds of current and would be syslog-ng users at the South Californian Linux Expo at the syslog-ng booth and giving a presentation about message parsing and language bindings. FOSDEM: https://czanik.blogs.balabit.com/2015/02/fosdem-2015-first-syslog-ng-superh… DevConf: https://czanik.blogs.balabit.com/2015/02/czp-devconf-2015/ Scale: https://czanik.blogs.balabit.com/2015/02/czp-scale-2015-lemmings-makers-and… All incubator features packaged ------------------------------- For RPM based distributions, all incubator features are now available as a package. This includes now ZeroMQ, kafka and grok. OpenSUSE, SLES12: https://build.opensuse.org/project/show/home:czanik:syslog-ng36 Fedora, RHEL7: https://copr.fedoraproject.org/coprs/czanik/syslog-ng36/ RHEL6: https://copr.fedoraproject.org/coprs/czanik/syslog-ng36epel6/ NEW RELEASES syslog-ng PE 5F3: https://jluby.blogs.balabit.com/2015/03/19/the-syslog-ng-premium-edition-5f… syslog-ng store box 4F1: https://jluby.blogs.balabit.com/2015/03/05/syslog-ng-store-box-4f1-released/ Your feedback and news tips about the next issue is welcome at documentation(a)balabit.com To read this newsletter on-line, visit: http://insider.blogs.balabit.com/ Peter Czanik (CzP) <peter.czanik(a)balabit.com> BalaBit IT Security / syslog-ng upstream http://czanik.blogs.balabit.com/ https://twitter.com/PCzanik

1 0

GSoC 2015 - syslog-ng for Java
by Szabó Péter 19 Mar '15

19 Mar '15

Hi, My name is Peter Szabo and I am an undergraduate student at Budapest University of Technology and Economics. I am using tons of open source software every day, including syslog-ng and it is time to give something back to the community. I have looked through the list of your projects and multiple ideas seemed interesting. I have experience in C/C++, Python and Java. After some thinking I have decided to choose *Java language binding*. It fits the most to my interests and it provides a great opportunity to deepen my knowledge. Regards, Peter Szabo

1 0

Apply to GSoC
by András Mamenyák 18 Mar '15

18 Mar '15

Hello! My name is András Mamenyák and I am currently studying Computer Science Engineering at the University of Debrecen. I heard about the GSoC program from my teacher and after checking out the project ideas, one of them caught my attention:* syslog-ng configuration editor using Qt*. It would be really amazing if I could contribute to it! My favourite programming language is C++ and I already have some reference works including a Qt application. I would like to ask about the details of the project, how complex will the application be? Is it required that the app reads existing configuration files and displays them? Or anything else specific not mentioned in the brief description? Hope to hear from you guys soon! Regards, András

1 0

patterndb v3 vs v4
by Matt Zagrabelny 18 Mar '15

18 Mar '15

Greetings! Does anyone have any documentation about the differences between version 3 and version 4 of the patterndb? I see on the balabit website: <patterndb version='4' pub_date='2010-10-17'> However my patterns are v3 and I am wondering what I am missing out on! Thanks! -m

2 2

sysyemd and syslog-ng
by Sivadas.M.P 17 Mar '15

17 Mar '15

Hi! For the first time I have compiled and installed syslog-ng with the help of Mr.Peter and its working, but manual startup is required for the program. Have anyone automated the process using systemd to startup the process the system startup? Thanks and rgds -- SIVADAS.M.P VAL&FS2, C-DOT, Electronics City Phase - I Bangalore - 560100 Karnataka Phone : 080-25119001 Ext: 9143 ===================================================================================== Disclaimer: ---------- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. The sender does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission.

2 1

Project: syslog-ng configuration editor using Qt
by 徐彬彬 17 Mar '15

17 Mar '15

Hi, all I'm interested in Project: syslog-ng configuration editor using Qt. I cannot find Mentor Laszlo Budai <https://github.com/lbudai>'s email address, are there anyone can provide? or Mr Budai, will you directly contact with me? Thanks, and Regards! ---- Binbin Xu 徐彬彬 Pursuing a Master's Degree Major: Computer Science & Technology @Zhejiang University Lab: State Key Lab of CAD&CG @Zhejiang University

1 0

GSoC '15 - syslog-ng as a command line tool
by Noémi Ványi 16 Mar '15

16 Mar '15

Hi, My name is Noemi Vanyi and I am a fourth-year Computer Engineering student at Budapest University of Technology and Economics. I am familiar with C and Python languages. I am a daily user of syslog-ng and I would like to contribute to it. I am interested in working on syslog-ng as a command line tool. My github page: https://github.com/kvch Best regards, Noemi Vanyi

1 0

Gsoc'15
by Sagar Ghai 16 Mar '15

16 Mar '15

Hi, I would be interested in taking up one of the projects named: syslog-ng configuration editor using Qt. Can someone help me to proceed further.

1 0

Gsoc'15 Project Query
by Aman Jain 15 Mar '15

15 Mar '15

HI, I finally after gone through various projects ideas listen on your idea page i decided to go for Web Socket, can you please explain about that projecct idea.

1 0

Log Message flow visualization
by Kristóf Havasi 14 Mar '15

14 Mar '15

My name is Kristóf Havasi and I'm currently a first-year student at Budapest University of Technology and Economics. My primary motivation was to find one topic for the summer of 2015 which is within my circle of interests ,one that i consider suitable for myself to get familiar with in greater depths. After perceiving GSoC, I stumbled upon this project of yours named "Log Message Flow visualization" which i have found to be well fitting to the above-mentioned expectations, considering that i am highly interested in network technologies. I have got familiar with C language in the last two years, i am recently pursuing the intent to know more and more about The syslog-ng, and am very excited about the idea of contributing to it. Best regards, Kristóf Havasi

1 0

GSoC - 2015 reg..,
by Manikandan Selvaganesh 14 Mar '15

14 Mar '15

Hey Laszlo Budai, I am* Manikandan Selvaganesh* doing my final year* B.E ( Computer Science and Engineering )* in Sri Krishna College of Engineering & Technology, India. Currently, I am doing my interns in Red hat. I have a great interest in C, C++, HTML, CSS and PHP. I have done a number of projects in C, Performance analysis of data structures using C, Family Tree Maintenance using C, Memory Games using C and now i am working on "*Implementing logging framework in a gluster file system*" ( Code contributions are in Github ). I am highly interested in working on the GSoC project "*syslog-ng configuration editor using Qt*". I am also contributing codes to the Mozilla community and Fedora community. Could you help me on getting started? Regards, Manikandan Selvaganesh.

1 0

Single host logs aren't being written
by Brandon Kendall 13 Mar '15

13 Mar '15

Hello everyone. I have a centralized syslog-ng server running that collect syslog messages from Cisco firewalls. The .conf file is very straightforward and contains the following: options { use_fqdn(no); use_dns(yes); dns_cache(yes); dns_cache_size(2000); dns_cache_expire(87600); keep_hostname(no); long_hostnames(no); flush_lines(0); normalize_hostnames(yes); create_dirs(yes); dir_group(group_name); dir_perm(0751); stats_freq(600); stats_level(1); group(group_name); perm(0640); }; source s_network_1 { udp(); }; destination d_network_1 { file ("/var/syslog/$R_YEAR-$R_MONTH-$R_DAY/$HOST/$R_YEAR-$R_MONTH-$R_DAY-$HOST-$R_HOUR.log"); }; log { source(s_network_1); destination(d_network_1); }; The goal is to have the logs from each device arranged in a hierarchy that is as follows (simplified): Date/device_name/hour-1.log Date/device/name/hour2.log etc This has been working great. Recently I configured another network device to send syslog messages to this server, and they aren't being logged. Using tcpdump on the syslog-ng box, I've verified the messages are making it to the server from the network device. They are UDP and using the correct port. I've compared the message format in the pcap to other devices that are still logging and everything matches. I have no errors in /var/log/syslog files, nor do I have errors in /var/log/messages. I've hit a dead end in troubleshooting, since all other devices sending logs to this server are being correctly written to log files. Can someone point me to anything else to check? This is syslog-ng 3.1.2 running on RHEL 5.8. Thanks!

2 4

Regarding syslog-ng server monitoring mobile application
by Amar Budhiraja 13 Mar '15

13 Mar '15

Hi, I am a junior undergraduate student currently pursuing computer science and engineering. I was looking at the GSoC ideas for syslog-ng and I found the idea of syslog-ng server monitoring with mobile app quite interesting. My skill set includes Java, C/C++, Python and Android. I have worked with android earlier and I have developed about 5 applications, 2 end-to-end and 3 prototypes. I have also been coding in Java for about 3 years now and have a pretty good understanding of the same. I do not have any coding knowledge regarding SSL control socket but I have worked with socket in C for a networks project, so I believe I can pick it up as and when required. As for syslog-ng, I installed and worked around it a little bit and I found myself to be quite comfortable with it at a user level. I believe building a mobile application would be relatively less codebase dependent and more couple in a API sort of way. I would like to contribute to this project over the summer. Could you please guide me where should I start? May be wireframing or a small demo app? Thank you Sincerely, Amar Budhiraja

2 3

Syslog-ng: GSoC2015: Project: Riak Destination
by Parth Oberoi 12 Mar '15

12 Mar '15

Hello everyone, I am a prospective gsoc 2015 applicant and wishes to apply to it under the New Destination Project -Riak Destination . @algernon-the mentor for this project gave me a few pointers to get started get started, so i have gone through the following things 1- compiled syslog-ng from source 2- went through the configuration docs(chapter 5), found it pretty interesting 3- Read up on the Google protocol Buffers and reading through the examples of its c library protobuf-c 4- did set up a single riak node()(will experiment with it after i set up the riak-c-client which i am currently installing) The things i am planning to do in the coming couple of days is to figure out the features of riak 2.0 that riak-c-client does not support and really would have to decide whether to use this library and implement the missing features or develop the new one . Only after this step can i lay down a project plan for the GSoC time period. Also i have working knowledge of C, lex and yacc (brushing them up these days). Any suggestions or tips or ideas would be welcome. I usually learn as i go and have a keen interest in new technologies,so any other prerequisite that i should have or that can help me in the project should be told. I am usually always online so i can be reached at htrapdev(a)gmail.com , irc nick: @htrap. Github: github.com/htrap Please let me know if any other details are required. looking forward to suggestions. Regards, Parth Oberoi

1 0

[GSoC '15] syslog-ng configuration editor using Qt
by Fábián Kristóf - Szabolcs 12 Mar '15

12 Mar '15

Hello, I'm currently studying at the University of Debrecen - Department of Informatics, I'm applying to the "syslog-ng configuration editor using Qt" project for syslog-ng. I've worked with Qt before in some home and university projects (like a traffic counter application using Qt <https://github.com/krajsz/Traffic-counter-with-OpenCV>), and contributed to a local project named Robocar World Championship ( http://justine.inf.unideb.hu/ ) and of course I'm comfortable with c++. I'm looking forward to work on this project. My question is that on what should I put more attention before proposing for this project? I guess the main target would be to get familiar with the syslog-ng configuration language. Thanks in advance, Fábián Kristóf

1 0

Parsing more than MSG macro
by Thomas Straubinger 12 Mar '15

12 Mar '15

Hello, is there a way to process more than the $MSG macro with a syslog-ng parse filter? We are forwarding our syslogs via rsyslog in this format (client config): $template tmpl_forward,"%hostname% %syslogtag% \"%msg%\"\n" *.* @@syslog:514;tmpl_forward I have created the following parser rule in syslog-ng: parser p_INTERNAL { csv-parser(columns("INTERNAL.TIME_LOGGED", "INTERNAL.TIME_RECEIVED", "INTERNAL.RELAY_HOST", "INTERNAL.LOGGING_HOST", "INTERNAL.PROGRAM", "INTERNAL.MESSAGE") flags(escape-double-char,strip-whitespace) delimiters(" ") quote-pairs('""[]') ); }; I want to create the logfile in this format: destination d_intern2 { file("/log-local/__OPS__/$YEAR-$MONTH/xxx-${INTERN.LOGGING_HOST}.log" ); }; Unfortunately, syslog-ng does not fill up the $MSG macro with the hole content provided by the client via "%hostname% %syslogtag% \"%msg%\"\n". So it's not possible to fill (parse) the desired 'INTERNAL.LOGGING_HOST' variable. How could i achieve, to, get the content of %hostname% (sent by rsyslog) into the 'INTERNAL.LOGGING_HOST' variable of syslog-ng? Thank you! Thomas

2 2

[GSOC'15 Intro] Python Language Binding
by Akash Gangil 11 Mar '15

11 Mar '15

Hi, I am applying to the "Python Language Binding" project for syslog-ng in this years GSOC' 15. I am going through the incubator code which has basic implementations. I wanted to know what level of detail are you guys expecting in the proposal? Or if there is any specific task you would want to screen applicants? As for myself, I am a second years Masters student at Georgia Tech. And have interfaced with quite a few things that are needed for this project. - I, in a team of 3, led <https://github.com/akashgangil/Tiger/graphs/contributors> the development of a compiler for a toy programming language as a part of the class project. https://github.com/akashgangil/Tiger - As a part of my research work, which deals with designing a data management and analytics system for scientific "big" data, I have also used <https://github.com/akashgangil/khanEVPath/blob/master/src/fileprocessor.cpp…> Python/C Api, to allow writing plugins in python, which can be consumed by the system. https://github.com/akashgangil/khanEVPath <https://github.com/akashgangil/khanEVPath> - I was also a GSOC student in 2009 for Tux4kids and a mentor in 2010 for the same. So I am pretty familiar with the program, - Beside I have extensively used tools like logstash, elasticsearch in the past and appreciate the problems that are associated with log data management and processing. This is also one of the reasons the project interests me. I am still going through the code and trying to get in more details for the proposal. Hoping to get something ready soon. Thanks! -- Akash

2 1

make error in syslog-ng version 3.6.1 with FC20
by Sivadas.M.P 11 Mar '15

11 Mar '15

Hi! I have tried the version syslog-ng-3.4.7-1.fc20.x86_64 and succeeded to log the messages to MySQL DB. Later found from web that there are some bugs which are solved in 3.6.1. When trying out the syslog-ng version 3.6.1 with FC20 (source code) I am getting the following error during make. ------------------------------------------------------------------------------------------------------ In file included from modules/afsql/afsql.c:24:0: modules/afsql/afsql.h:28:21: fatal error: dbi/dbi.h: No such file or directory #include <dbi/dbi.h> ^ compilation terminated. make[2]: *** [modules/afsql/modules_afsql_libafsql_la-afsql.lo] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 ----------------------------------------------------------------------------------------------------- Kindly suggest any remedy for this issue. regards -- SIVADAS.M.P VAL&FS2, C-DOT, Electronics City Phase - I Bangalore - 560100 Karnataka Phone : 080-25119001 Ext: 9143 ===================================================================================== Disclaimer: ---------- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. The sender does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission.

2 1

GSoC Introduction, syslog-ng as a command line tool
by Bagossy Attila 10 Mar '15

10 Mar '15

Hi, I'd like to introduce myself to the community. I am Attila Bagossy, undergraduate student at the University of Debrecen, Faculty of Informatics. I've been writing programs since I was a child and when I read the letter of Mr László Budai (received through the Neptun system, forwarded by Mr Norbert Bátfai), I couldn't resist to take a chance. I've been coding in C for nearly four years, but I also have experience with OO languages such as C++ or C#. I'm interested in the following project: syslog-ng as a command line tool. I found this project the most interesting and I'm really excited about developing a new tool and making syslog-ng more powerful. Currently, I'm examining the code and getting familiar with it. This is a great opportunity and I want to give my best. Regards, Attila Bagossy University of Debrecen

1 0

Introduction. Interested in Android App to monitor syslog-ng servers for GSoC 2015
by karan grover 10 Mar '15

10 Mar '15

Hello there, I am Karan Grover. I am currently pursuing BTech in Computer Science at IIIT Delhi. I am an android developer, and I wish to contribute to syslog-ng by developing an android app to monitor syslog-ng server. I will be working on a project involving SNMP with my professor in the future, and I plan to use syslog-ng to manage the logs then. I think the android app, would come handy. I want to work on this project, as I want it to be solved for myself too. I will be learning about syslog-ng in the coming week. Except this, I have all the skills desirable for the project. A little bit about me: I have been an android developer at 2 startups - Backpack Labs <https://www.usebackpack.com/> and LEAF Wearables <http://www.leafwearables.com/>. I also keep working on a couple of side projects. A big one is near release. I look forward to start my open source journey by contributing to syslog-ng, and learn how to write beautiful, readable and well documented code. I have already mailed my introduction to Zoltan Pallagi. I am posting here to introduce myself to the community. Thank you.

1 0