Hi all, I am currently 4th year undergraduate student at Faculty of Engineering, Jamia Millia Islamia, New Delhi, India. I would like to contribute to a GSoC 2016 project with open source community of syslog-ng. In last summer vacation i worked (as intern )for a company where i was the part of data aggregator project (one of the core member of this project ). Main idea of this project is to build scalable system so that it can handle millions of request per minute. For this we used kafka messaging system. Producer simply produce message to particular topic and consumer get message from that topic and feed to async task (celery worker). I think I can contribute syslog-ng project kafka source. @Viktor Juhasz <https://github.com/juhaszviktor> (Mentor) kindly give me suggestions. -- Md Mehrab Alam https://www.linkedin.com/in/iammehrabalam https://github.com/iammehrabalam
Hi On Wednesday 9 March 2016 at 12:06, md mehrab wrote:
Hi all,
I am currently 4th year undergraduate student at Faculty of Engineering, Jamia Millia Islamia, New Delhi, India. I would like to contribute to a GSoC 2016 project with open source community of syslog-ng.
In last summer vacation i worked (as intern )for a company where i was the part of data aggregator project (one of the core member of this project ). Main idea of this project is to build scalable system so that it can handle millions of request per minute. For this we used kafka messaging system. Producer simply produce message to particular topic and consumer get message from that topic and feed to async task (celery worker).
I think I can contribute syslog-ng project kafka source. @Viktor Juhasz (https://github.com/juhaszviktor) (Mentor) kindly give me suggestions.
That'd be a nice addition to the project IMHO. If I may suggest, could you please opt for the C Kafka binding (https://github.com/edenhill/librdkafka) rather than a Java-based one? Good luck, m.
ya sure, I am exploring C kafka binding (above repo link). On Wed, Mar 9, 2016 at 5:59 PM, Marc Falzon <m@baha.mu> wrote:
Hi
On Wednesday 9 March 2016 at 12:06, md mehrab wrote:
Hi all,
I am currently 4th year undergraduate student at Faculty of Engineering,
Jamia Millia Islamia, New Delhi, India. I would like to contribute to a GSoC 2016 project with open source community of syslog-ng.
In last summer vacation i worked (as intern )for a company where i was
the part of data aggregator project (one of the core member of this project ). Main idea of this project is to build scalable system so that it can handle millions of request per minute. For this we used kafka messaging system. Producer simply produce message to particular topic and consumer get message from that topic and feed to async task (celery worker).
I think I can contribute syslog-ng project kafka source. @Viktor Juhasz (https://github.com/juhaszviktor) (Mentor) kindly give
me suggestions.
That'd be a nice addition to the project IMHO. If I may suggest, could you please opt for the C Kafka binding (https://github.com/edenhill/librdkafka) rather than a Java-based one?
Good luck,
m.
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
-- Md Mehrab Alam https://www.linkedin.com/in/iammehrabalam https://github.com/iammehrabalam
I setup kafka server locally and test kafka consumer (example of librdkafka <https://github.com/edenhill/librdkafka/blob/master/examples/rdkafka_consumer_example.c>) with different property like group.id, auto.offset.reset etc. Also read messages from kafka (i.e particular topic and particular partition ) without duplicating them. is there any task for me? On Wed, Mar 9, 2016 at 6:41 PM, md mehrab <md.mehrab@gmail.com> wrote:
ya sure, I am exploring C kafka binding (above repo link).
On Wed, Mar 9, 2016 at 5:59 PM, Marc Falzon <m@baha.mu> wrote:
Hi
On Wednesday 9 March 2016 at 12:06, md mehrab wrote:
Hi all,
I am currently 4th year undergraduate student at Faculty of
Engineering, Jamia Millia Islamia, New Delhi, India. I would like to contribute to a GSoC 2016 project with open source community of syslog-ng.
In last summer vacation i worked (as intern )for a company where i was
the part of data aggregator project (one of the core member of this project ). Main idea of this project is to build scalable system so that it can handle millions of request per minute. For this we used kafka messaging system. Producer simply produce message to particular topic and consumer get message from that topic and feed to async task (celery worker).
I think I can contribute syslog-ng project kafka source. @Viktor Juhasz (https://github.com/juhaszviktor) (Mentor) kindly give
me suggestions.
That'd be a nice addition to the project IMHO. If I may suggest, could you please opt for the C Kafka binding ( https://github.com/edenhill/librdkafka) rather than a Java-based one?
Good luck,
m.
______________________________________________________________________________ Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng FAQ: http://www.balabit.com/wiki/syslog-ng-faq
-- Md Mehrab Alam
https://www.linkedin.com/in/iammehrabalam https://github.com/iammehrabalam
-- Md Mehrab Alam https://www.linkedin.com/in/iammehrabalam https://github.com/iammehrabalam
participants (2)
-
Marc Falzon
-
md mehrab