[syslog-ng] [GSoC] Project: Kafka source

[md mehrab]

I setup kafka server locally and test kafka consumer (example of librdkafka
<https://github.com/edenhill/librdkafka/blob/master/examples/rdkafka_consumer_example.c>)
with different property like group.id, auto.offset.reset etc.
Also read messages from kafka (i.e particular topic and particular
partition ) without duplicating them.

is there any task for me?


On Wed, Mar 9, 2016 at 6:41 PM, md mehrab <md.mehrab at gmail.com> wrote:

> ya sure,
> I am exploring C kafka binding (above repo link).
>
>
>
> On Wed, Mar 9, 2016 at 5:59 PM, Marc Falzon <m at baha.mu> wrote:
>
>> Hi
>>
>>
>> On Wednesday 9 March 2016 at 12:06, md mehrab wrote:
>>
>> >
>> > Hi all,
>> >
>> > I am currently 4th year undergraduate student at Faculty of
>> Engineering, Jamia Millia Islamia, New Delhi, India. I would like to
>> contribute to a GSoC 2016 project with open source community of syslog-ng.
>> >
>> > In last summer vacation i worked (as intern )for a company where i was
>> the part of data aggregator project (one of the core member of this project
>> ). Main idea of this project is to build scalable system so that it can
>> handle millions of request per minute. For this we used kafka messaging
>> system. Producer simply produce message to particular topic and consumer
>> get message from that topic and feed to async task (celery worker).
>> >
>> >
>> > I think I can contribute syslog-ng project kafka source.
>> > @Viktor Juhasz (https://github.com/juhaszviktor) (Mentor) kindly give
>> me suggestions.
>>
>>
>> That'd be a nice addition to the project IMHO. If I may suggest, could
>> you please opt for the C Kafka binding (
>> https://github.com/edenhill/librdkafka) rather than a Java-based one?
>>
>> Good luck,
>>
>> m.
>>
>> ______________________________________________________________________________
>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
>> Documentation:
>> http://www.balabit.com/support/documentation/?product=syslog-ng
>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>>
>>
>
>
> --
> Md Mehrab Alam
>
> https://www.linkedin.com/in/iammehrabalam
> https://github.com/iammehrabalam
>



-- 
Md Mehrab Alam

https://www.linkedin.com/in/iammehrabalam
https://github.com/iammehrabalam
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.balabit.hu/pipermail/syslog-ng/attachments/20160310/d388cc34/attachment.htm