[syslog-ng] Problem building syslog-ng 3.11.1 and elastic search
Ronald Fenner
rfenner at gamecircus.com
Tue Feb 27 16:52:01 UTC 2018
Ok the new release built with no problems other than my configurations are now out of date.
Ronald Fenner
Network Architect
Game Circus LLC.
rfenner at gamecircus.com
> On Feb 27, 2018, at 10:08 AM, Ronald Fenner <rfenner at gamecircus.com> wrote:
>
> I believe it is however it shouldn't be a problem since the tarball was re archived on a linux machine then uploaded so it shouldn't be the case.
>
> I'll give the 3.14 one a try shortly.
>
> Ronald Fenner
> Network Architect
> Game Circus LLC.
>
> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>> On Feb 27, 2018, at 8:57 AM, László Várady <laszlo.varady at balabit.com <mailto:laszlo.varady at balabit.com>> wrote:
>>
>> Hi,
>>
>> A weird question:
>> Is it possible that your S3 bucket uses a case-insensitive file system? I'm not really familiar with S3, but we had issues building ivykis e.g. on case-insensitive HFS:
>>
>> https://github.com/buytenh/ivykis/issues/7 <https://github.com/buytenh/ivykis/issues/7>
>>
>> A workaround would be to build ivykis "in-tree" separately, and configure syslog-ng to use the system ivykis:
>>
>> ./configure --with-ivykis=system ...
>>
>> --
>> László Várady
>>
>> On Tue, Feb 27, 2018 at 1:54 AM Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>> wrote:
>> Yes I'm still getting the error.
>> -ebs: Making all in contrib
>> 1519691695,,ui,message, amazon-ebs: Making all in iv_getaddrinfo
>> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT test.o -M$
>> 1519691695,,ui,message, amazon-ebs: mv -f .deps/test.Tpo .deps/test.Po
>> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT iv_getadd$
>> 1519691695,,ui,message, amazon-ebs: mv -f .deps/iv_getaddrinfo.Tpo .deps/iv_getaddrinfo.Po
>> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o test test.o iv_getaddrinfo.o ../../src/libivyk$
>> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall -pthread -Wno-error -o test test.o iv_getaddrinfo.o ../../src/.libs/libivykis.a -lpthread_nonshared -p$
>> 1519691695,,ui,message, amazon-ebs: Making all in kojines
>> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT main.o -MD -MP -MF .dep$
>> 1519691695,,ui,message, amazon-ebs: mv -f .deps/main.Tpo .deps/main.Po
>> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT kojines.o -MD -MP -MF .$
>> 1519691695,,ui,message, amazon-ebs: mv -f .deps/kojines.Tpo .deps/kojines.Po
>> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o kojines main.o kojines.o ../../src/libivykis.l$
>> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall -pthread -Wno-error -o kojines main.o kojines.o ../../src/.libs/libivykis.a -lpthread_nonshared -pthre$
>> 1519691695,,ui,message, amazon-ebs: make[6]: Nothing to be done for `all-am'.
>> 1519691695,,ui,message, amazon-ebs: Making all in misc
>> 1519691695,,ui,message, amazon-ebs: make[5]: Nothing to be done for `all'.
>> 1519691695,,ui,message, amazon-ebs: Making all in man3
>> 1519691695,,ui,message, amazon-ebs: make[5]: *** No rule to make target `IV_FD_PUMP_INIT.3'%!(PACKER_COMMA) needed by `all-am'. Stop.
>> 1519691695,,ui,message, amazon-ebs: make[4]: *** [all-recursive] Error 1
>> 1519691695,,ui,message, amazon-ebs: make[3]: *** [all] Error 2
>> 1519691695,,ui,message, amazon-ebs: make[2]: *** [lib/ivykis/src/libivykis.la <http://libivykis.la/>] Error 2
>> 1519691695,,ui,message, amazon-ebs: make[1]: *** [all-recursive] Error 1
>> 1519691695,,ui,message, amazon-ebs: make: *** [all] Error 2
>> 1519691695,,ui,message, amazon-ebs: Failed to make syslog-ng
>>
>> The odd thing when I was testing the edit where I download the archive then unzipped it an edited the file it seemed to work ok.
>> But when I downloaded made the change re archived it and put in an S3 bucket I get this error.
>>
>>
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>>
>> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>>> On Feb 26, 2018, at 1:25 PM, Laszlo Budai <laszlo.budai at outlook.com <mailto:laszlo.budai at outlook.com>> wrote:
>>>
>>> Hi,
>>>
>>> today we removed the Shield support from syslog-ng OSE: https://github.com/balabit/syslog-ng/pull/1895 <https://github.com/balabit/syslog-ng/pull/1895>.
>>>
>>> You mentioned an ivykis(Lithuanian word, meaning: event) error. Did it work finally?
>>>
>>> regards,
>>> Laszlo Budai
>>>
>>> Get Outlook for iOS <https://aka.ms/o0ukef>
>>> From: syslog-ng <syslog-ng-bounces at lists.balabit.hu <mailto:syslog-ng-bounces at lists.balabit.hu>> on behalf of Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>>
>>> Sent: Monday, February 26, 2018 7:48:45 AM
>>> To: Syslog-ng users' and developers' mailing list
>>> Subject: Re: [syslog-ng] Problem building syslog-ng 3.11.1 and elastic search
>>>
>>> Thanks I'll give it another shot. I had tried modifying the settings.gradle but the the build kicked out an error about ivy kiss (think that was the name) in I think the tests when they were built and I didn't spend the time to find the make command to skip them.
>>> If I have problems with the attempt I'll post the error I get.
>>>
>>> Apparently the plugin isn't listed In the maven repo either which did seem to be available as below you can see it searched there for it as well.
>>>
>>> Ronald Fenner
>>> Network Architect
>>> Game Circus LLC.
>>>
>>> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>>>> On Feb 26, 2018, at 12:33 AM, Kókai Péter <peter.kokai at balabit.com <mailto:peter.kokai at balabit.com>> wrote:
>>>>
>>>> Hello,
>>>>
>>>> There is a open issue at github(https://github.com/balabit/syslog-ng/issues/1891 <https://github.com/balabit/syslog-ng/issues/1891>), you can follow up there. Also it has a patch, that could solve this issue temporary.
>>>>
>>>> Based on your use case
>>>> * if you do not need java and/or java based solution (elasticsearch, kafka, hdfs) you could either *--disable-java* overall
>>>> * if you need java but not the elasticsearch you could remove the elastic-v2 from compilation via editting: *modules/java-modules/settings.gradle*
>>>> * if you need those there is a patch in the issue, that uses atlassian instead of the elasticsearch (which seems down)
>>>>
>>>>
>>>>
>>>> --
>>>> Kokan
>>>>
>>>> On Fri, Feb 23, 2018 at 2:08 AM Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>> wrote:
>>>> So I tried using the latest version 3.13.2 downloaded from GitHub
>>>> And again get the same error
>>>>
>>>> FAILURE: Build failed with an exception.
>>>>
>>>> * What went wrong:
>>>> Could not resolve all files for configuration ':elastic-v2:compileClasspath'.
>>>> > Could not find org.elasticsearch.plugin:shield:2.4.0.
>>>> Searched in the following locations:
>>>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield-2.4.0.jar
>>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield.jar
>>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield-2.4.0.jar
>>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield.jar
>>>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom>
>>>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar>
>>>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom>
>>>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar>
>>>> Required by:
>>>> project :elastic-v2
>>>>
>>>> * Try:
>>>> Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.
>>>>
>>>>
>>>> So it seems we can't build any version of syslog-ng because of this missing plugin.
>>>> Any thoughts?
>>>>
>>>> Ronald Fenner
>>>> Network Architect
>>>> Game Circus LLC.
>>>>
>>>> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>>>>> On Feb 22, 2018, at 5:14 PM, Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>> wrote:
>>>>>
>>>>> I have script that builds syslog-ng and it was working fine but apparently a plugin for elastic search seems to have gone missing and I'm getting this error:
>>>>>
>>>>> 1519328565,,ui,message, amazon-ebs: Could not resolve all files for configuration ':elastic-v2:compileClasspath'.
>>>>> 1519328565,,ui,message, amazon-ebs: > Could not find org.elasticsearch.plugin:shield:2.4.0.
>>>>> 1519328565,,ui,message, amazon-ebs: Searched in the following locations:
>>>>> 1519328565,,ui,message, amazon-ebs: file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>>>>> 1519328565,,ui,message, amazon-ebs: file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>>>>> 1519328565,,ui,message, amazon-ebs: https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$ <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$>
>>>>> 1519328565,,ui,message, amazon-ebs: https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$ <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$>
>>>>> 1519328565,,ui,message, amazon-ebs: http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$ <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$>
>>>>> 1519328565,,ui,message, amazon-ebs: 9 actionable tasks: 9 executed
>>>>> 1519328565,,ui,message, amazon-ebs: http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$ <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$>
>>>>> 1519328565,,ui,message, amazon-ebs: Required by:
>>>>> 1519328565,,ui,message, amazon-ebs: project :elastic-v2
>>>>> 1519328565,,ui,message, amazon-ebs:
>>>>> 1519328565,,ui,message, amazon-ebs: * Try:
>>>>> 1519328565,,ui,message, amazon-ebs: Run with --stacktrace option to get the stack trace. Run with --info or --debug option t$
>>>>> 1519328565,,ui,message, amazon-ebs:
>>>>>
>>>>> Is there a way to disable elasticsearch module specifically?
>>>>>
>>>>> Ronald Fenner
>>>>> Network Architect
>>>>> Game Circus LLC.
>>>>>
>>>>> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>>>>
>>>> ______________________________________________________________________________
>>>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
>>>> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
>>>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>>>>
>>>> ______________________________________________________________________________
>>>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
>>>> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
>>>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>>>>
>>>
>>> ______________________________________________________________________________
>>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
>>> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
>>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>>>
>>
>> ______________________________________________________________________________
>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
>> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.balabit.hu/pipermail/syslog-ng/attachments/20180227/c957fcb1/attachment-0001.html>
More information about the syslog-ng
mailing list