[syslog-ng] Problem building syslog-ng 3.11.1 and elastic search
Ronald Fenner
rfenner at gamecircus.com
Tue Feb 27 16:08:29 UTC 2018
I believe it is however it shouldn't be a problem since the tarball was re archived on a linux machine then uploaded so it shouldn't be the case.
I'll give the 3.14 one a try shortly.
Ronald Fenner
Network Architect
Game Circus LLC.
rfenner at gamecircus.com
> On Feb 27, 2018, at 8:57 AM, László Várady <laszlo.varady at balabit.com> wrote:
>
> Hi,
>
> A weird question:
> Is it possible that your S3 bucket uses a case-insensitive file system? I'm not really familiar with S3, but we had issues building ivykis e.g. on case-insensitive HFS:
>
> https://github.com/buytenh/ivykis/issues/7 <https://github.com/buytenh/ivykis/issues/7>
>
> A workaround would be to build ivykis "in-tree" separately, and configure syslog-ng to use the system ivykis:
>
> ./configure --with-ivykis=system ...
>
> --
> László Várady
>
> On Tue, Feb 27, 2018 at 1:54 AM Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>> wrote:
> Yes I'm still getting the error.
> -ebs: Making all in contrib
> 1519691695,,ui,message, amazon-ebs: Making all in iv_getaddrinfo
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT test.o -M$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/test.Tpo .deps/test.Po
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT iv_getadd$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/iv_getaddrinfo.Tpo .deps/iv_getaddrinfo.Po
> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o test test.o iv_getaddrinfo.o ../../src/libivyk$
> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall -pthread -Wno-error -o test test.o iv_getaddrinfo.o ../../src/.libs/libivykis.a -lpthread_nonshared -p$
> 1519691695,,ui,message, amazon-ebs: Making all in kojines
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT main.o -MD -MP -MF .dep$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/main.Tpo .deps/main.Po
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error -MT kojines.o -MD -MP -MF .$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/kojines.Tpo .deps/kojines.Po
> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o kojines main.o kojines.o ../../src/libivykis.l$
> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall -pthread -Wno-error -o kojines main.o kojines.o ../../src/.libs/libivykis.a -lpthread_nonshared -pthre$
> 1519691695,,ui,message, amazon-ebs: make[6]: Nothing to be done for `all-am'.
> 1519691695,,ui,message, amazon-ebs: Making all in misc
> 1519691695,,ui,message, amazon-ebs: make[5]: Nothing to be done for `all'.
> 1519691695,,ui,message, amazon-ebs: Making all in man3
> 1519691695,,ui,message, amazon-ebs: make[5]: *** No rule to make target `IV_FD_PUMP_INIT.3'%!(PACKER_COMMA) needed by `all-am'. Stop.
> 1519691695,,ui,message, amazon-ebs: make[4]: *** [all-recursive] Error 1
> 1519691695,,ui,message, amazon-ebs: make[3]: *** [all] Error 2
> 1519691695,,ui,message, amazon-ebs: make[2]: *** [lib/ivykis/src/libivykis.la <http://libivykis.la/>] Error 2
> 1519691695,,ui,message, amazon-ebs: make[1]: *** [all-recursive] Error 1
> 1519691695,,ui,message, amazon-ebs: make: *** [all] Error 2
> 1519691695,,ui,message, amazon-ebs: Failed to make syslog-ng
>
> The odd thing when I was testing the edit where I download the archive then unzipped it an edited the file it seemed to work ok.
> But when I downloaded made the change re archived it and put in an S3 bucket I get this error.
>
>
> Ronald Fenner
> Network Architect
> Game Circus LLC.
>
> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>> On Feb 26, 2018, at 1:25 PM, Laszlo Budai <laszlo.budai at outlook.com <mailto:laszlo.budai at outlook.com>> wrote:
>>
>> Hi,
>>
>> today we removed the Shield support from syslog-ng OSE: https://github.com/balabit/syslog-ng/pull/1895 <https://github.com/balabit/syslog-ng/pull/1895>.
>>
>> You mentioned an ivykis(Lithuanian word, meaning: event) error. Did it work finally?
>>
>> regards,
>> Laszlo Budai
>>
>> Get Outlook for iOS <https://aka.ms/o0ukef>
>> From: syslog-ng <syslog-ng-bounces at lists.balabit.hu <mailto:syslog-ng-bounces at lists.balabit.hu>> on behalf of Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>>
>> Sent: Monday, February 26, 2018 7:48:45 AM
>> To: Syslog-ng users' and developers' mailing list
>> Subject: Re: [syslog-ng] Problem building syslog-ng 3.11.1 and elastic search
>>
>> Thanks I'll give it another shot. I had tried modifying the settings.gradle but the the build kicked out an error about ivy kiss (think that was the name) in I think the tests when they were built and I didn't spend the time to find the make command to skip them.
>> If I have problems with the attempt I'll post the error I get.
>>
>> Apparently the plugin isn't listed In the maven repo either which did seem to be available as below you can see it searched there for it as well.
>>
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>>
>> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>>> On Feb 26, 2018, at 12:33 AM, Kókai Péter <peter.kokai at balabit.com <mailto:peter.kokai at balabit.com>> wrote:
>>>
>>> Hello,
>>>
>>> There is a open issue at github(https://github.com/balabit/syslog-ng/issues/1891 <https://github.com/balabit/syslog-ng/issues/1891>), you can follow up there. Also it has a patch, that could solve this issue temporary.
>>>
>>> Based on your use case
>>> * if you do not need java and/or java based solution (elasticsearch, kafka, hdfs) you could either *--disable-java* overall
>>> * if you need java but not the elasticsearch you could remove the elastic-v2 from compilation via editting: *modules/java-modules/settings.gradle*
>>> * if you need those there is a patch in the issue, that uses atlassian instead of the elasticsearch (which seems down)
>>>
>>>
>>>
>>> --
>>> Kokan
>>>
>>> On Fri, Feb 23, 2018 at 2:08 AM Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>> wrote:
>>> So I tried using the latest version 3.13.2 downloaded from GitHub
>>> And again get the same error
>>>
>>> FAILURE: Build failed with an exception.
>>>
>>> * What went wrong:
>>> Could not resolve all files for configuration ':elastic-v2:compileClasspath'.
>>> > Could not find org.elasticsearch.plugin:shield:2.4.0.
>>> Searched in the following locations:
>>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield-2.4.0.jar
>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield.jar
>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield-2.4.0.jar
>>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield.jar
>>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom>
>>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar>
>>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom>
>>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar>
>>> Required by:
>>> project :elastic-v2
>>>
>>> * Try:
>>> Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.
>>>
>>>
>>> So it seems we can't build any version of syslog-ng because of this missing plugin.
>>> Any thoughts?
>>>
>>> Ronald Fenner
>>> Network Architect
>>> Game Circus LLC.
>>>
>>> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>>>> On Feb 22, 2018, at 5:14 PM, Ronald Fenner <rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>> wrote:
>>>>
>>>> I have script that builds syslog-ng and it was working fine but apparently a plugin for elastic search seems to have gone missing and I'm getting this error:
>>>>
>>>> 1519328565,,ui,message, amazon-ebs: Could not resolve all files for configuration ':elastic-v2:compileClasspath'.
>>>> 1519328565,,ui,message, amazon-ebs: > Could not find org.elasticsearch.plugin:shield:2.4.0.
>>>> 1519328565,,ui,message, amazon-ebs: Searched in the following locations:
>>>> 1519328565,,ui,message, amazon-ebs: file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>>>> 1519328565,,ui,message, amazon-ebs: file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>>>> 1519328565,,ui,message, amazon-ebs: file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>>>> 1519328565,,ui,message, amazon-ebs: https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$ <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$>
>>>> 1519328565,,ui,message, amazon-ebs: https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$ <https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$>
>>>> 1519328565,,ui,message, amazon-ebs: http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$ <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$>
>>>> 1519328565,,ui,message, amazon-ebs: 9 actionable tasks: 9 executed
>>>> 1519328565,,ui,message, amazon-ebs: http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$ <http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$>
>>>> 1519328565,,ui,message, amazon-ebs: Required by:
>>>> 1519328565,,ui,message, amazon-ebs: project :elastic-v2
>>>> 1519328565,,ui,message, amazon-ebs:
>>>> 1519328565,,ui,message, amazon-ebs: * Try:
>>>> 1519328565,,ui,message, amazon-ebs: Run with --stacktrace option to get the stack trace. Run with --info or --debug option t$
>>>> 1519328565,,ui,message, amazon-ebs:
>>>>
>>>> Is there a way to disable elasticsearch module specifically?
>>>>
>>>> Ronald Fenner
>>>> Network Architect
>>>> Game Circus LLC.
>>>>
>>>> rfenner at gamecircus.com <mailto:rfenner at gamecircus.com>
>>>
>>> ______________________________________________________________________________
>>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
>>> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
>>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>>>
>>> ______________________________________________________________________________
>>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
>>> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
>>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>>>
>>
>> ______________________________________________________________________________
>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
>> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>>
>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng <https://lists.balabit.hu/mailman/listinfo/syslog-ng>
> Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng <http://www.balabit.com/support/documentation/?product=syslog-ng>
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq <http://www.balabit.com/wiki/syslog-ng-faq>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.balabit.hu/pipermail/syslog-ng/attachments/20180227/228dfa80/attachment-0001.html>
More information about the syslog-ng
mailing list