[syslog-ng] Problem building syslog-ng 3.11.1 and elastic search
László Várady
laszlo.varady at balabit.com
Tue Feb 27 14:57:15 UTC 2018
Hi,
A weird question:
Is it possible that your S3 bucket uses a case-insensitive file system? I'm
not really familiar with S3, but we had issues building ivykis e.g. on
case-insensitive HFS:
https://github.com/buytenh/ivykis/issues/7
A workaround would be to build ivykis "in-tree" separately, and configure
syslog-ng to use the system ivykis:
./configure --with-ivykis=system ...
--
László Várady
On Tue, Feb 27, 2018 at 1:54 AM Ronald Fenner <rfenner at gamecircus.com>
wrote:
> Yes I'm still getting the error.
> -ebs: Making all in contrib
> 1519691695,,ui,message, amazon-ebs: Making all in iv_getaddrinfo
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall
> -pthread -Wno-error -MT test.o -M$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/test.Tpo .deps/test.Po
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall
> -pthread -Wno-error -MT iv_getadd$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/iv_getaddrinfo.Tpo
> .deps/iv_getaddrinfo.Po
> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC
> --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o test test.o
> iv_getaddrinfo.o ../../src/libivyk$
> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall
> -pthread -Wno-error -o test test.o iv_getaddrinfo.o
> ../../src/.libs/libivykis.a -lpthread_nonshared -p$
> 1519691695,,ui,message, amazon-ebs: Making all in kojines
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error
> -MT main.o -MD -MP -MF .dep$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/main.Tpo .deps/main.Po
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error
> -MT kojines.o -MD -MP -MF .$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/kojines.Tpo
> .deps/kojines.Po
> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC
> --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o kojines main.o
> kojines.o ../../src/libivykis.l$
> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall
> -pthread -Wno-error -o kojines main.o kojines.o
> ../../src/.libs/libivykis.a -lpthread_nonshared -pthre$
> 1519691695,,ui,message, amazon-ebs: make[6]: Nothing to be done for
> `all-am'.
> 1519691695,,ui,message, amazon-ebs: Making all in misc
> 1519691695,,ui,message, amazon-ebs: make[5]: Nothing to be done for
> `all'.
> 1519691695,,ui,message, amazon-ebs: Making all in man3
> 1519691695,,ui,message, amazon-ebs: make[5]: *** No rule to make target
> `IV_FD_PUMP_INIT.3'%!(PACKER_COMMA) needed by `all-am'. Stop.
> 1519691695,,ui,message, amazon-ebs: make[4]: *** [all-recursive] Error 1
> 1519691695,,ui,message, amazon-ebs: make[3]: *** [all] Error 2
> 1519691695,,ui,message, amazon-ebs: make[2]: *** [lib/ivykis/src/
> libivykis.la] Error 2
> 1519691695,,ui,message, amazon-ebs: make[1]: *** [all-recursive] Error 1
> 1519691695,,ui,message, amazon-ebs: make: *** [all] Error 2
> 1519691695,,ui,message, amazon-ebs: Failed to make syslog-ng
>
> The odd thing when I was testing the edit where I download the archive
> then unzipped it an edited the file it seemed to work ok.
> But when I downloaded made the change re archived it and put in an S3
> bucket I get this error.
>
>
> Ronald Fenner
> Network Architect
> Game Circus LLC.
>
> rfenner at gamecircus.com
>
> On Feb 26, 2018, at 1:25 PM, Laszlo Budai <laszlo.budai at outlook.com>
> wrote:
>
> Hi,
>
> today we removed the Shield support from syslog-ng OSE:
> https://github.com/balabit/syslog-ng/pull/1895.
>
> You mentioned an ivykis(Lithuanian word, meaning: event) error. Did it
> work finally?
>
> regards,
> Laszlo Budai
>
> Get Outlook for iOS <https://aka.ms/o0ukef>
> ------------------------------
> *From:* syslog-ng <syslog-ng-bounces at lists.balabit.hu> on behalf of
> Ronald Fenner <rfenner at gamecircus.com>
> *Sent:* Monday, February 26, 2018 7:48:45 AM
> *To:* Syslog-ng users' and developers' mailing list
> *Subject:* Re: [syslog-ng] Problem building syslog-ng 3.11.1 and elastic
> search
>
> Thanks I'll give it another shot. I had tried modifying the
> settings.gradle but the the build kicked out an error about ivy kiss
> (think that was the name) in I think the tests when they were built and I
> didn't spend the time to find the make command to skip them.
> If I have problems with the attempt I'll post the error I get.
>
> Apparently the plugin isn't listed In the maven repo either which did seem
> to be available as below you can see it searched there for it as well.
>
> Ronald Fenner
> Network Architect
> Game Circus LLC.
>
> rfenner at gamecircus.com
>
> On Feb 26, 2018, at 12:33 AM, Kókai Péter <peter.kokai at balabit.com> wrote:
>
> Hello,
>
> There is a open issue at github(
> https://github.com/balabit/syslog-ng/issues/1891), you can follow up
> there. Also it has a patch, that could solve this issue temporary.
>
> Based on your use case
> * if you do not need java and/or java based solution (elasticsearch,
> kafka, hdfs) you could either *--disable-java* overall
> * if you need java but not the elasticsearch you could remove the
> elastic-v2 from compilation via editting:
> *modules/java-modules/settings.gradle*
> * if you need those there is a patch in the issue, that uses atlassian
> instead of the elasticsearch (which seems down)
>
>
>
> --
> Kokan
>
> On Fri, Feb 23, 2018 at 2:08 AM Ronald Fenner <rfenner at gamecircus.com>
> wrote:
>
>> So I tried using the latest version 3.13.2 downloaded from GitHub
>> And again get the same error
>>
>> FAILURE: Build failed with an exception.
>>
>> * What went wrong:
>> Could not resolve all files for configuration
>> ':elastic-v2:compileClasspath'.
>> > Could not find org.elasticsearch.plugin:shield:2.4.0.
>> Searched in the following locations:
>>
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield-2.4.0.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield-2.4.0.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield.jar
>>
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>>
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>> Required by:
>> project :elastic-v2
>>
>> * Try:
>> Run with --stacktrace option to get the stack trace. Run with --info or
>> --debug option to get more log output.
>>
>>
>> So it seems we can't build any version of syslog-ng because of this
>> missing plugin.
>> Any thoughts?
>>
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>>
>> rfenner at gamecircus.com
>>
>> On Feb 22, 2018, at 5:14 PM, Ronald Fenner <rfenner at gamecircus.com>
>> wrote:
>>
>> I have script that builds syslog-ng and it was working fine but
>> apparently a plugin for elastic search seems to have gone missing and I'm
>> getting this error:
>>
>> 1519328565,,ui,message, amazon-ebs: Could not resolve all files for
>> configuration ':elastic-v2:compileClasspath'.
>> 1519328565,,ui,message, amazon-ebs: > Could not find
>> org.elasticsearch.plugin:shield:2.4.0.
>> 1519328565,,ui,message, amazon-ebs: Searched in the following
>> locations:
>> 1519328565,,ui,message, amazon-ebs:
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>> 1519328565,,ui,message, amazon-ebs:
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$
>> 1519328565,,ui,message, amazon-ebs:
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$
>> 1519328565,,ui,message, amazon-ebs:
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$
>> 1519328565,,ui,message, amazon-ebs: 9 actionable tasks: 9 executed
>> 1519328565,,ui,message, amazon-ebs:
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$
>> 1519328565,,ui,message, amazon-ebs: Required by:
>> 1519328565,,ui,message, amazon-ebs: project :elastic-v2
>> 1519328565,,ui,message, amazon-ebs:
>> 1519328565,,ui,message, amazon-ebs: * Try:
>> 1519328565,,ui,message, amazon-ebs: Run with --stacktrace option to
>> get the stack trace. Run with --info or --debug option t$
>> 1519328565,,ui,message, amazon-ebs:
>>
>> Is there a way to disable elasticsearch module specifically?
>>
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>>
>> rfenner at gamecircus.com
>>
>>
>>
>> ______________________________________________________________________________
>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
>> Documentation:
>> http://www.balabit.com/support/documentation/?product=syslog-ng
>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>>
>>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
>
>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
>
>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.balabit.hu/pipermail/syslog-ng/attachments/20180227/021b0b74/attachment-0001.html>
More information about the syslog-ng
mailing list