[syslog-ng] Problem building syslog-ng 3.11.1 and elastic search
Nagy, Gábor
gabor.nagy at balabit.com
Tue Feb 27 14:38:10 UTC 2018
Hello Ronald!
I've gone through the same steps as you (downloaded 3.13.2 tarball,
edited settings.gradle and removed elastic-v2) and on my computer
there were no build problems.
You mentioned you only have problems when you put the edited tarball
into an S3 bucket.
Checking on your build logs the man page generation step failed during
ivykis build.
I have not found what could have caused that.
Manpage generation is disabled by default. If I enable it with
"--enable-manpages" configure option and then call make the manpages
installed properly.
E.g.:
install/share/man/man3/IV_FD_PUMP_INIT.3
install/share/man/man3/iv_fd_pump_init.3
install/share/man/man3/iv_fd_pump.3
Today we have released syslog-ng 3.14, with the Shield support
removed, therefore you won't have build problems with java (and don't
have to edit settings. gradle).
Can you check it with this tarball?
https://github.com/balabit/syslog-ng/releases/tag/syslog-ng-3.14.1
Regards,
Gabor
On Tue, Feb 27, 2018 at 1:53 AM, Ronald Fenner <rfenner at gamecircus.com> wrote:
> Yes I'm still getting the error.
> -ebs: Making all in contrib
> 1519691695,,ui,message, amazon-ebs: Making all in iv_getaddrinfo
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall
> -pthread -Wno-error -MT test.o -M$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/test.Tpo .deps/test.Po
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -D_GNU_SOURCE -I../../src/include -I../../src/include -g -O2 -Wall
> -pthread -Wno-error -MT iv_getadd$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/iv_getaddrinfo.Tpo
> .deps/iv_getaddrinfo.Po
> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC
> --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o test test.o
> iv_getaddrinfo.o ../../src/libivyk$
> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall
> -pthread -Wno-error -o test test.o iv_getaddrinfo.o
> ../../src/.libs/libivykis.a -lpthread_nonshared -p$
> 1519691695,,ui,message, amazon-ebs: Making all in kojines
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error
> -MT main.o -MD -MP -MF .dep$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/main.Tpo .deps/main.Po
> 1519691695,,ui,message, amazon-ebs: gcc -DHAVE_CONFIG_H -I. -I../..
> -I../../src/include -I../../src/include -g -O2 -Wall -pthread -Wno-error
> -MT kojines.o -MD -MP -MF .$
> 1519691695,,ui,message, amazon-ebs: mv -f .deps/kojines.Tpo
> .deps/kojines.Po
> 1519691695,,ui,message, amazon-ebs: /bin/sh ../../libtool --tag=CC
> --mode=link gcc -g -O2 -Wall -pthread -Wno-error -o kojines main.o
> kojines.o ../../src/libivykis.l$
> 1519691695,,ui,message, amazon-ebs: libtool: link: gcc -g -O2 -Wall
> -pthread -Wno-error -o kojines main.o kojines.o ../../src/.libs/libivykis.a
> -lpthread_nonshared -pthre$
> 1519691695,,ui,message, amazon-ebs: make[6]: Nothing to be done for
> `all-am'.
> 1519691695,,ui,message, amazon-ebs: Making all in misc
> 1519691695,,ui,message, amazon-ebs: make[5]: Nothing to be done for
> `all'.
> 1519691695,,ui,message, amazon-ebs: Making all in man3
> 1519691695,,ui,message, amazon-ebs: make[5]: *** No rule to make target
> `IV_FD_PUMP_INIT.3'%!(PACKER_COMMA) needed by `all-am'. Stop.
> 1519691695,,ui,message, amazon-ebs: make[4]: *** [all-recursive] Error 1
> 1519691695,,ui,message, amazon-ebs: make[3]: *** [all] Error 2
> 1519691695,,ui,message, amazon-ebs: make[2]: ***
> [lib/ivykis/src/libivykis.la] Error 2
> 1519691695,,ui,message, amazon-ebs: make[1]: *** [all-recursive] Error 1
> 1519691695,,ui,message, amazon-ebs: make: *** [all] Error 2
> 1519691695,,ui,message, amazon-ebs: Failed to make syslog-ng
>
> The odd thing when I was testing the edit where I download the archive then
> unzipped it an edited the file it seemed to work ok.
> But when I downloaded made the change re archived it and put in an S3 bucket
> I get this error.
>
>
> Ronald Fenner
> Network Architect
> Game Circus LLC.
>
> rfenner at gamecircus.com
>
> On Feb 26, 2018, at 1:25 PM, Laszlo Budai <laszlo.budai at outlook.com> wrote:
>
> Hi,
>
> today we removed the Shield support from syslog-ng OSE:
> https://github.com/balabit/syslog-ng/pull/1895.
>
> You mentioned an ivykis(Lithuanian word, meaning: event) error. Did it work
> finally?
>
> regards,
> Laszlo Budai
>
> Get Outlook for iOS
> ________________________________
> From: syslog-ng <syslog-ng-bounces at lists.balabit.hu> on behalf of Ronald
> Fenner <rfenner at gamecircus.com>
> Sent: Monday, February 26, 2018 7:48:45 AM
> To: Syslog-ng users' and developers' mailing list
> Subject: Re: [syslog-ng] Problem building syslog-ng 3.11.1 and elastic
> search
>
> Thanks I'll give it another shot. I had tried modifying the settings.gradle
> but the the build kicked out an error about ivy kiss (think that was the
> name) in I think the tests when they were built and I didn't spend the time
> to find the make command to skip them.
> If I have problems with the attempt I'll post the error I get.
>
> Apparently the plugin isn't listed In the maven repo either which did seem
> to be available as below you can see it searched there for it as well.
>
> Ronald Fenner
> Network Architect
> Game Circus LLC.
>
> rfenner at gamecircus.com
>
> On Feb 26, 2018, at 12:33 AM, Kókai Péter <peter.kokai at balabit.com> wrote:
>
> Hello,
>
> There is a open issue at
> github(https://github.com/balabit/syslog-ng/issues/1891), you can follow up
> there. Also it has a patch, that could solve this issue temporary.
>
> Based on your use case
> * if you do not need java and/or java based solution (elasticsearch, kafka,
> hdfs) you could either *--disable-java* overall
> * if you need java but not the elasticsearch you could remove the elastic-v2
> from compilation via editting: *modules/java-modules/settings.gradle*
> * if you need those there is a patch in the issue, that uses atlassian
> instead of the elasticsearch (which seems down)
>
>
>
> --
> Kokan
>
> On Fri, Feb 23, 2018 at 2:08 AM Ronald Fenner <rfenner at gamecircus.com>
> wrote:
>>
>> So I tried using the latest version 3.13.2 downloaded from GitHub
>> And again get the same error
>>
>> FAILURE: Build failed with an exception.
>>
>> * What went wrong:
>> Could not resolve all files for configuration
>> ':elastic-v2:compileClasspath'.
>> > Could not find org.elasticsearch.plugin:shield:2.4.0.
>> Searched in the following locations:
>>
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield-2.4.0.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java/syslog-ng-core/libs/shield.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield-2.4.0.jar
>>
>> file:/root/eventlog-0.2.12/syslog-ng-3.13.2/modules/java-modules/common/gradle/libs/shield.jar
>>
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>>
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.pom
>>
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.jar
>> Required by:
>> project :elastic-v2
>>
>> * Try:
>> Run with --stacktrace option to get the stack trace. Run with --info or
>> --debug option to get more log output.
>>
>>
>> So it seems we can't build any version of syslog-ng because of this
>> missing plugin.
>> Any thoughts?
>>
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>>
>> rfenner at gamecircus.com
>>
>> On Feb 22, 2018, at 5:14 PM, Ronald Fenner <rfenner at gamecircus.com> wrote:
>>
>> I have script that builds syslog-ng and it was working fine but apparently
>> a plugin for elastic search seems to have gone missing and I'm getting this
>> error:
>>
>> 1519328565,,ui,message, amazon-ebs: Could not resolve all files for
>> configuration ':elastic-v2:compileClasspath'.
>> 1519328565,,ui,message, amazon-ebs: > Could not find
>> org.elasticsearch.plugin:shield:2.4.0.
>> 1519328565,,ui,message, amazon-ebs: Searched in the following
>> locations:
>> 1519328565,,ui,message, amazon-ebs:
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/usr/lib/syslog-ng-java-compile-deps-mvn-repo/org/elasticsearch/plugin/shield$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java/syslog-ng-core/l$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>> 1519328565,,ui,message, amazon-ebs:
>> file:/home/ec2-user/eventlog-0.2.12/syslog-ng-3.11.1/modules/java-modules/common/g$
>> 1519328565,,ui,message, amazon-ebs:
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$
>> 1519328565,,ui,message, amazon-ebs:
>> https://repo1.maven.org/maven2/org/elasticsearch/plugin/shield/2.4.0/shield-2.4.0.$
>> 1519328565,,ui,message, amazon-ebs:
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$
>> 1519328565,,ui,message, amazon-ebs: 9 actionable tasks: 9 executed
>> 1519328565,,ui,message, amazon-ebs:
>> http://maven.elasticsearch.org/releases/org/elasticsearch/plugin/shield/2.4.0/shie$
>> 1519328565,,ui,message, amazon-ebs: Required by:
>> 1519328565,,ui,message, amazon-ebs: project :elastic-v2
>> 1519328565,,ui,message, amazon-ebs:
>> 1519328565,,ui,message, amazon-ebs: * Try:
>> 1519328565,,ui,message, amazon-ebs: Run with --stacktrace option to get
>> the stack trace. Run with --info or --debug option t$
>> 1519328565,,ui,message, amazon-ebs:
>>
>> Is there a way to disable elasticsearch module specifically?
>>
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>>
>> rfenner at gamecircus.com
>>
>>
>>
>> ______________________________________________________________________________
>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
>> Documentation:
>> http://www.balabit.com/support/documentation/?product=syslog-ng
>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
>
>
> ______________________________________________________________________________
> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
> Documentation:
> http://www.balabit.com/support/documentation/?product=syslog-ng
> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>
>
More information about the syslog-ng
mailing list