[syslog-ng] Encoding provlem when writing to postgres

[ml at bortal.de]

Hey Balazs,

i think ai am almost there yet ;)
(see below...)

Balazs Scheidler wrote:
>> Am 15.10.2008 um  Uhr haben Sie geschrieben:
>>     
>>> On Wed, 2008-10-15 at 09:53 +0200, ml at bortal.de wrote:
>>>       
>>>> Hello List,
>>>>
>>>> How can i fix this? I am running postgresql-8.1 with Debian 4.0.
>>>>         
>>> Probably the syslog client sends non-utf8 characters in its message.
>>> syslog-ng 2.0 and 2.1 do not really care about the message contents.
>>>
>>> 3.0 has support for various encodings and utf8 validation like this:
>>>
>>> This assumes that the input is latin1:
>>>
>>> source s_net { udp(encoding("iso-8859-1")); };
>>>
>>> And this one enforces valid utf8 messages
>>>
>>> source s_net { udp(flags(validate-utf8)); };
>>>
>>> I was planning to add another flag, but this is not yet implemented:
>>>
>>> source s_net { udp(flags(force-utf8)); };
>>>
>>> Which would enforce valid utf8 sequences by changing the input.
>>>
>>> As an alternative don't use utf8 as the character encoding of your
>>> database, use latin1, that'll permit any kind of data in the database.
>>>
>>>       
syslog-ng -F -v -f /etc/syslog-ng.conf -e
Configuration file has no version number, assuming syslog-ng 2.1 format. 
Please add @version: maj.min to the beginning of the file;
WARNING: global: the default value of chain_hostnames is changing to 
'no' in version 3.0, please update your configuration accordingly;
Your configuration file uses an obsoleted keyword, please update your 
configuration; keyword='sync', change='flush_lines'
Your configuration file uses an obsoleted keyword, please update your 
configuration; keyword='stats', change='stats_freq'
WARNING: input: sources do not remove new-line characters from messages 
by default in version 3.0, please add 'no-multi-line' flag to your 
configuration if you want to retain this functionality;
WARNING: file source: default value of follow_freq in file sources is 
changing in 3.0 to '1' for all files except /proc/kmsg;
syntax error in /etc/syslog-ng.conf at line 14.


Line 14 and 15 look like this:
-------------------------------------------------------------
source s_net { udp(encoding("iso-8859-1")); };
source s_net { udp(flags(validate-utf8)); };

I also tried to add: @version: 2.9 to the config file, but this did not 
work.


Any idea?

Thanks,
Mario