[syslog-ng]Tuning for high-throughput

Wyner, Peter syslog-ng@lists.balabit.hu
Thu, 6 May 2004 13:12:19 -0400


This is a multi-part message in MIME format.

------=_NextPart_000_0093_01C4336B.C1F96200
Content-Type: text/plain;
	charset="iso-8859-2"
Content-Transfer-Encoding: 7bit

On another topic.....

Anyone have any guidance on optimizing syslog-ng for high-volume
systems?  For example, what is a good range for sync(), and are there
any other options that may assist in lowering CPU?  We are not using any
variables in the directory of filenames other than $HOST.  Here's the
current conf:

options {
log_fifo_size(1024);
dns_cache(yes);
use_dns(yes);
chain_hostnames(no);
keep_hostname(no);
create_dirs(yes);};

source local { sun-streams("/dev/log"); internal(); };
source std_udp { udp( port(52001) ); };

destination all { file("/var/log/messages"); };
destination std { file("/syslog/std/current/$HOST" dir_perm(0755)
perm(0644)); };

log { source(local); destination(all); };
log { source(std_udp); destination(std); };

TIA,

Peter

------=_NextPart_000_0093_01C4336B.C1F96200
Content-Type: application/x-pkcs7-signature;
	name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
	filename="smime.p7s"

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIILjDCCA6Yw
ggMPoAMCAQICEHWNgosXAgaqes2nmr0jsCgwDQYJKoZIhvcNAQEFBQAwgcExCzAJBgNVBAYTAlVT
MRcwFQYDVQQKEw5WZXJpU2lnbiwgSW5jLjE8MDoGA1UECxMzQ2xhc3MgMiBQdWJsaWMgUHJpbWFy
eSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eSAtIEcyMTowOAYDVQQLEzEoYykgMTk5OCBWZXJpU2ln
biwgSW5jLiAtIEZvciBhdXRob3JpemVkIHVzZSBvbmx5MR8wHQYDVQQLExZWZXJpU2lnbiBUcnVz
dCBOZXR3b3JrMB4XDTk5MDIyNTAwMDAwMFoXDTA5MDIyNDIzNTk1OVowga0xFzAVBgNVBAoTDlZl
cmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3JrMUkwRwYDVQQLE0BV
c2UgaXMgc3ViamVjdCB0byB0ZXJtcyBhdCBodHRwczovL3d3dy52ZXJpc2lnbi5jb20vcnBhLWty
IChjKTk5MSYwJAYDVQQDEx1WZXJpU2lnbiBDbGFzcyAyIFBlcnNvbm5lbCBDQTCBnzANBgkqhkiG
9w0BAQEFAAOBjQAwgYkCgYEApwRsD6Jyt0oGLvjXKSw0nYK8SJFKx6z56fy5WXixVcBTWLHPbxY7
wUnVy/RuzOHMy7XHLk6IqjTpttBbfD4VVzThGLz/3fWvZ1kgCuU96oiKQNKaiRMpqbbV26d+4ec3
JJP9lHRNeuQybUzoXBaXr92S2WaKFGbk6loDqD1f+wsCAwEAAaOBsDCBrTARBglghkgBhvhCAQEE
BAMCAQYwDwYDVR0TBAgwBgEB/wIBATALBgNVHQ8EBAMCAQYwRAYDVR0gBD0wOzA5BgtghkgBhvhF
AQcXAjAqMCgGCCsGAQUFBwIBFhxodHRwczovL3d3dy52ZXJpc2lnbi5jb20vcnBhMDQGA1UdHwQt
MCswKaAnoCWGI2h0dHA6Ly9jcmwudmVyaXNpZ24uY29tL3BjYTItZzIuY3JsMA0GCSqGSIb3DQEB
BQUAA4GBAFJetpXbb3ymfgX2VIU72RqKRVlffMJl7vlA3lRux5ASgCQ8QKNj7IUf9R4bico9juNL
Lt+cG+6O51S5VpP+29HERPjLnECdkqzFzgTxEUbsiLyYyIwhfTeczGu9NKWTjL2cOR3qp5wazfVH
bSxzE2NqIS5afYd9vEy+8scDwoy2MIIDwDCCAymgAwIBAgIQSsgAA2Nh1BUDFvGGNpu3zTANBgkq
hkiG9w0BAQUFADCBrTEXMBUGA1UEChMOVmVyaVNpZ24sIEluYy4xHzAdBgNVBAsTFlZlcmlTaWdu
IFRydXN0IE5ldHdvcmsxSTBHBgNVBAsTQFVzZSBpcyBzdWJqZWN0IHRvIHRlcm1zIGF0IGh0dHBz
Oi8vd3d3LnZlcmlzaWduLmNvbS9ycGEta3IgKGMpOTkxJjAkBgNVBAMTHVZlcmlTaWduIENsYXNz
IDIgUGVyc29ubmVsIENBMB4XDTk5MDIyNTAwMDAwMFoXDTA5MDIyMzIzNTk1OVowgawxFzAVBgNV
BAoTDlZlcmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3JrMUkwRwYD
VQQLE0BVc2UgaXMgc3ViamVjdCB0byB0ZXJtcyBhdCBodHRwczovL3d3dy52ZXJpc2lnbi5jb20v
cnBhLWtyIChjKTk5MSUwIwYDVQQDExxWZXJpU2lnbiBDbGFzcyAyIEVtcGxveWVlIENBMIGfMA0G
CSqGSIb3DQEBAQUAA4GNADCBiQKBgQDAitGHYaLqMANVawg28Jf6GlQ1JB/ofZ3Iw3PT2Eb1kS3Z
OO2U17Amcyrel1BN/yIcvXAAmAxYKrGkco+lufctfGDjtd/pfU4hIWHV/DtUyaQJnLsi+aK6cGFP
hkai/QVk7Ao/plh2V7sWc0R88KUNl8BspvFjCCWxBBeVoI3+fwIDAQABo4HfMIHcMCkGA1UdEQQi
MCCkHjAcMRowGAYDVQQDExFQcml2YXRlTGFiZWwxLTExODARBglghkgBhvhCAQEEBAMCAQYwDwYD
VR0TBAgwBgEB/wIBADALBgNVHQ8EBAMCAQYwRAYDVR0gBD0wOzA5BgtghkgBhvhFAQcXAjAqMCgG
CCsGAQUFBwIBFhxodHRwczovL3d3dy52ZXJpc2lnbi5jb20vcnBhMDgGA1UdHwQxMC8wLaAroCmG
J2h0dHA6Ly9jcmwudmVyaXNpZ24uY29tL1ZTQ2xhc3MySW50LmNybDANBgkqhkiG9w0BAQUFAAOB
gQA2GP0zYNYX0wS12FRfUhrlkggo9KJA2sNbjBqGl++uohX+bMTOL8gByjO+8nlYM5eXkkVwWk4o
Hd33wYhOG4dXAj2TJdl+TnI1iUkXs7l3L20O+aSIJcHOdnNlaQWTd+f9k5YYOE1YbHqd6NKb6NDb
if1JwnUEA5el1JaB2CNB8DCCBBowggODoAMCAQICEFtZcVU995N5gM3Ds47cm9MwDQYJKoZIhvcN
AQEEBQAwgawxFzAVBgNVBAoTDlZlcmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJpU2lnbiBUcnVz
dCBOZXR3b3JrMUkwRwYDVQQLE0BVc2UgaXMgc3ViamVjdCB0byB0ZXJtcyBhdCBodHRwczovL3d3
dy52ZXJpc2lnbi5jb20vcnBhLWtyIChjKTk5MSUwIwYDVQQDExxWZXJpU2lnbiBDbGFzcyAyIEVt
cGxveWVlIENBMB4XDTA0MDQxMzAwMDAwMFoXDTA1MDQxMzIzNTk1OVowbjERMA8GA1UEChMIVkVS
SVNJR04xEDAOBgNVBAsTB1ZTLVBSTzExEzARBgNVBAMTClJlY2lwaWVudHMxMjAwBgNVBAMTKVBl
dGVyLld5bmVyIChXeW5lciBQZXRlciwgVmVyaVNpZ24sIEluYy4pMIGfMA0GCSqGSIb3DQEBAQUA
A4GNADCBiQKBgQDFJm21ZLXqQFYs3ifrl7pW3dZ9WgtWxflXFtVbXVaBrBE86eIo3or9tySTomO/
XL8bSvifck42mHZuhj22l2R534m+gDULaJJpbQJbXpw687d9OlYMIQiz+GysmwT1PyzLTsrxCbjo
FG3d5uMVZRifzNi8W5GBrH0IPcvwijHNJQIDAQABo4IBeDCCAXQwCQYDVR0TBAIwADBZBgNVHR8E
UjBQME6gTKBKhkhodHRwOi8vb25zaXRlY3JsLnZlcmlzaWduLmNvbS9WZXJpU2lnbkluY0V4Y2hh
bmdlRW1wbG95ZWVzL0xhdGVzdENSTC5jcmwwCwYDVR0PBAQDAgWgMB4GA1UdEQQXMBWBE3B3eW5l
ckB2ZXJpc2lnbi5jb20wgawGA1UdIASBpDCBoTCBngYLYIZIAYb4RQEHAQEwgY4wKAYIKwYBBQUH
AgEWHGh0dHBzOi8vd3d3LnZlcmlzaWduLmNvbS9DUFMwYgYIKwYBBQUHAgIwVjAVFg5WZXJpU2ln
biwgSW5jLjADAgEBGj1WZXJpU2lnbidzIENQUyBpbmNvcnAuIGJ5IHJlZmVyZW5jZSBsaWFiLiBs
dGQuIChjKTk3IFZlcmlTaWduMBEGCWCGSAGG+EIBAQQEAwIHgDAdBgNVHSUEFjAUBggrBgEFBQcD
BAYIKwYBBQUHAwIwDQYJKoZIhvcNAQEEBQADgYEAVSwmdi7y1LpNotPgBT8wH+RQWOCn2aQC0GAb
mssVck0keqmawxw7nqZBW8hERRf/enD+T0kcb/ygzxo0vDAlblPzl16YusVrLDGKsMYUpJCeR8TE
c7aXkFjYWPv0S5ukEiD/c03hXZk4C65OKcTMJxYrfrE94M3xLISxgVrk2WkxggL4MIIC9AIBATCB
wTCBrDEXMBUGA1UEChMOVmVyaVNpZ24sIEluYy4xHzAdBgNVBAsTFlZlcmlTaWduIFRydXN0IE5l
dHdvcmsxSTBHBgNVBAsTQFVzZSBpcyBzdWJqZWN0IHRvIHRlcm1zIGF0IGh0dHBzOi8vd3d3LnZl
cmlzaWduLmNvbS9ycGEta3IgKGMpOTkxJTAjBgNVBAMTHFZlcmlTaWduIENsYXNzIDIgRW1wbG95
ZWUgQ0ECEFtZcVU995N5gM3Ds47cm9MwCQYFKw4DAhoFAKCCAYwwGAYJKoZIhvcNAQkDMQsGCSqG
SIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMDQwNTA2MTcxMjE4WjAjBgkqhkiG9w0BCQQxFgQU1PrE
MKCldl1+7tYUEBPJR83O1mIwWAYJKoZIhvcNAQkPMUswSTAKBggqhkiG9w0DBzAOBggqhkiG9w0D
AgICAIAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgwBwYFKw4DAhowCgYIKoZIhvcNAgUwgdIGCSsG
AQQBgjcQBDGBxDCBwTCBrDEXMBUGA1UEChMOVmVyaVNpZ24sIEluYy4xHzAdBgNVBAsTFlZlcmlT
aWduIFRydXN0IE5ldHdvcmsxSTBHBgNVBAsTQFVzZSBpcyBzdWJqZWN0IHRvIHRlcm1zIGF0IGh0
dHBzOi8vd3d3LnZlcmlzaWduLmNvbS9ycGEta3IgKGMpOTkxJTAjBgNVBAMTHFZlcmlTaWduIENs
YXNzIDIgRW1wbG95ZWUgQ0ECEFtZcVU995N5gM3Ds47cm9MwDQYJKoZIhvcNAQEBBQAEgYALUIgn
VrJwNutk52y98ghyPD7Nfi8SQIOBFksQjXjG1PA6QHtN6dBIGjtHy9gG6ZEVibLKQ+edHnAil0Dy
LRqYYV0f/k11n135hwttrEIzkH6HrNtVmixKEUR4QioG1Yh2DCip9KjhcIggtCCSrz/k3mWidrnc
UcxpzUzMKa7PTwAAAAAAAA==

------=_NextPart_000_0093_01C4336B.C1F96200--