<html><body><div style="color:#000; background-color:#fff; font-family:verdana, helvetica, sans-serif;font-size:12pt"><div><span>Hi,</span></div><div><span><br></span></div><div>I am using Syslog-NG which stores the Syslog to a remote MySQL server for central logging. </div><div><br></div><div>Now, I am running into a situation a lot of records inside the MySQL database is "almost" exactly the same, just except the timestamp is different. For example, I get "file system is full" every minute for a host and this message repeats itself periodically.</div><div><br></div><div>In order to better manage the MySQL database, do you have any suggestions how I can reduce the number of overall records inside the DB, but add the occurrence frequency instead? </div><div><br></div><div>For example, syslog message "file system is full" occurs every minutes on the system. There will be 24 x 60 "file system is full" records on my MySQL DB after 1 day. If no one
fix it, I will get 10 x 24 x 60 "file system is full" records for 10 hosts having the same problem for 1 day.</div><div><br></div><div>Can those records being "processed" some how and when I search the MySQL DB, I only see ONE record list the following only? </div><div><br></div><div><span class="Apple-tab-span" style="white-space:pre"> </span>Total occurrence<span class="Apple-tab-span" style="white-space:pre"> </span>Message content</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>==========<span class="Apple-tab-span" style="white-space:pre"> </span>===========</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>14,400<span class="Apple-tab-span" style="white-space:pre"> </span>File system is full</div><div><br></div><div>If I can do that, it will definitely reduce a log of space of my DB and speed up the query.</div><div><br></div><div>It seems this is a database problem as well. Please let me
know your idea at anytime.</div><div><br></div><div> </div><div>Regards,<br>Marcos</div></div></body></html>