[CentOS] any Log archive tools suggestions?

Fri Dec 7 17:09:35 UTC 2012
Gelen James <hahaha_30k at yahoo.com>

Hi all,

 Has any one used any log archiving tools? Please suggest one that's your favorite. 

Presently I have a project to archive raw log files on hundreds of Centos boxes to a central server and stored there for two years. The basic requirements of the project are:

 1, The log files will be sent from hundreds of Centos clients with a client side agent or similar.
 2, better there is a client side configuration file which specify log files to archive
 3, a server side configuration file specified where to logs from host ( or host groups), and the directory structure to store log files
 4, better there is a way to remove duplication of log files, i.e. md5 checksum, time stamp, etc.

Open source or commercial are both fine. And there is no need to do the indexing or other further processing, just raw files is fine.

Thanks a lot.

~Rob