[CentOS] Optimizing grep, sort, uniq for speed
Gordon Messmer
yinyang at eburg.com
Thu Jun 28 19:22:18 UTC 2012
On 06/28/2012 12:15 PM, Gordon Messmer wrote:
> You have two major performance problems in this script. First, UTF-8
> processing is slow. Second, wildcards are EXTREMELY SLOW!
Naturally, you should test both on your own data. I'm amused to admit
that I tested my own advice against my mail log and got more improvement
from the LANG setting than the string prefix. The combination of the
two reduced the amount of time to run your your pattern against my mail
logs by about 90%.
More information about the CentOS
mailing list