on 5-13-2009 4:21 AM James Bensley spake the following: > Hey Listee's > > I am trying to write a shell script to sort and compare my blacklist > for squidGuard with the nightly updates that come down in a tar ball. > It should be rather simple but I'm not to grate at this. The script is > to run nightly, it will download the latest blacklist tarball, un tar > it and then add any new entries to the existing black list. The > blacklists work by having a folder for each filtered category so the > folder "db" contains the subfolders "adult", "gambling", "drugs" etc > and each sub folder has two files, "domains" and "urls" (pretty self > explanitory). This is how far I have gotten (I haven't tested this > script yet as I haven't had a chance I have only gotten as far as > writting it, this is what I have so far: > > > #!/bin/bash > #This will be running from home directory > > wget http://www.blacklistsite.com/blacklist.tar > tar -cxf blacklist.tar > cd BL > > find ./ -type d -maxdepth 1 | while read FOLDER; do > SQUIDDB="usr/local/squidGuard/db/$FOLDER" > sort_db($SQUIDDB) > comm -3 $SQUIDDB/domains $FOLDER/domains > $SQUIDDB/domains.missing > comm -3 $SQUIDDB/urls $FOLDER/urls > $SQUIDDB/urls.missing > cat $SQUIDDB/domains.missing >> $SQUIDDB/domains > cat $SQUIDDB/urls.missing >> $SQUIDDB/urls > rm $SQUIDDB/domains.missing > rm $SQUIDDB/urls.missing > sort_db($SQUIDDB) > done > > sort_db(){ > sort -f $1/domains > $1/domains.sorted > sort -f $1/urls > $1/urls.sorted > rm $1/domains > rm $1/urls > mv $1/doamins.sorted $1/domains > mv $1/urls.sorted $1/urls > } > > Is it obvious I'm new to this? Hehe, I would also love to hear how > people would do this in a more efficient manner because obvisouly this > is pretty sloppy and as I said I haven't tested it yet so it might not > even run?! > > Thanks, James ;) > > -----BEGIN GEEK CODE BLOCK----- > Version: 3.1 > GIT/MU/U dpu s: a--> C++>$ U+> L++> B-> P+> E?> W+++>$ N K W++ O M++>$ V- > PS+++ PE++ Y+ PGP t 5 X+ R- tv+ b+> DI D+++ G+ e(+++++) h--(++) r++ z++ > ------END GEEK CODE BLOCK------ Are you looking to have a custom blacklist, or do you just want to know what changed? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 258 bytes Desc: OpenPGP digital signature URL: <http://lists.centos.org/pipermail/centos/attachments/20090513/d6e61bf9/attachment-0005.sig>