Hey Listee's
I am trying to write a shell script to sort and compare my blacklist for squidGuard with the nightly updates that come down in a tar ball. It should be rather simple but I'm not to grate at this. The script is to run nightly, it will download the latest blacklist tarball, un tar it and then add any new entries to the existing black list. The blacklists work by having a folder for each filtered category so the folder "db" contains the subfolders "adult", "gambling", "drugs" etc and each sub folder has two files, "domains" and "urls" (pretty self explanitory). This is how far I have gotten (I haven't tested this script yet as I haven't had a chance I have only gotten as far as writting it, this is what I have so far:
#!/bin/bash #This will be running from home directory
wget http://www.blacklistsite.com/blacklist.tar tar -cxf blacklist.tar cd BL
find ./ -type d -maxdepth 1 | while read FOLDER; do SQUIDDB="usr/local/squidGuard/db/$FOLDER" sort_db($SQUIDDB) comm -3 $SQUIDDB/domains $FOLDER/domains > $SQUIDDB/domains.missing comm -3 $SQUIDDB/urls $FOLDER/urls > $SQUIDDB/urls.missing cat $SQUIDDB/domains.missing >> $SQUIDDB/domains cat $SQUIDDB/urls.missing >> $SQUIDDB/urls rm $SQUIDDB/domains.missing rm $SQUIDDB/urls.missing sort_db($SQUIDDB) done
sort_db(){ sort -f $1/domains > $1/domains.sorted sort -f $1/urls > $1/urls.sorted rm $1/domains rm $1/urls mv $1/doamins.sorted $1/domains mv $1/urls.sorted $1/urls }
Is it obvious I'm new to this? Hehe, I would also love to hear how people would do this in a more efficient manner because obvisouly this is pretty sloppy and as I said I haven't tested it yet so it might not even run?!
Thanks, James ;)
-----BEGIN GEEK CODE BLOCK----- Version: 3.1 GIT/MU/U dpu s: a--> C++>$ U+> L++> B-> P+> E?> W+++>$ N K W++ O M++>$ V- PS+++ PE++ Y+ PGP t 5 X+ R- tv+ b+> DI D+++ G+ e(+++++) h--(++) r++ z++ ------END GEEK CODE BLOCK------