Hello, I have set up and did the initial sync for a new mirror in West Virginia. After looking at the mirrors list, I believe this is the first mirror to be located in WV
HTTP: http://centos.mirrors.wvstateu.edu Sync schedule: Every 12 hrs Bandwidth: 300Mbps Location: Institute, WV, USA Sponsor: West Virginia State University Sponsor URL: www.wvstateu.edu IP to authorize: 192.73.23.18 Email contact: kcarsey@wvstateu.edu
Also, I am having issues getting a good rsync script working with a lock file. Could someone provide a working example that I could modify to fit my configuration? Would be much appreciated!
I don't use a lockfile (and my mirror is in Germany - hence the eu reference), but I use the following:
0 3,15 * * * rsync -aqzH --delete eu-msync.centos.org::CentOS /var/www/centos/media
On Wed, Feb 25, 2015 at 9:29 AM, Kenny Carsey kcarsey@wvstateu.edu wrote:
Hello, I have set up and did the initial sync for a new mirror in West Virginia. After looking at the mirrors list, I believe this is the first mirror to be located in WV
HTTP: http://centos.mirrors.wvstateu.edu Sync schedule: Every 12 hrs Bandwidth: 300Mbps Location: Institute, WV, USA Sponsor: West Virginia State University Sponsor URL: www.wvstateu.edu IP to authorize: 192.73.23.18 Email contact: kcarsey@wvstateu.edu
Also, I am having issues getting a good rsync script working with a lock file. Could someone provide a working example that I could modify to fit my configuration? Would be much appreciated!
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Also - as a single point of reference (before IP filtering was done), I found out how long it would take to do a full mirror (~80GB), and it's about 8 hours at ~2.5 MB/s:
http://antipaucity.com/2014/05/22/soup-to-nuts-mirroring-of-centos/#.VO3i2FP...
On Wed, Feb 25, 2015 at 9:57 AM, Warren Myers volcimaster@gmail.com wrote:
I don't use a lockfile (and my mirror is in Germany - hence the eu reference), but I use the following:
0 3,15 * * * rsync -aqzH --delete eu-msync.centos.org::CentOS /var/www/centos/media
On Wed, Feb 25, 2015 at 9:29 AM, Kenny Carsey kcarsey@wvstateu.edu wrote:
Hello, I have set up and did the initial sync for a new mirror in West Virginia. After looking at the mirrors list, I believe this is the first mirror to be located in WV
HTTP: http://centos.mirrors.wvstateu.edu Sync schedule: Every 12 hrs Bandwidth: 300Mbps Location: Institute, WV, USA Sponsor: West Virginia State University Sponsor URL: www.wvstateu.edu IP to authorize: 192.73.23.18 Email contact: kcarsey@wvstateu.edu
Also, I am having issues getting a good rsync script working with a lock file. Could someone provide a working example that I could modify to fit my configuration? Would be much appreciated!
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
-- *Warren Myers* http://antipaucity.com http://twitter.com/warrenmyers http://www.linkedin.com/in/warrenmyers https://www.digitalocean.com/?refcode=d197a961987a TXT WMYERS to 50500 | http://contxts.com
This is what I have as my script for testing on a public mirror. It does not yet point to the master server.
#!/bin/bash echo "--BEGINNING REPOSITORY SYNC AT `date`--" if [ -f /var/lock/subsys/rsync_updates ]; then echo "Updates via rsync already running." echo "--ERROR: REPOSITORY SYNC ABORTED AT `date`--" exit 0 fi if [ -d /share/linux-os/centos/ ] ; then echo "--SYNCING CentOS REPOSITORY, PLEASE WAIT--" touch /var/lock/subsys/rsync_updates time rsync -avSHP --delete /" --exclude "HEADER.html"" --no-motd mirror.us.oneandone.net:centos /share/linux-os/centos/ /bin/rm -f /var/lock/subsys/rsync_updates echo "--CentOS REPOSITORY SYNC FINISHED AT `date`--" else echo "Target directory /share/linux-os/centos/ not present." echo "--ERROR: REPOSITORY SYNC ABORTED AT `date` --" fi
This is the output that it gives me.
[root@mirrors ~]# ./test.sh --BEGINNING REPOSITORY SYNC AT Wed Feb 25 10:19:16 EST 2015-- --SYNCING CentOS REPOSITORY, PLEASE WAIT-- Unexpected remote arg: mirror.us.oneandone.net:centos rsync error: syntax or usage error (code 1) at main.c(1201) [sender=3.0.6]
real 0m0.002s user 0m0.000s sys 0m0.002s --CentOS REPOSITORY SYNC FINISHED AT Wed Feb 25 10:19:16 EST 2015--
On Wed, Feb 25, 2015 at 9:58 AM, Warren Myers volcimaster@gmail.com wrote:
Also - as a single point of reference (before IP filtering was done), I found out how long it would take to do a full mirror (~80GB), and it's about 8 hours at ~2.5 MB/s:
http://antipaucity.com/2014/05/22/soup-to-nuts-mirroring-of-centos/#.VO3i2FP...
On Wed, Feb 25, 2015 at 9:57 AM, Warren Myers volcimaster@gmail.com wrote:
I don't use a lockfile (and my mirror is in Germany - hence the eu reference), but I use the following:
0 3,15 * * * rsync -aqzH --delete eu-msync.centos.org::CentOS /var/www/centos/media
On Wed, Feb 25, 2015 at 9:29 AM, Kenny Carsey kcarsey@wvstateu.edu wrote:
Hello, I have set up and did the initial sync for a new mirror in West Virginia. After looking at the mirrors list, I believe this is the first mirror to be located in WV
HTTP: http://centos.mirrors.wvstateu.edu Sync schedule: Every 12 hrs Bandwidth: 300Mbps Location: Institute, WV, USA Sponsor: West Virginia State University Sponsor URL: www.wvstateu.edu IP to authorize: 192.73.23.18 Email contact: kcarsey@wvstateu.edu
Also, I am having issues getting a good rsync script working with a lock file. Could someone provide a working example that I could modify to fit my configuration? Would be much appreciated!
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
-- *Warren Myers* http://antipaucity.com http://twitter.com/warrenmyers http://www.linkedin.com/in/warrenmyers https://www.digitalocean.com/?refcode=d197a961987a TXT WMYERS to 50500 | http://contxts.com
-- *Warren Myers* http://antipaucity.com http://twitter.com/warrenmyers http://www.linkedin.com/in/warrenmyers https://www.digitalocean.com/?refcode=d197a961987a TXT WMYERS to 50500 | http://contxts.com
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Hi Kenny,
We've been using this simple script for years and it works great. If I had to guess, the error you're receiving is because you're missing the second ':' between the host and module in the rsync statement.
#!/bin/bash # Updates local mirrors. # # 2011-03-24 Initial version.
LOCKFILE="/var/run/mirror-rsync.pid"
# Update CentOS if [ -f ${LOCKFILE} ] then exit 1 else echo ${$} > ${LOCKFILE} /usr/bin/rsync -aqzH --no-o --no-g --delay-updates --delete msync-dvd.centos.org::CentOS-incdvd /var/www/html/centos/ /bin/rm -f ${LOCKFILE} fi
--- Brian Downey The Linux Fix o: (877) 447-6291 x107 c: (734) 276-1549 f: (530) 221-4154
On 2015-02-25 07:19, Kenny Carsey wrote:
This is what I have as my script for testing on a public mirror. It does not yet point to the master server.
#!/bin/bash echo "--BEGINNING REPOSITORY SYNC AT `date`--" if [ -f /var/lock/subsys/rsync_updates ]; then echo "Updates via rsync already running." echo "--ERROR: REPOSITORY SYNC ABORTED AT `date`--" exit 0 fi if [ -d /share/linux-os/centos/ ] ; then echo "--SYNCING CentOS REPOSITORY, PLEASE WAIT--" touch /var/lock/subsys/rsync_updates time rsync -avSHP --delete /" --exclude "HEADER.html"" --no-motd mirror.us.oneandone.net:centos /share/linux-os/centos/ /bin/rm -f /var/lock/subsys/rsync_updates echo "--CentOS REPOSITORY SYNC FINISHED AT `date`--" else echo "Target directory /share/linux-os/centos/ not present." echo "--ERROR: REPOSITORY SYNC ABORTED AT `date` --" fi
This is the output that it gives me.
[root@mirrors ~]# ./test.sh --BEGINNING REPOSITORY SYNC AT Wed Feb 25 10:19:16 EST 2015-- --SYNCING CentOS REPOSITORY, PLEASE WAIT-- Unexpected remote arg: mirror.us.oneandone.net:centos rsync error: syntax or usage error (code 1) at main.c(1201) [sender=3.0.6]
real 0m0.002s user 0m0.000s sys 0m0.002s --CentOS REPOSITORY SYNC FINISHED AT Wed Feb 25 10:19:16 EST 2015--
On Wed, Feb 25, 2015 at 9:58 AM, Warren Myers volcimaster@gmail.com wrote:
Also - as a single point of reference (before IP filtering was done), I found out how long it would take to do a full mirror (~80GB), and it's about 8 hours at ~2.5 MB/s:
http://antipaucity.com/2014/05/22/soup-to-nuts-mirroring-of-centos/#.VO3i2FP...
[1]
On Wed, Feb 25, 2015 at 9:57 AM, Warren Myers volcimaster@gmail.com wrote:
I don't use a lockfile (and my mirror is in Germany - hence the eu reference), but I use the following:
0 3,15 * * * rsync -aqzH --delete eu-msync.centos.org::CentOS /var/www/centos/media
On Wed, Feb 25, 2015 at 9:29 AM, Kenny Carsey kcarsey@wvstateu.edu wrote:
Hello, I have set up and did the initial sync for a new mirror in West Virginia. After looking at the mirrors list, I believe this is the first mirror to be located in WV
HTTP: http://centos.mirrors.wvstateu.edu [2] Sync schedule: Every 12 hrs
Bandwidth: 300Mbps Location: Institute, WV, USA Sponsor: West Virginia State University Sponsor URL: www.wvstateu.edu [3] IP to authorize: 192.73.23.18 Email contact: kcarsey@wvstateu.edu
Also, I am having issues getting a good rsync script working with a lock file. Could someone provide a working example that I could modify to fit my configuration? Would be much appreciated!
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror [4]
--
WARREN MYERS http://antipaucity.com [5] http://twitter.com/warrenmyers [6] http://www.linkedin.com/in/warrenmyers [7] https://www.digitalocean.com/?refcode=d197a961987a [8]
TXT WMYERS to 50500 | http://contxts.com [9]
--
WARREN MYERS http://antipaucity.com [5] http://twitter.com/warrenmyers [6] http://www.linkedin.com/in/warrenmyers [7] https://www.digitalocean.com/?refcode=d197a961987a [8]
TXT WMYERS to 50500 | http://contxts.com [9] _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror [4]
--
Kenny Carsey Systems Administrator West Virginia State University
108 Hamblin Hall PO Box 1000 Institute, WV 25112 kcarsey@wvstateu.edu (304)204-4337
Links:
[1] http://antipaucity.com/2014/05/22/soup-to-nuts-mirroring-of-centos/#.VO3i2FP... [2] http://centos.mirrors.wvstateu.edu [3] http://www.wvstateu.edu [4] http://lists.centos.org/mailman/listinfo/centos-mirror [5] http://antipaucity.com [6] http://twitter.com/warrenmyers [7] http://www.linkedin.com/in/warrenmyers [8] https://www.digitalocean.com/?refcode=d197a961987a [9] http://contxts.com
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Brian,
This seems to work just fine.
Thank you!!
On Wed, Feb 25, 2015 at 10:27 AM, Brian Downey bdowney@thelinuxfix.com wrote:
Hi Kenny,
We've been using this simple script for years and it works great. If I had to guess, the error you're receiving is because you're missing the second ':' between the host and module in the rsync statement.
#!/bin/bash # Updates local mirrors. # # 2011-03-24 Initial version.
LOCKFILE="/var/run/mirror-rsync.pid"
# Update CentOS if [ -f ${LOCKFILE} ] then exit 1 else echo ${$} > ${LOCKFILE} /usr/bin/rsync -aqzH --no-o --no-g --delay-updates --delete msync-dvd.centos.org::CentOS-incdvd /var/www/html/centos/ /bin/rm -f ${LOCKFILE} fi
Brian Downey The Linux Fix o: (877) 447-6291 x107 c: (734) 276-1549 f: (530) 221-4154
On 2015-02-25 07:19, Kenny Carsey wrote:
This is what I have as my script for testing on a public mirror. It does not yet point to the master server.
#!/bin/bash echo "--BEGINNING REPOSITORY SYNC AT `date`--" if [ -f /var/lock/subsys/rsync_updates ]; then echo "Updates via rsync already running." echo "--ERROR: REPOSITORY SYNC ABORTED AT `date`--" exit 0 fi if [ -d /share/linux-os/centos/ ] ; then echo "--SYNCING CentOS REPOSITORY, PLEASE WAIT--" touch /var/lock/subsys/rsync_updates time rsync -avSHP --delete /" --exclude "HEADER.html"" --no-motd mirror.us.oneandone.net:centos /share/linux-os/centos/ /bin/rm -f /var/lock/subsys/rsync_updates echo "--CentOS REPOSITORY SYNC FINISHED AT `date`--" else echo "Target directory /share/linux-os/centos/ not present." echo "--ERROR: REPOSITORY SYNC ABORTED AT `date` --" fi
This is the output that it gives me.
[root@mirrors ~]# ./test.sh --BEGINNING REPOSITORY SYNC AT Wed Feb 25 10:19:16 EST 2015-- --SYNCING CentOS REPOSITORY, PLEASE WAIT-- Unexpected remote arg: mirror.us.oneandone.net:centos rsync error: syntax or usage error (code 1) at main.c(1201) [sender=3.0.6]
real 0m0.002s user 0m0.000s sys 0m0.002s --CentOS REPOSITORY SYNC FINISHED AT Wed Feb 25 10:19:16 EST 2015--
On Wed, Feb 25, 2015 at 9:58 AM, Warren Myers volcimaster@gmail.com wrote:
Also - as a single point of reference (before IP filtering was
done), I found out how long it would take to do a full mirror (~80GB), and it's about 8 hours at ~2.5 MB/s:
of-centos/#.VO3i2FPF83Q
[1]
On Wed, Feb 25, 2015 at 9:57 AM, Warren Myers volcimaster@gmail.com wrote:
I don't use a lockfile (and my mirror is in Germany - hence the eu reference), but I use the following:
0 3,15 * * * rsync -aqzH --delete eu-msync.centos.org::CentOS /var/www/centos/media
On Wed, Feb 25, 2015 at 9:29 AM, Kenny Carsey kcarsey@wvstateu.edu wrote:
Hello, I have set up and did the initial sync for a new mirror in West Virginia. After looking at the mirrors list, I believe this is the first mirror to be located in WV
HTTP: http://centos.mirrors.wvstateu.edu [2] Sync schedule: Every 12 hrs
Bandwidth: 300Mbps Location: Institute, WV, USA Sponsor: West Virginia State University Sponsor URL: www.wvstateu.edu [3] IP to authorize: 192.73.23.18 Email contact: kcarsey@wvstateu.edu
Also, I am having issues getting a good rsync script working with a lock file. Could someone provide a working example that I could modify to fit my configuration? Would be much appreciated!
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror [4]
--
WARREN MYERS http://antipaucity.com [5] http://twitter.com/warrenmyers [6] http://www.linkedin.com/in/warrenmyers [7] https://www.digitalocean.com/?refcode=d197a961987a [8]
TXT WMYERS to 50500 | http://contxts.com [9]
--
WARREN MYERS http://antipaucity.com [5] http://twitter.com/warrenmyers [6] http://www.linkedin.com/in/warrenmyers [7] https://www.digitalocean.com/?refcode=d197a961987a [8]
TXT WMYERS to 50500 | http://contxts.com [9] _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror [4]
--
Kenny Carsey Systems Administrator West Virginia State University
108 Hamblin Hall PO Box 1000 Institute, WV 25112 kcarsey@wvstateu.edu (304)204-4337
Links:
[1] http://antipaucity.com/2014/05/22/soup-to-nuts-mirroring- of-centos/#.VO3i2FPF83Q [2] http://centos.mirrors.wvstateu.edu [3] http://www.wvstateu.edu [4] http://lists.centos.org/mailman/listinfo/centos-mirror [5] http://antipaucity.com [6] http://twitter.com/warrenmyers [7] http://www.linkedin.com/in/warrenmyers [8] https://www.digitalocean.com/?refcode=d197a961987a [9] http://contxts.com
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
On Wed, Feb 25, 2015 at 07:27:57AM -0800, Brian Downey wrote:
We've been using this simple script for years and it works great. If I had to guess, the error you're receiving is because you're missing the second ':' between the host and module in the rsync statement.
I have developped a simple mirror() bash function. It - can be run from cron or by hand, - uses locks (via lockfile command), - can have several packages in one script (even if they need different mirroring frequency), - can dry run to show the actual rsync command, - remembers time of last mirroring and last successful mirroring, - (and more).
My CentOS mirroring script which calls the mirror() function is quite short: #!/bin/bash . /local/scripts/mirror/mirror-functions mirror rsync://eu-msync.centos.org/CentOS/ $p/linux-centos
There may be more mirror ... lines, preceeded with e.g. gap=12 (meaning: do not mirror if 12 hours have not yet passed since last _successful_ mirroring; default is 2 hours). The are also other options.
I have placed the scripts with examples on our server: http://ftp.icm.edu.pl/private/rzm/sunsite/
R.
-
Brian Downey -
Kenny Carsey -
Rafal Maszkowski -
Warren Myers