Hi,
We would like to host a mirror for CentOS. Earlier, we used to have our own CentOS repository for all the 5, 5.2, 5.3, 5.4 versions, so that we could do a local yum. We used to run the following daily at 2200hrs UTC:
rsync -v -aH --progress --bwlimit=3072 rsync://mirrors.kernel.org/centos/data/web/centos
Now, after going through the Public Mirror How-To, we ran the following:
rsync -v -aH --progress --delete --bwlimit=3072 msync.centos.org::CentOS /data/web/centos
And, we found that it deleted all files we had for 5, 5.2 and 5.3. So, we did another rsync with "mirrors.kernel.org", and then did another rsync with "msync.centos.org" but this time without the "--delete" flag. So, now we also have all the ISOs available at "mirrors.kernel.org".
Is it ok to run the rsync without the "--delete" flag?
Our mirrors can be reached at: http://mirrors.ispros.com.bd/centos We are located in Dhaka, Bangladesh. Cron job runs twice a day at 0900 and 2100hrs UTC. Our uplink for this mirror will be dynamically allocated between 5 - 50 Mbps, depending on our network load. Is that acceptable?
Is it also possible to have our name as one of the possible resolutions against yum updates?
We apologize beforehand if some of the questions above sound a bit too naive. This is the first time we are hosting officially for CentOS.
Regards NYAMUL HASSAN ============================ IS Pros Limited 41/1 Kazi Nazrul Islam Avenue Kawran Bazaar, Dhaka 1209 Bangladesh Tel: +880 17 1320 1878
On Tue, 16 Mar 2010, Nyamul Hassan wrote:
Is it ok to run the rsync without the "--delete" flag?
Not a very good idea since you will keep accumulating outdated content - instead of keeping only the latest version of packages, you will end up keeping every version that is ever released (sort of).
Agreed. But, will "yum install" work if we do not have content in those folders?
What about the ISOs? Running the "--delete" deletes the ISOs as well. Is there way to keep the ISOs inspite of using this flag?
Will omitting the "--delete" flag make our server unsuitable to become a public mirror?
Regards HASSAN
On Tue, Mar 16, 2010 at 3:51 PM, Prof. P. Sriram sriram@ae.iitm.ac.inwrote:
On Tue, 16 Mar 2010, Nyamul Hassan wrote:
Is it ok to run the rsync without the "--delete" flag?
Not a very good idea since you will keep accumulating outdated content - instead of keeping only the latest version of packages, you will end up keeping every version that is ever released (sort of).
-- sriram _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Is it only deleting your DVD ISOs or all your ISOs? I suspect only the DVD ISOs since you should be getting the CD ISOs with your normal sync. You could look at using --exclude for the DVD files, but if you aren't also actively syncing your DVD ISOs you could also end up with drift. If you are just manually grabbing DVD ISOs you may just want to move them out of the CentOS tree for your own use.
Not using the --delete could result in you accidentally providing incorrect packages to anyone using your mirror and could result is disk space issues. I think anyone using your mirror would appreciate you keeping your mirror exactly the same as your upstream.
Matt Ruzicka Sr. Systems Engineer mruzicka@cisp.commailto:mruzicka@cisp.com www.cisp.comhttp://www.cisp.com/ www.yocolo.comhttp://www.yocolo.com/
419.724.5345 : tel 419.867.6913 : fax
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Nyamul Hassan Sent: Tuesday, March 16, 2010 5:57 AM To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] New Mirror Request
Agreed. But, will "yum install" work if we do not have content in those folders?
What about the ISOs? Running the "--delete" deletes the ISOs as well. Is there way to keep the ISOs inspite of using this flag?
Will omitting the "--delete" flag make our server unsuitable to become a public mirror?
Regards HASSAN
On Tue, Mar 16, 2010 at 3:51 PM, Prof. P. Sriram <sriram@ae.iitm.ac.inmailto:sriram@ae.iitm.ac.in> wrote: On Tue, 16 Mar 2010, Nyamul Hassan wrote:
Is it ok to run the rsync without the "--delete" flag?
Not a very good idea since you will keep accumulating outdated content - instead of keeping only the latest version of packages, you will end up keeping every version that is ever released (sort of).
-- sriram _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.orgmailto:CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Thank you for your input Matt.
We are running rsync for the DVDs as well twice a day. And, we are also running rsync with the master server twice daily as well.
Our upload bandwidth is a bit more of a dynamic allocation rather than dedicated, depending upon our network usage. But, it should not be below 5 Mbps at any time, and if network usage permits, we can go as high as 100 Mbps. I hope that is not a problem.
Regards HASSAN
On Tue, Mar 16, 2010 at 8:39 PM, Matt Ruzicka mruzicka@cisp.com wrote:
Is it only deleting your DVD ISOs or all your ISOs? I suspect only the DVD ISOs since you should be getting the CD ISOs with your normal sync. You could look at using --exclude for the DVD files, but if you aren’t also actively syncing your DVD ISOs you could also end up with drift. If you are just manually grabbing DVD ISOs you may just want to move them out of the CentOS tree for your own use.
Not using the --delete could result in you accidentally providing incorrect packages to anyone using your mirror and could result is disk space issues. I think anyone using your mirror would appreciate you keeping your mirror exactly the same as your upstream.
*Matt Ruzicka*
Sr. Systems Engineer
mruzicka@cisp.com
www.cisp.com
www.yocolo.com
419.724.5345 : tel
419.867.6913 : fax
*From:* centos-mirror-bounces@centos.org [mailto: centos-mirror-bounces@centos.org] *On Behalf Of *Nyamul Hassan *Sent:* Tuesday, March 16, 2010 5:57 AM *To:* Mailing list for CentOS mirrors. *Subject:* Re: [CentOS-mirror] New Mirror Request
Agreed. But, will "yum install" work if we do not have content in those folders?
What about the ISOs? Running the "--delete" deletes the ISOs as well. Is there way to keep the ISOs inspite of using this flag?
Will omitting the "--delete" flag make our server unsuitable to become a public mirror?
Regards
HASSAN
On Tue, Mar 16, 2010 at 3:51 PM, Prof. P. Sriram sriram@ae.iitm.ac.in wrote:
On Tue, 16 Mar 2010, Nyamul Hassan wrote:
Is it ok to run the rsync without the "--delete" flag?
Not a very good idea since you will keep accumulating outdated content - instead of keeping only the latest version of packages, you will end up keeping every version that is ever released (sort of).
-- sriram _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Am 16.03.10 10:56, schrieb Nyamul Hassan:
Agreed. But, will "yum install" work if we do not have content in those folders?
Yes. There is only *ONE* version 5 at all times. At the moment it is 5.4.
What about the ISOs? Running the "--delete" deletes the ISOs as well. Is there way to keep the ISOs inspite of using this flag?
You do not need anything below 5.x (where x is the most current release).
Will omitting the "--delete" flag make our server unsuitable to become a public mirror?
No, but you don't need all that cruft. 5.1, 5.2, 5.3 aren't seeing any updates anymore anyway.
Regards,
Ralph
Ok. Can we be published as a public mirror?
Regards HASSAN
----- Original Message ----- From: "Ralph Angenendt" ralph.angenendt@gmail.com To: centos-mirror@centos.org Sent: Wednesday, March 17, 2010 04:49 Subject: Re: [CentOS-mirror] New Mirror Request
Am 16.03.10 10:56, schrieb Nyamul Hassan:
Agreed. But, will "yum install" work if we do not have content in those folders?
Yes. There is only *ONE* version 5 at all times. At the moment it is 5.4.
What about the ISOs? Running the "--delete" deletes the ISOs as well. Is there way to keep the ISOs inspite of using this flag?
You do not need anything below 5.x (where x is the most current release).
Will omitting the "--delete" flag make our server unsuitable to become a public mirror?
No, but you don't need all that cruft. 5.1, 5.2, 5.3 aren't seeing any updates anymore anyway.
Regards,
Ralph _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Am 16.03.10 08:08, schrieb Nyamul Hassan:
Our mirrors can be reached at: http://mirrors.ispros.com.bd/centos We are located in Dhaka, Bangladesh. Cron job runs twice a day at 0900 and 2100hrs UTC. Our uplink for this mirror will be dynamically allocated between 5 - 50 Mbps, depending on our network load. Is that acceptable?
Sure, especially in that area. Would you be the contact for that mirror? Who is the sponsor of that mirror (What should the name on the mirror page be)? URL to the sponsor?
Is it also possible to have our name as one of the possible resolutions against yum updates?
I don't understand that question. Will it be used in mirrorlists? Yes - but creation of those mirrorlists is done automatically agains the GeoIP database, and I am not sure how accurate that is in your area.
Or was your question a different one?
Ralph
Thanks for your answers. The sponsor details are:
Name: IS Pros Ltd. URL: www.ispros.com.bd Contact: Nyamul Hassan hassan@ispros.com.bd
If you need any more information, please let us know.
Regards HASSAN
----- Original Message ----- From: "Ralph Angenendt" ralph.angenendt@gmail.com To: centos-mirror@centos.org Sent: Thursday, March 18, 2010 04:26 Subject: Re: [CentOS-mirror] New Mirror Request
Am 16.03.10 08:08, schrieb Nyamul Hassan:
Our mirrors can be reached at: http://mirrors.ispros.com.bd/centos We are located in Dhaka, Bangladesh. Cron job runs twice a day at 0900 and 2100hrs UTC. Our uplink for this mirror will be dynamically allocated between 5 - 50 Mbps, depending on our network load. Is that acceptable?
Sure, especially in that area. Would you be the contact for that mirror? Who is the sponsor of that mirror (What should the name on the mirror page be)? URL to the sponsor?
Is it also possible to have our name as one of the possible resolutions against yum updates?
I don't understand that question. Will it be used in mirrorlists? Yes - but creation of those mirrorlists is done automatically agains the GeoIP database, and I am not sure how accurate that is in your area.
Or was your question a different one?
Ralph _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
On Thu, Mar 18, 2010 at 3:03 AM, Nyamul Hassan mnhassan@usa.net wrote:
Thanks for your answers. The sponsor details are:
Name: IS Pros Ltd. URL: www.ispros.com.bd Contact: Nyamul Hassan hassan@ispros.com.bd
If you need any more information, please let us know.
Do I see it correctly that you mirror all archs and all releases? I will add the mirror this evening (which is around 8 to 9 hours away from now).
Cheers and thanks,
Ralph
Yes, you are correct to notice that we are offering all archs and all releases offered by the Master Msync.
Thanks for confirming when our mirror will be published.
Regards HASSAN
On Thu, Mar 18, 2010 at 4:54 PM, Ralph Angenendt ralph.angenendt@gmail.comwrote:
On Thu, Mar 18, 2010 at 3:03 AM, Nyamul Hassan mnhassan@usa.net wrote:
Thanks for your answers. The sponsor details are:
Name: IS Pros Ltd. URL: www.ispros.com.bd Contact: Nyamul Hassan hassan@ispros.com.bd
If you need any more information, please let us know.
Do I see it correctly that you mirror all archs and all releases? I will add the mirror this evening (which is around 8 to 9 hours away from now).
Cheers and thanks,
Ralph _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Am 18.03.10 13:30, schrieb Nyamul Hassan:
Yes, you are correct to notice that we are offering all archs and all releases offered by the Master Msync.
Thanks for confirming when our mirror will be published.
I added your mirror, it should show up soon on our mirror pages.
Thanks for supporting CentOS.
Regards,
Ralph
Thank you Ralph, I see it on the list!
Regards HASSAN
On Fri, Mar 19, 2010 at 4:33 AM, Ralph Angenendt ralph.angenendt@gmail.com wrote:
Am 18.03.10 13:30, schrieb Nyamul Hassan:
Yes, you are correct to notice that we are offering all archs and all releases offered by the Master Msync.
Thanks for confirming when our mirror will be published.
I added your mirror, it should show up soon on our mirror pages.
Thanks for supporting CentOS.
Regards,
Ralph _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
As an update to the original conversation of keeping the DVDs from being deleted, and also to get the latest DVD ISOs, I've modified my crontab to include the following:
rsync -v -azH --filter='protect *DVD*iso' --delete --progress msync.centos.org::CentOS /data/web/centos rsync -n -v -amH --filter='include */' --filter='include *DVD*iso' --filter='exclude *' --progress mirrors.kernel.org::centos /data/web/centos
Is that the correct syntax?
Also, is "mirrors.kernel.org" a safe bet for the updated DVD ISOs?
Regards HASSAN
On Fri, Mar 19, 2010 at 12:35 PM, Nyamul Hassan mnhassan@usa.net wrote:
Thank you Ralph, I see it on the list!
Regards HASSAN
On Fri, Mar 19, 2010 at 4:33 AM, Ralph Angenendt ralph.angenendt@gmail.com wrote:
Am 18.03.10 13:30, schrieb Nyamul Hassan:
Yes, you are correct to notice that we are offering all archs and all releases offered by the Master Msync.
Thanks for confirming when our mirror will be published.
I added your mirror, it should show up soon on our mirror pages.
Thanks for supporting CentOS.
Regards,
Ralph _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
-
Matt Ruzicka -
Nyamul Hassan -
Prof. P. Sriram -
Ralph Angenendt