Hi Centos friends,
Recently I am trying to do a mirror for centos rpm git repos and lookaside cache, but I meet some problems and hope someone can give me some instructions here:
1. For the git repos from https://git.centos.org/project/rpms, how can I get a complete list for all the rpm repos, and then I can create a script to clone them together;
2. For the lookaside cache, I tried to use rsync or lftp to mirror it, but all failed, Is there any special steps I need to follow to do the mirror?
Thanks in advance. Weiwei
On 11/14/2014 07:34 AM, Wang, Weiwei wrote:
Hi Centos friends,
Recently I am trying to do a mirror for centos rpm git repos and lookaside cache, but I meet some problems and hope someone can give me some instructions here:
For the git repos from https://git.centos.org/project/rpms, howcan I get a complete list for all the rpm repos, and then I can create a script to clone them together;
you should be using the api instead of scraping the site, refer: http://gitblit.com/rpc.html
For the lookaside cache, I tried to use rsync or lftp to mirrorit, but all failed, Is there any special steps I need to follow to do the mirror?
there is no rsync access to the lookaside, yet; but you should be able to walk the git path and get what you need, when you need it.
What problem are you trying to solve here, are you looking for a local cache for network-performance reasons or just looking for a local repo, just in case git.c.o goes down ?
在 2014年11月14日，下午6:04，Karanbir Singh mail-lists@karan.org 写道：
On 11/14/2014 07:34 AM, Wang, Weiwei wrote: Hi Centos friends,
Recently I am trying to do a mirror for centos rpm git repos and lookaside cache, but I meet some problems and hope someone can give me some instructions here:
For the git repos from https://git.centos.org/project/rpms, howcan I get a complete list for all the rpm repos, and then I can create a script to clone them together;
you should be using the api instead of scraping the site, refer: http://gitblit.com/rpc.html
Thanks, I will try the api by referring to above link.
For the lookaside cache, I tried to use rsync or lftp to mirrorit, but all failed, Is there any special steps I need to follow to do the mirror?
there is no rsync access to the lookaside, yet; but you should be able to walk the git path and get what you need, when you need it.
What problem are you trying to solve here, are you looking for a local cache for network-performance reasons or just looking for a local repo, just in case git.c.o goes down ?
I would say both. So do you have any suggestions for mirroring it other than walking the git?
Thanks Weiwei
-- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc _______________________________________________ CentOS-devel mailing list CentOS-devel@centos.org http://lists.centos.org/mailman/listinfo/centos-devel
On 14/11/14 12:14, Wang, Weiwei wrote:
在 2014年11月14日，下午6:04，Karanbir Singh mail-lists@karan.org 写道：
On 11/14/2014 07:34 AM, Wang, Weiwei wrote: Hi Centos friends,
Recently I am trying to do a mirror for centos rpm git repos and lookaside cache, but I meet some problems and hope someone can give me some instructions here:
For the git repos from https://git.centos.org/project/rpms, howcan I get a complete list for all the rpm repos, and then I can create a script to clone them together;
you should be using the api instead of scraping the site, refer: http://gitblit.com/rpc.html
Thanks, I will try the api by referring to above link.
For the lookaside cache, I tried to use rsync or lftp to mirrorit, but all failed, Is there any special steps I need to follow to do the mirror?
there is no rsync access to the lookaside, yet; but you should be able to walk the git path and get what you need, when you need it.
What problem are you trying to solve here, are you looking for a local cache for network-performance reasons or just looking for a local repo, just in case git.c.o goes down ?
I would say both. So do you have any suggestions for mirroring it other than walking the git?
use the api to get list of repos and use that list with the get_sources script to get the non-text souces for the git repos you care about.
Longer term, having an rsync target for this is definitely on the agenda.
-
Karanbir Singh -
Wang, Weiwei