[CentOS-devel] How to mirror https://git.centos.org/project/rpms and https://git.centos.org/sources/

[Karanbir Singh]

On 14/11/14 12:14, Wang, Weiwei wrote:
> 
> 
> 
> 
>> 在 2014年11月14日，下午6:04，Karanbir Singh <mail-lists at karan.org> 写道：
>>
>>> On 11/14/2014 07:34 AM, Wang, Weiwei wrote:
>>> Hi Centos friends,
>>>
>>>
>>>
>>> Recently I am trying to  do a mirror for centos rpm git repos and
>>> lookaside cache, but I meet some problems and hope someone can give me
>>> some instructions here:
>>>
>>> 1.     For the git repos from https://git.centos.org/project/rpms, how
>>> can I get a complete list for all the rpm repos, and then I can create a
>>> script to clone them together;
>>
>> you should be using the api instead of scraping the site, refer:
>> http://gitblit.com/rpc.html
> 
> Thanks, I will try the api by referring to above link.
> 
> 
>>
>>> 2.     For the lookaside cache, I tried to use rsync or lftp to mirror
>>> it, but all failed, Is there any special steps I need to follow to do
>>> the mirror?
>>
>> there is no rsync access to the lookaside, yet; but you should be able
>> to walk the git path and get what you need, when you need it.
>>
>> What problem are you trying to solve here, are you looking for a local
>> cache for network-performance reasons or just looking for a local repo,
>> just in case git.c.o goes down ?
> 
> I would say both. So do you have any suggestions for mirroring it other than walking the git?
> 

use the api to get list of repos and use that list with the get_sources
script to get the non-text souces for the git repos you care about.

Longer term, having an rsync target for this is definitely on the agenda.


-- 
Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
GnuPG Key : http://www.karan.org/publickey.asc