I want to setup a bublic mirror server, yes, but not been successful in getting Debian / Ubuntu mirrors up, yet On Tue, Apr 20, 2021 at 11:11 PM Valeri Galtsev <galtsev at kicp.uchicago.edu> wrote: > > > On 4/20/21 4:03 PM, Valeri Galtsev wrote: > > > > > > On 4/20/21 3:53 PM, Rudi Ahlers wrote: > >> ok, so do you simply rsync the repositories from the other distributions > >> you need? > >> > > > > I forgot to mention: before mirroring using higher tier repository: > contact their admin, ask if they do not mind that you will mirror using > them as a higher tier mirror, and tell them all details: public/private > mirror, your bandwidth, how often you plan to run sync - and ask them > what frequency of sync is OK with them. > > After you roll out and know all works, if your plan is public mirror, > next step will be to register your mirror. > > All in all, every distribution has HOWTO instruction to become their > mirror, follow these. > > And as always, use web search to find these instructions: duckduckgo is > your friend. > > Valeri > > > Short answer: yes. > > > > Long answer: > > Every repository has its own suggestion how to mirror. I do not have > > Debian mirror, my friend sysadmin in the next building maintains one, no > > need for two in the same institution. Here in my cron job script for > > mirroring CentOS (with some local details obfuscated): > > > > #============== > > #!/usr/local/bin/bash > > # We use locks... > > > > touch=/usr/bin/touch > > echo=/bin/echo > > ps=/bin/ps > > cat=/bin/cat > > grep=/usr/bin/grep > > wc=/usr/bin/wc > > rm=/bin/rm > > sendmail=/usr/sbin/sendmail > > date=/bin/date > > rsync=/usr/local/bin/rsync > > # DEFAULTS > > ADDR=recipient at server > > FROM=sender at hostingmirror > > lockfile=/.../lock/centosmirror.lock > > mirror=/.../mirror/centos > > logfile=/.../mirrorlog/centos.log > > > > # check if log file exists, and create if not > > > > if [ ! -f $logfile ]; then > > $touch $logfile > > fi > > > > # check if lock exists, then bale out sending warning, > > # otherwise rsync > > > > if [ -f $lockfile ]; then > > > > # check if the process resembling lock still exists, > > # if not, just delete lock > > > > if [ "$($ps -p `$cat $lockfile` | $wc -l)" -gt 1 ]; then > > > > # Send the message > > ( > > $echo "From: $FROM" > > $echo "To: $ADDR" > > $echo "Subject: CentOS mirror failed" > > $echo "" > > $echo "CentOS mirror process bailed out as there is another process" > > $echo "with the same name and the following PID:" > > $echo "" > > $echo "`$cat $lockfile`" > > echo "" > > echo "You may want to check logs:" > > echo "" > > echo "/.../mirrorlog/centos.log" > > ) | $sendmail -F $ADDR -t > > > > else > > > > # no process, just delete the lock, and mirror > > > > $rm -f $lockfile > > > > $echo $$ > $lockfile > > $echo "`$date` started mirroring" >> $logfile > > $rsync -aqH --exclude .~tmp~/ --exclude .~tmp~ --delete > > us-msync.centos.org::CentOS /data/mirror/centos > > $echo "`$date` finished mirroring" >> $logfile > > $rm $lockfile > > > > fi > > > > else > > > > $echo $$ > $lockfile > > $echo "`$date` started mirroring" >> $logfile > > $rsync -aqH --exclude .~tmp~/ --exclude .~tmp~ --delete > > us-msync.centos.org::CentOS /data/mirror/centos > > $echo "`$date` finished mirroring" >> $logfile > > $rm $lockfile > > > > fi > > #================================ > > > >> On Tue, Apr 20, 2021 at 3:14 PM Valeri Galtsev > >> <galtsev at kicp.uchicago.edu> > >> wrote: > >> > >>> > >>> > >>>> On Apr 20, 2021, at 12:34 AM, Rudi Ahlers <rudiahlers at gmail.com> > wrote: > >>>> > >>>> Pulp is a bit overkill for my liking. > >>>> > >>> > >>> Coming back to the original question: mirror hosting variety of > >>> distributions, does not have to have any packaging or other tools > >>> used by > >>> those distributions. Public mirror box I support runs FreeBSD, and > hosts > >>> mirrors of CentOS, Ubuntu, CPAN, EPEL, … > >>> > >>> I hope, this helps. > >>> > >>> Valeri > >>> > >>>> > >>>> On Mon, Apr 19, 2021 at 2:44 PM Arnaud Gelly <arnaud.gelly at gmail.com> > >>> wrote: > >>>> > >>>>> Hello, > >>>>> > >>>>> Is Pulp not supposed to do what you want : RPM, DEB and more in the > >>>>> same > >>>>> software ? > >>>>> > >>>>> I'm not using Pulp, just reading their website. > >>>>> > >>>>> Regards, > >>>>> -- > >>>>> > >>>>> > >>>>> > >>>>> On Mon, 19 Apr 2021 at 14:26, Rudi Ahlers <rudiahlers at gmail.com> > >>>>> wrote: > >>>>> > >>>>>> Thank you. This at least point me in the right direction. I don't > >>>>>> quite > >>>>>> want to setup 2 servers, or 2 VM's for this. > >>>>>> > >>>>>> > >>>>>> On Mon, Apr 19, 2021 at 2:03 PM Robert Heller <heller at deepsoft.com> > >>>>> wrote: > >>>>>> > >>>>>>> At Mon, 19 Apr 2021 08:55:54 +0200 CentOS mailing list < > >>>>>> centos at centos.org> > >>>>>>> wrote: > >>>>>>> > >>>>>>>> > >>>>>>>> Hi, > >>>>>>>> > >>>>>>>> Does anyone have some instructions on setting up a CentOS server > as > >>>>>>> mirror > >>>>>>>> for Debian and Ubuntu distributions? I already setup a YUM > >>>>>>>> mirror and > >>>>>>> this > >>>>>>>> works fairly well, but cannot seem to figure out how to mirror > >>>>>>>> Debian > >>>>>> and > >>>>>>>> Ubuntu repositories. > >>>>>>> > >>>>>>> You need to grab a copy of debmirror, which is just a Perl > >>>>>>> script, so > >>>>> it > >>>>>>> should work under CentOS. I don't know where to get a version as a > >>>>>> tarball > >>>>>>> -- > >>>>>>> I had an available VM running Ubuntu and just installed it there > and > >>>>> NFS > >>>>>>> mounted the mirror disk from the CentOS server. There is a config > >>>>>>> file > >>>>>> for > >>>>>>> debmirror to control where you mirror from and just what you mirror > >>>>>>> (versions, > >>>>>>> arches, etc.). There is a man page and and example config file. > You > >>>>> then > >>>>>>> run > >>>>>>> debmirror from crontab (eg every day). > >>>>>>> > >>>>>>> Unfortunately, the Debian flavor repositories are not structured to > >>>>> just > >>>>>>> be > >>>>>>> rsync'ed like the CentOS repositories. > >>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>> > >>>>>>> -- > >>>>>>> Robert Heller -- Cell: 413-658-7953 GV: 978-633-5364 > >>>>>>> Deepwoods Software -- Custom Software Services > >>>>>>> http://www.deepsoft.com/ -- Linux Administration Services > >>>>>>> heller at deepsoft.com -- Webhosting Services > >>>>>>> > >>>>>>> _______________________________________________ > >>>>>>> CentOS mailing list > >>>>>>> CentOS at centos.org > >>>>>>> https://lists.centos.org/mailman/listinfo/centos > >>>>>>> > >>>>>> > >>>>>> > >>>>>> -- > >>>>>> Kind Regards > >>>>>> Rudi Ahlers > >>>>>> Website: http://www.rudiahlers.co.za > >>>>>> _______________________________________________ > >>>>>> CentOS mailing list > >>>>>> CentOS at centos.org > >>>>>> https://lists.centos.org/mailman/listinfo/centos > >>>>>> > >>>>> _______________________________________________ > >>>>> CentOS mailing list > >>>>> CentOS at centos.org > >>>>> https://lists.centos.org/mailman/listinfo/centos > >>>>> > >>>> > >>>> > >>>> -- > >>>> Kind Regards > >>>> Rudi Ahlers > >>>> Website: http://www.rudiahlers.co.za > >>>> _______________________________________________ > >>>> CentOS mailing list > >>>> CentOS at centos.org > >>>> https://lists.centos.org/mailman/listinfo/centos > >>> > >>> _______________________________________________ > >>> CentOS mailing list > >>> CentOS at centos.org > >>> https://lists.centos.org/mailman/listinfo/centos > >>> > >> > >> > > > > -- > ++++++++++++++++++++++++++++++++++++++++ > Valeri Galtsev > Sr System Administrator > Department of Astronomy and Astrophysics > Kavli Institute for Cosmological Physics > University of Chicago > Phone: 773-702-4247 > ++++++++++++++++++++++++++++++++++++++++ > _______________________________________________ > CentOS mailing list > CentOS at centos.org > https://lists.centos.org/mailman/listinfo/centos > -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za