[CentOS-mirror] Rsync command line (hard links)

Anssi Johansson avij at centosproject.org
Fri Jun 22 14:40:10 UTC 2018


Cochrane, Bryan T kirjoitti 22.6.2018 klo 14.46:
> rsync -ah --stats --delete eu-msync.centos.org::CentOS /bak/centos/CentOS

I believe you can sync OK now, but a comment on this command line.

rsync's -h option is "output numbers in a human-readable format". While 
that may be nice for logging purposes and such, I would recommend adding 
the -H option as well. -H is "preserve hard links", which is 
particularly useful at point release times.

For a slightly simplified example, 6.9's rpms take up around 8 GB of 
disk space. The updated packages in the upcoming 6.10 take up around 1 
GB. If your rsync does not use that -H option, you will need to download 
around 8 GB of 6.10 packages when 6.10 gets released. If you have -H 
enabled, you will need to download only that 1 GB of fresh 6.10 
packages. The remaining unchanged packages (around 7 GB) will be hard 
linked between 6.9 and 6.10, and transferring this hard link information 
is very quick.

Each hard linked file needs to be stored on disk only once, saving you 
some hard disk space.

If you (or any others reading this message) don't have -H in your rsync 
command line, please add it. The next time you sync your mirror, rsync 
will remove the duplicate files and create hard links for them.

In certain rare situations the underlying file system does not 
understand hard links. In this case the -H flag won't help.


More information about the CentOS-mirror mailing list