[CentOS] rsync question: building list taking forever

[Cliff Pratt]

On Mon, Oct 20, 2014 at 3:05 PM, Tim Dunphy <bluethundr at gmail.com> wrote:

> >
> > > Don't forget that the time taken to build the file list is a function
> of
> > > the number of files present, and not their size. If you have many
> > millions
> > > of small files, it will indeed take a very long time. Over sshfs with
> > > a slowish link, it could be days.
> > >
> > > ....and it may end up failing silently or noisily anyway.
>
>
> Ahhh, but isn't that part of the beauty of adventure that being a linux
> admin is all about? *twitch*
>
>
Adventure? Nah, that's why my rsync scripts rsync chunks of the filesystem
rather than all of it in one go, and why it gets to run twice each time.
Once bitten, twice shy.

Cheers,

Cliff