[Dirvish] Dirvish/rsync thinking partition is 'new'

Adrian von Bidder avbidder at fortytwo.ch
Sun Mar 6 16:34:59 UTC 2011


On Sunday 06 March 2011 13.28:29 Paul Slootman wrote:
> Seems a bit on the assinine side to duplicate say, an
> 
> > unchanged 100GB iso image, just because the user 'touch'd, 
> > chmod'ed or chown'ed it. Really a rather serious waste of
> > resources.

There's no choice here: hardlinked files have the same inode, which means if 
the inode changes, the file has to be duplicated. There shouldn't be a need 
to retransmit it - if that's currently the case it should be fixed.

> I don't know whether the COW implementation on top of btrfs might help
> in that respect.

It depends on how rsync works, exactly, but from the btrfs side there's no 
need for the file data to be duplicated: the directory with the "inode" 
information [ I understand there's no inode in the traditional sense, but 
the ownership and mode information is obviously stored somewhere ] is 
duplicated, but the two copies of the file point to the same data on disk.  
Haven't tested this scenario though, so maybe rsync does something "stupid" 
that causes the file to be duplicated.

The dirvish cow patch just removes the "--link-dest" option and adds "--
inplace" to the rsync call.

cheers
-- vbi



-- 
Prompted by the theft of Eileen, MOBA staff installed a fake video
camera over a sign at their Dedham branch reading: "Warning. This
gallery is protected by fake video cameras."
        -- http://en.wikipedia.org/wiki/Museum_Of_Bad_Art
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 836 bytes
Desc: This is a digitally signed message part.
Url : http://www.dirvish.org/pipermail/dirvish/attachments/20110306/9de4b0c7/attachment.bin 


More information about the Dirvish mailing list