[Dirvish] dirvish not making hard links but copying files, consuming much space

Loren M. Lang lorenl at alzatex.com
Thu Jun 15 22:46:14 UTC 2006


Team Bloombox wrote:
> Hi Eric,
> 
> thanks for your reply.
> 
>> -----Original Message-----
>> From: dirvish-bounces at dirvish.org 
>> [mailto:dirvish-bounces at dirvish.org] On Behalf Of Eric Mountain
>> Sent: Friday, June 09, 2006 10:46 PM
>> To: dirvish at dirvish.org
>> Subject: Re: [Dirvish] dirvish not making hard links but 
>> copying files,consuming much space
>>
>> Hi,
>>
>> On Thursday 08 June 2006 19:10, Bloombox Team spake thus:
>> [...]
>>> /etc/apache2/ssl/nemesis41.key
>>>     Jun 20  2005 20060605-2304
>>>     Jun 20  2005 20060604-2304
>>>     Jun 20  2005 20060603-2304
>>>     Jun 20  2005 20060602-2304, 20060602-0958, 20060602-0912, 
>>> 20060602-0852
>> OK, so the date on the file hasn't changed according to 
>> dirvish-locate.  Maybe the time, or something else.
>>
>> Please supply the output of:
>>
>> 	stat /etc/apache2/ssl/nemesis41.key
>> 	stat 
>> /backup/dirvish/n41/20060602-2304/tree/etc/apache2/ssl/nemesis41.key
>> 	stat 
>> /backup/dirvish/n41/20060603-2304/tree/etc/apache2/ssl/nemesis41.key
> 
> Output of "stat /etc/apache2/ssl/nemesis41.key"
> ###########
>   File: ,,/etc/apache2/ssl/nemesis41.key"
>   Size: 891             Blocks: 8          IO Block: 4096   reguläre Datei
> Device: 302h/770d       Inode: 2801667     Links: 1
> Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
> Access: 2006-06-11 06:43:08.000000000 +0200
> Modify: 2005-06-20 14:00:00.000000000 +0200
> Change: 2006-01-29 12:09:35.000000000 +0100
> 
> Now the weird thing: If I run 
> 
> stat /backup/dirvish/n41/20060602-2304/tree/etc/apache2/ssl/nemesis41.key
> 
> it says:
> ###
> stat: Aufruf von stat für
> ,,/backup/dirvish/n41/20060602-2304/tree/etc/apache2/ssl/nemesis41.key"
> nicht möglich: Datei oder Verzeichnis nicht gefunden
> ###
> 
> which means: file or directory not found. And really: The file isnt't there!
> So, what's this now? How can the file vanish? Do I have file system problems
> or what?
> 
> ###
> nemesis41:/backup/dirvish/n41/20060602-0852/tree/etc/apache2/ssl# ls -l
> insgesamt 0
> ###
> 
> It's just the same with all other backups: There is nothing in that
> directory within the vault n41.
> 
>> The most important are the stat's of the backup as they will 
>> show what it is in the inode data that rsync thinks is 
>> different (barring checksums/contents of the file which is 
>> unlikely to have changed given the file's nature) and 
>> justifies creating a copy of the file.
> Sadly I cannot give you the information required as the file has vanished
> from all vaults?! Maybe there's something wrong with the way rsync is called
> by dirvish?
> 
> Here is the output for another file which is still available within the
> vault and which is not listed as "changed" by the dirvish run on 2006-06-03
> (I've removed the second match for apache2.conf.gz):
> 
> nemesis41:/backup/dirvish/n41/20060603-2304# dirvish-locate n41 apache2.conf
> ###
> 2 matches in 11 images
> /etc/apache2/apache2.conf
>     Aug  8  2005 20060609-2304
>     Aug  8  2005 20060608-2304
>     Aug  8  2005 20060607-2304
>     Aug  8  2005 20060606-2304
>     Aug  8  2005 20060605-2304
>     Aug  8  2005 20060604-2304
>     Aug  8  2005 20060603-2304
>     Aug  8  2005 20060602-2304, 20060602-0958, 20060602-0912, 20060602-0852
> 
> ###
> STAT-Runs
> ###
> 
> nemesis41:/backup/dirvish/n41/20060602-2304# stat
> tree/etc/apache2/apache2.conf
>   File: ,,tree/etc/apache2/apache2.conf"
>   Size: 12895           Blocks: 32         IO Block: 4096   reguläre Datei
> Device: 305h/773d       Inode: 8144412     Links: 4
> Access: (0644/-rw-r--r--)  Uid: ( 1001/tapeback)   Gid: (    0/    root)
> Access: 2006-06-03 23:05:50.000000000 +0200
> Modify: 2005-08-08 10:47:00.000000000 +0200
> Change: 2006-06-02 23:36:34.000000000 +0200
> 
> nemesis41:/backup/dirvish/n41/20060603-2304# stat
> tree/etc/apache2/apache2.conf
> ###
>   File: ,,tree/etc/apache2/apache2.conf"
>   Size: 12895           Blocks: 32         IO Block: 4096   reguläre Datei
> Device: 305h/773d       Inode: 10601284    Links: 1
> Access: (0644/-rw-r--r--)  Uid: ( 1001/tapeback)   Gid: (    0/    root)
> Access: 2006-06-04 23:06:04.000000000 +0200
> Modify: 2005-08-08 10:47:00.000000000 +0200
> Change: 2006-06-03 23:49:43.000000000 +0200

The file change time is different which though the modified time is the
same.  This means something tried to change the meta-data (e.g. file
permissions, user, group, times), but the file data is unchanged.  As
there is no way to create a link to the same file with different
meta-data, all rsync can do is copy the whole file.  Now if there was an
option to tell rsync to update the meta-data on the existing file
instead of creating a new copy, you'd lose the old meta-data, but save a
lot of space.  The odd thing is the only the change time is different
like some program is going across all the files and doing something like
setting the permissions to the same values there already set too.

> 
> 
> and later on:
> 
> nemesis41:/backup/dirvish/n41/20060609-2304# stat
> tree/etc/apache2/apache2.conf
>   File: ,,tree/etc/apache2/apache2.conf"
>   Size: 12895           Blocks: 32         IO Block: 4096   reguläre Datei
> Device: 305h/773d       Inode: 7606218     Links: 1
> Access: (0644/-rw-r--r--)  Uid: ( 1001/tapeback)   Gid: (    0/    root)
> Access: 2006-06-10 23:06:00.000000000 +0200
> Modify: 2005-08-08 10:47:00.000000000 +0200
> Change: 2006-06-10 00:05:42.000000000 +0200
> 

The change time is different again.

> 
> And guess, what a diff run finds out about differences of both apache2.conf:
> diff /etc/apache2/apache2.conf
> /backup/dirvish/n41/20060609-2304/tree/etc/apache2/apache2.conf
> 
> Right, nothing. :-(
> 
> I'm afraid I'm the greatest fool running around and it's just a
> configuration issue - but I can't find anything wrong?!
> 
> Best regards,
> Jens
> 
> 
> _______________________________________________
> Dirvish mailing list
> Dirvish at dirvish.org
> http://www.dirvish.org/mailman/listinfo/dirvish
> 


-- 
Loren M. Lang
lorenl at alzatex.com
http://www.alzatex.com/


Public Key: ftp://ftp.tallye.com/pub/lorenl_pubkey.asc
Fingerprint: CEE1 AAE2 F66C 59B5 34CA  C415 6D35 E847 0118 A3D2


-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 250 bytes
Desc: OpenPGP digital signature
Url : http://www.dirvish.org/pipermail/dirvish/attachments/20060615/09efeff9/signature.bin


More information about the Dirvish mailing list