Jens Hauuser

Problem with backup

I'm experiencing a strange problem at a server with Debian Linux and dirvish with the following version:

dirvish version 1.2

Dirvish inits a vault after running a dirvish --init --vault n41 and it also runs fine about 1 to 3 times after initialization by only storing about 100MB of files which have changed.

After a few runs dirvish backups all files which is about 5GB each run - and this jus fills up my backup storage very fast ...

The problem is: Those files haven't changed at all from my point of view.

If I run dirvish-locate for a file, I get the following information for an unchanged file:

/etc/apache2/ssl/nemesis41.key
Jun 20  2005 20060605-2304
Jun 20  2005 20060604-2304
Jun 20  2005 20060603-2304
Jun 20  2005 20060602-2304, 20060602-0958, 20060602-0912, 20060602-0852

Please find below some information about my system called nemesis41 (vault n41) and feel free to tell if you need something else. I'm running out of ideas with this one - mostly because I have the same configuration on another system mostly the same like this one and everything works as expected ...

master.conf

bank:
       /backup/dirvish
xdev: 1
index: gzip
image-default: %Y%m%d-%H%M

exclude:
       lost+found/
       core
       *~
       .nfs*

Runall:
       n41
       n40

expire-default: +60 days
expire-rule:
#       MIN HR    DOM MON       DOW  STRFTIME_FMT
        *   *     *   *         1    +3 months
#       *   *     1-7 *         1    +1 year
#       *   *     1-7 1,4,7,10  1
#       *   10-20 *   *         *    +4 days
#       *   *     *   *         2-7  +15 days

default.conf (/backup/dirvish/n41/dirvish)

client: nemesis41
tree: /
log: gzip
exclude:
       /backup
       /backup-tmp
       /proc
       /floppy
       /dev
       /var/cache/apt/archives/*.deb
       /var/cache/man
       /var/lib/amavis
       /var/lib/php5
       /var/log
       /var/spool
       /tmp
       /var/tmp
       access
       error
       *.MYD
       *.MYI
       Data*.fs
       Data*.fs.old
       event.log
       Z2.log
       *.tgz

INIT RUN

summary

client: nemesis41
tree: /
rsh: ssh
Server: nemesis41
Bank: /backup/dirvish
vault: n41
branch: default
Image: 20060602-0852
Reference: default
Image-now: 2006-06-02 08:52:27
Expire: +60 days == 2006-08-01 08:52:27
exclude:
       lost+found/
       core
       *~
       .nfs*
       /backup
       /backup-tmp
       /proc
       /floppy
       /dev
       /var/cache/apt/archives/*.deb
       /var/cache/man
       /var/lib/amavis
       /var/lib/php5
       /var/log
       /var/spool
       /tmp
       /var/tmp
       access
       error
       *.MYD
       *.MYI
       Data*.fs
       Data*.fs.old
       event.log
       Z2.log
       *.tgz
SET permissions devices init numeric-ids stats xdev
UNSET checksum sparse whole-file zxfer

ACTION: rsync -vrltH --delete -pgo --stats -D --numeric-ids
-x --exclude-from=/backup/dirvish/n41/20060602-0852/exclude /
/backup/dirvish/n41/20060602-0852/tree
Backup-begin: 2006-06-02 08:52:27
Backup-complete: 2006-06-02 09:10:31
Status: success

INIT

log.gz

ACTION: rsync -vrltH --delete -pgo --stats -D --numeric-ids
-x --exclude-from=/backup/dirvish/n41/20060602-0852/exclude /
/backup/dirvish/n41/20060602-0852/tree

building file list ... done

REMARK: file list deleted ....

Number of files: 154041
Number of files transferred: 42
Total file size: 5309619662 bytes
Total transferred file size: 582412 bytes
Literal data: 582412 bytes
Matched data: 0 bytes
File list size: 4323112
File list generation time: 131.762 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 4907890
Total bytes received: 1334

sent 4907890 bytes  received 1334 bytes  33973.87 bytes/sec
total size is 5309619662  speedup is 1081.56

LATER RUN

client: nemesis41
tree: /
rsh: ssh
Server: nemesis41
Bank: /backup/dirvish
vault: n41
branch: default
Image: 20060605-2304
Reference: 20060604-2304
Image-now: 2006-06-05 23:04:02
Expire: +60 days == 2006-08-04 23:04:02
exclude:
       lost+found/
       core
       *~
       .nfs*
       /backup
       /backup-tmp
       /proc
       /floppy
       /dev
       /var/cache/apt/archives/*.deb
       /var/cache/man
       /var/lib/amavis
       /var/lib/php5
       /var/log
       /var/spool
       /tmp
       /var/tmp
       access
       error
       *.MYD
       *.MYI
       Data*.fs
       Data*.fs.old
       event.log
       Z2.log
       *.tgz
SET permissions devices numeric-ids stats xdev
UNSET checksum init sparse whole-file zxfer

ACTION: rsync -vrltH --delete -pgo --stats -D --numeric-ids 
-x --exclude-from=/backup/dirvish/n41/20060605-2304/exclude
--link-dest=/backup/dirvish/n41/20060604-2304/tree / 
/backup/dirvish/n41/20060605-2304/tree
Backup-begin: 2006-06-05 23:04:02
Backup-complete: 2006-06-05 23:24:16
Status: success

LATER RUN

log-gz

ACTION: rsync -vrltH --delete -pgo --stats -D --numeric-ids
-x --exclude-from=/backup/dirvish/n41/20060605-2304/exclude 
--link-dest=/backup/dirvish/n41/20060604-2304/tree /  
/backup/dirvish/n41/20060605-2304/tree

building file list ... done

REMARK: file list deleted ....

Number of files: 156309
Number of files transferred: 67
Total file size: 5466114355 bytes
Total transferred file size: 6351712 bytes
Literal data: 6351972 bytes
Matched data: 0 bytes
File list size: 4412307
File list generation time: 146.789 seconds
File list transfer time: 0.061 seconds
Total bytes sent: 10768137
Total bytes received: 1674

sent 10768137 bytes  received 1674 bytes  53984.02 bytes/sec
total size is 5466114355  speedup is 507.54