[PVE-User] WG: WG: taking advantage of the lvm snapshot

[Holger Ernst]

I just checked the logs, it is 800Gb which are synced in 90 min over a
100Mbit line (but this are quick machines giving 500Mb sequential read
speed)

My log which is created from a shellsript which makes/removes the
snapshots and starts the python script:

2012-07-11 [ 4:00:01]
=================================================================
Count:1 - Device:/dev/pve1/vm-103-disk-1 - active
=================================================================
  Logical volume "vm-103-disk-1-syncsnap" created
=================================================================
Count:2 - Device:/dev/pve1/vm-103-disk-2 - active
=================================================================
  Logical volume "vm-103-disk-2-syncsnap" created
=================================================================
Count:1 - Device:/dev/pve1/vm-103-disk-1 - active
=================================================================
Block size is 0.5 MB
Running: ssh -C -c blowfish root at 10.1.1.248 ./blocksync.py server
/dev/pve1/vm-103-disk-1 -b 524288 -i /root/.ssh/id_rsa
Starting sync...
Completed in   82.1 minutes
same: 1355989, diff: 65331, 1421320/1421320, 144.2 MB/s
####################################
=================================================================
Count:2 - Device:/dev/pve1/vm-103-disk-2 - active
=================================================================
Block size is 0.5 MB
Running: ssh -C -c blowfish root at 10.1.1.248 ./blocksync.py server
/dev/pve1/vm-103-disk-2 -b 524288 -i /root/.ssh/id_rsa
Starting sync...
Completed in    5.9 minutes
same: 204637, diff: 163, 204800/204800, 291.6 MB/s
####################################
=================================================================
Count:1 - Device:/dev/pve1/vm-103-disk-1 - active
=================================================================
  Logical volume "vm-103-disk-1-syncsnap" successfully removed
=================================================================
Count:2 - Device:/dev/pve1/vm-103-disk-2 - active
=================================================================
  Logical volume "vm-103-disk-2-syncsnap" successfully removed
=================================================================
2012-07-11 [ 5:28:07]
=================================================================

Holger

> Well, it is on Github.
> 
> And to clarify, this script syncs block devices quickly. Not more not
> less. For using it with Proxmox and as a reliable fallback you need to
> do some extra work: Make proxmox backup target, make snapshot, remove
> snapshot, and most important: A propper error handling (you propably
> will get two broken systems when the master fails during a sync run so
> better use two alternating backups. And so on...).
> 
> Regards, Holger
> 
> 
> > > You find it here: https://gist.github.com/1843764
> > >
> > > It takes aprox. 90 min to sync 500GB (depending on amount of
changed
> data) while using all of
> > the line.
> > Do you have plans to put it in repo, say somewhere on github ?
> 
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> 
> 
> 
>