[PVE-User] Disk migration gone totally wrong

[Eneko Lacunza]

Hi all,

On Wednesday we migrated a VM disk from a local storage to another local 
storage. I have the task history and apparently it was successful, BUT 
it seems the new storage ended with a blank, totally sparsed raw file. 
Migration was run with delete source, so we recovered today from backup 
+ git. (No data was lost and no bits were injured! ;)  )

The only strange thing I can see is that the task did not reach 100% in 
the log:

create full clone of drive virtio0 (storage-local:123/vm-123-disk-1.raw)
Formatting '/srv/storage-local2/images/123/vm-123-disk-1.raw', fmt=raw 
size=88046829568
transferred: 0 bytes remaining: 88046829568 bytes total: 88046829568 
bytes progression: 0.00 %
transferred: 1760936591 bytes remaining: 86285892977 bytes total: 
88046829568 bytes progression: 2.00 %
transferred: 3521873182 bytes remaining: 84524956386 bytes total: 
88046829568 bytes progression: 4.00 %
...
transferred: 84595393848 bytes remaining: 3451435720 bytes total: 
88046829568 bytes progression: 96.08 %
transferred: 86356330440 bytes remaining: 1690499128 bytes total: 
88046829568 bytes progression: 98.08 %
TASK OK

Any idea about what happened? The VM was stopped, as a previous attempt 
to migrate the disk with the VM running failed (the attempt was a day 
earlier and the VM continued to work though all day on Wednesday)

create full clone of drive virtio0 (storage-local:123/vm-123-disk-1.raw)
Formatting '/srv/storage-local2/images/123/vm-123-disk-1.raw', fmt=raw 
size=88046829568
transferred: 14466547712 bytes remaining: 73580281856 bytes total: 
88046829568 bytes progression: 16.43 %
transferred: 14496432128 bytes remaining: 73550397440 bytes total: 
88046829568 bytes progression: 16.46 %
...
transferred: 87989288960 bytes remaining: 57540608 bytes total: 
88046829568 bytes progression: 99.93 %
transferred: 88009342976 bytes remaining: 37486592 bytes total: 
88046829568 bytes progression: 99.96 %
transferred: 88042045440 bytes remaining: 4784128 bytes total: 
88046829568 bytes progression: 99.99 %
transferred: 88046829568 bytes remaining: 0 bytes total: 88046829568 
bytes progression: 100.00 %
TASK ERROR: storage migration failed: mirroring error: VM 123 qmp 
command 'block-job-complete' failed - The active block job for

Any idea what happened? This is a Dell T610 with H200 RAID controller. 
Disk was moving from a RAID1 volume to another, configured as a 
Directory storage, Source storage is ext3, destination storage is ext4. 
We never experienced a data loss like this moving disks/VMs...

proxmox-ve-2.6.32: 3.2-121 (running kernel: 2.6.32-26-pve)
pve-manager: 3.2-1 (running version: 3.2-1/1933730b)
pve-kernel-2.6.32-27-pve: 2.6.32-121
pve-kernel-2.6.32-26-pve: 2.6.32-114
pve-kernel-2.6.32-23-pve: 2.6.32-109
lvm2: 2.02.98-pve4
clvm: 2.02.98-pve4
corosync-pve: 1.4.5-1
openais-pve: 1.1.4-3
libqb0: 0.11.1-2
redhat-cluster-pve: 3.2.0-2
resource-agents-pve: 3.9.2-4
fence-agents-pve: 4.0.5-1
pve-cluster: 3.0-12
qemu-server: 3.1-15
pve-firmware: 1.1-2
libpve-common-perl: 3.0-14
libpve-access-control: 3.0-11
libpve-storage-perl: 3.0-19
pve-libspice-server1: 0.12.4-3
vncterm: 1.1-6
vzctl: 4.0-1pve5
vzprocps: 2.0.11-2
vzquota: 3.1-2
pve-qemu-kvm: 1.7-4
ksm-control-daemon: 1.1-1
glusterfs-client: 3.4.2-1

Thanks
Eneko

-- 
Zuzendari Teknikoa / Director Técnico
Binovo IT Human Project, S.L.
Telf. 943575997
       943493611
Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
www.binovo.es