[pve-devel] migration problems since qemu 1.3

[Stefan Priebe - Profihost AG]

Hi,

i had it again.

Migration hangs at:
Dec 20 15:23:03 starting migration of VM 107 to node 'cloud1-1202' 
(10.255.0.20)
Dec 20 15:23:03 copying disk images
Dec 20 15:23:03 starting VM 107 on remote node 'cloud1-1202'
Dec 20 15:23:06 starting migration tunnel
Dec 20 15:23:06 starting online/live migration on port 60000

I even canot connect anymore through console to this VM.

Stefan

Am 20.12.2012 12:31, schrieb Stefan Priebe - Profihost AG:
> Hi,
>
> at least migration works at all ;-) I'll wait until tomorrow and test
> again. I've restarted all VMs with latest pve-qemu-kvm.
>
> Thanks!
>
> Am 20.12.2012 11:57, schrieb Alexandre DERUMIER:
>> with last git, I think it's related to balloon driver enabled by
>> default, and qmp command send (see my previous mail).
>>
>>
>> can you try to replace (in QemuServer.pm)
>>
>>          if (!defined($conf->{balloon}) || $conf->{balloon}) {
>>              vm_mon_cmd($vmid, "balloon", value =>
>> $conf->{balloon}*1024*1024)
>>                  if $conf->{balloon};
>>
>>              vm_mon_cmd($vmid, 'qom-set',
>>                         path => "machine/peripheral/balloon0",
>>                         property => "stats-polling-interval",
>>                         value => 2);
>>          }
>>
>> by
>>
>>          if (!defined($conf->{balloon}) || $conf->{balloon}) {
>>              vm_mon_cmd_nocheck($vmid, "balloon", value =>
>> $conf->{balloon}*1024*1024)
>>                  if $conf->{balloon};
>>
>>              vm_mon_cmd_nocheck($vmid, 'qom-set',
>>                         path => "machine/peripheral/balloon0",
>>                         property => "stats-polling-interval",
>>                         value => 2);
>>          }
>>
>>
>> (vm_mon_cmd_nocheck)
>>
>> ----- Mail original -----
>>
>> De: "Stefan Priebe - Profihost AG" <s.priebe at profihost.ag>
>> À: "Alexandre DERUMIER" <aderumier at odiso.com>
>> Cc: pve-devel at pve.proxmox.com
>> Envoyé: Jeudi 20 Décembre 2012 11:48:06
>> Objet: Re: [pve-devel] migration problems since qemu 1.3
>>
>> Hi,
>>
>> Am 20.12.2012 10:04, schrieb Alexandre DERUMIER:
>>>>> Yes. It works fine with NEWLY started VMs but if the VMs are running
>>>>> more than 1-3 days. It stops working and the VMs just crahs during
>>>>> migration.
>>> Maybe vm running since 1-3 days,have more memory used, so I take more
>>> time to live migrate.
>>
>> I see totally different outputs - the vm crashes and the status output
>> stops.
>>
>> with git from yesterday i'm just getting this:
>> ----------------------------------------------------------
>> Dec 20 11:34:21 starting migration of VM 100 to node 'cloud1-1203'
>> (10.255.0.22)
>> Dec 20 11:34:21 copying disk images
>> Dec 20 11:34:21 starting VM 100 on remote node 'cloud1-1203'
>> Dec 20 11:34:23 ERROR: online migrate failure - command '/usr/bin/ssh -o
>> 'BatchMode=yes' root at 10.255.0.22 qm start 100 --stateuri tcp --skiplock
>> --migratedfrom cloud1-1202' failed: exit code 255
>> Dec 20 11:34:23 aborting phase 2 - cleanup resources
>> Dec 20 11:34:24 ERROR: migration finished with problems (duration
>> 00:00:03)
>> TASK ERROR: migration problems
>> ----------------------------------------------------------
>>
>>
>>> Does it crash at start of the migration ? or in the middle of the
>>> migration ?
>>
>> At the beginning mostly i see no more output after:
>> migration listens on port 60000
>>
>>
>>> what is your vm conf ? (memory size, storage ?)
>> 2GB mem, RBD / Ceph Storage
>>
>> Stefan
>>