<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">Hi all,<br>
      <br>
      It's been a while and I have been doing tests in the background.<br>
      <br>
      I found some issues were related to faulty drives, but after
      removing them migration issues continued. I had the same issues
      with PVE 3.2, nfs, rbd and local storage.<br>
      <br>
      I also noticed that out office production cluster doesn't seem to
      suffer this problem (PVE 3.3) .<br>
      <br>
      Today I found this post on the forum:<br>
<a class="moz-txt-link-freetext" href="http://forum.proxmox.com/threads/19733-storage-migration-virtio-failed">http://forum.proxmox.com/threads/19733-storage-migration-virtio-failed</a><br>
      <br>
      Short is that in /usr/share/perl5/PVE/QemuServer.pm<br>
      changing:<br>
      ---<br>
      <pre class="bbcode_code" style="height:84px;">     if ($vmiddst == $vmid) {
                # switch the disk if source and destination are on the same guest
                vm_mon_cmd($vmid, "block-job-complete", device => "drive-$drive");
     }
---
</pre>
      with<br>
      ---<br>
      <pre class="bbcode_code" style="height:84px;">     if ($vmiddst == $vmid) {
                sleep 10;
                # switch the disk if source and destination are on the same guest
                vm_mon_cmd($vmid, "block-job-complete", device => "drive-$drive");
     }
---
</pre>
      <br>
      So adding a sleep, seems to have fixed all the migration problems
      so far (I continue testing while I write this email).<br>
      <br>
      The problem seems related to performance. The problem-suffering
      cluster has 3 nodes each with 1 desktop CPU, 2 GB RAM, 2
      relatively old hard disks (~60MB/s write on NFS). Network is
      1x1Gbit on each node, all on the same HP 1gbit switch.<br>
      <br>
      Although a work-around, maybe putting a sleep 1 could help some
      users while not being noticeable for the rest?<br>
      <br>
      Cheers<br>
      Eneko<br>
      <br>
      <br>
      On 13/10/14 15:04, Eneko Lacunza wrote:<br>
    </div>
    <blockquote cite="mid:543BCDF0.7000403@binovo.es" type="cite">
      <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
      <div class="moz-cite-prefix">Just tried moving a VM WS2008R2 with
        virtio v74 from local storage to NFS (2 different servers) and
        RBD, all failed.<br>
        <br>
        Does anyone with PVE 3.3 have working online storage migration
        with Windows guests and virtio?<br>
        <br>
        Thanks<br>
        Eneko<br>
        <br>
        On 13/10/14 11:29, Eneko Lacunza wrote:<br>
      </div>
      <blockquote cite="mid:543B9B95.4050704@binovo.es" type="cite">
        <meta content="text/html; charset=utf-8"
          http-equiv="Content-Type">
        <div class="moz-cite-prefix">I have tried with virtio v74, but
          it also fails. All failures so far with WS2012R2, Debian8beta2
          works ok. I'm trying with WS2008R2 now.<br>
          <br>
          On 10/10/14 20:41, Eneko Lacunza wrote:<br>
        </div>
        <blockquote
cite="mid:CAMWpibitaGiRkCmOed_0z6wXWesuKAFJPTO_gxBBKEBSxA03GA@mail.gmail.com"
          type="cite">
          <p>I think problem is windows virtio v81. Debian 8beta has
            worked ok; I will do further tests on monday.</p>
          <div class="gmail_quote">El 10/10/2014 17:49, "Luis G.
            Coralle" <<a moz-do-not-send="true"
              href="mailto:luiscoralle@fi.uncoma.edu.ar">luiscoralle@fi.uncoma.edu.ar</a>>


            escribió:<br type="attribution">
            <blockquote class="gmail_quote" style="margin:0 0 0
              .8ex;border-left:1px #ccc solid;padding-left:1ex">
              <div dir="ltr">Removing snapshots?</div>
              <div class="gmail_extra"><br>
                <div class="gmail_quote">2014-10-10 8:36 GMT-03:00 Eneko
                  Lacunza <span dir="ltr"><<a moz-do-not-send="true"
                      href="mailto:elacunza@binovo.es" target="_blank">elacunza@binovo.es</a>></span>:<br>
                  <blockquote class="gmail_quote" style="margin:0 0 0
                    .8ex;border-left:1px #ccc solid;padding-left:1ex">
                    <div bgcolor="#FFFFFF" text="#000000">
                      <div><br>
                        Yes doing it with VM off works, but I can't make
                        it work with VMs on. It used to work in 3.2 and
                        before, something must be broken.
                        <div>
                          <div><br>
                            <br>
                            On 10/10/14 13:27, Luis G. Coralle wrote:<br>
                          </div>
                        </div>
                      </div>
                      <div>
                        <div>
                          <blockquote type="cite">
                            <div dir="ltr">In some cases the same,
                              migrating a hard drive from a remote
                              storage to a local one.
                              <div>I fix this turning off the vm</div>
                            </div>
                            <div class="gmail_extra"><br>
                              <div class="gmail_quote">2014-10-10 7:37
                                GMT-03:00 Eneko Lacunza <span dir="ltr"><<a
                                    moz-do-not-send="true"
                                    href="mailto:elacunza@binovo.es"
                                    target="_blank">elacunza@binovo.es</a>></span>:<br>
                                <blockquote class="gmail_quote"
                                  style="margin:0 0 0
                                  .8ex;border-left:1px #ccc
                                  solid;padding-left:1ex">Hi all,<br>
                                  <br>
                                  I tried local to RBD storage migration
                                  with VM running, and it fails like it
                                  does with NFS:<br>
                                  <br>
                                  transferred: 53687091200 bytes
                                  remaining: 0 bytes total: 53687091200
                                  bytes progression: 100.00 %<br>
                                  Removing all snapshots: 100%
                                  complete...done.<br>
                                  image has watchers - not removing<br>
                                  Removing image: 0% complete...failed.<br>
                                  rbd: error: image still has watchers<br>
                                  TASK ERROR: storage migration failed:
                                  mirroring error: VM 103 qmp command
                                  'block-job-complete' failed - The
                                  active block job for device
                                  'drive-virtio0' cannot be completed<br>
                                  <br>
                                  I noticed that during migration HTML5
                                  console's key drop-down menu doesn't
                                  work (VM doesn't receive keys).<br>
                                  <br>
                                  # pveversion -v<br>
                                  proxmox-ve-2.6.32: 3.3-138 (running
                                  kernel: 2.6.32-33-pve)<br>
                                  pve-manager: 3.3-2 (running version:
                                  3.3-2/995e687e)<br>
                                  pve-kernel-2.6.32-32-pve: 2.6.32-136<br>
                                  pve-kernel-2.6.32-33-pve: 2.6.32-138<br>
                                  lvm2: 2.02.98-pve4<br>
                                  clvm: 2.02.98-pve4<br>
                                  corosync-pve: 1.4.7-1<br>
                                  openais-pve: 1.1.4-3<br>
                                  libqb0: 0.11.1-2<br>
                                  redhat-cluster-pve: 3.2.0-2<br>
                                  resource-agents-pve: 3.9.2-4<br>
                                  fence-agents-pve: 4.0.10-1<br>
                                  pve-cluster: 3.0-15<br>
                                  qemu-server: 3.1-35<br>
                                  pve-firmware: 1.1-3<br>
                                  libpve-common-perl: 3.0-19<br>
                                  libpve-access-control: 3.0-15<br>
                                  libpve-storage-perl: 3.0-23<br>
                                  pve-libspice-server1: 0.12.4-3<br>
                                  vncterm: 1.1-8<br>
                                  vzctl: 4.0-1pve6<br>
                                  vzprocps: 2.0.11-2<br>
                                  vzquota: 3.1-2<br>
                                  pve-qemu-kvm: 2.1-9<br>
                                  ksm-control-daemon: 1.1-1<br>
                                  glusterfs-client: 3.5.2-1<br>
                                  <br>
                                  Is storage migration working for you
                                  in PVE 3.3?<br>
                                  <br>
                                  Cheers<span><font color="#888888"><br>
                                      Eneko<br>
                                      <br>
                                      -- <br>
                                      Zuzendari Teknikoa / Director
                                      Técnico<br>
                                      Binovo IT Human Project, S.L.<br>
                                      Telf. <a moz-do-not-send="true"
                                        href="tel:943575997"
                                        value="+34943575997"
                                        target="_blank">943575997</a><br>
                                            <a moz-do-not-send="true"
                                        href="tel:943493611"
                                        value="+34943493611"
                                        target="_blank">943493611</a><br>
                                      Astigarraga bidea 2, planta 6
                                      dcha., ofi. 3-2; 20180 Oiartzun
                                      (Gipuzkoa)<br>
                                      <a moz-do-not-send="true"
                                        href="http://www.binovo.es"
                                        target="_blank">www.binovo.es</a><br>
                                      <br>
_______________________________________________<br>
                                      pve-user mailing list<br>
                                      <a moz-do-not-send="true"
                                        href="mailto:pve-user@pve.proxmox.com"
                                        target="_blank">pve-user@pve.proxmox.com</a><br>
                                      <a moz-do-not-send="true"
                                        href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user"
                                        target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
                                    </font></span></blockquote>
                              </div>
                              <br>
                              <br clear="all">
                              <div><br>
                              </div>
                              -- <br>
                              Luis G. Coralle<br>
                            </div>
                          </blockquote>
                          <br>
                          <br>
                          <pre cols="72">-- 
Zuzendari Teknikoa / Director Técnico
Binovo IT Human Project, S.L.
Telf. <a moz-do-not-send="true" href="tel:943575997" value="+34943575997" target="_blank">943575997</a>
      <a moz-do-not-send="true" href="tel:943493611" value="+34943493611" target="_blank">943493611</a>
Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
<a moz-do-not-send="true" href="http://www.binovo.es" target="_blank">www.binovo.es</a></pre>
                        </div>
                      </div>
                    </div>
                    <br>
                    _______________________________________________<br>
                    pve-user mailing list<br>
                    <a moz-do-not-send="true"
                      href="mailto:pve-user@pve.proxmox.com"
                      target="_blank">pve-user@pve.proxmox.com</a><br>
                    <a moz-do-not-send="true"
                      href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user"
                      target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
                    <br>
                  </blockquote>
                </div>
                <br>
                <br clear="all">
                <div><br>
                </div>
                -- <br>
                Luis G. Coralle<br>
              </div>
            </blockquote>
          </div>
        </blockquote>
        <br>
        <br>
        <pre class="moz-signature" cols="72">-- 
Zuzendari Teknikoa / Director Técnico
Binovo IT Human Project, S.L.
Telf. 943575997
      943493611
Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="http://www.binovo.es">www.binovo.es</a></pre>
      </blockquote>
      <br>
      <br>
      <pre class="moz-signature" cols="72">-- 
Zuzendari Teknikoa / Director Técnico
Binovo IT Human Project, S.L.
Telf. 943575997
      943493611
Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="http://www.binovo.es">www.binovo.es</a></pre>
    </blockquote>
    <br>
    <br>
    <pre class="moz-signature" cols="72">-- 
Zuzendari Teknikoa / Director Técnico
Binovo IT Human Project, S.L.
Telf. 943575997
      943493611
Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
<a class="moz-txt-link-abbreviated" href="http://www.binovo.es">www.binovo.es</a></pre>
  </body>
</html>