<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DE" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi all,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I’ve taken over an Proxmox (not live) Cluster with 3 Nodes. I’m also really new in this family, so be patient please. ;-)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Proxmox Version of…<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">- Node 1: 3.0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">- Node 2: 3.0 <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">- Node 3: 3.0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">root@node1:~# pvecm n<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Node Sts Inc Joined Name<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 0 M 0 2013-06-04 12:40:42 /dev/block/8:49<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 1 M 768 2013-06-04 12:40:10 node1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 2 M 780 2013-06-04 13:26:56 node2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 3 M 772 2013-06-04 12:40:10 node3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">root@node2:~# pvecm n<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Node Sts Inc Joined Name<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 1 M 788 2013-06-05 10:27:00 node1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 2 M 784 2013-06-05 10:27:00 node2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 3 M 788 2013-06-05 10:27:00 node3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">root@node3:~# pvecm n<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Node Sts Inc Joined Name<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 1 M 772 2013-06-04 12:40:11 node1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 2 M 780 2013-06-04 13:26:56 node2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> 3 M 760 2013-06-04 12:34:25 node3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">If I try to migrate an CT from Node 2 -> Node 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black;background:white">Jun 05 10:15:22 # /usr/bin/ssh -o 'BatchMode=yes' root@10.162.195.3 /bin/true</span><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black"><br>
<span style="background:white">Jun 05 10:15:22 ssh: connect to host 10.162.195.3 port 22: No route to host</span><br>
<span style="background:white">Jun 05 10:15:22 ERROR: migration aborted (duration 00:00:03): Can't connect to destination address using public key</span><br>
<span style="background:white">TASK ERROR: migration aborted</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I’m able to ssh between all those Nodes, so I don’t know where the problem is.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Another problem which I have:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">If I’m migrate an CT from Node 2 -> Node 1, I’ receiving follow log. The migration works, but the CT stays offline.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black;background:white">Jun 05 10:12:18 starting migration of CT 107 to node 'node1' (10.162.192.1)</span><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black"><br>
<span style="background:white">Jun 05 10:12:18 container is running - using online migration</span><br>
<span style="background:white">Jun 05 10:12:18 container data is on shared storage 'local'</span><br>
<span style="background:white">Jun 05 10:12:18 start live migration - suspending container</span><br>
<span style="background:white">Jun 05 10:12:18 dump container state</span><br>
<span style="background:white">Jun 05 10:12:19 dump 2nd level quota</span><br>
<span style="background:white">Jun 05 10:12:20 initialize container on remote node 'node1'</span><br>
<span style="background:white">Jun 05 10:12:21 initializing remote quota</span><br>
<span style="background:white">Jun 05 10:12:21 turn on remote quota</span><br>
<span style="background:white">Jun 05 10:12:21 load 2nd level quota</span><br>
<span style="background:white">Jun 05 10:12:21 # /usr/bin/ssh -o 'BatchMode=yes' root@10.162.192.1 '(vzdqload 107 -U -G -T < /var/lib/vz/dump/quotadump.107 && vzquota reload2 107)'</span><br>
<span style="background:white">Jun 05 10:12:21 ERROR: online migrate failure - Failed to load 2nd level quota: bash: /var/lib/vz/dump/quotadump.107: No such file or directory</span><br>
<span style="background:white">Jun 05 10:12:21 start final cleanup</span><br>
<span style="background:white">Jun 05 10:12:21 ERROR: migration finished with problems (duration 00:00:04)</span><br>
<span style="background:white">TASK ERROR: migration problems<o:p></o:p></span></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black;background:white"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">If I try to start those CT on Node 1, it’s starting well on Node 2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black;background:white">Starting container ...</span><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black"><br>
<span style="background:white">vzquota : (warning) Quota is running for id 107 already</span><br>
<span style="background:white">Container is mounted</span><br>
<span style="background:white">Adding IP address(es): 10.162.192.19</span><br>
<span style="background:white">Setting CPU units: 1000</span><br>
<span style="background:white">Setting CPUs: 8</span><br>
<span style="background:white">Unable to start init, probably incorrect template</span><br>
<span style="background:white">Container start failed</span><br>
<span style="background:white">Killing container ...</span><br>
<span style="background:white">Container was stopped</span><br>
<span style="background:white">Container is unmounted</span><br>
<span style="background:white">TASK ERROR: command 'vzctl start 107' failed: exit code 47<o:p></o:p></span></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black;background:white"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:8.5pt;font-family:"Tahoma","sans-serif";color:black;background:white"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Any help it’s much appreciated.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Regards<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Markus</span><span lang="EN-US" style="font-size:10.0pt;color:blue;mso-fareast-language:DE">
</span><span style="font-size:10.0pt;color:blue;mso-fareast-language:DE"><o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>