<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta name=Generator content="Microsoft Word 12 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body bgcolor=white lang=EN-GB link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='color:#1F497D'>I think you’re right and I’m assuming that’s the way the process works, but I suppose I’m asking:<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Why does it not enumerate the disks associated with a VM (and only those disks, used and unused), then remove them? Is there a technical reason not to do it that way?<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>e.g. why does:<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>rm /mnt/pve/nfsA/images/113/vm-113-disk-1.raw<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>turn into<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>rm /mnt/pve/nfsA/images/113/vm-113-disk-1.raw<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>rm /mnt/pve/nfsB/images/113/vm-113-disk-1.raw<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>What if a VM had two disks on two separate mountpoints and you remove one of the disks? You’d never expect it to remove the other one.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>It’s probably a good idea not to have two clusters share the same mount on the grounds of confusion and overlapping ID numbers, but deleting files which one cluster technically shouldn’t even know exist doesn’t make much sense to me.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Chris<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext'>From:</span></b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext'> pve-user [mailto:pve-user-bounces@pve.proxmox.com] <b>On Behalf Of </b>Eneko Lacunza<br><b>Sent:</b> 16 October 2014 11:44<br><b>To:</b> pve-user@pve.proxmox.com<br><b>Subject:</b> Re: [PVE-User] Two proxmox clusters sharing same storage<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal>Hi Chris,<br><br>Likely explanation is that when you remove a VM, it looks for all disks (used and unused) on all storages for removal. It is confused because you use the very same export point for both clusters.<br><br>I suggest you use different export points for different clusters, even if on the same FS. If you what to share templates, just hardlink or bind-mount the directory. This will allow you to share the space without confusing Proxmox.<br><br>Cheers<br>Eneko<br><br>On 16/10/14 12:37, Chris Murray wrote:<o:p></o:p></p></div><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><p class=MsoNormal>Hi,<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Can anyone explain why the below happens please and if it’s meant to?<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Suppose I have two clusters.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Cluster #1 uses NFS mount A (and B and C)<o:p></o:p></p><p class=MsoNormal>Cluster #2 uses NFS mount B (and C)<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>On cluster #1, I create a VM with ID 113 on NFS A. Install an OS, all fine.<o:p></o:p></p><p class=MsoNormal>On cluster #2, I create a VM with ID 113 on NFS B. Install an OS, all fine.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Both are working at this point.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>On cluster #1, power down and remove VM 113.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Cluster #2’s VM 113 hangs. Look on NFS B... the virtual disk has disappeared.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Why would the deletion of the VM from cluster #1 affect the disk on NFS B, despite it not being used for that VM? I understand that there’s a mount to B from cluster #1, but the only file it should have deleted was on A.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>I ran into this while migrating from one cluster to another. I was very careful to ensure that I wouldn’t overlap two VMs with one file while I was DD’ing behind the scenes, but still suffered missing files when some of the original VMs were deleted because some old VMs were sharing the same ID numbers as new VMs.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Regards,<o:p></o:p></p><p class=MsoNormal>Chris<o:p></o:p></p><p class=MsoNormal><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><br><br><br><o:p></o:p></span></p><pre>_______________________________________________<o:p></o:p></pre><pre>pve-user mailing list<o:p></o:p></pre><pre><a href="mailto:pve-user@pve.proxmox.com">pve-user@pve.proxmox.com</a><o:p></o:p></pre><pre><a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><o:p></o:p></pre></blockquote><p class=MsoNormal><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><br><br><br><o:p></o:p></span></p><pre>-- <o:p></o:p></pre><pre>Zuzendari Teknikoa / Director Técnico<o:p></o:p></pre><pre>Binovo IT Human Project, S.L.<o:p></o:p></pre><pre>Telf. 943575997<o:p></o:p></pre><pre> 943493611<o:p></o:p></pre><pre>Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)<o:p></o:p></pre><pre><a href="http://www.binovo.es">www.binovo.es</a><o:p></o:p></pre></div></body></html>