<div dir="ltr">Yes... That's sounds good...<div><br></div><div>However, my tests running out in a LG laptop i3 64bits with 4 GB of memory...</div><div>I just run two PVE into VirtualBox and make my laptop act like a NFS storage...</div>

<div>Payful, but for testing purpose, running pretty well...</div><div><br></div><div>Thanks Leslie for you background... Do not forget to keep us updated about your progress</div><div><br></div><div>Cheers...</div></div>

<div class="gmail_extra"><br><br><div class="gmail_quote">2013/12/7 Leslie-Alexandre DENIS <span dir="ltr"><<a href="mailto:infoslad@gmail.com" target="_blank">infoslad@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


  
    
  
  <div text="#000000" bgcolor="#FFFFFF">
    Hi everybody,<br>
    <br>
    Just to say, I'm currently building a HA topology that consists of 3
    nodes, one NFS or iSCSI filer and 2 hypervisors with HA capability.<br>
    All of my experiments are far from finished but I can understand the
    Gilberto's point of view regarding fencing vs scripting plus manual
    tasks.<br>
    You can consider to "fence" in a semi-auto way with fping and L2/L3
    probes if you don't have all the hardware necessary to fence
    correctly.<br>
    The result is almost the same if you do it correctly.<br>
    <br>
    I'll let you know how I had setup my HA after my labs tests.<br>
    <br>
    PS : concerning the NFS storage, you might want to virtualize some
    FreenNAS or custom SAN software solution on top of ZFS and replicate
    the data to another VM.<br>
    I would love to hear some feedbacks about that type of solution
    because It adds some SPOF to the topology.<br>
    <br>
    Kind regards,<br>
    <div>Le 07/12/2013 16:53, Gilberto Nunes a
      écrit :<br>
    </div><div><div class="h5">
    <blockquote type="cite">
      <div dir="ltr">No... No DRBD at all...
        <div><br>
        </div>
        <div>I lead here with two server and plus one, as a NFS shared
          storage....</div>
        <div><br>
        </div>
        <div><br>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <br>
        <div class="gmail_quote">
          2013/12/7 David Thompson <span dir="ltr"><<a href="mailto:david@digitaltransitions.ca" target="_blank">david@digitaltransitions.ca</a>></span><br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div style="word-wrap:break-word">Ok, I can see how that
              might work. I still don’t see how its beneficial if you
              have to circumvent the technology built into the server
              such as running other scripts to get it up and running
              manually. 
              <div>
                Thanks for the information. I’m still curious to hear
                from others who run this type of solution. </div>
              <div><br>
              </div>
              <div>I take it you are running this on a 2 node cluster
                with DRBD then correct? Still trying to wrap my head all
                around the world of high availability and how to best
                address this type of solution.</div>
              <div><br>
              </div>
              <div>I like proxmox far more than other solutions,
                especially for the fact that its Open Sourced and unlike
                proprietary solutions, has zero / no hooks that lead
                anything back to the NSA unless I am mistaken.</div>
              <div><span><font color="#888888"><br>
                    <div>
                      <div>
                        <div><br>
                        </div>
                        <div><br>
                        </div>
                        <div>David</div>
                        <div><br>
                        </div>
                      </div>
                      <div><br>
                      </div>
                      <br>
                    </div>
                  </font></span>
                <div>
                  <div>
                    <br>
                    <div>
                      <div>On Dec 7, 2013, at 10:07 AM, Gilberto Nunes
                        <<a href="mailto:gilberto.nunes32@gmail.com" target="_blank">gilberto.nunes32@gmail.com</a>>
                        wrote:</div>
                      <br>
                      <blockquote type="cite">
                        <div style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">


                          <div dir="ltr">
                            <div>Hi David</div>
                            <div><br>
                            </div>
                            <div>Thanks for your response...</div>
                            <div><br>
                            </div>
                            <div>I think that the mainly goal is exclude
                              the fence device from two node plus
                              Storage, and to keep the things more
                              flexible and more simple...</div>
                            <div><br>
                            </div>
                            <div>On the other hand, there's a lot of
                              script settings that we can handle to
                              bring the VM on line quickly as possible.</div>
                            <div><br>
                            </div>
                            <div>So, some of us, wants keep the scenario
                              more simple as possible and, if Proxmox
                              can work without hardware fence, for me is
                              much better, because it will be easier to
                              explain to a possible customer, how many
                              hardware they need to acquire... No
                              special hardware like fence...</div>
                            <div><br>
                            </div>
                            <div>Well.... At least for me, it's
                              great....</div>
                            <div><br>
                            </div>
                            <div><br>
                            </div>
                            <div>Thanks for other friends that response
                              this thread...</div>
                            <div><br>
                            </div>
                            <div>Cheers</div>
                          </div>
                          <div class="gmail_extra">
                            <br>
                            <br>
                            <div class="gmail_quote">2013/12/6 David
                              Thompson<span> </span><span dir="ltr"><<a href="mailto:david@digitaltransitions.ca" target="_blank">david@digitaltransitions.ca</a>></span><br>
                              <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                                <div style="word-wrap:break-word">I
                                  can’t understand why one would build a
                                  HA cluster without fencing. I’ve just
                                  finished building a HA cluster myself
                                  with IPMI fencing and I see the
                                  fencing section as being the pivotal
                                  point for the whole setup to work
                                  properly.
                                  <div>
                                    <br>
                                  </div>
                                  <div>I can only assume that if your
                                    node(s) go down, then they stay down
                                    and you have to manually interject
                                    and power them up. Correct?</div>
                                  <div><br>
                                  </div>
                                  <div>Perhaps for a testing environment
                                    it might do, but if you’re testing a
                                    system to deploy in production,
                                    wouldn’t one want to have the base
                                    (perhaps not production hardware),
                                    but at a minimum the type of same
                                    software you’d want to use? In this
                                    case IPMI enabled fencing, NFS
                                    backend storage, and proxmox servers
                                    clustered? —> Or something of
                                    similar abilities.</div>
                                  <div><br>
                                  </div>
                                  <div>the fence_ipmilan section with
                                    the “power_wait” option seems to be
                                    the crux that holds this all
                                    together efficiently, at least for
                                    those who are using ipmi for
                                    fencing.</div>
                                  <div><br>
                                  </div>
                                  <div>Sorry, not trying to sound
                                    sarcastic and I apologize if I do,
                                    just trying to figure out why one
                                    would build a system without the
                                    security that fencing provides to HA
                                    for failover with the added ability
                                    to bring servers back online
                                    automatically… Perhaps you or
                                    someone else here can explain this
                                    more to me as to why one would do
                                    this. Just trying to get a good
                                    solid grasp on HA clusters and
                                    different configurations that can be
                                    done with them.</div>
                                  <div><br>
                                  </div>
                                  <div>Thanks,</div>
                                  <div><br>
                                    <div>David</div>
                                    <div>
                                      <div><br>
                                        <div>
                                          <div>On Dec 6, 2013, at 3:23
                                            PM, Gilberto Nunes <<a href="mailto:gilberto.nunes32@gmail.com" target="_blank">gilberto.nunes32@gmail.com</a>>
                                            wrote:</div>
                                          <br>
                                          <blockquote type="cite">
                                            <div dir="ltr">I meant: I
                                              get it!!!
                                              <div><br>
                                              </div>
                                              <div>That's work pretty
                                                awsome!!!</div>
                                            </div>
                                            <div class="gmail_extra"><br>
                                              <br>
                                              <div class="gmail_quote">2013/11/10
                                                Gilberto Nunes<span> </span><span dir="ltr"><<a href="mailto:gilberto.nunes32@gmail.com" target="_blank">gilberto.nunes32@gmail.com</a>></span><br>
                                                <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                                                  <div dir="ltr">That's
                                                    cool ahmad...
                                                    <div><br>
                                                    </div>
                                                    <div>
                                                      I will try it as
                                                      soon as I can...</div>
                                                    <div><br>
                                                    </div>
                                                    <div>Thanks </div>
                                                  </div>
                                                  <div class="gmail_extra"><br>
                                                    <br>
                                                    <div class="gmail_quote">2013/11/10
                                                      ahmad imanudin<span> </span><span dir="ltr"><<a href="mailto:ahmadiman1126@gmail.com" target="_blank">ahmadiman1126@gmail.com</a>></span><br>
                                                      <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                                                        <div>
                                                          <div dir="ltr">
                                                          <div class="gmail_extra">
                                                          <div class="gmail_quote">
                                                          <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">

<br>
----------------------------------------------------------------------<br>
                                                          <br>
                                                          Message: 1<br>
                                                          Date: Fri, 8
                                                          Nov 2013
                                                          11:40:58 -0200<br>
                                                          From: Gilberto
                                                          Nunes <<a href="mailto:gilberto.nunes32@gmail.com" target="_blank">gilberto.nunes32@gmail.com</a>><br>
                                                          To:<span> </span><a href="mailto:pve-user@pve.proxmox.com" target="_blank">pve-user@pve.proxmox.com</a><br>
                                                          Subject:
                                                          [PVE-User]
                                                          Question about
                                                          Proxmox HA<br>
                                                          Message-ID:<br>
                                                                 <span> </span><<a href="mailto:CAOKSTBt9Qr05nRKnYpEX2ksQjLL0D_JabRoDYy4N3NUEgs3i6Q@mail.gmail.com" target="_blank">CAOKSTBt9Qr05nRKnYpEX2ksQjLL0D_JabRoDYy4N3NUEgs3i6Q@mail.gmail.com</a>><br>


                                                          Content-Type:
                                                          text/plain;
                                                          charset=ISO-8859-1
                                                          <div><br>
                                                          <br>
                                                          Hello<br>
                                                          <br>
                                                          We have here a
                                                          cluster
                                                          created with 3
                                                          nodes and a
                                                          simple
                                                          storage...<br>
                                                          It's just to
                                                          test
                                                          porposes...<br>
                                                          There is no
                                                          fence devices,
                                                          for now.<br>
                                                          After setting
                                                          up all Proxmox
                                                          Hosts and
                                                          VM's, when I
                                                          turn off a VM
                                                          on<br>
                                                          node1, for
                                                          example, the
                                                          VM is started
                                                          on node2.<br>
                                                          But when I
                                                          plugged off
                                                          the network
                                                          cable, the
                                                          some doesn't
                                                          happen!<br>
                                                          <br>
                                                          </div>
                                                          <div>Why?
                                                          Because the
                                                          cluster is
                                                          without fence
                                                          device??<br>
                                                          <br>
                                                          </div>
                                                          Thanks...<br>
                                                          </blockquote>
                                                          <div><br>
                                                          </div>
                                                          <div>Hi
                                                          Gilberto,<br>
                                                          </div>
                                                          <div><br>
                                                          </div>
                                                          <div>I Have
                                                          been testing
                                                          Proxmox HA
                                                          without
                                                          fencing device
                                                          and works. I
                                                          test with 2
                                                          nodes Proxmox
                                                          but have not
                                                          tried with 3
                                                          nodes. I also
                                                          posting in my
                                                          blog about
                                                          howto : <a href="http://ahmad.imanudin.com/2013/08/18/tips-proxmox-configure-proxmox-high-availability-without-fencing-device/" target="_blank">http://ahmad.imanudin.com/2013/08/18/tips-proxmox-configure-proxmox-high-availability-without-fencing-device/</a> with
                                                          indonesian
                                                          language :D</div>
                                                          <div><br>
                                                          </div>
                                                          <div>This is
                                                          my Cluster
                                                          configuration</div>
                                                          <div><span>*************************************</span></div>
                                                          <div><span>cp
                                                          /etc/pve/cluster.conf
/etc/pve/cluster.conf.new</span></div>
                                                          <div><span>nano
/etc/pve/cluster.conf.new</span></div>
                                                          <div><span><br>
                                                          </span></div>
                                                          <div>
                                                          <div><font><i><?xml
version="1.0"?></i></font></div>
                                                          <div><font><i><cluster
                                                          config_version="5"
                                                          name="<b>excellent</b>"></i></font></div>
                                                          <div><font><i><cman
                                                          expected_votes="1"
keyfile="/var/lib/pve-cluster/corosync.authkey"<span> </span><b>two_node</b>="1"/></i></font></div>
                                                          <div><font><i><fencedevices></i></font></div>
                                                          <div><font><i><fencedevice
                                                          agent="fence_manual"
name="human"/></i></font></div>
                                                          <div><font><i></fencedevices></i></font></div>
                                                          <div><font><i><clusternodes></i></font></div>
                                                          <div><font><i><clusternode
                                                          name="<b>pve1</b>"
                                                          nodeid="1"
                                                          votes="1"></i></font></div>
                                                          <div><font><i><fence></i></font></div>
                                                          <div><font><i><method
name="single"></i></font></div>
                                                          <div><font><i><device
                                                          name="human"
                                                          nodename="<b>pve1</b>"/></i></font></div>
                                                          <div><font><i></method></i></font></div>
                                                          <div><font><i></fence></i></font></div>
                                                          <div><font><i></clusternode></i></font></div>
                                                          <div><font><i><clusternode
                                                          name="<b>pve2</b>"
                                                          nodeid="2"
                                                          votes="1"></i></font></div>
                                                          <div><font><i><fence></i></font></div>
                                                          <div><font><i><method
name="single"></i></font></div>
                                                          <div><font><i><device
                                                          name="human"
                                                          nodename="<b>pve2</b>"/></i></font></div>
                                                          <div><font><i></method></i></font></div>
                                                          <div><font><i></fence></i></font></div>
                                                          <div><font><i></clusternode></i></font></div>
                                                          <div><font><i></clusternodes></i></font></div>
                                                          <div><font><i></cluster></i></font></div>
                                                          </div>
                                                          <div><br>
                                                          </div>
                                                          <div>Note : </div>
                                                          <div>excellent
                                                          = My Cluster
                                                          name</div>
                                                          <div>pve1 =
                                                          Hostname for
                                                          Proxmox 1
                                                          (node 1)</div>
                                                          <div>pve2 =
                                                          Hostname for
                                                          Proxmox 2
                                                          (node 2)</div>
                                                          <div><br>
                                                          </div>
                                                          <div>Importan
                                                          : You must
                                                          edit
                                                          config_version
                                                          every change
                                                          cluster
                                                          configuration.</div>
                                                          <div><br>
                                                          </div>
                                                          <div>Next you
                                                          can configure
                                                          VM with clue
                                                          from here : <a href="http://pve.proxmox.com/wiki/High_Availability_Cluster" target="_blank">http://pve.proxmox.com/wiki/High_Availability_Cluster</a> and
                                                          try to power
                                                          off host
                                                          Proxmox.</div>
                                                          <div>Example :</div>
                                                          <div><br>
                                                          </div>
                                                          <div>I have VM
                                                          running on
                                                          Proxmox 1
                                                          (node1) and
                                                          have been
                                                          configured HA.
                                                          Forced off
                                                          node 1 and run
                                                          this command
                                                          from node 2 to
                                                          take over VM</div>
                                                          <div><br>
                                                          </div>
                                                          <div>fence_ack_manual
                                                          pve1 (pve1 is
                                                          hostname node
                                                          1)<br>
                                                          </div>
                                                          <div><br>
                                                          </div>
                                                          <div>after
                                                          that, you must
                                                          confirm with
                                                          answer <i>absolutely</i></div>
                                                          <div><i><br>
                                                          </i></div>
                                                          <div>Thanks</div>
                                                          <span><font color="#888888"><br>
                                                          -- <br>
                                                          <div dir="ltr">
                                                          <div><font color="#666666"><br>
                                                          </font></div>
                                                          <div><font color="#666666"><br>
                                                          </font></div>
                                                          <font color="#666666" face="verdana,
                                                          sans-serif">**<br>
                                                          Best Regards,<br>
                                                          <br>
                                                          <br>
                                                          Ahmad Imanudin
                                                          -  Sharing is
                                                          Beautiful !<br>
                                                          Web : <a href="http://ahmad.imanudin.com/" target="_blank">http://ahmad.imanudin.com</a>,
YM : ahmad_imanudin</font></div>
                                                          <div><span style="color:rgb(102,102,102);font-family:verdana,sans-serif">FB
                                                          :</span><span style="color:rgb(102,102,102);font-family:verdana,sans-serif"> </span><a href="http://facebook.com/imanudin11" style="font-family:verdana,sans-serif" target="_blank">http://facebook.com/imanudin11</a><span style="color:rgb(102,102,102);font-family:verdana,sans-serif"> Twitter
                                                          : @ahmad_9111</span> </div>
                                                          </font></span></div>
                                                          </div>
                                                          </div>
                                                          <br>
                                                        </div>
_______________________________________________<br>
                                                        pve-user mailing
                                                        list<br>
                                                        <a href="mailto:pve-user@pve.proxmox.com" target="_blank">pve-user@pve.proxmox.com</a><br>
                                                        <a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
                                                        <br>
                                                      </blockquote>
                                                    </div>
                                                    <span><font color="#888888"><br>
                                                        <br clear="all">
                                                        <div><br>
                                                        </div>
                                                        --<span> </span><br>
                                                        Gilberto
                                                        Ferreira<br>
                                                      </font></span></div>
                                                </blockquote>
                                              </div>
                                              <br>
                                              <br clear="all">
                                              <div><br>
                                              </div>
                                              --<span> </span><br>
                                              Gilberto Ferreira<br>
                                            </div>
_______________________________________________<br>
                                            pve-user mailing list<br>
                                            <a href="mailto:pve-user@pve.proxmox.com" target="_blank">pve-user@pve.proxmox.com</a><br>
                                            <a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
                                          </blockquote>
                                        </div>
                                        <br>
                                      </div>
                                    </div>
                                  </div>
                                </div>
                              </blockquote>
                            </div>
                            <br>
                            <br clear="all">
                            <div><br>
                            </div>
                            --<span> </span><br>
                            Gilberto Ferreira</div>
                        </div>
                      </blockquote>
                    </div>
                    <br>
                  </div>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
        <br clear="all">
        <div><br>
        </div>
        -- <br>
        Gilberto Ferreira<br>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      <pre>_______________________________________________
pve-user mailing list
<a href="mailto:pve-user@pve.proxmox.com" target="_blank">pve-user@pve.proxmox.com</a>
<a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a>
</pre>
    </blockquote>
    <br>
  </div></div></div>

<br>_______________________________________________<br>
pve-user mailing list<br>
<a href="mailto:pve-user@pve.proxmox.com">pve-user@pve.proxmox.com</a><br>
<a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br>Gilberto Ferreira<br>
</div>