[PVE-User] Question about Proxmox HA

Leslie-Alexandre DENIS infoslad at gmail.com
Sat Dec 7 17:52:55 CET 2013


Hi everybody,

Just to say, I'm currently building a HA topology that consists of 3 
nodes, one NFS or iSCSI filer and 2 hypervisors with HA capability.
All of my experiments are far from finished but I can understand the 
Gilberto's point of view regarding fencing vs scripting plus manual tasks.
You can consider to "fence" in a semi-auto way with fping and L2/L3 
probes if you don't have all the hardware necessary to fence correctly.
The result is almost the same if you do it correctly.

I'll let you know how I had setup my HA after my labs tests.

PS : concerning the NFS storage, you might want to virtualize some 
FreenNAS or custom SAN software solution on top of ZFS and replicate the 
data to another VM.
I would love to hear some feedbacks about that type of solution because 
It adds some SPOF to the topology.

Kind regards,
Le 07/12/2013 16:53, Gilberto Nunes a écrit :
> No... No DRBD at all...
>
> I lead here with two server and plus one, as a NFS shared storage....
>
>
>
>
> 2013/12/7 David Thompson <david at digitaltransitions.ca 
> <mailto:david at digitaltransitions.ca>>
>
>     Ok, I can see how that might work. I still don't see how its
>     beneficial if you have to circumvent the technology built into the
>     server such as running other scripts to get it up and running
>     manually.
>     Thanks for the information. I'm still curious to hear from others
>     who run this type of solution.
>
>     I take it you are running this on a 2 node cluster with DRBD then
>     correct? Still trying to wrap my head all around the world of high
>     availability and how to best address this type of solution.
>
>     I like proxmox far more than other solutions, especially for the
>     fact that its Open Sourced and unlike proprietary solutions, has
>     zero / no hooks that lead anything back to the NSA unless I am
>     mistaken.
>
>
>
>     David
>
>
>
>
>     On Dec 7, 2013, at 10:07 AM, Gilberto Nunes
>     <gilberto.nunes32 at gmail.com <mailto:gilberto.nunes32 at gmail.com>>
>     wrote:
>
>>     Hi David
>>
>>     Thanks for your response...
>>
>>     I think that the mainly goal is exclude the fence device from two
>>     node plus Storage, and to keep the things more flexible and more
>>     simple...
>>
>>     On the other hand, there's a lot of script settings that we can
>>     handle to bring the VM on line quickly as possible.
>>
>>     So, some of us, wants keep the scenario more simple as possible
>>     and, if Proxmox can work without hardware fence, for me is much
>>     better, because it will be easier to explain to a possible
>>     customer, how many hardware they need to acquire... No special
>>     hardware like fence...
>>
>>     Well.... At least for me, it's great....
>>
>>
>>     Thanks for other friends that response this thread...
>>
>>     Cheers
>>
>>
>>     2013/12/6 David Thompson<david at digitaltransitions.ca
>>     <mailto:david at digitaltransitions.ca>>
>>
>>         I can't understand why one would build a HA cluster without
>>         fencing. I've just finished building a HA cluster myself with
>>         IPMI fencing and I see the fencing section as being the
>>         pivotal point for the whole setup to work properly.
>>
>>         I can only assume that if your node(s) go down, then they
>>         stay down and you have to manually interject and power them
>>         up. Correct?
>>
>>         Perhaps for a testing environment it might do, but if you're
>>         testing a system to deploy in production, wouldn't one want
>>         to have the base (perhaps not production hardware), but at a
>>         minimum the type of same software you'd want to use? In this
>>         case IPMI enabled fencing, NFS backend storage, and proxmox
>>         servers clustered? ---> Or something of similar abilities.
>>
>>         the fence_ipmilan section with the "power_wait" option seems
>>         to be the crux that holds this all together efficiently, at
>>         least for those who are using ipmi for fencing.
>>
>>         Sorry, not trying to sound sarcastic and I apologize if I do,
>>         just trying to figure out why one would build a system
>>         without the security that fencing provides to HA for failover
>>         with the added ability to bring servers back online
>>         automatically... Perhaps you or someone else here can explain
>>         this more to me as to why one would do this. Just trying to
>>         get a good solid grasp on HA clusters and different
>>         configurations that can be done with them.
>>
>>         Thanks,
>>
>>         David
>>
>>         On Dec 6, 2013, at 3:23 PM, Gilberto Nunes
>>         <gilberto.nunes32 at gmail.com
>>         <mailto:gilberto.nunes32 at gmail.com>> wrote:
>>
>>>         I meant: I get it!!!
>>>
>>>         That's work pretty awsome!!!
>>>
>>>
>>>         2013/11/10 Gilberto Nunes<gilberto.nunes32 at gmail.com
>>>         <mailto:gilberto.nunes32 at gmail.com>>
>>>
>>>             That's cool ahmad...
>>>
>>>             I will try it as soon as I can...
>>>
>>>             Thanks
>>>
>>>
>>>             2013/11/10 ahmad imanudin<ahmadiman1126 at gmail.com
>>>             <mailto:ahmadiman1126 at gmail.com>>
>>>
>>>
>>>                     ----------------------------------------------------------------------
>>>
>>>                     Message: 1
>>>                     Date: Fri, 8 Nov 2013 11:40:58 -0200
>>>                     From: Gilberto Nunes <gilberto.nunes32 at gmail.com
>>>                     <mailto:gilberto.nunes32 at gmail.com>>
>>>                     To:pve-user at pve.proxmox.com
>>>                     <mailto:pve-user at pve.proxmox.com>
>>>                     Subject: [PVE-User] Question about Proxmox HA
>>>                     Message-ID:
>>>                     <CAOKSTBt9Qr05nRKnYpEX2ksQjLL0D_JabRoDYy4N3NUEgs3i6Q at mail.gmail.com
>>>                     <mailto:CAOKSTBt9Qr05nRKnYpEX2ksQjLL0D_JabRoDYy4N3NUEgs3i6Q at mail.gmail.com>>
>>>                     Content-Type: text/plain; charset=ISO-8859-1
>>>
>>>
>>>                     Hello
>>>
>>>                     We have here a cluster created with 3 nodes and
>>>                     a simple storage...
>>>                     It's just to test porposes...
>>>                     There is no fence devices, for now.
>>>                     After setting up all Proxmox Hosts and VM's,
>>>                     when I turn off a VM on
>>>                     node1, for example, the VM is started on node2.
>>>                     But when I plugged off the network cable, the
>>>                     some doesn't happen!
>>>
>>>                     Why? Because the cluster is without fence device??
>>>
>>>                     Thanks...
>>>
>>>
>>>                 Hi Gilberto,
>>>
>>>                 I Have been testing Proxmox HA without fencing
>>>                 device and works. I test with 2 nodes Proxmox
>>>                 but have not tried with 3 nodes. I also posting in
>>>                 my blog about howto :
>>>                 http://ahmad.imanudin.com/2013/08/18/tips-proxmox-configure-proxmox-high-availability-without-fencing-device/ with
>>>                 indonesian language :D
>>>
>>>                 This is my Cluster configuration
>>>                 *************************************
>>>                 cp /etc/pve/cluster.conf /etc/pve/cluster.conf.new
>>>                 nano /etc/pve/cluster.conf.new
>>>
>>>                 /<?xml version="1.0"?>/
>>>                 /<cluster config_version="5" name="*excellent*">/
>>>                 /<cman expected_votes="1"
>>>                 keyfile="/var/lib/pve-cluster/corosync.authkey"*two_node*="1"/>/
>>>                 /<fencedevices>/
>>>                 /<fencedevice agent="fence_manual" name="human"/>/
>>>                 /</fencedevices>/
>>>                 /<clusternodes>/
>>>                 /<clusternode name="*pve1*" nodeid="1" votes="1">/
>>>                 /<fence>/
>>>                 /<method name="single">/
>>>                 /<device name="human" nodename="*pve1*"/>/
>>>                 /</method>/
>>>                 /</fence>/
>>>                 /</clusternode>/
>>>                 /<clusternode name="*pve2*" nodeid="2" votes="1">/
>>>                 /<fence>/
>>>                 /<method name="single">/
>>>                 /<device name="human" nodename="*pve2*"/>/
>>>                 /</method>/
>>>                 /</fence>/
>>>                 /</clusternode>/
>>>                 /</clusternodes>/
>>>                 /</cluster>/
>>>
>>>                 Note :
>>>                 excellent = My Cluster name
>>>                 pve1 = Hostname for Proxmox 1 (node 1)
>>>                 pve2 = Hostname for Proxmox 2 (node 2)
>>>
>>>                 Importan : You must edit config_version every change
>>>                 cluster configuration.
>>>
>>>                 Next you can configure VM with clue from here :
>>>                 http://pve.proxmox.com/wiki/High_Availability_Cluster and
>>>                 try to power off host Proxmox.
>>>                 Example :
>>>
>>>                 I have VM running on Proxmox 1 (node1) and have been
>>>                 configured HA. Forced off node 1 and run this
>>>                 command from node 2 to take over VM
>>>
>>>                 fence_ack_manual pve1 (pve1 is hostname node 1)
>>>
>>>                 after that, you must confirm with answer /absolutely/
>>>                 /
>>>                 /
>>>                 Thanks
>>>
>>>                 -- 
>>>
>>>
>>>                 **
>>>                 Best Regards,
>>>
>>>
>>>                 Ahmad Imanudin -  Sharing is Beautiful !
>>>                 Web : http://ahmad.imanudin.com
>>>                 <http://ahmad.imanudin.com/>, YM : ahmad_imanudin
>>>                 FB :http://facebook.com/imanudin11 Twitter :
>>>                 @ahmad_9111
>>>
>>>                 _______________________________________________
>>>                 pve-user mailing list
>>>                 pve-user at pve.proxmox.com
>>>                 <mailto:pve-user at pve.proxmox.com>
>>>                 http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>
>>>
>>>
>>>
>>>             --
>>>             Gilberto Ferreira
>>>
>>>
>>>
>>>
>>>         --
>>>         Gilberto Ferreira
>>>         _______________________________________________
>>>         pve-user mailing list
>>>         pve-user at pve.proxmox.com <mailto:pve-user at pve.proxmox.com>
>>>         http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>
>>
>>
>>
>>     --
>>     Gilberto Ferreira
>
>
>
>
> -- 
> Gilberto Ferreira
>
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://pve.proxmox.com/pipermail/pve-user/attachments/20131207/9a6acbfe/attachment-0015.html>


More information about the pve-user mailing list