[PVE-User] Question about Proxmox HA
Leslie-Alexandre DENIS
infoslad at gmail.com
Sat Dec 7 17:52:55 CET 2013
Hi everybody,
Just to say, I'm currently building a HA topology that consists of 3
nodes, one NFS or iSCSI filer and 2 hypervisors with HA capability.
All of my experiments are far from finished but I can understand the
Gilberto's point of view regarding fencing vs scripting plus manual tasks.
You can consider to "fence" in a semi-auto way with fping and L2/L3
probes if you don't have all the hardware necessary to fence correctly.
The result is almost the same if you do it correctly.
I'll let you know how I had setup my HA after my labs tests.
PS : concerning the NFS storage, you might want to virtualize some
FreenNAS or custom SAN software solution on top of ZFS and replicate the
data to another VM.
I would love to hear some feedbacks about that type of solution because
It adds some SPOF to the topology.
Kind regards,
Le 07/12/2013 16:53, Gilberto Nunes a écrit :
> No... No DRBD at all...
>
> I lead here with two server and plus one, as a NFS shared storage....
>
>
>
>
> 2013/12/7 David Thompson <david at digitaltransitions.ca
> <mailto:david at digitaltransitions.ca>>
>
> Ok, I can see how that might work. I still don't see how its
> beneficial if you have to circumvent the technology built into the
> server such as running other scripts to get it up and running
> manually.
> Thanks for the information. I'm still curious to hear from others
> who run this type of solution.
>
> I take it you are running this on a 2 node cluster with DRBD then
> correct? Still trying to wrap my head all around the world of high
> availability and how to best address this type of solution.
>
> I like proxmox far more than other solutions, especially for the
> fact that its Open Sourced and unlike proprietary solutions, has
> zero / no hooks that lead anything back to the NSA unless I am
> mistaken.
>
>
>
> David
>
>
>
>
> On Dec 7, 2013, at 10:07 AM, Gilberto Nunes
> <gilberto.nunes32 at gmail.com <mailto:gilberto.nunes32 at gmail.com>>
> wrote:
>
>> Hi David
>>
>> Thanks for your response...
>>
>> I think that the mainly goal is exclude the fence device from two
>> node plus Storage, and to keep the things more flexible and more
>> simple...
>>
>> On the other hand, there's a lot of script settings that we can
>> handle to bring the VM on line quickly as possible.
>>
>> So, some of us, wants keep the scenario more simple as possible
>> and, if Proxmox can work without hardware fence, for me is much
>> better, because it will be easier to explain to a possible
>> customer, how many hardware they need to acquire... No special
>> hardware like fence...
>>
>> Well.... At least for me, it's great....
>>
>>
>> Thanks for other friends that response this thread...
>>
>> Cheers
>>
>>
>> 2013/12/6 David Thompson<david at digitaltransitions.ca
>> <mailto:david at digitaltransitions.ca>>
>>
>> I can't understand why one would build a HA cluster without
>> fencing. I've just finished building a HA cluster myself with
>> IPMI fencing and I see the fencing section as being the
>> pivotal point for the whole setup to work properly.
>>
>> I can only assume that if your node(s) go down, then they
>> stay down and you have to manually interject and power them
>> up. Correct?
>>
>> Perhaps for a testing environment it might do, but if you're
>> testing a system to deploy in production, wouldn't one want
>> to have the base (perhaps not production hardware), but at a
>> minimum the type of same software you'd want to use? In this
>> case IPMI enabled fencing, NFS backend storage, and proxmox
>> servers clustered? ---> Or something of similar abilities.
>>
>> the fence_ipmilan section with the "power_wait" option seems
>> to be the crux that holds this all together efficiently, at
>> least for those who are using ipmi for fencing.
>>
>> Sorry, not trying to sound sarcastic and I apologize if I do,
>> just trying to figure out why one would build a system
>> without the security that fencing provides to HA for failover
>> with the added ability to bring servers back online
>> automatically... Perhaps you or someone else here can explain
>> this more to me as to why one would do this. Just trying to
>> get a good solid grasp on HA clusters and different
>> configurations that can be done with them.
>>
>> Thanks,
>>
>> David
>>
>> On Dec 6, 2013, at 3:23 PM, Gilberto Nunes
>> <gilberto.nunes32 at gmail.com
>> <mailto:gilberto.nunes32 at gmail.com>> wrote:
>>
>>> I meant: I get it!!!
>>>
>>> That's work pretty awsome!!!
>>>
>>>
>>> 2013/11/10 Gilberto Nunes<gilberto.nunes32 at gmail.com
>>> <mailto:gilberto.nunes32 at gmail.com>>
>>>
>>> That's cool ahmad...
>>>
>>> I will try it as soon as I can...
>>>
>>> Thanks
>>>
>>>
>>> 2013/11/10 ahmad imanudin<ahmadiman1126 at gmail.com
>>> <mailto:ahmadiman1126 at gmail.com>>
>>>
>>>
>>> ----------------------------------------------------------------------
>>>
>>> Message: 1
>>> Date: Fri, 8 Nov 2013 11:40:58 -0200
>>> From: Gilberto Nunes <gilberto.nunes32 at gmail.com
>>> <mailto:gilberto.nunes32 at gmail.com>>
>>> To:pve-user at pve.proxmox.com
>>> <mailto:pve-user at pve.proxmox.com>
>>> Subject: [PVE-User] Question about Proxmox HA
>>> Message-ID:
>>> <CAOKSTBt9Qr05nRKnYpEX2ksQjLL0D_JabRoDYy4N3NUEgs3i6Q at mail.gmail.com
>>> <mailto:CAOKSTBt9Qr05nRKnYpEX2ksQjLL0D_JabRoDYy4N3NUEgs3i6Q at mail.gmail.com>>
>>> Content-Type: text/plain; charset=ISO-8859-1
>>>
>>>
>>> Hello
>>>
>>> We have here a cluster created with 3 nodes and
>>> a simple storage...
>>> It's just to test porposes...
>>> There is no fence devices, for now.
>>> After setting up all Proxmox Hosts and VM's,
>>> when I turn off a VM on
>>> node1, for example, the VM is started on node2.
>>> But when I plugged off the network cable, the
>>> some doesn't happen!
>>>
>>> Why? Because the cluster is without fence device??
>>>
>>> Thanks...
>>>
>>>
>>> Hi Gilberto,
>>>
>>> I Have been testing Proxmox HA without fencing
>>> device and works. I test with 2 nodes Proxmox
>>> but have not tried with 3 nodes. I also posting in
>>> my blog about howto :
>>> http://ahmad.imanudin.com/2013/08/18/tips-proxmox-configure-proxmox-high-availability-without-fencing-device/ with
>>> indonesian language :D
>>>
>>> This is my Cluster configuration
>>> *************************************
>>> cp /etc/pve/cluster.conf /etc/pve/cluster.conf.new
>>> nano /etc/pve/cluster.conf.new
>>>
>>> /<?xml version="1.0"?>/
>>> /<cluster config_version="5" name="*excellent*">/
>>> /<cman expected_votes="1"
>>> keyfile="/var/lib/pve-cluster/corosync.authkey"*two_node*="1"/>/
>>> /<fencedevices>/
>>> /<fencedevice agent="fence_manual" name="human"/>/
>>> /</fencedevices>/
>>> /<clusternodes>/
>>> /<clusternode name="*pve1*" nodeid="1" votes="1">/
>>> /<fence>/
>>> /<method name="single">/
>>> /<device name="human" nodename="*pve1*"/>/
>>> /</method>/
>>> /</fence>/
>>> /</clusternode>/
>>> /<clusternode name="*pve2*" nodeid="2" votes="1">/
>>> /<fence>/
>>> /<method name="single">/
>>> /<device name="human" nodename="*pve2*"/>/
>>> /</method>/
>>> /</fence>/
>>> /</clusternode>/
>>> /</clusternodes>/
>>> /</cluster>/
>>>
>>> Note :
>>> excellent = My Cluster name
>>> pve1 = Hostname for Proxmox 1 (node 1)
>>> pve2 = Hostname for Proxmox 2 (node 2)
>>>
>>> Importan : You must edit config_version every change
>>> cluster configuration.
>>>
>>> Next you can configure VM with clue from here :
>>> http://pve.proxmox.com/wiki/High_Availability_Cluster and
>>> try to power off host Proxmox.
>>> Example :
>>>
>>> I have VM running on Proxmox 1 (node1) and have been
>>> configured HA. Forced off node 1 and run this
>>> command from node 2 to take over VM
>>>
>>> fence_ack_manual pve1 (pve1 is hostname node 1)
>>>
>>> after that, you must confirm with answer /absolutely/
>>> /
>>> /
>>> Thanks
>>>
>>> --
>>>
>>>
>>> **
>>> Best Regards,
>>>
>>>
>>> Ahmad Imanudin - Sharing is Beautiful !
>>> Web : http://ahmad.imanudin.com
>>> <http://ahmad.imanudin.com/>, YM : ahmad_imanudin
>>> FB :http://facebook.com/imanudin11 Twitter :
>>> @ahmad_9111
>>>
>>> _______________________________________________
>>> pve-user mailing list
>>> pve-user at pve.proxmox.com
>>> <mailto:pve-user at pve.proxmox.com>
>>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>
>>>
>>>
>>>
>>> --
>>> Gilberto Ferreira
>>>
>>>
>>>
>>>
>>> --
>>> Gilberto Ferreira
>>> _______________________________________________
>>> pve-user mailing list
>>> pve-user at pve.proxmox.com <mailto:pve-user at pve.proxmox.com>
>>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>
>>
>>
>>
>> --
>> Gilberto Ferreira
>
>
>
>
> --
> Gilberto Ferreira
>
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.proxmox.com/pipermail/pve-user/attachments/20131207/9a6acbfe/attachment.htm>
More information about the pve-user
mailing list