[PVE-User] Impossible to create two nodes cluster.

[Angel Docampo]

Everytime I need to create a cluster in proxmox I suffer a bit PITA. But
now I simply can't do it. I've reinstalled several times and deleted and
recreated the cluster again and again. No luck.

Multicast does not work in this network, so I used unicast. There are
another proxmox cluster in the same network and it's working (it was
very painfull also to install, but once I realized the problem was
unicast and the mtu size, it works very well, except when adding a node,
that always is another pain).

So, I would like to explain how I'm doing this and perhaps I'm pretty
obfuscated to see what is happening.

I've installed two debian 7.1, LVM partitions (not necessary, but I did
it anyway), and installed proxmox. The servers works as expected separately.

The server p01 have the IP: 192.168.200.197
The server p02 have the IP: 192.168.201.191

The two networks are visible each other, and as cluster protocol is udp,
it should work. Am I wrong?

Then on p01, I've created the cluster with "pvecm create testcluster",
it worked
I've copied /etc/pve/cluster.conf to /etc/pve/cluster.conf.new,
increased the version number and add transport="udpu" to the cman
section and added the section <totem netmtu="1400" /> (I tried without
it also). Then I've activated the new configuration throught the GUI.

I've double checked /etc/hosts to assure they resolve the names through
this mechanism.

Then on p02 I tried to add the node with "pvecm add p01" (also tried
with IP and also tried this command from p01, both with hostname and IP
of the p02 node).

root at p02:~# pvecm add p01
root at p01's
password:

copy corosync auth
key
stopping pve-cluster
service
Stopping pve cluster filesystem:
pve-cluster.
backup old
database

Starting pve cluster filesystem :
pve-cluster.
Starting
cluster:

   Checking if cluster has been disabled at boot... [  OK
]
   Checking Network Manager... [  OK
]
   Global setup... [  OK
]
   Loading kernel modules... [  OK
]
   Mounting configfs... [  OK
]
   Starting cman... [  OK
]
   Waiting for quorum...
[FAILED]
   Waiting for quorum...

Well, it never works. The node waits for a quorum forever. I can see the
p02 node on the p01 GUI (with a red light), but I have no access.
If I run:
root at p01:~# pvecm status
Version: 6.2.0
Config Version: 2
Cluster Name: testcluster
Cluster Id: 692
Cluster Member: Yes
Cluster Generation: 1276
Membership state: Cluster-Member
Nodes: 1
Expected votes: 1
Total votes: 1
Node votes: 1
Quorum: 1
Active subsystems: 5
Flags:
Ports Bound: 0
Node name: p01
Node ID: 1
Multicast addresses: 239.192.2.182
Node addresses: 192.168.200.197

root at p02:~# pvecm status
Version: 6.2.0
Config Version: 2
Cluster Name: testcluster
Cluster Id: 692
Cluster Member: Yes
Cluster Generation: 24
Membership state: Cluster-Member
Nodes: 1
Expected votes: 2
Total votes: 1
Node votes: 1
Quorum: 2 Activity blocked
Active subsystems: 1
Flags:
Ports Bound: 0
Node name: p02
Node ID: 2
Multicast addresses: 239.192.2.182
Node addresses: 192.168.201.191

root at p01:~# pvecm nodes
Node  Sts   Inc   Joined                        Name
   1   M   1276   2013-09-26 13:02:19  p01
   2   X      0                                          p02

root at p02:~# pvecm nodes
Node  Sts   Inc   Joined                      Name
   1   X      0                                        p01
   2   M     24   2013-09-26 13:04:02  p02

And trying to access from p01 GUI to the local resources of p02, Appears
the message "can't open '/etc/pve/authkey.pub' - No such file or
directory (401)" As the /etc/pve/ mountpoint on p02 is a) read only and
b) not the same than p01 (i.e: on p01 there are more files), and
/etc/pve/authkey.pub is not in p02.

Some help is very appretiated
Regards,

--
Angel Docampo


Nota Legal<http://www.dltec.net/notalegal.html>