[pve-devel] proxmox3->4 : online upgrade howto

[Alexandre DERUMIER]

Hi,

I have finished to migrate a small 5 nodes cluster from proxmox3 to proxmox4,
using qemu live migration.



Here the howto:

requirements:
-------------
external storage (nfs,ceph).
don't have tested with clvm + iscsi, or local ceph(which should work)


1)Upgrade a first node to proxmox 4.0 and recreate cluster
------------------------------------------------------------ 
Have an empty node, 
then upgrade it to proxmox 4.0, folowing the current wiki


# apt-get update && apt-get dist-upgrade
# apt-get remove proxmox-ve-2.6.32 pve-manager corosync-pve openais-pve redhat-cluster-pve pve-cluster pve-firmware 
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list.d/pve-enterprise.list
# apt-get update
# apt-get install pve-kernel-4.2.2-1-pve
# apt-get dist-upgrade

reboot

# apt-get install proxmox-ve
# apt-get remove pve-kernel-2.6.32-41-pve

# pvecm create <clustername>


2) upgrade second node
----------------------
# apt-get update && apt-get dist-upgrade
# apt-get remove proxmox-ve-2.6.32 pve-manager corosync-pve openais-pve redhat-cluster-pve pve-cluster pve-firmware 
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list
# sed -i 's/wheezy/jessie/g' /etc/apt/sources.list.d/pve-enterprise.list
# apt-get update
# apt-get install pve-kernel-4.2.2-1-pve
# apt-get dist-upgrade


---> here no reboot

# apt-get install proxmox-ve

if, apt return an error like:

"Setting up pve-manager (4.0-48) ...
Failed to get D-Bus connection: Unknown error -1
Failed to get D-Bus connection: Unknown error -1
dpkg: error processing package pve-manager (--configure):
 subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of proxmox-ve:
 proxmox-ve depends on pve-manager; however:
  Package pve-manager is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
 dependency problems - leaving unconfigured
Errors were encountered while processing:"


then,

# touch /proxmox_install_mode
# apt-get install proxmox-ve
# rm /proxmox_install_mode

now the tricky part

mount /etc/pve

# /usr/bin/pmxcfs -l

add node to cluster

# pvecm add ipofnode1 -force

close old corosync and delete old config
# killall -9 corosync
# /etc/init.d/pve-cluster stop
# rm /var/lib/config.db*

start new corosync and pve-cluster

# corosync
# /etc/init.d/pve-cluster start

verify than you can write in /etc/pve/ and that's is correctly replicate on other proxmox4 nodes
#touch /etc/pve/test.txt
#rm /etc/pve/test.txt

migrate vms (do it for each vmid)

# qm migrate <vmid> <target_proxmox4_server> -online

(migrate must do done with cli, because pvestatd can't start without systemd, so gui is not working)


# reboot node

3) do the same thing for next node(s)

4) when all nodes are migrated, remove

# rm /etc/pve/cluster.conf