[PVE-User] Change Ceph Public Network

[clayj at n7qnm.net]

I have Promox and Ceph running on 5 servers.  

 

I currently have 2 NICs in each server, a 1Gb NIC that's configured as the
Ceph "public network", 192.168.75.0/24; and a 2.5Gb NIC that's configured as
the Ceph "cluster network, 192.168.70.0/24.   The .75 net is also what
connects the servers to the "rest of the world", including some Synology NAS
servers.

 

I have a 1Tb SSD drive on 4 of the 5 servers configured as  Ceph OSDs.

 

I'd like to get better performance out of Ceph, so I added a 3rd 2Gb NIC to
each server, 192.168.71.0/24.

 

I took down all my VMs; and in ceph.conf, changed the mon entries and the
public_network entries from 192.168.75.xx to 192.168.71.xx; then did a
"restart ceph-target" on each of the Proxmox servers.

 

That was a complete disaster!   Ceph never came back up and I had to reverse
the process in order to restore.

 

Is there a "correct" way to do this; or did I just miss a step.  Is there a
config file for the OSDs that I need to change?

 

Thanks in advance!

 

Clay Jackson

clayj at n7qnm.net <mailto:clayj at n7qnm.net>