[PVE-User] Ceph: PANIC or DON'T PANIC? ;-)

[Marco Gaiarin]

Mandi! Alwin Antreich
  In chel di` si favelave...

> What did the full ceph status show?

Do you mean 'ceph status'? I've not saved it, but was OK, as now:

 root at thor:~# ceph status
    cluster 8794c124-c2ec-4e81-8631-742992159bd6
     health HEALTH_OK
     monmap e4: 4 mons at {0=10.27.251.7:6789/0,1=10.27.251.8:6789/0,2=10.27.251.11:6789/0,3=10.27.251.12:6789/0}
            election epoch 94, quorum 0,1,2,3 0,1,2,3
     osdmap e114: 6 osds: 6 up, 6 in
      pgmap v2524432: 768 pgs, 3 pools, 944 GB data, 237 kobjects
            1874 GB used, 7435 GB / 9310 GB avail
                 768 active+clean
  client io 7693 B/s rd, 302 kB/s wr, 65 op/s


> Did you add all the monitors to your storage config in proxmox?
> A client is speaking to the monitor first to get the proper maps and then connects to the OSDs. The storage would not be
> available if you only have one monitor configured on the storage tab in proxmox and that mon would be not avialable (eg.
> 1 mons down).

I've currently 4 nodes in my cluster: all node are pve clusterized, 2
are cpu only (ceph mon), 2 (and one more to come) storage node
(mon+osd(s)).

Yes, i've not changed the storage configuration, and when the CPU nodes
started at least the two storage nodes where online.


> Did you configure timesyncd properly?
> On reboot the time has to be synced by the host, so all ceph hosts share the same time. The ceph map updates require the
> proper time, so every host knows which map is the current one.

Now, yes. As stated, i've had configured with only a NTP server that was
a VM in the same cluster; now, they use two NTP server, one remote.

Fixed the ntp server, servers get in sync, ceph status got OK but mons
does not start to peers themself ('pgmap' logs).


Thanks.

-- 
dott. Marco Gaiarin				        GNUPG Key ID: 240A3D66
  Associazione ``La Nostra Famiglia''          http://www.lanostrafamiglia.it/
  Polo FVG   -   Via della Bontà, 7 - 33078   -   San Vito al Tagliamento (PN)
  marco.gaiarin(at)lanostrafamiglia.it   t +39-0434-842711   f +39-0434-842797

		Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA!
    http://www.lanostrafamiglia.it/25/index.php/component/k2/item/123
	(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)