[PVE-User] Ceph: PANIC or DON'T PANIC? ;-)

Marco Gaiarin gaio at sv.lnf.it
Mon Nov 28 15:31:41 CET 2016

Mandi! Alwin Antreich
  In chel di` si favelave...

> What did the full ceph status show?

Do you mean 'ceph status'? I've not saved it, but was OK, as now:

 root at thor:~# ceph status
    cluster 8794c124-c2ec-4e81-8631-742992159bd6
     health HEALTH_OK
     monmap e4: 4 mons at {0=,1=,2=,3=}
            election epoch 94, quorum 0,1,2,3 0,1,2,3
     osdmap e114: 6 osds: 6 up, 6 in
      pgmap v2524432: 768 pgs, 3 pools, 944 GB data, 237 kobjects
            1874 GB used, 7435 GB / 9310 GB avail
                 768 active+clean
  client io 7693 B/s rd, 302 kB/s wr, 65 op/s

> Did you add all the monitors to your storage config in proxmox?
> A client is speaking to the monitor first to get the proper maps and then connects to the OSDs. The storage would not be
> available if you only have one monitor configured on the storage tab in proxmox and that mon would be not avialable (eg.
> 1 mons down).

I've currently 4 nodes in my cluster: all node are pve clusterized, 2
are cpu only (ceph mon), 2 (and one more to come) storage node

Yes, i've not changed the storage configuration, and when the CPU nodes
started at least the two storage nodes where online.

> Did you configure timesyncd properly?
> On reboot the time has to be synced by the host, so all ceph hosts share the same time. The ceph map updates require the
> proper time, so every host knows which map is the current one.

Now, yes. As stated, i've had configured with only a NTP server that was
a VM in the same cluster; now, they use two NTP server, one remote.

Fixed the ntp server, servers get in sync, ceph status got OK but mons
does not start to peers themself ('pgmap' logs).


dott. Marco Gaiarin				        GNUPG Key ID: 240A3D66
  Associazione ``La Nostra Famiglia''          http://www.lanostrafamiglia.it/
  Polo FVG   -   Via della Bontà, 7 - 33078   -   San Vito al Tagliamento (PN)
  marco.gaiarin(at)lanostrafamiglia.it   t +39-0434-842711   f +39-0434-842797

	(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)

More information about the pve-user mailing list