[PVE-User] Cant connect to ceph anymore

[Alwin Antreich]

Hi,

On Thu, Sep 13, 2018, 23:59 <proxmox at elchaka.de> wrote:

> Hey Marcus,
>
> Thanks for your Message.
>
> Am 13. September 2018 22:58:04 MESZ schrieb Marcus Haarmann <
> marcus.haarmann at midoco.de>:
> >Hi,
> >
> >so you would drive a 12.2 (luminous) service with a 10.x (jewel)
> >client.
>
> Sorry, with
>
> "The last Step was to Update the ceph Client on this proxmox node, but now
> i am Not able to connect to the ceph Storage anymore :*("
>
> I ment ive upgraded this Node to 12.2.x, too. After this i had the
> descriped issue.
>
In 12.2.8 the output for'rbd ls' and other commands had a slight change,
units GB to GiB. For your PVE 5.x, if you're on the latest packages it
should work to connect.


> >Just a thought:
> >
> >Check the "ceph features" output on your server if it allows jewel
> >clients.
> >Sample output should contain a group with a jewel attribute in the
> >client section.
>
> This is clean. All other Node are already luminous (but with PVE  5.x)
>
> >
> >If this is not the case, try to set:
> >ceph osd set-require-min-compat-client jewel
>
> It is already On Jewel, becouse ive upgraded from Jewel but didnt set this
> to luminous till all Node are Running luminous fine.
>
> Hope you or someone Else has Another idea why i can not See my Images
> through the proxmox GUI anymore - and so i can not start my appropriate vms.
>
> - Mehmet
>
> >(which should be default for luminous, but can be removed which leads
> >to incompability)
> >
> >Check this link for details:
> >https://ceph.com/community/new-luminous-upgrade-complete/
> >
> >Maybe this helps, good luck
> >Marcus Haarmann
> >
> >
> >Von: proxmox at elchaka.de
> >An: "pve-user" <pve-user at pve.proxmox.com>
> >Gesendet: Donnerstag, 13. September 2018 19:41:13
> >Betreff: [PVE-User] Cant connect to ceph anymore
> >
> >Hi,
> >
> >I had a proxmox 4.x Server with installed ceph Jewel (10.x) via
> >ceph-deploy.
> >
> >The ceph Cluster is standalone Not managed by proxmox.
> >
> >I could use this ceph Cluster without any issues and the vms working
> >fine.
> >
> >Now I upgraded my ceph Cluster to 12.2.x and was still able to connect
> >my vms via proxmox (qemu/librbd).
> >
> >The last Step was to Update the ceph Client on this proxmox node, but
> >now i am Not able to connect to the ceph Storage anymore :*(
> >
> >
> >Actually i cannot Update the proxmox Node to 5.x because there is a
> >important vm Running with local Storage.
>
You need to migrate the VM to another node (storage), as you need to get
the node to PVE 5.x. IIRC in PVE4.4, from the command line, you could try
to use the 'with_local_storage' option in 'qm migrate'. Or move the disks
to NFS and then to another node.

--
Cheers,
Alwin

>