[pve-devel] ceph jewel released

[Alexandre DERUMIER]

Hi,

after having done test with jewel on debian,
I can said that .deb packaging is a big shit :/

They are bugs in init.d script, in system.d unit files and also in /etc/default/ceph deployment and /etc/init.d/ceph deployment.


So, it's really better to wait the next point release, seem that they don't have too much tested in on debian/ubuntu. (thanks redhat :p)


----- Mail original -----
De: "aderumier" <aderumier at odiso.com>
À: "pve-devel" <pve-devel at pve.proxmox.com>
Envoyé: Vendredi 22 Avril 2016 15:43:09
Objet: Re: [pve-devel] ceph jewel released

Also, krbd is not compatible with default images flag, 
so we need to inform lxc user to add "rbd default features = 1" in ceph.conf 


> * The default RBD image features for new images have been updated to 
> enable the following: exclusive lock, object map, fast-diff, and 
> deep-flatten. These features are not currently supported by the RBD 
> kernel driver nor older RBD clients. They can be disabled on a per-image 
> basis via the RBD CLI, or the default features can be updated to the 
> pre-Jewel setting by adding the following to the client section of the Ceph 
> configuration file:: 
> 
> rbd default features = 1 


jewel now also support rbd export through nbd (with librbd), I don't known performance vs krbd 
http://www.sebastien-han.fr/blog/2016/04/04/ceph-jewel-preview-map-rbd-devices-on-nbd/ 

With this, we don't depend on kernel version and all features are always available for lxc 


----- Mail original ----- 
De: "aderumier" <aderumier at odiso.com> 
À: "pve-devel" <pve-devel at pve.proxmox.com> 
Envoyé: Vendredi 22 Avril 2016 14:31:25 
Objet: Re: [pve-devel] ceph jewel released 

I have tested the rbd creation, it still working fine 

# rbd create vm-100-disk-1 -p poolceph --size 32G --image-format 2 

# rbd info vm-100-disk-1 -p poolceph 
rbd image 'vm-100-disk-1': 
size 32768 MB in 8192 objects 
order 22 (4096 kB objects) 
block_name_prefix: rbd_data.37356b8b4567 
format: 2 
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 
flags: 


The release note said that v1 format is deprecated, and that rbd create will throw a warning 


----- Mail original ----- 
De: "aderumier" <aderumier at odiso.com> 
À: "pve-devel" <pve-devel at pve.proxmox.com> 
Envoyé: Vendredi 22 Avril 2016 13:57:33 
Objet: Re: [pve-devel] ceph jewel released 

for pve cephserver, some changes are needed : 

- use systemd unit 
systemctl start ceph-mon at 0 ((ceph-mon at id) 
systemctl start ceph-osd at 0 (ceph-osd at id) 


When creating mon & osd, permissions need to be ceph:ceph now 




----- Mail original ----- 
De: "Stefan Priebe" <s.priebe at profihost.ag> 
À: "pve-devel" <pve-devel at pve.proxmox.com> 
Envoyé: Vendredi 22 Avril 2016 10:20:10 
Objet: Re: [pve-devel] ceph jewel released 

As far as I remember with jewel 

Stefan 

Excuse my typo sent from my mobile phone. 

Am 22.04.2016 um 10:04 schrieb Alexandre DERUMIER <aderumier at odiso.com>: 

>>> There are some changes for example the image-format parameter does not exist anymore. 
> 
> Do you known since well image-format v2 is the default ? 
> 
> I don't known if we can safely remove it in rbdplugin.pm, or if we need to introduce a new option. 
> 
> ----- Mail original ----- 
> De: "Stefan Priebe" <s.priebe at profihost.ag> 
> À: "pve-devel" <pve-devel at pve.proxmox.com> 
> Envoyé: Vendredi 22 Avril 2016 09:36:33 
> Objet: Re: [pve-devel] ceph jewel released 
> 
> There are some changes for example the image-format parameter does not exist anymore. 
> 
> Stefan 
> 
> Excuse my typo sent from my mobile phone. 
> 
>> Am 22.04.2016 um 09:29 schrieb Alexandre DERUMIER <aderumier at odiso.com>: 
>> 
>> http://ceph.com/releases/v10-2-0-jewel-released/ 
>> 
>> I'm going to test it next week with proxmox. 
>> (should work out of the box, I don't think they are api or rbd command changes) 
>> _______________________________________________ 
>> pve-devel mailing list 
>> pve-devel at pve.proxmox.com 
>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 
> _______________________________________________ 
> pve-devel mailing list 
> pve-devel at pve.proxmox.com 
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 
> 
> _______________________________________________ 
> pve-devel mailing list 
> pve-devel at pve.proxmox.com 
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 
_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 
_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 

_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 
_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel