[pve-devel] [PATCH] Add rados block plugin storage

[Alexandre DERUMIER]

>>IMHO 3 is enough (or max 4). I someone seriously using 10 monitor servers? 

10 monhost  is recommended for big big clusters. (100 hosts cluster ;)
Don't know exactly how much mons for how much ceph storage servers.

>> simply store it on /etc/pve/private/ceph/ ? 

not possible, if the key is not defined, the rbd command or qemu drive option will check the file in harcorded path.

BTW,1 file is enough for store all the keys
/etc/ceph/ceph.keyring

# cat /etc/ceph/ceph.keyring 
[client.admin]
        key = AQAmOcZPwNY7GRAAuvJjVAKIm1r3JKqLCa4LGQ==
[client.admin2]
        key = AQAmOcZPwNY7GRAAuvJjVAKIm1r3JKqLCa4LGQ==


But with a symlink, it's working fine.

# ls -l /etc/ceph/ceph.keyring 
lrwxrwxrwx 1 root root 31 Jun  1 08:50 /etc/ceph/ceph.keyring -> /etc/pve/priv/ceph/ceph.keyring
rbd -p pool2 -m 10.3.94.27:6789 -n client.admin --auth_supported cephx\;none ls

#rbd -p pool2 -m 10.3.94.27:6789 -n client.admin --auth_supported cephx\;none ls
vm-114-disk-1
vm-114-disk-2
vm-114-disk-3


maybe symlink of the ceph directory is better ?



----- Mail original ----- 

De: "Dietmar Maurer" <dietmar at proxmox.com> 
À: "Alexandre DERUMIER" <aderumier at odiso.com> 
Cc: pve-devel at pve.proxmox.com 
Envoyé: Vendredi 1 Juin 2012 08:41:29 
Objet: RE: [pve-devel] [PATCH] Add rados block plugin storage 

> >>Also, it is usually easier to use separate properties: 
> >> 
> >>monhost1 10.3.94.27:6789 
> >>monhost2 10.3.94.28:6789 
> >>monhost3 10.3.94.29:6789 
> 
> >>What do you think? 
> Sure, it's ok for me. (We can have 10 monhost max) 

IMHO 3 is enough (or max 4). I someone seriously using 10 monitor servers? 

If so, we better keep the list syntax. 

> >>We already have a json format type for 'IP or DNS name with optional 
> >>port', we use that in ISCSIPlugin for portal. It is called 'pve-storage-portal- 
> dns'. 
> 
> must be only ip for the moment, as qemu-rbd complain if dns name is use 
> 
> 
> 
> > rbd_id admin 
> > rbd_key AQAmOcZPwNY7GRAAuvJjVAKIm1r3JKqLCa4LGQ== 
> > rbd_authsupported cephx;none 
> >Do we really want to store such sensitive data here? 
> 
> Sure, I have do it to be easy to implement. 
> the key can be stored in a external file, /etc/ceph/client.rbd_id.keyring. 
> But we need to replicate the file between the proxmox hosts. (I don't know 
> how to do this ;) 

simply store it on /etc/pve/private/ceph/ ? 





-- 

-- 




	Alexandre D erumier 
Ingénieur Système 
Fixe : 03 20 68 88 90 
Fax : 03 20 68 90 81 
45 Bvd du Général Leclerc 59100 Roubaix - France 
12 rue Marivaux 75002 Paris - France