[pve-devel] manually add servers to the PVE corosync cluster

[Alexandre DERUMIER]

Hi Michael,

Hi Stefan & co.,


>>How is your setup? Have you installed Ceph/Sheepdog on the Proxmox nodes
>>directly? Or do you run it on dedicated storage servers?

sheepdog can be installed on proxmox server or external server.
ceph cannot be installed to proxmox for the moment ( need recent kernel, recent glibc,recent xfs/brtfs)


>>Also I would like to hear if you have installed Ceph/Sheepdog on servers
>>with also RAID configured, or you let Ceph/Sheepdog handle individual disks
>>directly?

you can do with or without raid. recommandation is without raid.
(sheepdog: 1 sheepdog deamon by disk, ceph : 1 osd-daemon by disk)

Looking forward to hear your performance conclusions :-)

Both seem to run fine. Maybe ceph seem to be more stable, but need more tunning.
Sheepdog seem to be simplier, just a daemon, no special filesystem.

Ceph can have a journal on a fast ssd to speedup write.

I'll do more test this week with full ssd setup.
I'll try to do a sheepdog package for proxmox this week to . (sheepdog 0.4 is coming soon)


-Alexandre

----- Mail original ----- 

De: "Michael Svendsen" <michael at nsec.dk> 
À: pve-devel at pve.proxmox.com 
Envoyé: Lundi 2 Juillet 2012 17:10:59 
Objet: Re: [pve-devel] manually add servers to the PVE corosync cluster 

Hi Stefan & co., 

Sounds good that you are testing both. I have been thinking on doing some 
performance/scalability tests as well. 
I have a handful Proxmox servers (not in cluster and not with shared storage 
available) 

How is your setup? Have you installed Ceph/Sheepdog on the Proxmox nodes 
directly? Or do you run it on dedicated storage servers? 
Also I would like to hear if you have installed Ceph/Sheepdog on servers 
with also RAID configured, or you let Ceph/Sheepdog handle individual disks 
directly? 

Looking forward to hear your performance conclusions :-) 



- Michael 


-----Oprindelig meddelelse----- 
Fra: pve-devel-bounces at pve.proxmox.com 
[mailto:pve-devel-bounces at pve.proxmox.com] På vegne af Stefan Priebe - 
Profihost AG 
Sendt: 2. juli 2012 15:24 
Til: pve-devel at pve.proxmox.com 
Emne: Re: [pve-devel] manually add servers to the PVE corosync cluster 


Am 29.06.2012 17:49, schrieb Martin Maurer: 
>> Cc: pve-devel at pve.proxmox.com 
>> Subject: Re: [pve-devel] manually add servers to the PVE corosync 
>> cluster 
>> 
>> I'm sorry it works even when the proxmox server is not in the same 
>> corosync cluster. 
>> 
> 
> I am quite interested in your comparison between sheepdog and ceph, please 
share your findings here. 

Right now Alexandre and myself do heavy testing of both. But it seems that 
both have it strength and weakness. Ceph has good squential write values and 
seem to be really stable (if youn setup it correctly). Also it is really 
good documented instead of sheepdog. 

Sheepdog has good random I/O values but lacks in stability, documentation 
and sequential stuff. 

Greets 
Stefan 
_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 

_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 



-- 

-- 



	

Alexandre D e rumier 

Ingénieur Systèmes et Réseaux 


Fixe : 03 20 68 88 85 

Fax : 03 20 68 90 88 


45 Bvd du Général Leclerc 59100 Roubaix 
12 rue Marivaux 75002 Paris