[PVE-User] Custom storage in ProxMox 5

[Alexandre DERUMIER]

Hi,

>>Ceph has rather larger overheads

Agree. they are overhead, but performance increase with each release.
I think the biggest problem is that you can reach more than 70-90k iops with 1 vm disk currently.
and maybe latency could be improve too.

>>much bigger PITA to admin
don't agree. I'm running 5 ceph cluster (around 200TB ssd). almost 0 maintenance.

>>does not perform as well on whitebox hardware 
define whitebox hardware ?  
the only thing is to no use consumer ssd (because they sucks with direct io)


>>an Ceph run multiple replication and ec levels for different files on the same volume?
you can manage it by pool. (as block storage).
>> Near instantaneous spanshots 
yes

>>and restores 

a lit bit slower to rollback

>>at any level of the filesystem you choose? 

why are you talking about filesystem ? Are you mounting lizard inside your vm? or for hosting vm disk ?


>>Run on commodity hardware with trivial adding of disks as required? 
yes
----- Mail original -----
De: "Lindsay Mathieson" <lindsay.mathieson at gmail.com>
À: "proxmoxve" <pve-user at pve.proxmox.com>
Envoyé: Vendredi 30 Mars 2018 05:05:11
Objet: Re: [PVE-User] Custom storage in ProxMox 5

Ceph has rather larger overheads, much bigger PITA to admin, does not perform as well on whitebox hardware – in fact the Ceph crowd std reply to issues is to spend big on enterprise hardware and is far less flexible. 

Can Ceph run multiple replication and ec levels for different files on the same volume? Can you change goal settings on the fly? Near instantaneous spanshots and restores at any level of the filesystem you choose? Run on commodity hardware with trivial adding of disks as required? 



ZFS is not a distributed filesystem, so don’t know why you bring it up. Though I am using ZFS as the underlying filesystem. 



-- 
Lindsay Mathieson 



________________________________ 
From: pve-user <pve-user-bounces at pve.proxmox.com> on behalf of admin at extremeshok.com <admin at extremeshok.com> 
Sent: Friday, March 30, 2018 11:53:10 AM 
To: pve-user at pve.proxmox.com 
Subject: Re: [PVE-User] Custom storage in ProxMox 5 

Don't waste your time with lizardfs. 

Proxmox 5+ has proper Ceph and ZFS support. 

Ceph does everything and more, and ZFS is about the de-facto container 
storage medium. 


On 03/30/2018 03:20 AM, Lindsay Mathieson wrote: 
> I was working on a custom storage plugin (lizardfs) for VE 4.x, looking to revisit it. Has the API changed much (or at all) for PX 5? Is there any documentation for it? 
> 
> Thanks, 
> 
> -- 
> Lindsay Mathieson 
> 
> _______________________________________________ 
> pve-user mailing list 
> pve-user at pve.proxmox.com 
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 

_______________________________________________ 
pve-user mailing list 
pve-user at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
_______________________________________________ 
pve-user mailing list 
pve-user at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user