[PVE-User] Custom storage in ProxMox 5

[Alwin Antreich]

Hi Lindsay,

On Fri, Mar 30, 2018 at 03:05:11AM +0000, Lindsay Mathieson wrote:
> Ceph has rather larger overheads, much bigger PITA to admin, does not perform as well on whitebox hardware – in fact the Ceph crowd std reply to issues is to spend big on enterprise hardware and is far less flexible.
I really don't think that holds true. It is very straightforward to
install and maintain. As all distributed systems, there is some
complexitiy involved, that an admin has to know.

Our stack has its own toolset, but you can also use ceph-deploy or
better ceph-ansible for ceph installation and maintanance.
https://pve.proxmox.com/pve-docs/chapter-pveceph.html

The hardware topic is always a pitty. People that are new to ceph (or
any other system) usually don't understand the workings of it and have
high expectations about the performance they can achieve. When people
find out that it is to the contrary of their expectations, they show up
on the mailing lists and forums.

In the end it comes down to proper planning, hardware purchase and
testing, that leeds to the verdict, buy enterprise hardware if you want
to have enterprise performance. Irrespective of distributed system.

>
> Can Ceph run multiple replication and ec levels for different files on the same volume? Can you change goal settings on the fly? Near instantaneous spanshots and restores at any level of the filesystem you choose? Run on commodity hardware with trivial adding of disks as required?
Yes, but as ceph is working differently, these terminologies may not do
or mean the same.

>
>
>
> ZFS is not a distributed filesystem, so don’t know why you bring it up. Though I am using ZFS as the underlying filesystem.
While not distributed, in some cases, the storage replication (pvesr)
might be a consideration worth.
https://pve.proxmox.com/pve-docs/chapter-pvesr.html

>
>
>
> --
> Lindsay Mathieson
>
>
>
> ________________________________
> From: pve-user <pve-user-bounces at pve.proxmox.com> on behalf of admin at extremeshok.com <admin at extremeshok.com>
> Sent: Friday, March 30, 2018 11:53:10 AM
> To: pve-user at pve.proxmox.com
> Subject: Re: [PVE-User] Custom storage in ProxMox 5
>
> Don't waste your time with lizardfs.
>
> Proxmox 5+ has proper Ceph and ZFS support.
>
> Ceph does everything and more, and ZFS is about the de-facto container
> storage medium.
>
>
> On 03/30/2018 03:20 AM, Lindsay Mathieson wrote:
> > I was working on a custom storage plugin (lizardfs) for VE 4.x, looking to revisit it. Has the API changed much (or at all) for PX 5? Is there any documentation for it?
Check out the other storage plugins, AFAIC, there is no specific
documentation.

For completness, for our PVE API, check out the following links.
https://pve.proxmox.com/pve-docs/api-viewer/index.html
https://pve.proxmox.com/wiki/Proxmox_VE_API

> >
> > Thanks,
> >
> > --
> > Lindsay Mathieson
> >
--
Cheers,
Alwin