[PVE-User] Ceph or Gluster

[Mohamed Sadok Ben Jazia]

As it will we a large infrastructure, the number of nodes will increase
while demand is increasing.
The network will be mainly needed for backups (not sure to make a node for
backups only), and also for VM and LXC migration to use nodes in an optimal
way.
 A good bandwidth is needed while moving container storages to be user
friendly for users who want upgrade his container and we have to move it to
another free node.
Any recommendation is welcome
Thank you

On 22 April 2016 at 14:44, Eneko Lacunza <elacunza at binovo.es> wrote:

> Hi Mohamed,
>
> El 22/04/16 a las 15:00, Mohamed Sadok Ben Jazia escribió:
>
>> Thank you Eneko,
>> I read in proxmox forum that distributed storage needs 10GBit or faster on
>> the local network and a dedicated network.
>> Could you detail your used infrastructure to see if it matches those
>> conditions?
>>
> We only have small/tiny clusters (3 clusters). I'll detail the one in our
> office that is the "biggest".
>
> 4 Proxmox 4.x nodes:
>     - 1 node for backup/helper: 2 cores, 16GB RAM, NFS export for
> backups/ISO
>     - 3 main nodes: 4 cores (one with HT), 32 GB RAM, 2x1gbit ethernet
>         - Execute VMs (46 total, 17 running right now)
>         - Ceph storage: each node has
>             - 1 MDS daemon
>             - 3x1TB OSD disk
>             - 1xSSD disk for OSD journals
>
> We are using 1gbit interface for VM access, Proxmox cluster. The other
> 1gbit port is for ceph public/private networks. We're using size=2 for
> Ceph. (Two replicas for each data).
>
> With this setup we only saturate the ceph network in special backup times
> (weekend), network is below 20% of average use normally.
>
> Of course, this depends on your loads, also if you're planning nodes with
> more OSD, then it is easier to saturate network.
>
> Also, you have to take into account failures; what happens when something
> brokes (node, OSD disk) and how long it will take until replica count is
> restored. In this, your network can also have a big impact.
>
> What size of storage/virtualization load are you planning?
>
>
> Cheers
> Eneko
>
> --
> Zuzendari Teknikoa / Director Técnico
> Binovo IT Human Project, S.L.
> Telf. 943493611
>       943324914
> Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
> www.binovo.es
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>