[PVE-User] What is the purpose of second gluster server in storage config?

Iztok Gregori iztok.gregori at elettra.eu
Fri May 3 09:44:24 CEST 2019

On 06/04/19 13:05, Thomas Lamprecht wrote:
> On 4/6/19 8:39 AM, Igor Podlesny wrote:
>> -- Beyond of the obvious "well, it's for redundancy". That's obvious..
>> but "What subsystems and under what circumstances are gonna use it?"
>> -- isn't at all.
>> I have strong suspicion that qemu-kvm isn't capable of fail-over
>> switching in case its primary gluster server went down. At least
>> preliminary tests showed that on single node's (that is a part of
>> replicated gluster cluster setup) failure VM's disks are gone
>> (effectively are kinda pulled off for VMs).
>> Second server's IP isn't even seen among arguments of kvm process.
>> Moreover, /proc/mounts doesn't even contain any mention of
>> backup-volfile-servers or similar options.
> Quite a bit ago QEMU only supported a single server when passing a
> GlusterFS backed volume, thus Proxmox VE tries to bing both set servers
> on the relevant GlusterFS ports and passed the first one available.
> Then, some QEMU releases ago, support for passing multiple GlusterFS
> servers was added to QEMU, which it now uses to failover.
> Nobody changed our QEMU interface to adapt to that new, even better
> possibility..
> maybe it came from the fact that the more scalable and better integrated
> ceph was already on the plate, and GlusterFS usage in PVE declined a bit,
> maybe it just wasn't noticed by GlusterFS users, thus nobody stepped up or
> made much noise changing that. Anyway, I'd be open for patches regarding
> this.
> cheers,
> Thomas

Hi to all!

So what happens when one of the configured servers fails, Proxmox 
recognize the failure and mounts the secondary? If this so the running 
VMs are able to cope with the loose of connectivity or have to reboot?

I think that the possibility to pass multiple servers to QEMU should be 
implemented. Where can I open a feature request?


More information about the pve-user mailing list