[PVE-User] pve-csync version of pve-zsync?

[Alexandre DERUMIER]

Hi,

I'm currently a lot busy working on network code.

for now, we have implemented ceph replication out of proxmox code, I'll try to work on it this summer.


----- Mail original -----
De: "Mark Adams" <mark at openvs.co.uk>
À: "proxmoxve" <pve-user at pve.proxmox.com>
Envoyé: Mardi 15 Mai 2018 00:13:03
Objet: Re: [PVE-User] pve-csync version of pve-zsync?

Hi Alexandre, 

Did you ever get a chance to take a look at this? 

Regards, 
Mark 

On 13 March 2018 at 18:32, Alexandre DERUMIER <aderumier at odiso.com> wrote: 

> Hi, 
> 
> I have plans to implement storage replication for rbd in proxmox, 
> like for zfs export|import. (with rbd export-diff |rbd import-diff ) 
> 
> I'll try to work on it next month. 
> 
> I'm not sure that currently a plugin infrastructe in done in code, 
> and that it's able to manage storages with differents name. 
> 
> Can't tell if it'll be hard to implement, but the workflow is almost the 
> same. 
> 
> I'll try to look also at rbd mirror, but it's only work with librbd in 
> qemu, not with krbd, 
> so it can't be implemented for container. 
> 
> 
> ----- Mail original ----- 
> De: "Mark Adams" <mark at openvs.co.uk> 
> À: "proxmoxve" <pve-user at pve.proxmox.com> 
> Envoyé: Mardi 13 Mars 2018 18:52:21 
> Objet: Re: [PVE-User] pve-csync version of pve-zsync? 
> 
> Hi Alwin, 
> 
> I might have to take another look at it, but have you actually done this 
> with 2 proxmox clusters? I can't remember the exact part I got stuck on as 
> it was quite a while ago, but it wasn't as straight forward as you 
> suggest. 
> I think you couldn't use the same cluster name, which in turn created 
> issues trying to use the "remote" (backup/dr/whatever you wanna call it) 
> cluster with proxmox because it needed to be called ceph. 
> 
> The docs I was referring to were the ceph ones yes. Some of the options 
> listed in that doc do not work in the current proxmox version (I think the 
> doc hasn't been updated for newer versions...) 
> 
> Regards, 
> Mark 
> 
> On 13 March 2018 at 17:19, Alwin Antreich <a.antreich at proxmox.com> wrote: 
> 
> > On Mon, Mar 12, 2018 at 04:51:32PM +0000, Mark Adams wrote: 
> > > Hi Alwin, 
> > > 
> > > The last I looked at it, rbd mirror only worked if you had different 
> > > cluster names. Tried to get it working with proxmox but to no avail, 
> > > without really messing with how proxmox uses ceph I'm not sure it's 
> > > feasible, as proxmox assumes the default cluster name for 
> everything... 
> > That isn't mentioned anywhere in the ceph docs, they use for ease of 
> > explaining two different cluster names. 
> > 
> > If you have a config file named after the cluster, then you can specifiy 
> > it on the command line. 
> > http://docs.ceph.com/docs/master/rados/configuration/ 
> > ceph-conf/#running-multiple-clusters 
> > 
> > > 
> > > Also the documentation was a bit poor for it IMO. 
> > Which documentation do you mean? 
> > ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ 
> > 
> > > 
> > > Would also be nice to choose specifically which VM's you want to be 
> > > mirroring, rather than the whole cluster. 
> > It is done either per pool or image separately. See the link above. 
> > 
> > > 
> > > I've manually done rbd export-diff and rbd import-diff between 2 
> separate 
> > > proxmox clusters over ssh, and it seems to work really well... It 
> would 
> > > just be nice to have a tool like pve-zsync so I don't have to write 
> some 
> > > script myself. Seems to me like something that would be desirable as 
> part 
> > > of proxmox as well? 
> > That would basically implement the ceph rbd mirror feature. 
> > 
> > > 
> > > Cheers, 
> > > Mark 
> > > 
> > > On 12 March 2018 at 16:37, Alwin Antreich <a.antreich at proxmox.com> 
> > wrote: 
> > > 
> > > > Hi Mark, 
> > > > 
> > > > On Mon, Mar 12, 2018 at 03:49:42PM +0000, Mark Adams wrote: 
> > > > > Hi All, 
> > > > > 
> > > > > Has anyone looked at or thought of making a version of pve-zsync 
> for 
> > > > ceph? 
> > > > > 
> > > > > This would be great for DR scenarios... 
> > > > > 
> > > > > How easy do you think this would be to do? I imagine it wouId it 
> be 
> > quite 
> > > > > similar to pve-zsync, but using rbd export-diff and rbd 
> import-diff 
> > > > instead 
> > > > > of zfs send and zfs receive? so could the existing script be 
> > relatively 
> > > > > easily modified? (I know nothing about perl....) 
> > > > > 
> > > > > Cheers, 
> > > > > Mark 
> > > > > _______________________________________________ 
> > > > > pve-user mailing list 
> > > > > pve-user at pve.proxmox.com 
> > > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> > > > Isn't ceph mirror already what you want? It can mirror a image or a 
> > > > whole pool. It keeps track of changes and serves remote image 
> deletes 
> > > > (adjustable delay). 
> > > > 
> > 
> > _______________________________________________ 
> > pve-user mailing list 
> > pve-user at pve.proxmox.com 
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> > 
> 
_______________________________________________ 
pve-user mailing list 
pve-user at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user