<html><head></head><body>I see problems with making backups but not with restoring them. I just used the backup and restore features to move about a dozen VMs into a new RBD-based cluster and it went very smoothly and quickly.<br>
I have noticed previously that taking backups of an rbd-based VM takes forever and sometimes deadlocked the cluster service by consuming all available memory.<br>
But I haven't experienced either of your specific issues.<br>
-Adam<br><br><div class="gmail_quote">On January 5, 2015 8:52:50 AM CST, Lindsay Mathieson <lindsay.mathieson@gmail.com> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<pre class="k9mail">I have my ceph cluster setup - 6 osd's on 2 ndoes with ssd journals. Its fast <br />enough for my requirements - 140 MBS/s seq write, 500 MB/s seq read, IOPS are <br />reasonable to.<br /><br />I have 20 VM's running ver rbd, they perform quite well. responsive desktops <br />and servers, no complaints there.<br /><br />Where it all goes wrong is snapshots and backup restores.<br /><br />Snapshots I've mentioned before, over 10 minutes to take a snapshot of a small <br />VM is wrong. The actual disk snapshot is near instant, its the live state that <br />takes all the time. The same VM only takes 30 seconds to snapshot on cephfs or <br />NFS. The one rollback I tried to 40 min and was corrupted at the end.<br /><br />Restores - I started a VM restore this evening, this is one I've done before <br />on our crappy NAS nfs server - takes about 30 min.<br /><br />2.5 *hours* later it reached 20% at that rate it would be 8 hours to finish.<br /><br />I cancelled it
and restarted the restore to cephfs (same storage). It takes it <br />8 *minutes* to get to 20%<br /><br />Oddly, a disk migration from cephfs to rbd is much faster - about 40min for <br />the same virtual disk. Its literally much quicker to restore VM's to cephfs, <br />then migrate the disk to ceph rbd.<br /><br /><br /><br /><br />Any idea why snapshot and backup restore operations are so slow on rbd? it is <br />literally making the snapshot and backup function useless for my purposes. <br />Surely I'm not the only one for whom this is a problem.</pre></blockquote></div><br>
-- <br>
Sent from my Android device with K-9 Mail. Please excuse my brevity.</body></html>