<div dir="ltr"><div>here is my details.<br><br>none 100M 76K 100M 1% /run/user<br>/dev/sda1 1.9G 89M 1.7G 5% /boot<br>/dev/sda4 147G 125G 15G 90% /data<br>
/dev/sdb1 870G 71G 755G 9% /Personal<br>/dev/sdb2 965G 200M 916G 1% /Archive<br>/dev/sr0 785M 785M 0 100% /media/ykhan/Ubuntu 13.04 amd64<br>10.1.1.18:/acipool/cmdnfs 268G 118G 150G 45% /mnt/nfs18<br>
root@ubuntu-ykhan:/mnt/nfs18# <br></div><br>#10.1.1.18 is my omniOS storage.<br><br><div><br>root@omni:~# zpool status<br> pool: acipool<br> state: ONLINE<br> scan: resilvered 12.3G in 0h11m with 0 errors on Tue Sep 10 15:37:36 2013<br>
config:<br><br> NAME STATE READ WRITE CKSUM<br> acipool ONLINE 0 0 0<br> raidz2-0 ONLINE 0 0 0<br> c2t0d0 ONLINE 0 0 0<br> c2t1d0 ONLINE 0 0 0<br>
c2t2d0 ONLINE 0 0 0<br> c2t3d0 ONLINE 0 0 0<br><br>errors: No known data errors<br><br> pool: rpool<br> state: ONLINE<br> scan: none requested<br>config:<br><br> NAME STATE READ WRITE CKSUM<br>
rpool ONLINE 0 0 0<br> c1d0s0 ONLINE 0 0 0<br><br>errors: No known data errors<br><br><br><br></div><div>Now Copying a 32 GB image from ubuntu to omni, an NFS mount is established on ubuntu. <br>
<br></div><div>it is giving me average of 60MBPS and bumps up and down b/w 50MBPS to 80MBPS<br><br><br></div><div>ubunto<----NFS protocol<--------omniOS<br></div><div> <br>root@ubuntu-ykhan:/# time rsync --progress /mnt/nfs18/test.qcow2 /tmp/<br>
test.qcow2<br><br> 10950180864 31% 70.16MB/s 0:05:25<br><br></div><div></div><div>here you can see the output<br></div><div><br>sent 34369438440 bytes received 31 bytes 62319924.70 bytes/sec<br>total size is 34365243392 speedup is 1.00<br>
<br>real 9m11.445s<br>user 4m48.160s<br>sys 2m31.644s<br><br><br>ubunto---->NFS protocol-------->omniOS<br><br>root@ubuntu-ykhan:/# time rsync --progress /tmp/test.qcow2 /mnt/nfs18/test.qcow123<br>test.qcow2<br>
34365243392 100% 51.92MB/s 0:10:31 (xfer#1, to-check=0/1)<br><br>sent 34369438440 bytes received 31 bytes 54082515.30 bytes/sec<br>total size is 34365243392 speedup is 1.00<br><br>real 10m34.863s<br>user 5m49.448s<br>
sys 2m50.416s<br><br><br><br></div><div>as you can see i can have good speed but the problem is with Proxmox VM. i tried every single cache stype (write back, write through, write back (unsafe) balh blah blah ) in Proxmox. but nothing works still same slow speed,<br>
<br><br></div><div>any idea any one please........................<br></div><div>Thanks,<br><br></div><div><br></div><div><br><br><br><br><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Sun, Sep 15, 2013 at 3:59 PM, Michael Rasmussen <span dir="ltr"><<a href="mailto:mir@miras.org" target="_blank">mir@miras.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Sun, 15 Sep 2013 00:42:14 +0500<br>
<div class="im">Muhammad Yousuf Khan <<a href="mailto:sirtcp@gmail.com">sirtcp@gmail.com</a>> wrote:<br>
<br>
</div><div class="im">> Dell 490 12 GB RAM, Raidz2. 4 different size drives (500GB available<br>
> storage)<br>
</div>Raidz2 is not blazingly fast when writing. Each write most also write<br>
parity data to all disks in the raid.<br>
<a href="http://zfsguru.com/forum/buildingyourownzfsserver/570" target="_blank">http://zfsguru.com/forum/buildingyourownzfsserver/570</a><br>
<div class="im"><br>
> but my part of confusion is why rsync, scp and other protocol from console<br>
> works fine like they are Giving me 50MBPS. even virtualbox VM is doing good<br>
> but on the other hand things are not working with Proxmox.<br>
<br>
</div>This is my figures:<br>
NAME STATE READ WRITE CKSUM<br>
vMotion ONLINE 0 0 0<br>
mirror-0 ONLINE 0 0 0<br>
c7t1d0 ONLINE 0 0 0<br>
c7t0d0 ONLINE 0 0 0<br>
mirror-1 ONLINE 0 0 0<br>
c7t2d0 ONLINE 0 0 0<br>
c7t3d0 ONLINE 0 0 0<br>
<br>
NAME PROPERTY VALUE SOURCE<br>
vMotion/nfs compressratio 1.40x -<br>
vMotion/nfs recordsize 128K default<br>
vMotion/nfs checksum on default<br>
vMotion/nfs compression lz4 inherited from vMotion<br>
vMotion/nfs atime off inherited from vMotion<br>
vMotion/nfs aclmode passthrough local<br>
vMotion/nfs aclinherit passthrough-x local<br>
vMotion/nfs xattr on default<br>
vMotion/nfs copies 1 default<br>
vMotion/nfs version 5 -<br>
vMotion/nfs utf8only off -<br>
vMotion/nfs normalization none -<br>
vMotion/nfs casesensitivity sensitive -<br>
vMotion/nfs nbmand off default<br>
vMotion/nfs sharesmb off default<br>
vMotion/nfs primarycache all default<br>
vMotion/nfs secondarycache all default<br>
vMotion/nfs dedup off default<br>
vMotion/nfs sync disabled inherited from vMotion<br>
<br>
[mir@sleipner:~]$ time scp 192.168.2.116:dump.img /tmp<br>
dump.img 100% 2048MB 32.0MB/s 01:04<br>
<br>
real 1m8.962s<br>
user 0m19.844s<br>
sys 0m13.612s<br>
[mir@sleipner:~]$ time scp /tmp/dump.img 192.168.2.116:/tmp<br>
dump.img 100% 2048MB 19.0MB/s 01:48<br>
<br>
real 1m51.179s<br>
user 0m19.892s<br>
sys 0m11.404s<br>
<div class="im"><br>
<br>
--<br>
Hilsen/Regards<br>
Michael Rasmussen<br>
<br>
Get my public GnuPG keys:<br>
michael <at> rasmussen <dot> cc<br>
<a href="http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E" target="_blank">http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E</a><br>
mir <at> datanom <dot> net<br>
<a href="http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C" target="_blank">http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C</a><br>
mir <at> miras <dot> org<br>
<a href="http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917" target="_blank">http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917</a><br>
--------------------------------------------------------------<br>
</div>I should have been a country-western singer. After all, I'm older than<br>
most western countries.<br>
-- George Burns<br>
<br>_______________________________________________<br>
pve-user mailing list<br>
<a href="mailto:pve-user@pve.proxmox.com">pve-user@pve.proxmox.com</a><br>
<a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
<br></blockquote></div><br></div>