[PVE-User] KVM VM on NFS worst performance.
Muhammad Yousuf Khan
sirtcp at gmail.com
Mon Sep 16 12:08:57 CEST 2013
here is my details.
none 100M 76K 100M 1% /run/user
/dev/sda1 1.9G 89M 1.7G 5% /boot
/dev/sda4 147G 125G 15G 90% /data
/dev/sdb1 870G 71G 755G 9% /Personal
/dev/sdb2 965G 200M 916G 1% /Archive
/dev/sr0 785M 785M 0 100% /media/ykhan/Ubuntu
13.04 amd64
10.1.1.18:/acipool/cmdnfs 268G 118G 150G 45% /mnt/nfs18
root at ubuntu-ykhan:/mnt/nfs18#
#10.1.1.18 is my omniOS storage.
root at omni:~# zpool status
pool: acipool
state: ONLINE
scan: resilvered 12.3G in 0h11m with 0 errors on Tue Sep 10 15:37:36 2013
config:
NAME STATE READ WRITE CKSUM
acipool ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
c2t0d0 ONLINE 0 0 0
c2t1d0 ONLINE 0 0 0
c2t2d0 ONLINE 0 0 0
c2t3d0 ONLINE 0 0 0
errors: No known data errors
pool: rpool
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
rpool ONLINE 0 0 0
c1d0s0 ONLINE 0 0 0
errors: No known data errors
Now Copying a 32 GB image from ubuntu to omni, an NFS mount is established
on ubuntu.
it is giving me average of 60MBPS and bumps up and down b/w 50MBPS to 80MBPS
ubunto<----NFS protocol<--------omniOS
root at ubuntu-ykhan:/# time rsync --progress /mnt/nfs18/test.qcow2 /tmp/
test.qcow2
10950180864 31% 70.16MB/s 0:05:25
here you can see the output
sent 34369438440 bytes received 31 bytes 62319924.70 bytes/sec
total size is 34365243392 speedup is 1.00
real 9m11.445s
user 4m48.160s
sys 2m31.644s
ubunto---->NFS protocol-------->omniOS
root at ubuntu-ykhan:/# time rsync --progress /tmp/test.qcow2
/mnt/nfs18/test.qcow123
test.qcow2
34365243392 100% 51.92MB/s 0:10:31 (xfer#1, to-check=0/1)
sent 34369438440 bytes received 31 bytes 54082515.30 bytes/sec
total size is 34365243392 speedup is 1.00
real 10m34.863s
user 5m49.448s
sys 2m50.416s
as you can see i can have good speed but the problem is with Proxmox VM. i
tried every single cache stype (write back, write through, write back
(unsafe) balh blah blah ) in Proxmox. but nothing works still same slow
speed,
any idea any one please........................
Thanks,
On Sun, Sep 15, 2013 at 3:59 PM, Michael Rasmussen <mir at miras.org> wrote:
> On Sun, 15 Sep 2013 00:42:14 +0500
> Muhammad Yousuf Khan <sirtcp at gmail.com> wrote:
>
> > Dell 490 12 GB RAM, Raidz2. 4 different size drives (500GB available
> > storage)
> Raidz2 is not blazingly fast when writing. Each write most also write
> parity data to all disks in the raid.
> http://zfsguru.com/forum/buildingyourownzfsserver/570
>
> > but my part of confusion is why rsync, scp and other protocol from
> console
> > works fine like they are Giving me 50MBPS. even virtualbox VM is doing
> good
> > but on the other hand things are not working with Proxmox.
>
> This is my figures:
> NAME STATE READ WRITE CKSUM
> vMotion ONLINE 0 0 0
> mirror-0 ONLINE 0 0 0
> c7t1d0 ONLINE 0 0 0
> c7t0d0 ONLINE 0 0 0
> mirror-1 ONLINE 0 0 0
> c7t2d0 ONLINE 0 0 0
> c7t3d0 ONLINE 0 0 0
>
> NAME PROPERTY VALUE SOURCE
> vMotion/nfs compressratio 1.40x -
> vMotion/nfs recordsize 128K default
> vMotion/nfs checksum on default
> vMotion/nfs compression lz4 inherited from vMotion
> vMotion/nfs atime off inherited from vMotion
> vMotion/nfs aclmode passthrough local
> vMotion/nfs aclinherit passthrough-x local
> vMotion/nfs xattr on default
> vMotion/nfs copies 1 default
> vMotion/nfs version 5 -
> vMotion/nfs utf8only off -
> vMotion/nfs normalization none -
> vMotion/nfs casesensitivity sensitive -
> vMotion/nfs nbmand off default
> vMotion/nfs sharesmb off default
> vMotion/nfs primarycache all default
> vMotion/nfs secondarycache all default
> vMotion/nfs dedup off default
> vMotion/nfs sync disabled inherited from vMotion
>
> [mir at sleipner:~]$ time scp 192.168.2.116:dump.img /tmp
> dump.img 100% 2048MB 32.0MB/s 01:04
>
> real 1m8.962s
> user 0m19.844s
> sys 0m13.612s
> [mir at sleipner:~]$ time scp /tmp/dump.img 192.168.2.116:/tmp
> dump.img 100% 2048MB 19.0MB/s 01:48
>
> real 1m51.179s
> user 0m19.892s
> sys 0m11.404s
>
>
> --
> Hilsen/Regards
> Michael Rasmussen
>
> Get my public GnuPG keys:
> michael <at> rasmussen <dot> cc
> http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E
> mir <at> datanom <dot> net
> http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C
> mir <at> miras <dot> org
> http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917
> --------------------------------------------------------------
> I should have been a country-western singer. After all, I'm older than
> most western countries.
> -- George Burns
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.proxmox.com/pipermail/pve-user/attachments/20130916/35712743/attachment.htm>
More information about the pve-user
mailing list