[PVE-User] KVM VM on NFS worst performance.

Muhammad Yousuf Khan sirtcp at gmail.com
Mon Sep 16 12:08:57 CEST 2013


here is my details.

none                          100M   76K  100M   1% /run/user
/dev/sda1                     1.9G   89M  1.7G   5% /boot
/dev/sda4                     147G  125G   15G  90% /data
/dev/sdb1                     870G   71G  755G   9% /Personal
/dev/sdb2                     965G  200M  916G   1% /Archive
/dev/sr0                      785M  785M     0 100% /media/ykhan/Ubuntu
13.04 amd64
10.1.1.18:/acipool/cmdnfs  268G  118G  150G  45% /mnt/nfs18
root at ubuntu-ykhan:/mnt/nfs18#

#10.1.1.18 is my omniOS storage.


root at omni:~# zpool status
  pool: acipool
 state: ONLINE
  scan: resilvered 12.3G in 0h11m with 0 errors on Tue Sep 10 15:37:36 2013
config:

        NAME        STATE     READ WRITE CKSUM
        acipool     ONLINE       0     0     0
          raidz2-0  ONLINE       0     0     0
            c2t0d0  ONLINE       0     0     0
            c2t1d0  ONLINE       0     0     0
            c2t2d0  ONLINE       0     0     0
            c2t3d0  ONLINE       0     0     0

errors: No known data errors

  pool: rpool
 state: ONLINE
  scan: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        rpool       ONLINE       0     0     0
          c1d0s0    ONLINE       0     0     0

errors: No known data errors



Now Copying a 32 GB image from ubuntu to omni, an NFS mount is established
on ubuntu.

it is giving me average of 60MBPS and bumps up and down b/w 50MBPS to 80MBPS


ubunto<----NFS protocol<--------omniOS

root at ubuntu-ykhan:/# time rsync --progress /mnt/nfs18/test.qcow2 /tmp/
test.qcow2

 10950180864  31%   70.16MB/s    0:05:25

here you can see the output

sent 34369438440 bytes  received 31 bytes  62319924.70 bytes/sec
total size is 34365243392  speedup is 1.00

real    9m11.445s
user    4m48.160s
sys     2m31.644s


ubunto---->NFS protocol-------->omniOS

root at ubuntu-ykhan:/# time rsync --progress /tmp/test.qcow2
/mnt/nfs18/test.qcow123
test.qcow2
 34365243392 100%   51.92MB/s    0:10:31 (xfer#1, to-check=0/1)

sent 34369438440 bytes  received 31 bytes  54082515.30 bytes/sec
total size is 34365243392  speedup is 1.00

real    10m34.863s
user    5m49.448s
sys     2m50.416s



as you can see i can have good speed but the problem is with Proxmox VM. i
tried every single cache stype (write back, write through, write back
(unsafe) balh blah blah ) in Proxmox. but nothing works still same slow
speed,


any idea any one please........................
Thanks,









On Sun, Sep 15, 2013 at 3:59 PM, Michael Rasmussen <mir at miras.org> wrote:

> On Sun, 15 Sep 2013 00:42:14 +0500
> Muhammad Yousuf Khan <sirtcp at gmail.com> wrote:
>
> > Dell 490 12 GB RAM, Raidz2. 4 different size drives (500GB available
> > storage)
> Raidz2 is not blazingly fast when writing. Each write most also write
> parity data to all disks in the raid.
> http://zfsguru.com/forum/buildingyourownzfsserver/570
>
> > but my part of confusion is why rsync, scp and other protocol from
> console
> > works fine like they are Giving me 50MBPS. even virtualbox VM is doing
> good
> > but on the other hand things are not working with Proxmox.
>
> This is my figures:
>         NAME        STATE     READ WRITE CKSUM
>         vMotion     ONLINE       0     0     0
>           mirror-0  ONLINE       0     0     0
>             c7t1d0  ONLINE       0     0     0
>             c7t0d0  ONLINE       0     0     0
>           mirror-1  ONLINE       0     0     0
>             c7t2d0  ONLINE       0     0     0
>             c7t3d0  ONLINE       0     0     0
>
> NAME         PROPERTY          VALUE            SOURCE
> vMotion/nfs  compressratio     1.40x            -
> vMotion/nfs  recordsize        128K             default
> vMotion/nfs  checksum          on               default
> vMotion/nfs  compression       lz4              inherited from vMotion
> vMotion/nfs  atime             off              inherited from vMotion
> vMotion/nfs  aclmode           passthrough      local
> vMotion/nfs  aclinherit        passthrough-x    local
> vMotion/nfs  xattr             on               default
> vMotion/nfs  copies            1                default
> vMotion/nfs  version           5                -
> vMotion/nfs  utf8only          off              -
> vMotion/nfs  normalization     none             -
> vMotion/nfs  casesensitivity   sensitive        -
> vMotion/nfs  nbmand            off              default
> vMotion/nfs  sharesmb          off              default
> vMotion/nfs  primarycache      all              default
> vMotion/nfs  secondarycache    all              default
> vMotion/nfs  dedup             off              default
> vMotion/nfs  sync              disabled         inherited from vMotion
>
> [mir at sleipner:~]$ time scp 192.168.2.116:dump.img /tmp
> dump.img                             100% 2048MB  32.0MB/s 01:04
>
> real    1m8.962s
> user    0m19.844s
> sys     0m13.612s
> [mir at sleipner:~]$ time scp /tmp/dump.img 192.168.2.116:/tmp
> dump.img                             100% 2048MB  19.0MB/s 01:48
>
> real    1m51.179s
> user    0m19.892s
> sys     0m11.404s
>
>
> --
> Hilsen/Regards
> Michael Rasmussen
>
> Get my public GnuPG keys:
> michael <at> rasmussen <dot> cc
> http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E
> mir <at> datanom <dot> net
> http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C
> mir <at> miras <dot> org
> http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917
> --------------------------------------------------------------
> I should have been a country-western singer.  After all, I'm older than
> most western countries.
>                 -- George Burns
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://pve.proxmox.com/pipermail/pve-user/attachments/20130916/35712743/attachment-0015.html>


More information about the pve-user mailing list