[pve-devel] Error in PVE with win2008r2 and 256GB RAM

Alexandre DERUMIER aderumier at odiso.com
Fri Dec 5 07:39:32 CET 2014


>>4) I do a live migration of this VM,
>>and after i see in the PVE GUI:
>>Memory total: 248 GB.
>>Memory used: 12.66 GB.
>>- This for me, is very strange.... ¿? ¿? ¿?

Ths is because live migration don't copy zero block memory, that windows fill at boot (only windows do that, not linux)

(zero block are reserved on the host).


Note that with ksm on the host, theses zeros are merged (on the host side), when memory reach 80% by default.




----- Mail original ----- 

De: "Cesar Peschiera" <brain at click.com.py> 
À: "Alexandre DERUMIER" <aderumier at odiso.com>, pve-devel at pve.proxmox.com 
Envoyé: Vendredi 5 Décembre 2014 06:08:22 
Objet: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM 

> At boot, windows fill the memory with zero. and that's use cpu 

Please, let me to do a questions, 
due to that i don't know if this is good or bad. 

These are my actions in chronological order: 
(with the latest Win virtio drivers version: 0.1-94) 

1) I configure the Win2008R2 SP1 VM with 248 GB. RAM 
2) I power on the VM 
3) After, i see in the PVE GUI this: 
Memory total: 248 GB. 
Memory used: 239.9 GB. 

And i see on the VM: 
Memory total: 248 GB. 
In Cache: 119 MB. 
Available: 237 GB. 
Free: 237 GB. 

4) I do a live migration of this VM, 
and after i see in the PVE GUI: 
Memory total: 248 GB. 
Memory used: 12.66 GB. 
- This for me, is very strange.... ¿? ¿? ¿? 

And i see on the VM: 
Memory total: 248 GB. 
In Cache: 133 MB. (14 MB of variation) 
Available: 237 GB. 
Free: 237 GB. 
- Almost the same (only a variation in cache) 

5) I do a live migration of this VM to the original PVE host 
and after i see in the PVE GUI: 
Memory total: 248 GB. 
Memory used: 12.67 GB. 
- Almost the same, only a minimal variation in "Memory used" 

And i see on the VM: 
Memory total: 248 GB. 
In Cache: 134 MB. (1 MB of variation) 
Available: 237 GB. 
Free: 237 GB. 
- Almost the same, only a minimal variation in "cache" 

The questions: 
-------------- 
Is this a normal behaviour?, 
and, why? 

Best regards 
Cesar 

----- Original Message ----- 
From: "Alexandre DERUMIER" <aderumier at odiso.com> 
To: "Cesar Peschiera" <brain at click.com.py> 
Cc: <pve-devel at pve.proxmox.com> 
Sent: Monday, December 01, 2014 2:47 AM 
Subject: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM 


>>3) In parallel to this strange behavior, htop on PVE is showing that the 
>>process that consume a lot of processor is: "/usr/bin/kvm", this behavior 
>>is 
>>repetitive in all threads of processor that the VM has access. 

The kvm process is your vm ;) (each guestvm is a kvm process) 


>>4) In parallel to this strange behavior, while that the VM is configured 
>>with 62GB RAM, htop on PVE is showing that the use of the memory is 
>>growing 
>>in each second that elapses, and when his memory bar say that have used 
>>"63964/257912MB", the consumption of threads of processors of this VM 
>>returns to normal state. While that the VM has more RAM, the behavior is 
>>the 
>>same, but the VM takes longer time to reach to a normal state. 

At boot, windows fill the memory with zero. and that's use cpu 

BTW, do you use balloning/dynamic memory feature of proxmox ? 
can you try to add balloon:0 in your config. (to disable the balloon device) 


>>5) As a second test, after of see all these behaviours, I log to Windows 
>>Server, and htop show me a high consumption of many threads of processors 
>>(+/- 50%), but after that the session was initiated, the consumption of 
>>processors returns to normal state. 

>>6) In htop, i see the same behaviour of consumption of processor while 
>>that 
>>a session of windows is closing, i guess that any thing that i do in this 
>>VM 
>>will consume processor resources extra needlessly. 

really don't known, this should require some cpu profiling inside windows. 



----- Mail original ----- 

De: "Cesar Peschiera" <brain at click.com.py> 
À: pve-devel at pve.proxmox.com 
Envoyé: Lundi 1 Décembre 2014 06:35:14 
Objet: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM 

Hi to PVE team developers 

This is a new summary of a major problem between PVE, KVM and Win2008R2 SP1 
VM. 

Maybe i am doing something wrong, or maybe PVE or KVM need some corrections, 
but i have done many test for get that the Win2008R2 SP1 works correctly 
without successful, so that i would like consult about this to the PVE 
developers 

Summary of the problem: 
------------------------- 
When i turn on the Win2008R2 VM, the cpu go to the 100% in use for each 
thread enabled in the VM, and when the VM is configured for example with 4GB 
RAM, this VM works perfectly. 

This is my Hardware setup: 
--------------------------- 
- DELL poweredge R720 Server, 
- Two processors Intel Xeon CPU E5-2690 v2 @ 3.00GHz., each processor has 
10 cores and 20 threads (Hyperthreading), 
- 256GB RAM. in performace mode 

This is my Software setup: 
-------------------------- 
- The Software is recently installed: 
- PVE 3.3-5 (from his ISO and upgraded), 
- Kernel: pve-kernel-2.6.32-34-pve, 
- As VM: Win2008R2 SP1 using the 2 Intel processors and 248 GB RAM, 
- VM without the use of tablet for pointer enabled in PVE (i use vmmouse of 
VMware). 

Here the symptoms and my actions performed: 
----------------------------------------------- 

1) Doing some tests, i have changed manually the size the page file of 
Windows Server to 10 GB, and configured the VM with 62 GB. RAM (63488 MB. 
RAM), now i can see that the Windows Server start with 100% of CPU, and 
after of two minutes more or less, the processor returns to a normal state. 

2) Seeing the task manager of Win2008R2 VM (while all cores and threads are 
at 100%), i get this: 
Image Name: System 
User Name: System 
CPU: 99% 
memory (Private workspace): 52 KB 
Description: NT Kernel & System 

All other processes are consuming 0% of CPU 


Here comes the more important information of side of PVE, 
and other actions performed: 
------------------------------------------------------------ 
3) In parallel to this strange behavior, htop on PVE is showing that the 
process that consume a lot of processor is: "/usr/bin/kvm", this behavior is 
repetitive in all threads of processor that the VM has access. 

4) In parallel to this strange behavior, while that the VM is configured 
with 62GB RAM, htop on PVE is showing that the use of the memory is growing 
in each second that elapses, and when his memory bar say that have used 
"63964/257912MB", the consumption of threads of processors of this VM 
returns to normal state. While that the VM has more RAM, the behavior is the 
same, but the VM takes longer time to reach to a normal state. 

5) As a second test, after of see all these behaviours, I log to Windows 
Server, and htop show me a high consumption of many threads of processors 
(+/- 50%), but after that the session was initiated, the consumption of 
processors returns to normal state. 

6) In htop, i see the same behaviour of consumption of processor while that 
a session of windows is closing, i guess that any thing that i do in this VM 
will consume processor resources extra needlessly. 

7) Moreover, while that the task manager of Win2008R2 VM says that have +/- 
60GB free, PVE in his tag "Summary" says exactly the conversely. 

8) Trying to solve the problem, i did the suggestions without successful of 
Mr. Spirit, according to this link: 
http://forum.proxmox.com/threads/19309-Windows-KVM-frequent-restarts?p=99436#post99436 

Maybe KVM or PVE have problems for manage lots RAM memory with numa enabled 
in the bios of the Server, but in am not sure. 
Only as a reference, i show this link: 
https://bugzilla.redhat.com/show_bug.cgi?id=872524 

I will be very grateful I will be very grateful to anyone that may help me. 

Best regards 
Cesar 

_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 



More information about the pve-devel mailing list