[PVE-User] KVM Guest Ubuntu goes RO-Filesystem every some night

[Christopher Meyering]

Hi,

the servers are "brand new" (oldest bought about 4 months ago).
The following bios is used:
Vendor: Intel Corporation
Version: SE5C610.86B.01.01.0009.060120151350
Release Date: 06/01/2015

the logs on the guest don't say anything (bad luck: they lay on the 
partition which went ro), and in host syslog / kern.log isn't anything 
strange either.

I forget a thing:
The guests drive live in an zfs store on the raid systems.
Maybe it's important to know this.

I'm thinking of switching to ubuntu virtual kernel, but i'm not quite 
sure if it will help or break even more stuff.

greetings,
chris

Am 20.05.2016 um 08:42 schrieb Brian :::
> Is there anything in logs on guest or host around that time?
>
> On Fri, May 20, 2016 at 7:42 AM, Eneko Lacunza <elacunza at binovo.es> wrote:
>> Hi,
>>
>> El 20/05/16 a las 08:19, Christopher Meyering escribió:
>>> Hi folks,
>>>
>>> Maybe someone of you has some idea how to get rid of my strange
>>> "ro-filesytem" problem.
>>>
>>> First of all some basics:
>>> Proxmox runs on a potent host, powering the kvm-guests with 2 raids. (1
>>> ssd raid & 2 sas raid)
>>> In our pve cluster we currently run 4 identical hosts with overall 50 kvm
>>> guests on it.
>>>
>>> Every guest runs ubuntu server 14.04 with webservers, mysql & solr
>>> services.
>>>
>>> Since 3 weeks ago some guests started to fall into ro-state root
>>> filesystems at night without any noticeable reason.
>>> The stress on the hosts and guests is quite normal at these times and the
>>> problems occure on different times between 01:00 and 06:30 in the morning.
>>> Occurently i can see some serious cpu soft locks with over 40s stuck time.
>>
>> This is on the PVE hosts? What brand/model are the servers, BIOS
>> version/date? (dmidecode)
>>
>> If BIOS is old (pre-2010 I think), there can be power management problems.
>> You can also check power management in BIOS/UEFI and limit power saving to
>> see if that helps.
>>
>> Cheers
>> Eneko
>>
>> --
>> Zuzendari Teknikoa / Director Técnico
>> Binovo IT Human Project, S.L.
>> Telf. 943493611
>>        943324914
>> Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
>> www.binovo.es
>>
>>
>> _______________________________________________
>> pve-user mailing list
>> pve-user at pve.proxmox.com
>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user

-- 

Mit freundlichem Gruß
Christopher Meyering
Technical Consultant

DIA Connecting Software
------------------------------------------------------------------------

DIA Connecting Software GmbH & Co. KG · Menkestraße 23 · 26419 Schortens
Fon 04461 / 899 89 39 · Fax 04461 / 899 89 41
www.dia-software.de <http://www.dia-software.de> · 
christopher.meyering at dia-software.de 
<mailto:christopher.meyering at dia-software.de>

Persönlich haftende Gesellschafterin: DIA Connecting Software 
Beteiligungs GmbH
Handelsregister Wilhelmshaven HR B 131 604
Geschäftsführer: Dipl.-Ing. Ansgar Gallas, Marco Walther
Registergericht: Amtsgericht Oldenburg
Handelsregister Wilhelmshaven: HR A 13 08 89
Umsatzsteuer-Identifikationsnummer: DE813971952

Die Information in dieser Email ist vertraulich und ist ausschließlich 
für den Adressaten bestimmt. Jeglicher Zugriff auf diese Email durch 
andere Personen als den Adressaten ist untersagt.
Sollten Sie nicht der für diese Email bestimmte Adressat sein, ist Ihnen 
jede Veröffentlichung, Vervielfältigung oder Weitergabe wie auch das 
Ergreifen oder Unterlassen von Maßnahmen im Vertrauen
auf erlangte Information untersagt. In dieser Email enthaltene Meinungen 
oder Empfehlungen unterliegen den Bedingungen des jeweiligen 
Kundenverhältnisses mit dem Adressaten.