IO hang after guest-fsfreeze for backup

[Eneko Lacunza]

Hi all,

Tonight one VM has "almost-locked" (login was working but froze when 
trying to log in).

Seems it lost IO access when backups started at 22:00:

feb 20 21:17:01 odoo CRON[8888]: (root) CMD (cd / && run-parts --report 
/etc/cron.hourly)
feb 20 21:17:01 odoo CRON[8887]: pam_unix(cron:session): session closed 
for user root
feb 20 22:00:03 odoo qemu-ga[493]: info: guest-ping called
feb 20 22:00:03 odoo qemu-ga[493]: info: guest-fsfreeze called
-- Boot c714a4fd6d894b8faaff984b50d27a44 --
feb 21 09:16:09 odoo kernel: Linux version 6.1.0-16-amd64 
(debian-kernel at lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU 
ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 
6.1.67-1 (2023->
feb 21 09:16:09 odoo kernel: Command line: 
BOOT_IMAGE=/vmlinuz-6.1.0-16-amd64 root=/dev/mapper/odoo--vg-root ro quiet

Guest is Debian 12 and PVE is

proxmox-ve: 8.1.0 (running kernel: 6.5.11-4-pve)
pve-manager: 8.1.3 (running version: 8.1.3/b46aac3b42da5d15)
proxmox-kernel-helper: 8.0.9
pve-kernel-6.2: 8.0.5
proxmox-kernel-6.5.11-4-pve-signed: 6.5.11-4
proxmox-kernel-6.5: 6.5.11-4
proxmox-kernel-6.2.16-19-pve: 6.2.16-19
proxmox-kernel-6.2: 6.2.16-19
pve-kernel-6.2.16-3-pve: 6.2.16-3
ceph: 17.2.7-pve1
ceph-fuse: 17.2.7-pve1
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx7
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-4
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.0
libproxmox-backup-qemu0: 1.4.0
libproxmox-rs-perl: 0.3.1
libpve-access-control: 8.0.7
libpve-apiclient-perl: 3.3.1
libpve-common-perl: 8.1.0
libpve-guest-common-perl: 5.0.6
libpve-http-server-perl: 5.0.5
libpve-network-perl: 0.9.4
libpve-rs-perl: 0.8.7
libpve-storage-perl: 8.0.5
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 5.0.2-4
lxcfs: 5.0.3-pve3
novnc-pve: 1.4.0-3
proxmox-backup-client: 3.0.4-1
proxmox-backup-file-restore: 3.0.4-1
proxmox-kernel-helper: 8.0.9
proxmox-mail-forward: 0.2.2
proxmox-mini-journalreader: 1.4.0
proxmox-widget-toolkit: 4.1.3
pve-cluster: 8.0.5
pve-container: 5.0.8
pve-docs: 8.1.3
pve-edk2-firmware: 4.2023.08-2
pve-firewall: 5.0.3
pve-firmware: 3.9-1
pve-ha-manager: 4.0.3
pve-i18n: 3.1.2
pve-qemu-kvm: 8.1.2-4
pve-xtermjs: 5.3.0-2
qemu-server: 8.0.10
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.0-pve3

Storage is Ceph r3 pool (ssd OSDs).

I have seen (old) reports of issues with guest-fsfreeze but this VM has 
been backing up regularly without issues, and guest was installed 2 
months ago.

Has any issue related to this been fixed lately? I'm unsure whether 
upgrading PVE to latest and/or disabling guest-fsfreeze could help.

Thanks

Eneko Lacunza
Zuzendari teknikoa | Director técnico
Binovo IT Human Project

Tel. +34 943 569 206 | https://www.binovo.es
Astigarragako Bidea, 2 - 2º izda. Oficina 10-11, 20180 Oiartzun

https://www.youtube.com/user/CANALBINOVO
https://www.linkedin.com/company/37269706/