[PVE-User] Server freezing randomly with Proxmox 6.2-4 on AMD Ryzen system

Hermann Himmelbauer hermann at qwer.tk
Fri Sep 4 16:45:47 CEST 2020


Dear Proxmox users,

I'm trying to install a 3-node cluster (latest proxmox/ceph) and
experience random freezes. The node can either be completely frozen (no
blinking cursor on console, no ping) or can get somewhat blocked / slow etc.

This happens most often on node 2 (approx. 3-4 times / day), node 3
never got stuck within 14 days runtime, node 1 once.

Unfortunately I did not find any way to trigger this behaviour, however,
I *think* that this happens most often if I stress the machine in some
way (performance test within a virtual machine) and then idling the machine.

When the machine freezes completely, there is no logfile. However, if it
is partially frozen, some info can be aquired via dmesg. (See attached
file). ("device=2b:00.0" is an intel 10GBit ethernet adapter (X550T). So
perhaps there is some driver issue regarding this ethernet adapter?)

The system consists of the following components:

- AMD Ryzen 3 3200G, 4x 3.60GHz, boxed (YD3200C5FHBOX)
- ASRock Rack X470D4U2-2T (Mainboard)
- Samsung SSD 970 EVO Plus 250GB, M.2 (MZ-V7S250BW) (builtin SSD for OS)
- 2 * Kingston Server Premier DIMM 16GB, DDR4-2666, CL19-19-19, ECC (BOM
Number: 9965745-002.A00G, Part Number: KSM26ED8/16ME)
- be quiet! Pure Power 11 CM 400W ATX 2.4 (BN296) (Power supply)
- 2 * Micron 5300 PRO - Read Intensive 960GB, SATA
(MTFDDAK960TDS-1AW1Z6) (SSD for Ceph)
- LogiLink PC0075, 2x RJ-45, PCIe 2.0 x1 (second NIC with two ports)

The system is Linux Debian 10.4 (Proxmox 6.2-4) with kernel 5.4.34-1-pve
#1 SMP PVE 5.4.34-2 (Thu, 07 May 2020 10:02:02 +0200) x86_64 GNU/Linux.

What I did so far (without success):

- Disabled C6 as I read that this CPU-state can lead to unstable systems
(via "python zenstates.py --c6-disable" -> still errors).
- Updated my Bios to the latest version (3.30)
- Checked that the CPU + RAM are compatible to the mainboard (they are
listed as compatible on the ASRock website)
- Checked logs in IPMI (undervoltage, temperature etc., nothing is logged)
- Memory test (memtest86, no errors)

Do you have any clue what could be the reason for these freezes? Should
I think of some hardware error? Or is this some known Linux bug that can
be fixed?

Best Regards,
Hermann

-- 
hermann at qwer.tk
PGP/GPG: 299893C7 (on keyservers)
-------------- next part --------------
[Tue Aug 18 12:44:20 2020] usb 5-1: USB disconnect, device number 2
[Wed Aug 19 09:29:38 2020] perf: interrupt took too long (2502 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
[Sat Aug 22 21:18:59 2020] perf: interrupt took too long (3134 > 3127), lowering kernel.perf_event_max_sample_rate to 63750
[Fri Aug 28 16:55:06 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff2420 flags=0x0080]               
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:04:34 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff5bf0 flags=0x0080]               
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:04:51 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff3d80 flags=0x0080]               
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:04:51 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff63c0 flags=0x0080]               
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:05:06 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff02e0 flags=0x0080]               
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:16:33 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff30c0 flags=0x0080]               
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:16:46 2020] BUG: unable to handle page fault for address: ffffffffffffffb8
[Fri Aug 28 17:16:46 2020] #PF: supervisor write access in kernel mode
[Fri Aug 28 17:16:46 2020] #PF: error_code(0x0002) - not-present page
[Fri Aug 28 17:16:46 2020] PGD 2d080e067 P4D 2d080e067 PUD 2d0810067 PMD 0 
[Fri Aug 28 17:16:46 2020] Oops: 0002 [#1] SMP NOPTI
[Fri Aug 28 17:16:46 2020] CPU: 0 PID: 1472 Comm: corosync Tainted: P           OE     5.4.34-1-pve #1
[Fri Aug 28 17:16:46 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Fri Aug 28 17:16:46 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Fri Aug 28 17:16:46 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Fri Aug 28 17:16:46 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Fri Aug 28 17:16:46 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Fri Aug 28 17:16:46 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Fri Aug 28 17:16:46 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Fri Aug 28 17:16:46 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Fri Aug 28 17:16:46 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Fri Aug 28 17:16:46 2020] FS:  00007fb728e5a700(0000) GS:ffff97092e800000(0000) knlGS:0000000000000000
[Fri Aug 28 17:16:46 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Aug 28 17:16:46 2020] CR2: ffffffffffffffb8 CR3: 00000007c65e8000 CR4: 00000000003406f0
[Fri Aug 28 17:16:46 2020] Call Trace:
[Fri Aug 28 17:16:46 2020]  ? hrtimer_init_sleeper+0x90/0x90
[Fri Aug 28 17:16:46 2020]  __x64_sys_nanosleep+0x7b/0xa0
[Fri Aug 28 17:16:46 2020]  do_syscall_64+0x57/0x190
[Fri Aug 28 17:16:46 2020]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[Fri Aug 28 17:16:46 2020] RIP: 0033:0x7fb732eea720
[Fri Aug 28 17:16:46 2020] Code: 00 f0 ff ff 77 44 c3 0f 1f 00 55 48 89 f5 53 48 89 fb 48 83 ec 18 e8 3f 00 04 00 48 89 ee 48 89 df 89 c2 b8 23 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2a 89 d7 89 44 24 0c e8 7d 00 04 00 8b 44 24
[Fri Aug 28 17:16:46 2020] RSP: 002b:00007fb728e59df0 EFLAGS: 00000293 ORIG_RAX: 0000000000000023
[Fri Aug 28 17:16:46 2020] RAX: ffffffffffffffda RBX: 00007fb728e59e20 RCX: 00007fb732eea720
[Fri Aug 28 17:16:46 2020] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00007fb728e59e20
[Fri Aug 28 17:16:46 2020] RBP: 0000000000000000 R08: 00007fb72bffe618 R09: 0000000000000000
[Fri Aug 28 17:16:46 2020] R10: 00000000000e7c62 R11: 0000000000000293 R12: 00000000cccccccd
[Fri Aug 28 17:16:46 2020] R13: 0000000000000002 R14: 00007fb728e5a700 R15: 0000000000000002
[Fri Aug 28 17:16:46 2020] Modules linked in: msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E)
[Fri Aug 28 17:16:46 2020]  libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Fri Aug 28 17:16:46 2020] CR2: ffffffffffffffb8
[Fri Aug 28 17:16:46 2020] ---[ end trace e2af4be9abde7025 ]---
[Fri Aug 28 17:16:46 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Fri Aug 28 17:16:46 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Fri Aug 28 17:16:46 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Fri Aug 28 17:16:46 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Fri Aug 28 17:16:46 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Fri Aug 28 17:16:46 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Fri Aug 28 17:16:46 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Fri Aug 28 17:16:46 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Fri Aug 28 17:16:46 2020] FS:  00007fb728e5a700(0000) GS:ffff97092e800000(0000) knlGS:0000000000000000
[Fri Aug 28 17:16:46 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Aug 28 17:16:46 2020] CR2: ffffffffffffffb8 CR3: 00000007c65e8000 CR4: 00000000003406f0
[Fri Aug 28 17:17:05 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff0820 flags=0x0080]               
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:17:09 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xff9758c0 flags=0x00a0]               
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:18:02 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff1df0 flags=0x0080]               
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 18:35:40 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff40d0 flags=0x0080]               
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 18:35:45 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff6960 flags=0x0080]               
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 18:35:58 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff45f0 flags=0x0080]               
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 19:25:30 2020] device tap101i0 entered promiscuous mode
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered disabled state
[Mon Aug 31 19:25:30 2020] device fwln101i0 entered promiscuous mode
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered forwarding state
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered blocking state
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered disabled state
[Mon Aug 31 19:25:30 2020] device fwpr101p0 entered promiscuous mode
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered blocking state
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered forwarding state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered disabled state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered forwarding state
[Mon Aug 31 22:23:20 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff0fa0 flags=0x0080]               
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[3]: 0000000000000000
[Tue Sep  1 17:19:26 2020] invalid opcode: 0000 [#2] SMP NOPTI
[Tue Sep  1 17:19:26 2020] CPU: 3 PID: 1105540 Comm: kvm Tainted: P      D    OE     5.4.34-1-pve #1
[Tue Sep  1 17:19:26 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Tue Sep  1 17:19:26 2020] RIP: 0010:apic_timer_interrupt+0x12/0x20
[Tue Sep  1 17:19:26 2020] Code: ff e7 0f 1f 84 00 00 00 00 00 0f 1f 40 00 c3 90 90 90 90 90 90 90 90 90 68 13 ff ff ff e8 b6 ec ff ff e8 d1 0a 00 00 e9 9b ed <ff> ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 68 08 ff ff ff e8 96 ec
[Tue Sep  1 17:19:26 2020] RSP: 0018:ffffac978220ba58 EFLAGS: 00010002
[Tue Sep  1 17:19:26 2020] RAX: 0000000000000000 RBX: ffffac978220bb10 RCX: ffff9706c0b496a0
[Tue Sep  1 17:19:26 2020] RDX: 0000000000000001 RSI: 0000000000004000 RDI: 000000000000000f
[Tue Sep  1 17:19:26 2020] RBP: ffffac978220ba80 R08: 0000000000000001 R09: ffff9706c0b49600
[Tue Sep  1 17:19:26 2020] R10: 000000000000000f R11: ffff9706c0a44600 R12: 0000000000000000
[Tue Sep  1 17:19:26 2020] R13: 0000000000000000 R14: 0000000000000000 R15: ffffac978220bb44
[Tue Sep  1 17:19:26 2020] FS:  00007f0ff830bb80(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:26 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:26 2020] CR2: 0000000000000030 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:26 2020] Call Trace:
[Tue Sep  1 17:19:26 2020]  ? __fget+0x4d/0x80
[Tue Sep  1 17:19:26 2020]  __fget_light+0x59/0x70
[Tue Sep  1 17:19:26 2020]  __fdget+0x13/0x20
[Tue Sep  1 17:19:26 2020]  do_sys_poll+0x1f8/0x510
[Tue Sep  1 17:19:26 2020]  ? update_curr+0x7a/0x1e0
[Tue Sep  1 17:19:26 2020]  ? wake_up_process+0x15/0x20
[Tue Sep  1 17:19:26 2020]  ? swake_up_locked.part.7+0x17/0x30
[Tue Sep  1 17:19:26 2020]  ? swake_up_one+0x37/0x40
[Tue Sep  1 17:19:26 2020]  ? poll_select_finish+0x210/0x210
[Tue Sep  1 17:19:26 2020]  ? poll_select_finish+0x210/0x210
[Tue Sep  1 17:19:26 2020]  ? poll_select_finish+0x210/0x210
[Tue Sep  1 17:19:26 2020]  ? kvm_arch_set_irq_inatomic+0x92/0xb0 [kvm]
[Tue Sep  1 17:19:26 2020]  ? irqfd_wakeup+0xf6/0x170 [kvm]
[Tue Sep  1 17:19:26 2020]  ? kvm_irq_delivery_to_apic+0x2b0/0x2b0 [kvm]
[Tue Sep  1 17:19:26 2020]  ? _copy_to_user+0x2b/0x40
[Tue Sep  1 17:19:26 2020]  ? put_timespec64+0x3f/0x60
[Tue Sep  1 17:19:26 2020]  ? ktime_get_ts64+0x46/0xe0
[Tue Sep  1 17:19:26 2020]  __x64_sys_ppoll+0xad/0xf0
[Tue Sep  1 17:19:26 2020]  do_syscall_64+0x57/0x190
[Tue Sep  1 17:19:26 2020]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[Tue Sep  1 17:19:26 2020] RIP: 0033:0x7f1002f36916
[Tue Sep  1 17:19:26 2020] Code: 7c 24 08 e8 5c 7e 01 00 41 b8 08 00 00 00 4c 8b 54 24 18 48 89 da 41 89 c1 48 8b 74 24 10 48 8b 7c 24 08 b8 0f 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 28 44 89 cf 89 44 24 08 e8 86 7e 01 00 8b 44
[Tue Sep  1 17:19:26 2020] RSP: 002b:00007fff5c4f7a50 EFLAGS: 00000293 ORIG_RAX: 000000000000010f
[Tue Sep  1 17:19:26 2020] RAX: ffffffffffffffda RBX: 00007fff5c4f7a70 RCX: 00007f1002f36916
[Tue Sep  1 17:19:26 2020] RDX: 00007fff5c4f7a70 RSI: 000000000000000c RDI: 00007f0dea164400
[Tue Sep  1 17:19:26 2020] RBP: 00007fff5c4f7ae0 R08: 0000000000000008 R09: 0000000000000000
[Tue Sep  1 17:19:26 2020] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f0ff7ffb3c0
[Tue Sep  1 17:19:26 2020] R13: 00007f0ff7ffb3c0 R14: 00007fff5c4f7adc R15: 0000000000000000
[Tue Sep  1 17:19:26 2020] Modules linked in: veth(E) msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E)
[Tue Sep  1 17:19:26 2020]  libiscsi_tcp(E) libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Tue Sep  1 17:19:26 2020] ---[ end trace e2af4be9abde7026 ]---
[Tue Sep  1 17:19:26 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Tue Sep  1 17:19:26 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Tue Sep  1 17:19:26 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Tue Sep  1 17:19:26 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Tue Sep  1 17:19:26 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Tue Sep  1 17:19:26 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Tue Sep  1 17:19:26 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Tue Sep  1 17:19:26 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Tue Sep  1 17:19:26 2020] FS:  00007f0ff830bb80(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:26 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:26 2020] CR2: 0000000000000030 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:45 2020] BUG: unable to handle page fault for address: ffffac978220bce8
[Tue Sep  1 17:19:45 2020] #PF: supervisor read access in kernel mode
[Tue Sep  1 17:19:45 2020] #PF: error_code(0x0000) - not-present page
[Tue Sep  1 17:19:45 2020] PGD 7eb55a067 P4D 7eb55a067 PUD 7eb55b067 PMD 7e6c6e067 PTE 0
[Tue Sep  1 17:19:45 2020] Oops: 0000 [#3] SMP NOPTI
[Tue Sep  1 17:19:45 2020] CPU: 3 PID: 1105610 Comm: kvm Tainted: P      D    OE     5.4.34-1-pve #1
[Tue Sep  1 17:19:45 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Tue Sep  1 17:19:45 2020] RIP: 0010:__wake_up_common+0x41/0x140
[Tue Sep  1 17:19:45 2020] Code: ec 18 4d 85 c9 74 0a 41 f6 01 04 0f 85 a2 00 00 00 48 8b 43 08 48 83 c3 08 48 8d 78 e8 48 8d 47 18 48 39 c3 0f 84 ca 00 00 00 <48> 8b 47 18 4c 89 45 c8 4d 89 cd 45 31 e4 89 4d d0 89 75 d4 4c 8d
[Tue Sep  1 17:19:45 2020] RSP: 0018:ffffac978261fdc8 EFLAGS: 00010097
[Tue Sep  1 17:19:45 2020] RAX: ffffac978220bce8 RBX: ffff9706c096c9d0 RCX: 0000000000000000
[Tue Sep  1 17:19:45 2020] RDX: 0000000000000001 RSI: 0000000000000003 RDI: ffffac978220bcd0
[Tue Sep  1 17:19:45 2020] RBP: ffffac978261fe08 R08: 0000000000000001 R09: 0000000000000000
[Tue Sep  1 17:19:45 2020] R10: 000000000000000c R11: ffff9706c086cc00 R12: ffff9706c096c9d0
[Tue Sep  1 17:19:45 2020] R13: ffff9706c096c9c0 R14: ffff9706b7f49780 R15: 0000000000000008
[Tue Sep  1 17:19:45 2020] FS:  00007f0de79ff700(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:45 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:45 2020] CR2: ffffac978220bce8 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:45 2020] Call Trace:
[Tue Sep  1 17:19:45 2020]  __wake_up_locked_key+0x1b/0x20
[Tue Sep  1 17:19:45 2020]  eventfd_write+0xd3/0x260
[Tue Sep  1 17:19:45 2020]  ? wake_up_q+0x80/0x80
[Tue Sep  1 17:19:45 2020]  __vfs_write+0x1b/0x40
[Tue Sep  1 17:19:45 2020]  vfs_write+0xab/0x1b0
[Tue Sep  1 17:19:45 2020]  ksys_write+0x61/0xe0
[Tue Sep  1 17:19:45 2020]  __x64_sys_write+0x1a/0x20
[Tue Sep  1 17:19:45 2020]  do_syscall_64+0x57/0x190
[Tue Sep  1 17:19:45 2020]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[Tue Sep  1 17:19:45 2020] RIP: 0033:0x7f100301a4a7
[Tue Sep  1 17:19:45 2020] Code: 44 00 00 41 54 49 89 d4 55 48 89 f5 53 89 fb 48 83 ec 10 e8 fb fc ff ff 4c 89 e2 48 89 ee 89 df 41 89 c0 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 35 44 89 c7 48 89 44 24 08 e8 34 fd ff ff 48
[Tue Sep  1 17:19:45 2020] RSP: 002b:00007f0de79f9530 EFLAGS: 00000293 ORIG_RAX: 0000000000000001
[Tue Sep  1 17:19:45 2020] RAX: ffffffffffffffda RBX: 000000000000000c RCX: 00007f100301a4a7
[Tue Sep  1 17:19:45 2020] RDX: 0000000000000008 RSI: 000055dfa09a0278 RDI: 000000000000000c
[Tue Sep  1 17:19:45 2020] RBP: 000055dfa09a0278 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Sep  1 17:19:45 2020] R10: 000055dfa0b069c0 R11: 0000000000000293 R12: 0000000000000008
[Tue Sep  1 17:19:45 2020] R13: 0000000000000004 R14: 00007f0de79f9698 R15: 000055dfa040c740
[Tue Sep  1 17:19:45 2020] Modules linked in: veth(E) msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E)
[Tue Sep  1 17:19:45 2020]  libiscsi_tcp(E) libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Tue Sep  1 17:19:45 2020] CR2: ffffac978220bce8
[Tue Sep  1 17:19:45 2020] ---[ end trace e2af4be9abde7027 ]---
[Tue Sep  1 17:19:45 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Tue Sep  1 17:19:45 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Tue Sep  1 17:19:45 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Tue Sep  1 17:19:45 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Tue Sep  1 17:19:45 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Tue Sep  1 17:19:45 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Tue Sep  1 17:19:45 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Tue Sep  1 17:19:45 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Tue Sep  1 17:19:45 2020] FS:  00007f0de79ff700(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:45 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:45 2020] CR2: ffffac978220bce8 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:46 2020] ------------[ cut here ]------------
[Tue Sep  1 17:19:46 2020] NETDEV WATCHDOG: enp43s0f0 (ixgbe): transmit queue 3 timed out
[Tue Sep  1 17:19:46 2020] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:448 dev_watchdog+0x264/0x270
[Tue Sep  1 17:19:46 2020] Modules linked in: veth(E) msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E)
[Tue Sep  1 17:19:46 2020]  libiscsi_tcp(E) libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Tue Sep  1 17:19:46 2020] CPU: 0 PID: 0 Comm: swapper/0 Tainted: P      D    OE     5.4.34-1-pve #1
[Tue Sep  1 17:19:46 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Tue Sep  1 17:19:46 2020] RIP: 0010:dev_watchdog+0x264/0x270
[Tue Sep  1 17:19:46 2020] Code: 48 85 c0 75 e6 eb a0 4c 89 ef c6 05 d5 0c e7 00 01 e8 b0 b1 fa ff 89 d9 4c 89 ee 48 c7 c7 40 89 84 86 48 89 c2 e8 9d 2b 70 ff <0f> 0b eb 82 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 41
[Tue Sep  1 17:19:46 2020] RSP: 0018:ffffac9780003e58 EFLAGS: 00010282
[Tue Sep  1 17:19:46 2020] RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000000006
[Tue Sep  1 17:19:46 2020] RDX: 0000000000000007 RSI: 0000000000000082 RDI: ffff97092e8178c0
[Tue Sep  1 17:19:46 2020] RBP: ffffac9780003e88 R08: 00000000000005ed R09: 00000000ffffffff
[Tue Sep  1 17:19:46 2020] R10: 0000000000000000 R11: ffff9709283d6ea0 R12: 0000000000000040
[Tue Sep  1 17:19:46 2020] R13: ffff97091e120000 R14: ffff97091e120480 R15: ffff97091e10cf40
[Tue Sep  1 17:19:46 2020] FS:  0000000000000000(0000) GS:ffff97092e800000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:46 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:46 2020] CR2: 000055b44ceff000 CR3: 000000076b154000 CR4: 00000000003406f0
[Tue Sep  1 17:19:46 2020] Call Trace:
[Tue Sep  1 17:19:46 2020]  <IRQ>
[Tue Sep  1 17:19:46 2020]  ? pfifo_fast_enqueue+0x160/0x160
[Tue Sep  1 17:19:46 2020]  call_timer_fn+0x32/0x130
[Tue Sep  1 17:19:46 2020]  run_timer_softirq+0x1a5/0x430
[Tue Sep  1 17:19:46 2020]  ? hrtimer_init_sleeper+0x90/0x90
[Tue Sep  1 17:19:46 2020]  ? ktime_get+0x3c/0xa0
[Tue Sep  1 17:19:46 2020]  ? lapic_next_event+0x20/0x30
[Tue Sep  1 17:19:46 2020]  ? clockevents_program_event+0x93/0xf0
[Tue Sep  1 17:19:46 2020]  __do_softirq+0xdc/0x2d4
[Tue Sep  1 17:19:46 2020]  irq_exit+0xa9/0xb0
[Tue Sep  1 17:19:46 2020]  smp_apic_timer_interrupt+0x79/0x130
[Tue Sep  1 17:19:46 2020]  apic_timer_interrupt+0xf/0x20
[Tue Sep  1 17:19:46 2020]  </IRQ>
[Tue Sep  1 17:19:46 2020] RIP: 0010:native_safe_halt+0x12/0x20
[Tue Sep  1 17:19:46 2020] Code: 48 02 20 48 8b 00 a8 08 75 c3 e9 7c ff ff ff 90 90 90 90 90 90 90 90 90 55 48 89 e5 e9 07 00 00 00 0f 00 2d 92 d9 50 00 fb f4 <5d> c3 66 66 2e 0f 1f 84 00 00 00 00 00 90 55 48 89 e5 e9 07 00 00
[Tue Sep  1 17:19:46 2020] RSP: 0018:ffffffff86a03e10 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[Tue Sep  1 17:19:46 2020] RAX: ffffffff85efe140 RBX: 0000000000000000 RCX: 0000000000000001
[Tue Sep  1 17:19:46 2020] RDX: 00000000be0f5ae2 RSI: ffffffff86a03de0 RDI: 0000000000000000
[Tue Sep  1 17:19:46 2020] RBP: ffffffff86a03e10 R08: 0000000000000002 R09: 000000000002a5c0
[Tue Sep  1 17:19:46 2020] R10: 001088ad6227cc18 R11: 0000000000000000 R12: 0000000000000000
[Tue Sep  1 17:19:46 2020] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[Tue Sep  1 17:19:46 2020]  ? __sched_text_end+0x5/0x5
[Tue Sep  1 17:19:46 2020]  default_idle+0x22/0x150
[Tue Sep  1 17:19:46 2020]  arch_cpu_idle+0x15/0x20
[Tue Sep  1 17:19:46 2020]  default_idle_call+0x2c/0x30
[Tue Sep  1 17:19:46 2020]  do_idle+0x1ea/0x270
[Tue Sep  1 17:19:46 2020]  cpu_startup_entry+0x1d/0x20
[Tue Sep  1 17:19:46 2020]  rest_init+0xae/0xb0
[Tue Sep  1 17:19:46 2020]  arch_call_rest_init+0xe/0x1b
[Tue Sep  1 17:19:46 2020]  start_kernel+0x551/0x570
[Tue Sep  1 17:19:46 2020]  x86_64_start_reservations+0x24/0x26
[Tue Sep  1 17:19:46 2020]  x86_64_start_kernel+0x74/0x77
[Tue Sep  1 17:19:46 2020]  secondary_startup_64+0xa4/0xb0
[Tue Sep  1 17:19:46 2020] ---[ end trace e2af4be9abde7028 ]---
[Tue Sep  1 17:19:46 2020] ixgbe 0000:2b:00.0 enp43s0f0: initiating reset due to tx timeout
[Tue Sep  1 17:19:46 2020] ixgbe 0000:2b:00.0 enp43s0f0: Reset adapter
[Tue Sep  1 17:20:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:20:41 2020] rcu:         3-...!: (108 GPs behind) idle=c28/0/0x0 softirq=22209626/22209627 fqs=1                                                   
[Tue Sep  1 17:20:41 2020]      (detected by 1, t=15002 jiffies, g=60868693, q=4558)
[Tue Sep  1 17:20:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:20:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:20:41 2020] rcu: rcu_sched kthread starved for 14999 jiffies! g60868693 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:20:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:20:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:20:41 2020] Call Trace:
[Tue Sep  1 17:20:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:20:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:20:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:20:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:20:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:20:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:20:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:20:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:20:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:21:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:21:41 2020] rcu:         3-...!: (0 ticks this GP) idle=6d0/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:21:41 2020]      (detected by 0, t=15002 jiffies, g=60868697, q=5752)
[Tue Sep  1 17:21:41 2020] Sending NMI from CPU 0 to CPUs 3:
[Tue Sep  1 17:21:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:21:41 2020] rcu: rcu_sched kthread starved for 15003 jiffies! g60868697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:21:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:21:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:21:41 2020] Call Trace:
[Tue Sep  1 17:21:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:21:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:21:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:21:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:21:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:21:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:21:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:21:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:21:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:24:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:24:41 2020] rcu:         3-...!: (0 ticks this GP) idle=e90/0/0x0 softirq=22209627/22209627 fqs=1                                                  
[Tue Sep  1 17:24:41 2020]      (detected by 1, t=60007 jiffies, g=60868697, q=8154)
[Tue Sep  1 17:24:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:24:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:24:41 2020] rcu: rcu_sched kthread starved for 45002 jiffies! g60868697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:24:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:24:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:24:41 2020] Call Trace:
[Tue Sep  1 17:24:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:24:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:24:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:24:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:24:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:24:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:24:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:24:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:24:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:25:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:25:41 2020] rcu:         3-...!: (0 ticks this GP) idle=504/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:25:41 2020]      (detected by 1, t=15002 jiffies, g=60868701, q=8880)
[Tue Sep  1 17:25:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:25:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:25:41 2020] rcu: rcu_sched kthread starved for 15002 jiffies! g60868701 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:25:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:25:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:25:41 2020] Call Trace:
[Tue Sep  1 17:25:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:25:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:25:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:25:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:25:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:25:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:25:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:25:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:25:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:28:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:28:41 2020] rcu:         3-...!: (0 ticks this GP) idle=74c/0/0x0 softirq=22209627/22209627 fqs=1                                                  
[Tue Sep  1 17:28:41 2020]      (detected by 1, t=60007 jiffies, g=60868701, q=10598)
[Tue Sep  1 17:28:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:28:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:28:41 2020] rcu: rcu_sched kthread starved for 45005 jiffies! g60868701 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:28:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:28:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:28:41 2020] Call Trace:
[Tue Sep  1 17:28:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:28:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:28:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:28:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:28:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:28:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:28:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:28:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:28:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:28:41 2020] ata7.00: exception Emask 0x0 SAct 0x8180000 SErr 0x0 action 0x6 frozen                                                                 
[Tue Sep  1 17:28:41 2020] ata7.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata7.00: cmd 60/00:98:00:08:00/01:00:00:00:00/40 tag 19 ncq dma 131072 in                                                              
                                    res 40/00:00:00:01:80/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata7.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata7.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata7.00: cmd 60/00:a0:00:00:00/01:00:00:00:00/40 tag 20 ncq dma 131072 in                                                              
                                    res 40/00:00:06:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata7.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata7.00: failed command: WRITE FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata7.00: cmd 61/08:d8:68:b8:bc/00:00:35:00:00/40 tag 27 ncq dma 4096 out                                                               
                                    res 40/00:00:00:01:80/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata7.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata7: hard resetting link
[Tue Sep  1 17:28:41 2020] ata8.00: exception Emask 0x0 SAct 0x4040c0 SErr 0x0 action 0x6 frozen                                                                  
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 60/00:30:00:08:00/01:00:00:00:00/40 tag 6 ncq dma 131072 in                                                               
                                    res 40/00:00:01:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 60/00:38:00:00:00/01:00:00:00:00/40 tag 7 ncq dma 131072 in                                                               
                                    res 40/00:00:00:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: WRITE FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 61/20:70:80:6f:b0/00:00:35:00:00/40 tag 14 ncq dma 16384 out                                                              
                                    res 40/00:00:00:01:80/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 60/08:b0:b8:f7:7a/00:00:15:00:00/40 tag 22 ncq dma 4096 in                                                                
                                    res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8: hard resetting link
[Tue Sep  1 17:28:41 2020] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[Tue Sep  1 17:28:46 2020] ata7.00: qc timeout (cmd 0xec)
[Tue Sep  1 17:28:46 2020] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x4)
[Tue Sep  1 17:28:46 2020] ata7.00: revalidation failed (errno=-5)
[Tue Sep  1 17:28:46 2020] ata7: hard resetting link
[Tue Sep  1 17:28:47 2020] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[Tue Sep  1 17:28:57 2020] ata7.00: qc timeout (cmd 0xec)
[Tue Sep  1 17:28:57 2020] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x4)
[Tue Sep  1 17:28:57 2020] ata7.00: revalidation failed (errno=-5)
[Tue Sep  1 17:28:57 2020] ata7: limiting SATA link speed to 3.0 Gbps
[Tue Sep  1 17:28:57 2020] ata7: hard resetting link
[Tue Sep  1 17:28:57 2020] ata7: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[Tue Sep  1 17:29:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:29:41 2020] rcu:         3-...!: (0 ticks this GP) idle=d2c/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:29:41 2020]      (detected by 1, t=15002 jiffies, g=60868705, q=7620)
[Tue Sep  1 17:29:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:29:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:29:41 2020] rcu: rcu_sched kthread starved for 15002 jiffies! g60868705 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:29:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:29:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:29:41 2020] Call Trace:
[Tue Sep  1 17:29:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:29:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:29:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:29:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:29:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:29:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:29:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:29:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:29:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:32:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:32:41 2020] rcu:         3-...!: (0 ticks this GP) idle=750/0/0x0 softirq=22209627/22209627 fqs=1                                                  
[Tue Sep  1 17:32:41 2020]      (detected by 1, t=60007 jiffies, g=60868705, q=9388)
[Tue Sep  1 17:32:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:32:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:32:41 2020] rcu: rcu_sched kthread starved for 45005 jiffies! g60868705 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:32:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:32:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:32:41 2020] Call Trace:
[Tue Sep  1 17:32:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:32:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:32:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:32:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:32:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:32:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:32:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:32:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:32:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:33:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:33:41 2020] rcu:         3-...!: (0 ticks this GP) idle=868/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:33:41 2020]      (detected by 1, t=15002 jiffies, g=60868709, q=7321)
[Tue Sep  1 17:33:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:33:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:33:41 2020] rcu: rcu_sched kthread starved for 15002 jiffies! g60868709 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:33:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:33:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:33:41 2020] Call Trace:
[Tue Sep  1 17:33:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:33:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:33:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:33:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:33:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:33:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:33:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:33:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:33:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:36:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:36:41 2020] rcu:         3-...!: (0 ticks this GP) idle=500/0/0x0 softirq=22209627/22209627 fqs=1 
[Tue Sep  1 17:36:41 2020]      (detected by 1, t=60007 jiffies, g=60868709, q=12917)
[Tue Sep  1 17:36:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:36:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:36:41 2020] rcu: rcu_sched kthread starved for 45005 jiffies! g60868709 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3
[Tue Sep  1 17:36:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:36:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:36:41 2020] Call Trace:
[Tue Sep  1 17:36:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:36:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:36:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:36:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:36:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:36:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:36:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:36:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:36:41 2020]  ret_from_fork+0x22/0x40
root at pmx02:~# 
[Tue Aug 18 12:44:20 2020] usb 5-1: USB disconnect, device number 2
[Wed Aug 19 09:29:38 2020] perf: interrupt took too long (2502 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
[Sat Aug 22 21:18:59 2020] perf: interrupt took too long (3134 > 3127), lowering kernel.perf_event_max_sample_rate to 63750
[Fri Aug 28 16:55:06 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff2420 flags=0x0080]               
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 16:55:06 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:04:34 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff5bf0 flags=0x0080]               
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:04:34 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:04:51 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff3d80 flags=0x0080]               
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:04:51 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff63c0 flags=0x0080]               
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:04:51 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:05:06 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff02e0 flags=0x0080]               
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:05:06 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:16:33 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff30c0 flags=0x0080]               
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:16:33 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:16:46 2020] BUG: unable to handle page fault for address: ffffffffffffffb8
[Fri Aug 28 17:16:46 2020] #PF: supervisor write access in kernel mode
[Fri Aug 28 17:16:46 2020] #PF: error_code(0x0002) - not-present page
[Fri Aug 28 17:16:46 2020] PGD 2d080e067 P4D 2d080e067 PUD 2d0810067 PMD 0 
[Fri Aug 28 17:16:46 2020] Oops: 0002 [#1] SMP NOPTI
[Fri Aug 28 17:16:46 2020] CPU: 0 PID: 1472 Comm: corosync Tainted: P           OE     5.4.34-1-pve #1
[Fri Aug 28 17:16:46 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Fri Aug 28 17:16:46 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Fri Aug 28 17:16:46 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Fri Aug 28 17:16:46 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Fri Aug 28 17:16:46 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Fri Aug 28 17:16:46 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Fri Aug 28 17:16:46 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Fri Aug 28 17:16:46 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Fri Aug 28 17:16:46 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Fri Aug 28 17:16:46 2020] FS:  00007fb728e5a700(0000) GS:ffff97092e800000(0000) knlGS:0000000000000000
[Fri Aug 28 17:16:46 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Aug 28 17:16:46 2020] CR2: ffffffffffffffb8 CR3: 00000007c65e8000 CR4: 00000000003406f0
[Fri Aug 28 17:16:46 2020] Call Trace:
[Fri Aug 28 17:16:46 2020]  ? hrtimer_init_sleeper+0x90/0x90
[Fri Aug 28 17:16:46 2020]  __x64_sys_nanosleep+0x7b/0xa0
[Fri Aug 28 17:16:46 2020]  do_syscall_64+0x57/0x190
[Fri Aug 28 17:16:46 2020]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[Fri Aug 28 17:16:46 2020] RIP: 0033:0x7fb732eea720
[Fri Aug 28 17:16:46 2020] Code: 00 f0 ff ff 77 44 c3 0f 1f 00 55 48 89 f5 53 48 89 fb 48 83 ec 18 e8 3f 00 04 00 48 89 ee 48 89 df 89 c2 b8 23 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2a 89 d7 89 44 24 0c e8 7d 00 04 00 8b 44 24
[Fri Aug 28 17:16:46 2020] RSP: 002b:00007fb728e59df0 EFLAGS: 00000293 ORIG_RAX: 0000000000000023
[Fri Aug 28 17:16:46 2020] RAX: ffffffffffffffda RBX: 00007fb728e59e20 RCX: 00007fb732eea720
[Fri Aug 28 17:16:46 2020] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00007fb728e59e20
[Fri Aug 28 17:16:46 2020] RBP: 0000000000000000 R08: 00007fb72bffe618 R09: 0000000000000000
[Fri Aug 28 17:16:46 2020] R10: 00000000000e7c62 R11: 0000000000000293 R12: 00000000cccccccd
[Fri Aug 28 17:16:46 2020] R13: 0000000000000002 R14: 00007fb728e5a700 R15: 0000000000000002
[Fri Aug 28 17:16:46 2020] Modules linked in: msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E)
[Fri Aug 28 17:16:46 2020]  libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Fri Aug 28 17:16:46 2020] CR2: ffffffffffffffb8
[Fri Aug 28 17:16:46 2020] ---[ end trace e2af4be9abde7025 ]---
[Fri Aug 28 17:16:46 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Fri Aug 28 17:16:46 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Fri Aug 28 17:16:46 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Fri Aug 28 17:16:46 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Fri Aug 28 17:16:46 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Fri Aug 28 17:16:46 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Fri Aug 28 17:16:46 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Fri Aug 28 17:16:46 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Fri Aug 28 17:16:46 2020] FS:  00007fb728e5a700(0000) GS:ffff97092e800000(0000) knlGS:0000000000000000
[Fri Aug 28 17:16:46 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Aug 28 17:16:46 2020] CR2: ffffffffffffffb8 CR3: 00000007c65e8000 CR4: 00000000003406f0
[Fri Aug 28 17:17:05 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff0820 flags=0x0080]               
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:17:05 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:17:09 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xff9758c0 flags=0x00a0]               
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:17:09 2020] AMD-Vi: DTE[3]: 0000000000000000
[Fri Aug 28 17:18:02 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff1df0 flags=0x0080]               
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[1]: 0000000000000009
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Fri Aug 28 17:18:02 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 18:35:40 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff40d0 flags=0x0080]               
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 18:35:40 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 18:35:45 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff6960 flags=0x0080]               
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 18:35:45 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 18:35:58 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff45f0 flags=0x0080]               
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 18:35:58 2020] AMD-Vi: DTE[3]: 0000000000000000
[Mon Aug 31 19:25:30 2020] device tap101i0 entered promiscuous mode
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered disabled state
[Mon Aug 31 19:25:30 2020] device fwln101i0 entered promiscuous mode
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 1(fwln101i0) entered forwarding state
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered blocking state
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered disabled state
[Mon Aug 31 19:25:30 2020] device fwpr101p0 entered promiscuous mode
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered blocking state
[Mon Aug 31 19:25:30 2020] vmbr0: port 2(fwpr101p0) entered forwarding state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered disabled state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered blocking state
[Mon Aug 31 19:25:30 2020] fwbr101i0: port 2(tap101i0) entered forwarding state
[Mon Aug 31 22:23:20 2020] iommu ivhd0: AMD-Vi: Event logged [ILLEGAL_DEV_TABLE_ENTRY device=2b:00.0 pasid=0x00000 address=0xffff0fa0 flags=0x0080]               
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[0]: 60000007e10a8603
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[1]: 0000000000000009
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[2]: 20000007e0d6a011
[Mon Aug 31 22:23:20 2020] AMD-Vi: DTE[3]: 0000000000000000
[Tue Sep  1 17:19:26 2020] invalid opcode: 0000 [#2] SMP NOPTI
[Tue Sep  1 17:19:26 2020] CPU: 3 PID: 1105540 Comm: kvm Tainted: P      D    OE     5.4.34-1-pve #1
[Tue Sep  1 17:19:26 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Tue Sep  1 17:19:26 2020] RIP: 0010:apic_timer_interrupt+0x12/0x20
[Tue Sep  1 17:19:26 2020] Code: ff e7 0f 1f 84 00 00 00 00 00 0f 1f 40 00 c3 90 90 90 90 90 90 90 90 90 68 13 ff ff ff e8 b6 ec ff ff e8 d1 0a 00 00 e9 9b ed <ff> ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 68 08 ff ff ff e8 96 ec
[Tue Sep  1 17:19:26 2020] RSP: 0018:ffffac978220ba58 EFLAGS: 00010002
[Tue Sep  1 17:19:26 2020] RAX: 0000000000000000 RBX: ffffac978220bb10 RCX: ffff9706c0b496a0
[Tue Sep  1 17:19:26 2020] RDX: 0000000000000001 RSI: 0000000000004000 RDI: 000000000000000f
[Tue Sep  1 17:19:26 2020] RBP: ffffac978220ba80 R08: 0000000000000001 R09: ffff9706c0b49600
[Tue Sep  1 17:19:26 2020] R10: 000000000000000f R11: ffff9706c0a44600 R12: 0000000000000000
[Tue Sep  1 17:19:26 2020] R13: 0000000000000000 R14: 0000000000000000 R15: ffffac978220bb44
[Tue Sep  1 17:19:26 2020] FS:  00007f0ff830bb80(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:26 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:26 2020] CR2: 0000000000000030 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:26 2020] Call Trace:
[Tue Sep  1 17:19:26 2020]  ? __fget+0x4d/0x80
[Tue Sep  1 17:19:26 2020]  __fget_light+0x59/0x70
[Tue Sep  1 17:19:26 2020]  __fdget+0x13/0x20
[Tue Sep  1 17:19:26 2020]  do_sys_poll+0x1f8/0x510
[Tue Sep  1 17:19:26 2020]  ? update_curr+0x7a/0x1e0
[Tue Sep  1 17:19:26 2020]  ? wake_up_process+0x15/0x20
[Tue Sep  1 17:19:26 2020]  ? swake_up_locked.part.7+0x17/0x30
[Tue Sep  1 17:19:26 2020]  ? swake_up_one+0x37/0x40
[Tue Sep  1 17:19:26 2020]  ? poll_select_finish+0x210/0x210
[Tue Sep  1 17:19:26 2020]  ? poll_select_finish+0x210/0x210
[Tue Sep  1 17:19:26 2020]  ? poll_select_finish+0x210/0x210
[Tue Sep  1 17:19:26 2020]  ? kvm_arch_set_irq_inatomic+0x92/0xb0 [kvm]
[Tue Sep  1 17:19:26 2020]  ? irqfd_wakeup+0xf6/0x170 [kvm]
[Tue Sep  1 17:19:26 2020]  ? kvm_irq_delivery_to_apic+0x2b0/0x2b0 [kvm]
[Tue Sep  1 17:19:26 2020]  ? _copy_to_user+0x2b/0x40
[Tue Sep  1 17:19:26 2020]  ? put_timespec64+0x3f/0x60
[Tue Sep  1 17:19:26 2020]  ? ktime_get_ts64+0x46/0xe0
[Tue Sep  1 17:19:26 2020]  __x64_sys_ppoll+0xad/0xf0
[Tue Sep  1 17:19:26 2020]  do_syscall_64+0x57/0x190
[Tue Sep  1 17:19:26 2020]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[Tue Sep  1 17:19:26 2020] RIP: 0033:0x7f1002f36916
[Tue Sep  1 17:19:26 2020] Code: 7c 24 08 e8 5c 7e 01 00 41 b8 08 00 00 00 4c 8b 54 24 18 48 89 da 41 89 c1 48 8b 74 24 10 48 8b 7c 24 08 b8 0f 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 28 44 89 cf 89 44 24 08 e8 86 7e 01 00 8b 44
[Tue Sep  1 17:19:26 2020] RSP: 002b:00007fff5c4f7a50 EFLAGS: 00000293 ORIG_RAX: 000000000000010f
[Tue Sep  1 17:19:26 2020] RAX: ffffffffffffffda RBX: 00007fff5c4f7a70 RCX: 00007f1002f36916
[Tue Sep  1 17:19:26 2020] RDX: 00007fff5c4f7a70 RSI: 000000000000000c RDI: 00007f0dea164400
[Tue Sep  1 17:19:26 2020] RBP: 00007fff5c4f7ae0 R08: 0000000000000008 R09: 0000000000000000
[Tue Sep  1 17:19:26 2020] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f0ff7ffb3c0
[Tue Sep  1 17:19:26 2020] R13: 00007f0ff7ffb3c0 R14: 00007fff5c4f7adc R15: 0000000000000000
[Tue Sep  1 17:19:26 2020] Modules linked in: veth(E) msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E)
[Tue Sep  1 17:19:26 2020]  libiscsi_tcp(E) libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Tue Sep  1 17:19:26 2020] ---[ end trace e2af4be9abde7026 ]---
[Tue Sep  1 17:19:26 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Tue Sep  1 17:19:26 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Tue Sep  1 17:19:26 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Tue Sep  1 17:19:26 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Tue Sep  1 17:19:26 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Tue Sep  1 17:19:26 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Tue Sep  1 17:19:26 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Tue Sep  1 17:19:26 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Tue Sep  1 17:19:26 2020] FS:  00007f0ff830bb80(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:26 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:26 2020] CR2: 0000000000000030 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:45 2020] BUG: unable to handle page fault for address: ffffac978220bce8
[Tue Sep  1 17:19:45 2020] #PF: supervisor read access in kernel mode
[Tue Sep  1 17:19:45 2020] #PF: error_code(0x0000) - not-present page
[Tue Sep  1 17:19:45 2020] PGD 7eb55a067 P4D 7eb55a067 PUD 7eb55b067 PMD 7e6c6e067 PTE 0
[Tue Sep  1 17:19:45 2020] Oops: 0000 [#3] SMP NOPTI
[Tue Sep  1 17:19:45 2020] CPU: 3 PID: 1105610 Comm: kvm Tainted: P      D    OE     5.4.34-1-pve #1
[Tue Sep  1 17:19:45 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Tue Sep  1 17:19:45 2020] RIP: 0010:__wake_up_common+0x41/0x140
[Tue Sep  1 17:19:45 2020] Code: ec 18 4d 85 c9 74 0a 41 f6 01 04 0f 85 a2 00 00 00 48 8b 43 08 48 83 c3 08 48 8d 78 e8 48 8d 47 18 48 39 c3 0f 84 ca 00 00 00 <48> 8b 47 18 4c 89 45 c8 4d 89 cd 45 31 e4 89 4d d0 89 75 d4 4c 8d
[Tue Sep  1 17:19:45 2020] RSP: 0018:ffffac978261fdc8 EFLAGS: 00010097
[Tue Sep  1 17:19:45 2020] RAX: ffffac978220bce8 RBX: ffff9706c096c9d0 RCX: 0000000000000000
[Tue Sep  1 17:19:45 2020] RDX: 0000000000000001 RSI: 0000000000000003 RDI: ffffac978220bcd0
[Tue Sep  1 17:19:45 2020] RBP: ffffac978261fe08 R08: 0000000000000001 R09: 0000000000000000
[Tue Sep  1 17:19:45 2020] R10: 000000000000000c R11: ffff9706c086cc00 R12: ffff9706c096c9d0
[Tue Sep  1 17:19:45 2020] R13: ffff9706c096c9c0 R14: ffff9706b7f49780 R15: 0000000000000008
[Tue Sep  1 17:19:45 2020] FS:  00007f0de79ff700(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:45 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:45 2020] CR2: ffffac978220bce8 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:45 2020] Call Trace:
[Tue Sep  1 17:19:45 2020]  __wake_up_locked_key+0x1b/0x20
[Tue Sep  1 17:19:45 2020]  eventfd_write+0xd3/0x260
[Tue Sep  1 17:19:45 2020]  ? wake_up_q+0x80/0x80
[Tue Sep  1 17:19:45 2020]  __vfs_write+0x1b/0x40
[Tue Sep  1 17:19:45 2020]  vfs_write+0xab/0x1b0
[Tue Sep  1 17:19:45 2020]  ksys_write+0x61/0xe0
[Tue Sep  1 17:19:45 2020]  __x64_sys_write+0x1a/0x20
[Tue Sep  1 17:19:45 2020]  do_syscall_64+0x57/0x190
[Tue Sep  1 17:19:45 2020]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[Tue Sep  1 17:19:45 2020] RIP: 0033:0x7f100301a4a7
[Tue Sep  1 17:19:45 2020] Code: 44 00 00 41 54 49 89 d4 55 48 89 f5 53 89 fb 48 83 ec 10 e8 fb fc ff ff 4c 89 e2 48 89 ee 89 df 41 89 c0 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 35 44 89 c7 48 89 44 24 08 e8 34 fd ff ff 48
[Tue Sep  1 17:19:45 2020] RSP: 002b:00007f0de79f9530 EFLAGS: 00000293 ORIG_RAX: 0000000000000001
[Tue Sep  1 17:19:45 2020] RAX: ffffffffffffffda RBX: 000000000000000c RCX: 00007f100301a4a7
[Tue Sep  1 17:19:45 2020] RDX: 0000000000000008 RSI: 000055dfa09a0278 RDI: 000000000000000c
[Tue Sep  1 17:19:45 2020] RBP: 000055dfa09a0278 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Sep  1 17:19:45 2020] R10: 000055dfa0b069c0 R11: 0000000000000293 R12: 0000000000000008
[Tue Sep  1 17:19:45 2020] R13: 0000000000000004 R14: 00007f0de79f9698 R15: 000055dfa040c740
[Tue Sep  1 17:19:45 2020] Modules linked in: veth(E) msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E)
[Tue Sep  1 17:19:45 2020]  libiscsi_tcp(E) libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Tue Sep  1 17:19:45 2020] CR2: ffffac978220bce8
[Tue Sep  1 17:19:45 2020] ---[ end trace e2af4be9abde7027 ]---
[Tue Sep  1 17:19:45 2020] RIP: 0010:hrtimer_nanosleep+0x9c/0x190
[Tue Sep  1 17:19:45 2020] Code: 39 c8 0f 8f e1 00 00 00 48 69 c0 00 ca 9a 3b 48 01 d0 48 89 c2 48 89 45 b0 4c 01 e2 0f 88 8d 00 00 00 48 39 c2 0f 8c 84 00 00 <00> 48 b8 ff ff ff ff ff ff ff 7f 48 39 f2 48 0f 4c d0 89 de 4c 89
[Tue Sep  1 17:19:45 2020] RSP: 0018:ffffac97812a3e88 EFLAGS: 00010286
[Tue Sep  1 17:19:45 2020] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[Tue Sep  1 17:19:45 2020] RDX: ffff97092e81dfc0 RSI: 0000000000000000 RDI: ffffac97812a3e88
[Tue Sep  1 17:19:45 2020] RBP: ffffac97812a3ef8 R08: 0000000000000338 R09: 0000000000000001
[Tue Sep  1 17:19:45 2020] R10: 0000000000000006 R11: ffff970905f54e00 R12: 0000000000000000
[Tue Sep  1 17:19:45 2020] R13: ffffac97812a3e88 R14: ffffac97812a3f08 R15: 0000000000000000
[Tue Sep  1 17:19:45 2020] FS:  00007f0de79ff700(0000) GS:ffff97092e8c0000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:45 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:45 2020] CR2: ffffac978220bce8 CR3: 0000000588d64000 CR4: 00000000003406e0
[Tue Sep  1 17:19:46 2020] ------------[ cut here ]------------
[Tue Sep  1 17:19:46 2020] NETDEV WATCHDOG: enp43s0f0 (ixgbe): transmit queue 3 timed out
[Tue Sep  1 17:19:46 2020] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:448 dev_watchdog+0x264/0x270
[Tue Sep  1 17:19:46 2020] Modules linked in: veth(E) msr(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) sctp(E) iptable_filter(E) bpfilter(E) bonding(E) softdog(E) nfnetlink_log(E) nfnetlink(E) edac_mce_amd(E) ipmi_ssif(E) kvm_amd(E) ccp(E) kvm(E) zfs(POE) zunicode(POE) zlua(POE) zavl(POE) icp(POE) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_intel(E) aesni_intel(E) snd_intel_dspcfg(E) crypto_simd(E) snd_hda_codec(E) snd_hda_core(E) cryptd(E) glue_helper(E) snd_hwdep(E) snd_pcm(E) pcspkr(E) wmi_bmof(E) k10temp(E) snd_timer(E) snd(E) ast(E) soundcore(E) drm_vram_helper(E) ttm(E) drm_kms_helper(E) drm(E) i2c_algo_bit(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) joydev(E) input_leds(E) cdc_ether(E) usbnet(E) mii(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E)
[Tue Sep  1 17:19:46 2020]  libiscsi_tcp(E) libiscsi(E) sunrpc(E) scsi_transport_iscsi(E) ip_tables(E) x_tables(E) autofs4(E) btrfs(E) xor(E) zstd_compress(E) raid6_pq(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) libcrc32c(E) uas(E) usbmouse(E) usb_storage(E) hid_generic(E) usbkbd(E) usbhid(E) hid(E) i2c_piix4(E) ixgbe(E) xfrm_algo(E) dca(E) mdio(E) r8169(E) realtek(E) ahci(E) libahci(E) wmi(E) video(E) gpio_amdpt(E) gpio_generic(E)
[Tue Sep  1 17:19:46 2020] CPU: 0 PID: 0 Comm: swapper/0 Tainted: P      D    OE     5.4.34-1-pve #1
[Tue Sep  1 17:19:46 2020] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U2-2T, BIOS P3.30 10/03/2019
[Tue Sep  1 17:19:46 2020] RIP: 0010:dev_watchdog+0x264/0x270
[Tue Sep  1 17:19:46 2020] Code: 48 85 c0 75 e6 eb a0 4c 89 ef c6 05 d5 0c e7 00 01 e8 b0 b1 fa ff 89 d9 4c 89 ee 48 c7 c7 40 89 84 86 48 89 c2 e8 9d 2b 70 ff <0f> 0b eb 82 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 41
[Tue Sep  1 17:19:46 2020] RSP: 0018:ffffac9780003e58 EFLAGS: 00010282
[Tue Sep  1 17:19:46 2020] RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000000006
[Tue Sep  1 17:19:46 2020] RDX: 0000000000000007 RSI: 0000000000000082 RDI: ffff97092e8178c0
[Tue Sep  1 17:19:46 2020] RBP: ffffac9780003e88 R08: 00000000000005ed R09: 00000000ffffffff
[Tue Sep  1 17:19:46 2020] R10: 0000000000000000 R11: ffff9709283d6ea0 R12: 0000000000000040
[Tue Sep  1 17:19:46 2020] R13: ffff97091e120000 R14: ffff97091e120480 R15: ffff97091e10cf40
[Tue Sep  1 17:19:46 2020] FS:  0000000000000000(0000) GS:ffff97092e800000(0000) knlGS:0000000000000000
[Tue Sep  1 17:19:46 2020] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Tue Sep  1 17:19:46 2020] CR2: 000055b44ceff000 CR3: 000000076b154000 CR4: 00000000003406f0
[Tue Sep  1 17:19:46 2020] Call Trace:
[Tue Sep  1 17:19:46 2020]  <IRQ>
[Tue Sep  1 17:19:46 2020]  ? pfifo_fast_enqueue+0x160/0x160
[Tue Sep  1 17:19:46 2020]  call_timer_fn+0x32/0x130
[Tue Sep  1 17:19:46 2020]  run_timer_softirq+0x1a5/0x430
[Tue Sep  1 17:19:46 2020]  ? hrtimer_init_sleeper+0x90/0x90
[Tue Sep  1 17:19:46 2020]  ? ktime_get+0x3c/0xa0
[Tue Sep  1 17:19:46 2020]  ? lapic_next_event+0x20/0x30
[Tue Sep  1 17:19:46 2020]  ? clockevents_program_event+0x93/0xf0
[Tue Sep  1 17:19:46 2020]  __do_softirq+0xdc/0x2d4
[Tue Sep  1 17:19:46 2020]  irq_exit+0xa9/0xb0
[Tue Sep  1 17:19:46 2020]  smp_apic_timer_interrupt+0x79/0x130
[Tue Sep  1 17:19:46 2020]  apic_timer_interrupt+0xf/0x20
[Tue Sep  1 17:19:46 2020]  </IRQ>
[Tue Sep  1 17:19:46 2020] RIP: 0010:native_safe_halt+0x12/0x20
[Tue Sep  1 17:19:46 2020] Code: 48 02 20 48 8b 00 a8 08 75 c3 e9 7c ff ff ff 90 90 90 90 90 90 90 90 90 55 48 89 e5 e9 07 00 00 00 0f 00 2d 92 d9 50 00 fb f4 <5d> c3 66 66 2e 0f 1f 84 00 00 00 00 00 90 55 48 89 e5 e9 07 00 00
[Tue Sep  1 17:19:46 2020] RSP: 0018:ffffffff86a03e10 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[Tue Sep  1 17:19:46 2020] RAX: ffffffff85efe140 RBX: 0000000000000000 RCX: 0000000000000001
[Tue Sep  1 17:19:46 2020] RDX: 00000000be0f5ae2 RSI: ffffffff86a03de0 RDI: 0000000000000000
[Tue Sep  1 17:19:46 2020] RBP: ffffffff86a03e10 R08: 0000000000000002 R09: 000000000002a5c0
[Tue Sep  1 17:19:46 2020] R10: 001088ad6227cc18 R11: 0000000000000000 R12: 0000000000000000
[Tue Sep  1 17:19:46 2020] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[Tue Sep  1 17:19:46 2020]  ? __sched_text_end+0x5/0x5
[Tue Sep  1 17:19:46 2020]  default_idle+0x22/0x150
[Tue Sep  1 17:19:46 2020]  arch_cpu_idle+0x15/0x20
[Tue Sep  1 17:19:46 2020]  default_idle_call+0x2c/0x30
[Tue Sep  1 17:19:46 2020]  do_idle+0x1ea/0x270
[Tue Sep  1 17:19:46 2020]  cpu_startup_entry+0x1d/0x20
[Tue Sep  1 17:19:46 2020]  rest_init+0xae/0xb0
[Tue Sep  1 17:19:46 2020]  arch_call_rest_init+0xe/0x1b
[Tue Sep  1 17:19:46 2020]  start_kernel+0x551/0x570
[Tue Sep  1 17:19:46 2020]  x86_64_start_reservations+0x24/0x26
[Tue Sep  1 17:19:46 2020]  x86_64_start_kernel+0x74/0x77
[Tue Sep  1 17:19:46 2020]  secondary_startup_64+0xa4/0xb0
[Tue Sep  1 17:19:46 2020] ---[ end trace e2af4be9abde7028 ]---
[Tue Sep  1 17:19:46 2020] ixgbe 0000:2b:00.0 enp43s0f0: initiating reset due to tx timeout
[Tue Sep  1 17:19:46 2020] ixgbe 0000:2b:00.0 enp43s0f0: Reset adapter
[Tue Sep  1 17:20:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:20:41 2020] rcu:         3-...!: (108 GPs behind) idle=c28/0/0x0 softirq=22209626/22209627 fqs=1                                                   
[Tue Sep  1 17:20:41 2020]      (detected by 1, t=15002 jiffies, g=60868693, q=4558)
[Tue Sep  1 17:20:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:20:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:20:41 2020] rcu: rcu_sched kthread starved for 14999 jiffies! g60868693 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:20:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:20:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:20:41 2020] Call Trace:
[Tue Sep  1 17:20:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:20:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:20:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:20:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:20:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:20:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:20:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:20:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:20:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:21:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:21:41 2020] rcu:         3-...!: (0 ticks this GP) idle=6d0/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:21:41 2020]      (detected by 0, t=15002 jiffies, g=60868697, q=5752)
[Tue Sep  1 17:21:41 2020] Sending NMI from CPU 0 to CPUs 3:
[Tue Sep  1 17:21:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:21:41 2020] rcu: rcu_sched kthread starved for 15003 jiffies! g60868697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:21:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:21:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:21:41 2020] Call Trace:
[Tue Sep  1 17:21:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:21:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:21:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:21:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:21:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:21:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:21:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:21:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:21:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:24:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:24:41 2020] rcu:         3-...!: (0 ticks this GP) idle=e90/0/0x0 softirq=22209627/22209627 fqs=1                                                  
[Tue Sep  1 17:24:41 2020]      (detected by 1, t=60007 jiffies, g=60868697, q=8154)
[Tue Sep  1 17:24:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:24:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:24:41 2020] rcu: rcu_sched kthread starved for 45002 jiffies! g60868697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:24:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:24:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:24:41 2020] Call Trace:
[Tue Sep  1 17:24:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:24:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:24:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:24:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:24:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:24:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:24:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:24:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:24:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:25:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:25:41 2020] rcu:         3-...!: (0 ticks this GP) idle=504/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:25:41 2020]      (detected by 1, t=15002 jiffies, g=60868701, q=8880)
[Tue Sep  1 17:25:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:25:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:25:41 2020] rcu: rcu_sched kthread starved for 15002 jiffies! g60868701 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:25:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:25:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:25:41 2020] Call Trace:
[Tue Sep  1 17:25:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:25:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:25:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:25:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:25:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:25:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:25:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:25:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:25:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:28:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:28:41 2020] rcu:         3-...!: (0 ticks this GP) idle=74c/0/0x0 softirq=22209627/22209627 fqs=1                                                  
[Tue Sep  1 17:28:41 2020]      (detected by 1, t=60007 jiffies, g=60868701, q=10598)
[Tue Sep  1 17:28:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:28:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:28:41 2020] rcu: rcu_sched kthread starved for 45005 jiffies! g60868701 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:28:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:28:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:28:41 2020] Call Trace:
[Tue Sep  1 17:28:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:28:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:28:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:28:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:28:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:28:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:28:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:28:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:28:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:28:41 2020] ata7.00: exception Emask 0x0 SAct 0x8180000 SErr 0x0 action 0x6 frozen                                                                 
[Tue Sep  1 17:28:41 2020] ata7.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata7.00: cmd 60/00:98:00:08:00/01:00:00:00:00/40 tag 19 ncq dma 131072 in                                                              
                                    res 40/00:00:00:01:80/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata7.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata7.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata7.00: cmd 60/00:a0:00:00:00/01:00:00:00:00/40 tag 20 ncq dma 131072 in                                                              
                                    res 40/00:00:06:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata7.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata7.00: failed command: WRITE FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata7.00: cmd 61/08:d8:68:b8:bc/00:00:35:00:00/40 tag 27 ncq dma 4096 out                                                               
                                    res 40/00:00:00:01:80/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata7.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata7: hard resetting link
[Tue Sep  1 17:28:41 2020] ata8.00: exception Emask 0x0 SAct 0x4040c0 SErr 0x0 action 0x6 frozen                                                                  
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 60/00:30:00:08:00/01:00:00:00:00/40 tag 6 ncq dma 131072 in                                                               
                                    res 40/00:00:01:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 60/00:38:00:00:00/01:00:00:00:00/40 tag 7 ncq dma 131072 in                                                               
                                    res 40/00:00:00:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: WRITE FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 61/20:70:80:6f:b0/00:00:35:00:00/40 tag 14 ncq dma 16384 out                                                              
                                    res 40/00:00:00:01:80/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8.00: failed command: READ FPDMA QUEUED
[Tue Sep  1 17:28:41 2020] ata8.00: cmd 60/08:b0:b8:f7:7a/00:00:15:00:00/40 tag 22 ncq dma 4096 in                                                                
                                    res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)                                                                   
[Tue Sep  1 17:28:41 2020] ata8.00: status: { DRDY }
[Tue Sep  1 17:28:41 2020] ata8: hard resetting link
[Tue Sep  1 17:28:41 2020] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[Tue Sep  1 17:28:46 2020] ata7.00: qc timeout (cmd 0xec)
[Tue Sep  1 17:28:46 2020] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x4)
[Tue Sep  1 17:28:46 2020] ata7.00: revalidation failed (errno=-5)
[Tue Sep  1 17:28:46 2020] ata7: hard resetting link
[Tue Sep  1 17:28:47 2020] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[Tue Sep  1 17:28:57 2020] ata7.00: qc timeout (cmd 0xec)
[Tue Sep  1 17:28:57 2020] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x4)
[Tue Sep  1 17:28:57 2020] ata7.00: revalidation failed (errno=-5)
[Tue Sep  1 17:28:57 2020] ata7: limiting SATA link speed to 3.0 Gbps
[Tue Sep  1 17:28:57 2020] ata7: hard resetting link
[Tue Sep  1 17:28:57 2020] ata7: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[Tue Sep  1 17:29:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:29:41 2020] rcu:         3-...!: (0 ticks this GP) idle=d2c/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:29:41 2020]      (detected by 1, t=15002 jiffies, g=60868705, q=7620)
[Tue Sep  1 17:29:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:29:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:29:41 2020] rcu: rcu_sched kthread starved for 15002 jiffies! g60868705 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:29:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:29:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:29:41 2020] Call Trace:
[Tue Sep  1 17:29:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:29:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:29:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:29:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:29:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:29:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:29:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:29:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:29:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:32:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:32:41 2020] rcu:         3-...!: (0 ticks this GP) idle=750/0/0x0 softirq=22209627/22209627 fqs=1                                                  
[Tue Sep  1 17:32:41 2020]      (detected by 1, t=60007 jiffies, g=60868705, q=9388)
[Tue Sep  1 17:32:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:32:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:32:41 2020] rcu: rcu_sched kthread starved for 45005 jiffies! g60868705 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:32:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:32:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:32:41 2020] Call Trace:
[Tue Sep  1 17:32:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:32:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:32:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:32:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:32:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:32:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:32:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:32:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:32:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:33:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:33:41 2020] rcu:         3-...!: (0 ticks this GP) idle=868/0/0x0 softirq=22209627/22209627 fqs=0                                                  
[Tue Sep  1 17:33:41 2020]      (detected by 1, t=15002 jiffies, g=60868709, q=7321)
[Tue Sep  1 17:33:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:33:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:33:41 2020] rcu: rcu_sched kthread starved for 15002 jiffies! g60868709 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3                              
[Tue Sep  1 17:33:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:33:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:33:41 2020] Call Trace:
[Tue Sep  1 17:33:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:33:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:33:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:33:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:33:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:33:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:33:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:33:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:33:41 2020]  ret_from_fork+0x22/0x40
[Tue Sep  1 17:36:41 2020] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[Tue Sep  1 17:36:41 2020] rcu:         3-...!: (0 ticks this GP) idle=500/0/0x0 softirq=22209627/22209627 fqs=1 
[Tue Sep  1 17:36:41 2020]      (detected by 1, t=60007 jiffies, g=60868709, q=12917)
[Tue Sep  1 17:36:41 2020] Sending NMI from CPU 1 to CPUs 3:
[Tue Sep  1 17:36:41 2020] NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0x12/0x20
[Tue Sep  1 17:36:41 2020] rcu: rcu_sched kthread starved for 45005 jiffies! g60868709 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3
[Tue Sep  1 17:36:41 2020] rcu: RCU grace-period kthread stack dump:
[Tue Sep  1 17:36:41 2020] rcu_sched       I    0    11      2 0x80004000
[Tue Sep  1 17:36:41 2020] Call Trace:
[Tue Sep  1 17:36:41 2020]  __schedule+0x2e6/0x700
[Tue Sep  1 17:36:41 2020]  schedule+0x33/0xa0
[Tue Sep  1 17:36:41 2020]  schedule_timeout+0x152/0x300
[Tue Sep  1 17:36:41 2020]  ? __next_timer_interrupt+0xd0/0xd0
[Tue Sep  1 17:36:41 2020]  rcu_gp_kthread+0x488/0x9a0
[Tue Sep  1 17:36:41 2020]  kthread+0x120/0x140
[Tue Sep  1 17:36:41 2020]  ? kfree_call_rcu+0x20/0x20
[Tue Sep  1 17:36:41 2020]  ? kthread_park+0x90/0x90
[Tue Sep  1 17:36:41 2020]  ret_from_fork+0x22/0x40
root at pmx02:~# 



More information about the pve-user mailing list