[pve-devel] [PATCH-SERIES v2 qemu] update to QEMU 8.0

Fiona Ebner f.ebner at proxmox.com
Mon May 15 15:39:49 CEST 2023


After weeks and weeks of (sometimes painful) debugging, it's finally
here. And got a load of stable fixes on top already. More testing is
always appreciated, especially backup, PBS live restore and snapshots,
which needed quite a few changes!

Changes from v1:
* Add fix for lintian overrides.
* Add patch squashing related changes (not required for 8.0 but will
make life easier going forward).

Fiona Ebner (7):
  d/rules: drop virtiofsd switch
  d/rules: set job flag for make based on DEB_BUILD_OPTIONS
  buildsys: fix lintian overrides
  update submodule and patches to QEMU 8.0.0
  add stable patches for 8.0.0
  PVE backup: don't call no_co_wrapper function from coroutine
  squash related patches

 ...d-support-for-sync-bitmap-mode-never.patch |   95 +-
 ...-support-for-conditional-and-always-.patch |   10 +-
 ...check-for-bitmap-mode-without-bitmap.patch |    6 +-
 ...-to-bdrv_dirty_bitmap_merge_internal.patch |    6 +-
 .../0006-mirror-move-some-checks-to-qmp.patch |   14 +-
 ...race-with-clients-disconnecting-earl.patch |    6 +-
 ...monize-defuse-PID-file-resolve-error.patch |   42 -
 ...memory-prevent-dma-reentracy-issues.patch} |    4 +-
 ...s-Internal-cdbs-have-16-byte-length.patch} |    0
 ...he-bitmap-index-of-the-section-offse.patch |   44 -
 ...al-deadlock-when-draining-during-tr.patch} |   10 +-
 ...he-iterator-variable-in-a-vmem-rdl_l.patch |   36 -
 ...sabling-re-entrancy-checking-per-MR.patch} |    6 +-
 ...ty-bitmap-syncing-when-vIOMMU-is-ena.patch |  141 --
 ...e-reentrancy-detection-for-script-R.patch} |    2 +-
 ...pci-fix-migration-compat-for-vectors.patch |   42 -
 ...-zeroes-with-BDRV_REQ_REGISTERED_BUF.patch |   36 -
 ...39-fix-large_send_mss-divide-by-zero.patch |   72 +
 ...-Fix-crash-when-executing-HMP-commit.patch |   48 +
 ...double-free-on-BUSY-or-similar-statu.patch |   32 -
 ...hen-getting-cursor-without-a-console.patch |   36 +
 ...our-channel-order-for-PNG-screenshot.patch |   77 ++
 ...arm-Fix-vd-vm-overlap-in-sve_ldff1_z.patch |   41 +
 ...ing-endian-conversions-for-doorbell-.patch |   67 -
 ...e-incorrect-computation-in-float32_e.patch |   56 +
 ...fix-field-corruption-in-type-4-table.patch |   50 -
 ...ge-wrong-XFRM-value-in-SGX-CPUID-lea.patch |   39 +
 ...t-assert_bdrv_graph_readable-by-defa.patch |  106 ++
 ...ix-transitional-migration-compat-for.patch |   35 -
 ...CI_ERR_UNCOR_MASK-register-for-machi.patch |  100 ++
 ...er-hpet-Fix-expiration-time-overflow.patch |   80 --
 ...after-free-in-blockdev_mark_auto_del.patch |   57 +
 ...vdpa-stop-all-svq-on-device-deletion.patch |   71 -
 ...ly-call-bdrv_activate-outside-corout.patch |   64 +
 ...tential-use-of-an-uninitialized-vari.patch |  132 --
 ...o_unref-for-calls-in-coroutine-conte.patch |  373 +++++
 ...ket-set-s-listener-NULL-in-char_sock.patch |   70 -
 ...-no_coroutine_fns-in-qmp_block_resiz.patch |   43 +
 ...il-MAP-notifier-without-caching-mode.patch |   41 -
 ...-tcg-Fix-atomic_mmu_lookup-for-reads.patch |   36 +
 ...-fail-DEVIOTLB_UNMAP-without-dt-mode.patch |   50 -
 ...uest-visible-maximum-access-size-to-.patch |  166 ---
 ...Introduce-and-use-reg_t-consistently.patch |  286 ----
 ...25-target-i386-Fix-BEXTR-instruction.patch |   97 --
 ...i386-Fix-C-flag-for-BLSI-BLSMSK-BLSR.patch |   47 -
 ...arget-i386-fix-ADOX-followed-by-ADCX.patch |  192 ---
 ...028-target-i386-Fix-BZHI-instruction.patch |   64 -
 ...k-file-change-locking-default-to-off.patch |    6 +-
 ...djust-network-script-path-to-etc-kvm.patch |    4 +-
 ...he-CPU-model-to-kvm64-32-instead-of-.patch |    4 +-
 ...ui-spice-default-to-pve-certificates.patch |    4 +-
 ...erfs-no-default-logfile-if-daemonize.patch |    8 +-
 ...lock-rbd-disable-rbd_cache_writethro.patch |    4 +-
 .../0007-PVE-Up-qmp-add-get_link_status.patch |    8 +-
 ...PVE-Up-glusterfs-allow-partial-reads.patch |   14 +-
 ...return-success-on-info-without-snaps.patch |    4 +-
 ...dd-add-osize-and-read-from-to-stdin-.patch |   12 +-
 ...E-Up-qemu-img-dd-add-isize-parameter.patch |   14 +-
 ...PVE-Up-qemu-img-dd-add-n-skip_create.patch |   10 +-
 ...add-l-option-for-loading-a-snapshot.patch} |   18 +-
 ...irtio-balloon-improve-query-balloon.patch} |   95 +-
 ...0015-PVE-qapi-modify-query-machines.patch} |   14 +-
 ...=> 0016-PVE-qapi-modify-spice-query.patch} |   13 +-
 ...nel-implementation-for-savevm-async.patch} |   11 +-
 ...sync-for-background-state-snapshots.patch} |  125 +-
 ...dd-optional-buffer-size-to-QEMUFile.patch} |   10 +-
 ...dd-the-zeroinit-block-driver-filter.patch} |   30 +-
 ...Add-dummy-id-command-line-parameter.patch} |   10 +-
 ...-target-i386-disable-LINT0-after-re.patch} |    4 +-
 ...e-posix-make-locking-optiono-on-cre.patch} |   18 +-
 ...-PVE-monitor-disable-oob-capability.patch} |    0
 ...ed-balloon-qemu-4-0-config-size-fal.patch} |    4 +-
 ...-Allow-version-code-in-machine-type.patch} |   31 +-
 ...-bcs-bitmap-initialization-to-job-c.patch} |    4 +-
 ...E-Backup-add-vma-backup-format-code.patch} |  277 ++--
 ...Backup-add-backup-dump-block-driver.patch} |   39 +-
 ...-sequential-job-transaction-support.patch} |    0
 ...irty-bitmap-tracking-for-incremental.patch |  452 ------
 ...kup-Proxmox-backup-patches-for-QEMU.patch} | 1210 +++++++++++------
 ...store-new-command-to-restore-from-p.patch} |   33 +-
 .../pve/0032-PVE-various-PBS-fixes.patch      |  219 ---
 ...k-driver-to-map-backup-archives-into.patch |   92 +-
 ...dd-query_proxmox_support-QMP-command.patch |   74 -
 ...t-stderr-to-journal-when-daemonized.patch} |    8 +-
 ...grate-dirty-bitmap-state-via-savevm.patch} |   54 +-
 ...E-add-query-pbs-bitmap-info-QMP-call.patch |  441 ------
 ...irty-bitmap-migrate-other-bitmaps-e.patch} |    4 +-
 ...ll-back-to-open-iscsi-initiatorname.patch} |    4 +-
 ...-transaction-to-synchronize-job-stat.patch |  293 ----
 ...VE-block-stream-increase-chunk-size.patch} |    4 +-
 ...-block-on-finishing-and-cleanup-crea.patch |  499 -------
 ...ccept-NULL-qiov-in-bdrv_pad_request.patch} |    4 +-
 ...> 0040-block-add-alloc-track-driver.patch} |   23 +-
 ...rbd-workaround-for-ceph-issue-53784.patch} |    8 +-
 ...fix-handling-of-holes-in-.bdrv_co_b.patch} |    4 +-
 ...routine-QMP-for-backup-cancel_backup.patch |  598 --------
 ...-rbd-implement-bdrv_co_block_status.patch} |   10 +-
 .../pve/0044-PBS-add-master-key-support.patch |   98 --
 ...alloc-track-fix-deadlock-during-drop.patch |  153 +++
 ...st-path-reads-without-allocation-if-.patch |   53 -
 ...apshots-hold-the-BQL-during-setup-ca.patch |  190 +++
 ...vm-async-don-t-hold-BQL-during-setup.patch |   29 +
 ...-register-yank-before-migration_inco.patch |   35 -
 .../pve/0051-vma-allow-partial-restore.patch  |  407 ------
 .../pve/0052-pbs-namespace-support.patch      |  233 ----
 ...e-jobs-correctly-cancel-in-error-sce.patch |   60 -
 ...nsure-jobs-in-di_list-are-referenced.patch |   73 -
 ...d-segfault-issues-upon-backup-cancel.patch |  118 --
 ...support-64KiB-unaligned-input-images.patch |   57 -
 ...d-triggering-assertion-in-error-case.patch |   25 -
 ...ck-alloc-track-avoid-premature-break.patch |   36 -
 ...-passing-max-workers-performance-set.patch |  144 --
 debian/patches/series                         |  128 +-
 debian/pve-qemu-kvm.lintian-overrides         |    8 +-
 debian/rules                                  |    4 +-
 qemu                                          |    2 +-
 116 files changed, 3020 insertions(+), 6790 deletions(-)
 delete mode 100644 debian/patches/extra/0002-init-daemonize-defuse-PID-file-resolve-error.patch
 rename debian/patches/extra/{0008-memory-prevent-dma-reentracy-issues.patch => 0002-memory-prevent-dma-reentracy-issues.patch} (98%)
 rename debian/patches/extra/{0010-scsi-megasas-Internal-cdbs-have-16-byte-length.patch => 0003-scsi-megasas-Internal-cdbs-have-16-byte-length.patch} (100%)
 delete mode 100644 debian/patches/extra/0003-virtio-mem-Fix-the-bitmap-index-of-the-section-offse.patch
 rename debian/patches/extra/{0011-ide-avoid-potential-deadlock-when-draining-during-tr.patch => 0004-ide-avoid-potential-deadlock-when-draining-during-tr.patch} (93%)
 delete mode 100644 debian/patches/extra/0004-virtio-mem-Fix-the-iterator-variable-in-a-vmem-rdl_l.patch
 rename debian/patches/extra/{0021-memory-Allow-disabling-re-entrancy-checking-per-MR.patch => 0005-memory-Allow-disabling-re-entrancy-checking-per-MR.patch} (91%)
 delete mode 100644 debian/patches/extra/0005-vhost-fix-vq-dirty-bitmap-syncing-when-vIOMMU-is-ena.patch
 rename debian/patches/extra/{0022-lsi53c895a-disable-reentrancy-detection-for-script-R.patch => 0006-lsi53c895a-disable-reentrancy-detection-for-script-R.patch} (97%)
 delete mode 100644 debian/patches/extra/0006-virtio-rng-pci-fix-migration-compat-for-vectors.patch
 delete mode 100644 debian/patches/extra/0007-block-fix-detect-zeroes-with-BDRV_REQ_REGISTERED_BUF.patch
 create mode 100644 debian/patches/extra/0007-rtl8139-fix-large_send_mss-divide-by-zero.patch
 create mode 100644 debian/patches/extra/0008-block-monitor-Fix-crash-when-executing-HMP-commit.patch
 delete mode 100644 debian/patches/extra/0009-block-iscsi-fix-double-free-on-BUSY-or-similar-statu.patch
 create mode 100644 debian/patches/extra/0009-ui-return-NULL-when-getting-cursor-without-a-console.patch
 create mode 100644 debian/patches/extra/0010-ui-Fix-pixel-colour-channel-order-for-PNG-screenshot.patch
 create mode 100644 debian/patches/extra/0011-target-arm-Fix-vd-vm-overlap-in-sve_ldff1_z.patch
 delete mode 100644 debian/patches/extra/0012-hw-nvme-fix-missing-endian-conversions-for-doorbell-.patch
 create mode 100644 debian/patches/extra/0012-softfloat-Fix-the-incorrect-computation-in-float32_e.patch
 delete mode 100644 debian/patches/extra/0013-hw-smbios-fix-field-corruption-in-type-4-table.patch
 create mode 100644 debian/patches/extra/0013-target-i386-Change-wrong-XFRM-value-in-SGX-CPUID-lea.patch
 create mode 100644 debian/patches/extra/0014-block-compile-out-assert_bdrv_graph_readable-by-defa.patch
 delete mode 100644 debian/patches/extra/0014-virtio-rng-pci-fix-transitional-migration-compat-for.patch
 create mode 100644 debian/patches/extra/0015-hw-pci-Disable-PCI_ERR_UNCOR_MASK-register-for-machi.patch
 delete mode 100644 debian/patches/extra/0015-hw-timer-hpet-Fix-expiration-time-overflow.patch
 create mode 100644 debian/patches/extra/0016-block-Fix-use-after-free-in-blockdev_mark_auto_del.patch
 delete mode 100644 debian/patches/extra/0016-vdpa-stop-all-svq-on-device-deletion.patch
 create mode 100644 debian/patches/extra/0017-block-Consistently-call-bdrv_activate-outside-corout.patch
 delete mode 100644 debian/patches/extra/0017-vhost-avoid-a-potential-use-of-an-uninitialized-vari.patch
 create mode 100644 debian/patches/extra/0018-block-bdrv-blk_co_unref-for-calls-in-coroutine-conte.patch
 delete mode 100644 debian/patches/extra/0018-chardev-char-socket-set-s-listener-NULL-in-char_sock.patch
 create mode 100644 debian/patches/extra/0019-block-Don-t-call-no_coroutine_fns-in-qmp_block_resiz.patch
 delete mode 100644 debian/patches/extra/0019-intel-iommu-fail-MAP-notifier-without-caching-mode.patch
 create mode 100644 debian/patches/extra/0020-accel-tcg-Fix-atomic_mmu_lookup-for-reads.patch
 delete mode 100644 debian/patches/extra/0020-intel-iommu-fail-DEVIOTLB_UNMAP-without-dt-mode.patch
 delete mode 100644 debian/patches/extra/0023-acpi-cpuhp-fix-guest-visible-maximum-access-size-to-.patch
 delete mode 100644 debian/patches/extra/0024-tests-tcg-i386-Introduce-and-use-reg_t-consistently.patch
 delete mode 100644 debian/patches/extra/0025-target-i386-Fix-BEXTR-instruction.patch
 delete mode 100644 debian/patches/extra/0026-target-i386-Fix-C-flag-for-BLSI-BLSMSK-BLSR.patch
 delete mode 100644 debian/patches/extra/0027-target-i386-fix-ADOX-followed-by-ADCX.patch
 delete mode 100644 debian/patches/extra/0028-target-i386-Fix-BZHI-instruction.patch
 rename debian/patches/pve/{0050-qemu-img-dd-add-l-option-for-loading-a-snapshot.patch => 0013-qemu-img-dd-add-l-option-for-loading-a-snapshot.patch} (89%)
 rename debian/patches/pve/{0013-PVE-virtio-balloon-improve-query-balloon.patch => 0014-PVE-virtio-balloon-improve-query-balloon.patch} (90%)
 rename debian/patches/pve/{0014-PVE-qapi-modify-query-machines.patch => 0015-PVE-qapi-modify-query-machines.patch} (84%)
 rename debian/patches/pve/{0015-PVE-qapi-modify-spice-query.patch => 0016-PVE-qapi-modify-spice-query.patch} (82%)
 rename debian/patches/pve/{0016-PVE-add-IOChannel-implementation-for-savevm-async.patch => 0017-PVE-add-IOChannel-implementation-for-savevm-async.patch} (97%)
 rename debian/patches/pve/{0017-PVE-add-savevm-async-for-background-state-snapshots.patch => 0018-PVE-add-savevm-async-for-background-state-snapshots.patch} (89%)
 rename debian/patches/pve/{0018-PVE-add-optional-buffer-size-to-QEMUFile.patch => 0019-PVE-add-optional-buffer-size-to-QEMUFile.patch} (96%)
 rename debian/patches/pve/{0019-PVE-block-add-the-zeroinit-block-driver-filter.patch => 0020-PVE-block-add-the-zeroinit-block-driver-filter.patch} (89%)
 rename debian/patches/pve/{0020-PVE-Add-dummy-id-command-line-parameter.patch => 0021-PVE-Add-dummy-id-command-line-parameter.patch} (87%)
 rename debian/patches/pve/{0021-PVE-Config-Revert-target-i386-disable-LINT0-after-re.patch => 0022-PVE-Config-Revert-target-i386-disable-LINT0-after-re.patch} (90%)
 rename debian/patches/pve/{0022-PVE-Up-Config-file-posix-make-locking-optiono-on-cre.patch => 0023-PVE-Up-Config-file-posix-make-locking-optiono-on-cre.patch} (89%)
 rename debian/patches/pve/{0023-PVE-monitor-disable-oob-capability.patch => 0024-PVE-monitor-disable-oob-capability.patch} (100%)
 rename debian/patches/pve/{0024-PVE-Compat-4.0-used-balloon-qemu-4-0-config-size-fal.patch => 0025-PVE-Compat-4.0-used-balloon-qemu-4-0-config-size-fal.patch} (95%)
 rename debian/patches/pve/{0025-PVE-Allow-version-code-in-machine-type.patch => 0026-PVE-Allow-version-code-in-machine-type.patch} (85%)
 rename debian/patches/pve/{0026-block-backup-move-bcs-bitmap-initialization-to-job-c.patch => 0027-block-backup-move-bcs-bitmap-initialization-to-job-c.patch} (96%)
 rename debian/patches/pve/{0027-PVE-Backup-add-vma-backup-format-code.patch => 0028-PVE-Backup-add-vma-backup-format-code.patch} (91%)
 rename debian/patches/pve/{0028-PVE-Backup-add-backup-dump-block-driver.patch => 0029-PVE-Backup-add-backup-dump-block-driver.patch} (89%)
 rename debian/patches/pve/{0037-PVE-Add-sequential-job-transaction-support.patch => 0030-PVE-Add-sequential-job-transaction-support.patch} (100%)
 delete mode 100644 debian/patches/pve/0031-PVE-Backup-Add-dirty-bitmap-tracking-for-incremental.patch
 rename debian/patches/pve/{0029-PVE-Backup-proxmox-backup-patches-for-qemu.patch => 0031-PVE-Backup-Proxmox-backup-patches-for-QEMU.patch} (53%)
 rename debian/patches/pve/{0030-PVE-Backup-pbs-restore-new-command-to-restore-from-p.patch => 0032-PVE-Backup-pbs-restore-new-command-to-restore-from-p.patch} (89%)
 delete mode 100644 debian/patches/pve/0032-PVE-various-PBS-fixes.patch
 delete mode 100644 debian/patches/pve/0034-PVE-add-query_proxmox_support-QMP-command.patch
 rename debian/patches/pve/{0036-PVE-redirect-stderr-to-journal-when-daemonized.patch => 0034-PVE-redirect-stderr-to-journal-when-daemonized.patch} (91%)
 rename debian/patches/pve/{0040-PVE-Migrate-dirty-bitmap-state-via-savevm.patch => 0035-PVE-Migrate-dirty-bitmap-state-via-savevm.patch} (83%)
 delete mode 100644 debian/patches/pve/0035-PVE-add-query-pbs-bitmap-info-QMP-call.patch
 rename debian/patches/pve/{0041-migration-block-dirty-bitmap-migrate-other-bitmaps-e.patch => 0036-migration-block-dirty-bitmap-migrate-other-bitmaps-e.patch} (92%)
 rename debian/patches/pve/{0042-PVE-fall-back-to-open-iscsi-initiatorname.patch => 0037-PVE-fall-back-to-open-iscsi-initiatorname.patch} (95%)
 delete mode 100644 debian/patches/pve/0038-PVE-Backup-Use-a-transaction-to-synchronize-job-stat.patch
 rename debian/patches/pve/{0046-PVE-block-stream-increase-chunk-size.patch => 0038-PVE-block-stream-increase-chunk-size.patch} (92%)
 delete mode 100644 debian/patches/pve/0039-PVE-Backup-Don-t-block-on-finishing-and-cleanup-crea.patch
 rename debian/patches/pve/{0047-block-io-accept-NULL-qiov-in-bdrv_pad_request.patch => 0039-block-io-accept-NULL-qiov-in-bdrv_pad_request.patch} (90%)
 rename debian/patches/pve/{0048-block-add-alloc-track-driver.patch => 0040-block-add-alloc-track-driver.patch} (95%)
 rename debian/patches/pve/{0053-Revert-block-rbd-workaround-for-ceph-issue-53784.patch => 0041-Revert-block-rbd-workaround-for-ceph-issue-53784.patch} (92%)
 rename debian/patches/pve/{0054-Revert-block-rbd-fix-handling-of-holes-in-.bdrv_co_b.patch => 0042-Revert-block-rbd-fix-handling-of-holes-in-.bdrv_co_b.patch} (90%)
 delete mode 100644 debian/patches/pve/0043-PVE-Use-coroutine-QMP-for-backup-cancel_backup.patch
 rename debian/patches/pve/{0055-Revert-block-rbd-implement-bdrv_co_block_status.patch => 0043-Revert-block-rbd-implement-bdrv_co_block_status.patch} (95%)
 delete mode 100644 debian/patches/pve/0044-PBS-add-master-key-support.patch
 create mode 100644 debian/patches/pve/0044-alloc-track-fix-deadlock-during-drop.patch
 delete mode 100644 debian/patches/pve/0045-PVE-block-pbs-fast-path-reads-without-allocation-if-.patch
 create mode 100644 debian/patches/pve/0045-migration-for-snapshots-hold-the-BQL-during-setup-ca.patch
 create mode 100644 debian/patches/pve/0046-savevm-async-don-t-hold-BQL-during-setup.patch
 delete mode 100644 debian/patches/pve/0049-PVE-savevm-async-register-yank-before-migration_inco.patch
 delete mode 100644 debian/patches/pve/0051-vma-allow-partial-restore.patch
 delete mode 100644 debian/patches/pve/0052-pbs-namespace-support.patch
 delete mode 100644 debian/patches/pve/0056-PVE-Backup-create-jobs-correctly-cancel-in-error-sce.patch
 delete mode 100644 debian/patches/pve/0057-PVE-Backup-ensure-jobs-in-di_list-are-referenced.patch
 delete mode 100644 debian/patches/pve/0058-PVE-Backup-avoid-segfault-issues-upon-backup-cancel.patch
 delete mode 100644 debian/patches/pve/0059-vma-create-support-64KiB-unaligned-input-images.patch
 delete mode 100644 debian/patches/pve/0060-vma-create-avoid-triggering-assertion-in-error-case.patch
 delete mode 100644 debian/patches/pve/0061-block-alloc-track-avoid-premature-break.patch
 delete mode 100644 debian/patches/pve/0062-PVE-Backup-allow-passing-max-workers-performance-set.patch

-- 
2.39.2






More information about the pve-devel mailing list