Commit graph

3781 commits

Author SHA1 Message Date
Christoph Heiss
eb95d27029 api: dbus-vmstate: reword description to match behaviour
This method allows to perform either a 'start' or 'stop' action on the
DBus VMState helper, not just stop it.

Signed-off-by: Christoph Heiss <c.heiss@proxmox.com>
Link: https://lore.proxmox.com/20250818123141.841088-2-c.heiss@proxmox.com
2025-08-26 09:00:05 +02:00
Fiona Ebner
240be36667 live import: correctly generate blockdev
The throttle node is generated later above the alloc-track block node,
so generating the alloc-track backing block node needs to happen with
'no-throttle' to avoid a duplicate node name and avoid an additional
throttle node in the graph.

Reported in the community forum:
https://forum.proxmox.com/threads/169766/

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
2025-08-25 12:03:50 +02:00
Fiona Ebner
bf3fc3ce6d bump version to 9.0.18
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
2025-08-14 12:41:44 +02:00
Fabian Grünbichler
4ce7b7dfce dbus-vmstate: fix installation
there's no need to have a separate Makefile and directory for these, it's just
files being copied. the missing handling of $PACKAGE in the old Makefile
resulted in the files being installed in the wrong place when building the
source package..

Reported-by: Fiona Ebner <f.ebner@proxmox.com>
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Link: https://lore.proxmox.com/20250814084409.182322-1-f.gruenbichler@proxmox.com
2025-08-14 10:49:56 +02:00
Fiona Ebner
4cbe5a6ef1 drive device: scsi: avoid setting nonexistent 'device_id' for scsi-{block, generic}
Fixes: 46d1225e ("drive device: fix regression with missing '/dev/disk/by-id' paths")
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250813085845.25516-3-f.ebner@proxmox.com
2025-08-13 12:06:53 +02:00
Fiona Ebner
4a92c0415d fix #6680: avoid setting nonexistent 'write-cache' option for scsi-{block, generic}
Only scsi-cd and scsi-hd have a 'write-cache' option, scsi-block and
scsi-generic do not.

Setting the 'cache' setting on such a drive in the VM configuration is
still valid and should not be prohibited, because it affects the
blockdev settings.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250813085845.25516-2-f.ebner@proxmox.com
2025-08-13 12:06:53 +02:00
Fiona Ebner
554ff73298 ovmf: rename 'is_template' parameter to 'readonly' to match its effect
Suggested-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250813081121.8569-1-f.ebner@proxmox.com
2025-08-13 10:19:17 +02:00
Fiona Ebner
9b1460220c cfg2cmd: add reminder comments to remove template handling for -drive
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812143900.138723-6-f.ebner@proxmox.com
2025-08-13 09:30:16 +02:00
Fiona Ebner
bc753d2bc7 code cleanup: drive: get rid of outdated drive_is_read_only() helper
The drive_is_read_only() helper only applies to '-drive', but not
'-blockdev' and is only used in a single place. Inline it to avoid
accidental usages popping up in the future.

This also gets rid of a hidden dependency from Drive to QemuConfig.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812143900.138723-5-f.ebner@proxmox.com
2025-08-13 09:30:16 +02:00
Fiona Ebner
69afe422e5 fix #6675: template backup: fix regression with IDE/SATA and blockdev
With ide-hd, the inserted block node needs to be marked as writable
too, but -blockdev will complain if it's marked as writable but the
actual backing device is read-only (e.g. read-only base LV).

IDE/SATA do not support being configured as read-only, the most
similar is using ide-cd instead of ide-hd, with most of the code and
configuration shared in QEMU.

Since a template is never actually started, the front-end device is
never accessed. The backup only accesses the inserted block node, so
it does not matter for the backup if the type is 'ide-cd' instead.

The same issue did not manifest for '-drive', because the '-snapshot'
option is used for template backups. The '-snapshot' option does not
affect '-blockdev', from 'man kvm':

> snapshot is incompatible with -blockdev

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812143900.138723-4-f.ebner@proxmox.com
2025-08-13 09:30:16 +02:00
Fiona Ebner
d45b08004a code cleanup: cfg2cmd: check if configuration is for template centrally
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812143900.138723-3-f.ebner@proxmox.com
2025-08-13 09:30:16 +02:00
Fiona Ebner
58b9298799 ovmf: pass along whether the VM is a template
This is in preparation to remove the hidden dependency from the Drive
module to QemuConfig.

Note that the drive_is_read_only() can be replaced with $is_template
for OVMF, because the helper only behaves differently for IDE and
SATA, but not for EFI disks.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812143900.138723-2-f.ebner@proxmox.com
2025-08-13 09:30:16 +02:00
Fiona Ebner
2f3c741bfd close #6378: expose guest-phys-bits CPU option
Quoting Fabian Grünbichler from the bug report:

> Intel ships some CPUs where the CPU address width and the IOMMU
> address width are different, which requires setting that option to
> properly support huge pages and/or VFIO:
>
> https://bugzilla.kernel.org/show_bug.cgi?id=220057
> https://lore.kernel.org/all/20250502224035.3183451-1-alex.williamson@redhat.com/t
> https://lore.kernel.org/qemu-devel/20250130134346.1754143-1-clg@redhat.com/

This likely also gives users a way forward with a regression reported
in the community forum:
https://forum.proxmox.com/threads/169586/

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812153144.154949-1-f.ebner@proxmox.com
2025-08-13 09:29:28 +02:00
Fiona Ebner
ad2610f218 make tidy
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
2025-08-12 16:04:39 +02:00
Fabian Grünbichler
2746b963cf bump version to 9.0.17
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
2025-08-12 15:14:04 +02:00
Fiona Ebner
e7cf7c0056 blockdev: delete/replace: re-use detach() helper
Re-using the detach() helper has the side effect of avoiding logging
errors to syslog for automatically removed child nodes. This should be
the case for all file nodes here. None are explicitly added via
blockdev-add and thus QEMU already auto-removes them.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812115652.79330-4-f.ebner@proxmox.com
2025-08-12 14:49:43 +02:00
Fiona Ebner
d2f055b03a blockdev: attach/detach: silence errors for QMP commands for which failure may be expected
Without passing 'noerr' to mon_cmd(), errors are logged to the system
journal. In attach() and detach(), there are two mon_cmd() calls that
are expected to fail in some scenarios for which the errors should not
be logged.

Reported-by: Friedrich Weber <f.weber@proxmox.com>
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812115652.79330-3-f.ebner@proxmox.com
2025-08-12 14:49:43 +02:00
Fiona Ebner
9e973210ea qmp client: add $noerr argument
Using the $noerr argument will allow callers to opt-in to handling
errors themselves.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250812115652.79330-2-f.ebner@proxmox.com
2025-08-12 14:49:43 +02:00
Fiona Ebner
1441c009bc print drive commandline: prohibit using snapshot-as-volume-chain qcow2 images
Require that snapshot-as-volume-chain qcow2 images are always used in
combination with '-blockdev', rather than '-drive'. With '-drive', the
'discard-no-unref' option is not set and the fragmentation can lead to
the same issue that for '-blockdev', was solved by commit a3a9a2ab
("fix #6543: use qcow2 'discard-no-unref' option when using
snapshot-as-volume-chain").

While it would be possible to set the flag for '-drive' too, the
snapshot-as-volume-chain feature already only works with machine type
>= 10.0, see commit 6b2b45fd ("snapshot create/delete: die early for
snapshot-as-volume-chain for pre-10.0 machine version") and it's only
tested for those. Avoid accidents and other unknown issues by being
strict and prohibiting usage without '-blockdev'.

Reported-by: Friedrich Weber <f.weber@proxmox.com>
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250811135154.253817-1-f.ebner@proxmox.com
2025-08-12 11:17:37 +02:00
Fiona Ebner
240f44a369 fix #6648: api: machine versions: fix ordering
It's necessary to numerically compare versions in machine types, so
introduce a new helper which does that.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250811104812.189393-3-f.ebner@proxmox.com
2025-08-11 14:59:10 +02:00
Fiona Ebner
9e4210a025 machine: add extract_version_parts helper
Note that the regex is changed to not include the '+pve' part. No
functional change intended.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/all/20250811104812.189393-2-f.ebner@proxmox.com
2025-08-11 14:59:10 +02:00
Fiona Ebner
6b2b45fd0d snapshot create/delete: die early for snapshot-as-volume-chain for pre-10.0 machine version
As reported in the community forum [0], a running VM with pre-10.0
machine version using a storage with snapshot-as-volume-chain will run
into issues when creating a snapshot. Similarly deleting the snapshot
of such a VM would fail. Having '-blockdev' is a hard requirement for
the implementation of the snapshot-as-volume-chain feature for running
VMs, so die and suggest upgrading the machine version.

[0]: https://forum.proxmox.com/threads/lvm-thick-with-iscsi-pve-9-0-3.169319/

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Tested-by: Hannes Laimer <h.laimer@proxmox.com>
Link: https://lore.proxmox.com/20250807104832.51784-1-f.ebner@proxmox.com
2025-08-07 14:31:55 +02:00
Thomas Lamprecht
9c094a357b bump version to 9.0.16
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-08-05 12:21:06 +02:00
Christoph Heiss
6df5858a1c vmstate: always quiesce warnings on vm stop cleanup
At this point, the dbus-vmstate helper is not expected to be running
anymore.

Using $noerr here didn't really make sense - as it never should be
running anymore at this point, plus the VM should also be stopped - thus
the "happy" path here is to fail removing the dbus-vmstate helper.
It resulted in another spurious warning _after_ a migration on the
source node.

Fixes: 067a0f55 ("vmstate: improve cleaning up dbus-vmstate and avoid spurious warning")
Reported-by: Friedrich Weber <f.weber@proxmox.com>
Signed-off-by: Christoph Heiss <c.heiss@proxmox.com>
Link: https://lore.proxmox.com/20250805095828.301188-1-c.heiss@proxmox.com
2025-08-05 12:13:45 +02:00
Thomas Lamprecht
e4bf96735f bump version to 9.0.15
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-08-04 16:03:23 +02:00
Christoph Heiss
067a0f55bb vmstate: improve cleaning up dbus-vmstate and avoid spurious warning
First, moving to vm_stop_cleanup(), which is a better fit for this.
It gets called by the cleanup API method in case of unclean shutdown or
from inside the guest.

In every case, the dbus-vmstate daemon should _never_ be running at this
point, as it is started only before migration and stopped directly after
migration, before vm_stop_cleanup() is even called. So it should only be
left running in case of a crash during migration.

Calling it anyway here ensures that the daemon is always (cleanly) shut
down. As the dbus-vmstate is part of the VM scope unit, that would it
tear it down too as a last resort.

Fixes the following spurious warning when a VM was shutdown from inside
the guest:

  `failed to retrieve org.qemu.VMState1 owners: org.freedesktop.DBus.Error.NameHasNoOwner: Could not get owners of name 'org.qemu.VMState1': no such name`

Reported-by: Hannes Duerr <h.duerr@proxmox.com>
Reported-by: Maximiliano Sandoval <m.sandoval@proxmox.com>
Signed-off-by: Christoph Heiss <c.heiss@proxmox.com>
Link: https://lore.proxmox.com/20250804133002.1625925-1-c.heiss@proxmox.com
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-08-04 16:02:45 +02:00
Thomas Lamprecht
43513e14ac bump version to 9.0.14
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-08-01 18:38:16 +02:00
Thomas Lamprecht
8c17743c87 re-tidy perl code
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-08-01 17:22:30 +02:00
Thomas Lamprecht
9660710462 api: migration checks: rename return prop to dependent-ha-resources and improve description
We actually query if there are any guests positive affinity rule for
the to-be migrated VM, while that normally means the they will be
migrated, it doesn't has to be (e.g., node constraints might interfere
here), and "comigrated" is not as much used compared to
"dependencies", so that might be easier to understand for non-native
speakers or users (vs devs, these details tend to leak).

Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-08-01 17:22:23 +02:00
Thomas Lamprecht
eba40484c9 api: migration preconditions: fix default value for "comigrated" HA vms
By returning an object instead of a array for the default the frontend
can get confused if it's using an iterator code that expects arrays.

Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-08-01 17:16:15 +02:00
Thomas Lamprecht
6b084e3b6b bump version to 9.0.13
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 14:26:17 +02:00
Fiona Ebner
4a0952d985 blockdev: delete: delete format block node first
Nodes need to be deleted from top to bottom. See also commit 32102c06
("blockdev: blockdev replace: delete format block node first").

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/20250731104935.53039-2-f.ebner@proxmox.com
2025-07-31 14:24:24 +02:00
Fiona Ebner
f06f3a3c4a fix #6580: blockdev: commit: re-open target format node as writable if necessary
Removing the first snapshot in a snapshot-as-volume-chain is done via
block-commit for performance reasons, rather than stream, because the
snapshot volume, being the base, is usually larger than the delta
since the snapshot.

When a drive has the 'ro' flag set in the virtual machine
configuration, all three nodes in the throttle->fmt->file chain are
opened with the read-only flag set and thus the format node could not
serve as the target for the stream operation.

Fix this, by temporarily re-opening the format node as writable. Note
that from the guest perspective, nothing changes, because the
read-only flag for the top throttle node is preserved.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/20250731104935.53039-1-f.ebner@proxmox.com
2025-07-31 14:24:24 +02:00
Thomas Lamprecht
8eec31e92d bump version to 9.0.12
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 11:34:12 +02:00
Fiona Ebner
0b9090c6ab block job: mirror: always detach the target node upon cancelling
This is a further improvement after commit 8e671e79 ("block job:
mirror: always detach the target node upon error"). It might be
that a cancelled job ends up in concluded state without an error
being set in the result of the 'query-block-jobs' QMP command and
the target node would not be detached. To fix it, also detach the
target node when cancelling the job. This is correct even when the job
was cancelled after completion, as in that case, the drive is not
switched over to use the target node.

Reported-by: Friedrich Weber <f.weber@proxmox.com>
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Tested-by: Friedrich Weber <f.weber@proxmox.com>
Link: https://lore.proxmox.com/20250731090956.23443-1-f.ebner@proxmox.com
2025-07-31 11:33:23 +02:00
Thomas Lamprecht
0aea31ee85 d/control: bump versioned dependency on pve-ha-manager
for affinity rule migration blocker.

Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 11:31:00 +02:00
Daniel Kral
cae2f44f83 api: migration preconditions: add checks for ha resource affinity rules
Add information about positive and negative ha resource affinity rules,
which the VM is part of, to the migration precondition API endpoint.
These inform callees about any comigrated resources or blocking
resources that are caused by the resource affinity rules.

Signed-off-by: Daniel Kral <d.kral@proxmox.com>
Link: https://lore.proxmox.com/20250730181428.392906-21-d.kral@proxmox.com
2025-07-31 10:53:44 +02:00
Thomas Lamprecht
b2f0236a8b bump version to 9.0.11
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 04:50:13 +02:00
Aaron Lauterer
46a9005ff3 rrddata: use new pve-vm-9.0 rrd location if file is present
Signed-off-by: Aaron Lauterer <a.lauterer@proxmox.com>
Link: https://lore.proxmox.com/20250726010626.1496866-30-a.lauterer@proxmox.com
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 04:47:47 +02:00
Aaron Lauterer
b14ae0d9a5 vmstatus: switch mem stat to PSS of VM cgroup
Instead of RSS, let's use the same PSS values as for the specific host
view as default, in case this value is not overwritten by the balloon
info.

Signed-off-by: Aaron Lauterer <a.lauterer@proxmox.com>
Link: https://lore.proxmox.com/20250726010626.1496866-29-a.lauterer@proxmox.com
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 04:47:47 +02:00
Thomas Lamprecht
dab637268e status api: improve description for new PSI metrics slightly
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 04:47:47 +02:00
Thomas Lamprecht
9fca6634e5 vm status: factor gathering cgroup memory usage out into dedicated method
no point in bloating the rather big vmstatus sub even further, this
way one can also add a descriptive name and comment.

Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 04:47:47 +02:00
Aaron Lauterer
d426de6c7d vmstatus: add memhost for host view of vm mem consumption
The mem field itself will switch from the outside view to the "inside"
view if the VM is reporting detailed memory usage informatio via the
ballooning device.

Since sometimes other processes belong to a VM too, for example swtpm,
we collect all PIDs belonging to the VM cgroup and fetch their PSS data
to account for shared libraries used.

Signed-off-by: Aaron Lauterer <a.lauterer@proxmox.com>
Link: https://lore.proxmox.com/20250726010626.1496866-28-a.lauterer@proxmox.com
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 04:47:47 +02:00
Folke Gleumes
213200ef79 metrics: add pressure stall information to status
[AL:
    * rebased on current master
    * switch to new, more generic read_cgroup_pressure function
    * add pressures to return properties
]

Originally-by: Folke Gleumes <f.gleumes@proxmox.com>
Signed-off-by: Aaron Lauterer <a.lauterer@proxmox.com>
Link: https://lore.proxmox.com/20250726010626.1496866-27-a.lauterer@proxmox.com
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-31 04:47:35 +02:00
Thomas Lamprecht
fb98d1d566 bump version to 9.0.10
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-30 23:06:55 +02:00
Thomas Lamprecht
b926ff9c66 d/control: bump dependency for pve-firewall & suggests for proxmox-firewall
To ensure we got the relevant rules for conntrack migration available.

Only do a suggests on the newer nft based proxmox-firewall, we do not
have any hard-dependency on it anywhere currently.

Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
2025-07-30 23:00:00 +02:00
Fiona Ebner
f27115cede image convert: make using zeroinit with target-image-opts work
Also add a test to witness this combination.

Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/20250730150325.138087-4-f.ebner@proxmox.com
2025-07-30 22:57:28 +02:00
Fiona Ebner
659b0716ce image convert: re-use generate_drive_blockdev()
This avoids having the handling for 'discard-no-unref' in two places.

In the tests, rename the relevant target images with a '-target'
suffix to test for them in the mocked volume_snapshot_info() helper.

Suggested-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/20250730150325.138087-3-f.ebner@proxmox.com
2025-07-30 22:57:28 +02:00
Fiona Ebner
4866264c59 image convert: avoid combining target image options and zeroinit filter
Would fail with an error
> Block format 'qcow2' does not support the option 'zeroinit:driver'
for a qcow2 target on a directory storage with
'snapshot-as-volume-chain'.

Reported-by: Friedrich Weber <f.weber@proxmox.com>
Signed-off-by: Fiona Ebner <f.ebner@proxmox.com>
Link: https://lore.proxmox.com/20250730150325.138087-2-f.ebner@proxmox.com
2025-07-30 22:57:28 +02:00
Christoph Heiss
a90fe981c9 migrate: flush old VM conntrack entries after successful migration
After a successful live-migration, the old VM-specific conntrack entries
are not needed anymore on the source node and can thus be flushed.

Tested-by: Stefan Hanreich <s.hanreich@proxmox.com>
Signed-off-by: Christoph Heiss <c.heiss@proxmox.com>
Link: https://lore.proxmox.com/20250730094549.263805-9-c.heiss@proxmox.com
2025-07-30 22:55:48 +02:00