[pve-devel] [PATCH 5/5] cloudinit : add support for generic storage + dedicated sata drive
Alexandre DERUMIER
aderumier at odiso.com
Mon Jul 6 12:56:16 CEST 2015
>>maybe could we add some kind of api to generate the configdrive once ?
>>something like : ( enable|disable) cloudinit api : create|delete the config drive on selected interface.
maybe simply extend : qm set xxx -(sata|ide|virtio)X storeid:configdrive
----- Mail original -----
De: "aderumier" <aderumier at odiso.com>
À: "Wolfgang Bumiller" <w.bumiller at proxmox.com>
Cc: "pve-devel" <pve-devel at pve.proxmox.com>
Envoyé: Lundi 6 Juillet 2015 11:49:30
Objet: Re: [pve-devel] [PATCH 5/5] cloudinit : add support for generic storage + dedicated sata drive
>>the idea of changing the config when starting a VM is weird. It makes
>>everything more complicated to handle.
>>It would be nicer if the user was presented with an interface similar to
>>when adding CDROMs: They'd choose a controler (IDE/SATA/...) and the
>>disk gets added to it.
>>From the backend side this would look similar to what your patches did
>>initially: react to a cloudinit storage type, except without modifying
>>the config.
>>`ahciX: cloudinit,storage=local`
maybe could we add some kind of api to generate the configdrive once ?
something like : ( enable|disable) cloudinit api : create|delete the config drive on selected interface.
also, I think it could be great to have something matching the other drives
ahciX : local:vm-xxx-cloudinit
Like this, we can keep current live migration,snapshot code without changing anything. (just need to change the parser)
----- Mail original -----
De: "Wolfgang Bumiller" <w.bumiller at proxmox.com>
À: "aderumier" <aderumier at odiso.com>
Cc: "pve-devel" <pve-devel at pve.proxmox.com>
Envoyé: Lundi 6 Juillet 2015 11:33:26
Objet: Re: [pve-devel] [PATCH 5/5] cloudinit : add support for generic storage + dedicated sata drive
> + if( $scfg->{path}) {
> + $name .= ".qcow2";
> + $fmt = 'qcow2';
> + }else{
> + $fmt = 'raw';
> + }
This looks like a weird condition?
> + $conf->{cloudinitdrive0} = PVE::QemuServer::print_drive($vmid, $drive);
> + update_config_nolock($vmid, $conf);
The idea of changing the config when starting a VM is weird. It makes
everything more complicated to handle.
It would be nicer if the user was presented with an interface similar to
when adding CDROMs: They'd choose a controler (IDE/SATA/...) and the
disk gets added to it.
>From the backend side this would look similar to what your patches did
initially: react to a cloudinit storage type, except without modifying
the config.
`ahciX: cloudinit,storage=local`
> + #fix me : remove old drive of if cloudinitdrive0 storeid change
Unless snapshots still reference it. Not sure if it makes sense to
support more than one cloud-init drive anyway, so there would only be
one, and this one contains snapshots and current data.
On Tue, Jun 30, 2015 at 04:01:50PM +0200, Alexandre Derumier wrote:
> This patch add support to create the cloudinit drive on any storage
>
> I introduce an
>
> cloudinitdrive0: local:100/vm-100-cloudinit.qcow2
>
> to store the generate iso reference.
>
> This is to avoid to scan everytime the storage at vm start,
> to see if the drive has already been generated.
> (and also if we change storeid from cloudinit option, we can remove the old drive easily).
>
> This drive is on a dedicated sata controller,so no conflict possible with current users config.
> sata will be migratable in qemu 2.4 (already ok in master).
>
> This drive works like other drives, so live migration will works out of the box
>
> Signed-off-by: Alexandre Derumier <aderumier at odiso.com>
> ---
> PVE/QemuServer.pm | 80 ++++++++++++++++++++++++++++++++-----------------------
> 1 file changed, 47 insertions(+), 33 deletions(-)
>
> diff --git a/PVE/QemuServer.pm b/PVE/QemuServer.pm
> index 82905ad..15fb471 100644
> --- a/PVE/QemuServer.pm
> +++ b/PVE/QemuServer.pm
> @@ -636,6 +636,9 @@ for (my $i = 0; $i < $MAX_SATA_DISKS; $i++) {
> $confdesc->{"sata$i"} = $satadesc;
> }
>
> +$drivename_hash->{"cloudinitdrive0"} = 1;
> +$confdesc->{"cloudinitdrive0"} = $satadesc;
> +
> for (my $i = 0; $i < $MAX_SCSI_DISKS; $i++) {
> $drivename_hash->{"scsi$i"} = 1;
> $confdesc->{"scsi$i"} = $scsidesc ;
> @@ -703,7 +706,8 @@ sub disknames {
> return ((map { "ide$_" } (0 .. ($MAX_IDE_DISKS - 1))),
> (map { "scsi$_" } (0 .. ($MAX_SCSI_DISKS - 1))),
> (map { "virtio$_" } (0 .. ($MAX_VIRTIO_DISKS - 1))),
> - (map { "sata$_" } (0 .. ($MAX_SATA_DISKS - 1))));
> + (map { "sata$_" } (0 .. ($MAX_SATA_DISKS - 1))),
> + 'cloudinitdrive');
> }
>
> sub valid_drivename {
> @@ -1163,6 +1167,10 @@ sub print_drivedevice_full {
> my $controller = int($drive->{index} / $MAX_SATA_DISKS);
> my $unit = $drive->{index} % $MAX_SATA_DISKS;
> $device = "ide-drive,bus=ahci$controller.$unit,drive=drive-$drive->{interface}$drive->{index},id=$drive->{interface}$drive->{index}";
> + } elsif ($drive->{interface} eq 'cloudinitdrive'){
> + my $controller = 1;
> + my $unit = 0;
> + $device = "ide-cd,bus=ahci$controller.$unit,drive=drive-$drive->{interface}$drive->{index},id=$drive->{interface}$drive->{index}";
> } elsif ($drive->{interface} eq 'usb') {
> die "implement me";
> # -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0
> @@ -2068,11 +2076,6 @@ sub write_vm_config {
> delete $conf->{cdrom};
> }
>
> - if ($conf->{cloudinit} && $conf->{ide3}) {
> - die "option cloudinit conflicts with ide3\n";
> - delete $conf->{cloudinit};
> - }
> -
> # we do not use 'smp' any longer
> if ($conf->{sockets}) {
> delete $conf->{smp};
> @@ -2615,21 +2618,6 @@ sub foreach_drive {
>
> &$func($ds, $drive);
> }
> -
> - if (my $storeid = $conf->{cloudinit}) {
> - my $storecfg = PVE::Storage::config();
> - my $imagedir = PVE::Storage::get_image_dir($storecfg, $storeid, $vmid);
> - my $iso_name = "vm-$vmid-cloudinit.qcow2";
> - my $iso_path = "$imagedir/$iso_name";
> - # Only snapshot it if it has already been created.
> - # (Which is not the case if the VM has never been started before with
> - # cloud-init enabled.)
> - if (-e $iso_path) {
> - my $ds = 'ide3';
> - my $drive = parse_drive($ds, "$storeid:$vmid/vm-$vmid-cloudinit.qcow2");
> - &$func($ds, $drive) if $drive;
> - }
> - }
> }
>
> sub foreach_volid {
> @@ -3203,6 +3191,13 @@ sub config_to_command {
> $ahcicontroller->{$controller}=1;
> }
>
> + if ($drive->{interface} eq 'cloudinitdrive') {
> + my $controller = 1;
> + $pciaddr = print_pci_addr("ahci$controller", $bridges);
> + push @$devices, '-device', "ahci,id=ahci$controller,multifunction=on$pciaddr" if !$ahcicontroller->{$controller};
> + $ahcicontroller->{$controller}=1;
> + }
> +
> my $drive_cmd = print_drive_full($storecfg, $vmid, $drive);
> push @$devices, '-drive',$drive_cmd;
> push @$devices, '-device', print_drivedevice_full($storecfg, $conf, $vmid, $drive, $bridges);
> @@ -4851,6 +4846,7 @@ sub print_pci_addr {
> 'net29' => { bus => 1, addr => 24 },
> 'net30' => { bus => 1, addr => 25 },
> 'net31' => { bus => 1, addr => 26 },
> + 'ahci1' => { bus => 1, addr => 27 },
> 'virtio6' => { bus => 2, addr => 1 },
> 'virtio7' => { bus => 2, addr => 2 },
> 'virtio8' => { bus => 2, addr => 3 },
> @@ -6381,17 +6377,25 @@ sub scsihw_infos {
> my $cloudinit_iso_size = 5; # in MB
>
> sub prepare_cloudinit_disk {
> - my ($vmid, $storeid) = @_;
> + my ($vmid, $conf, $storeid) = @_;
>
> my $storecfg = PVE::Storage::config();
> - my $imagedir = PVE::Storage::get_image_dir($storecfg, $storeid, $vmid);
> - my $iso_name = "vm-$vmid-cloudinit.qcow2";
> - my $iso_path = "$imagedir/$iso_name";
> - return $iso_path if -e $iso_path;
> + my $scfg = PVE::Storage::storage_config($storecfg, $storeid);
> + my $name = "vm-$vmid-cloudinit";
> + my $fmt = undef;
> + if( $scfg->{path}) {
> + $name .= ".qcow2";
> + $fmt = 'qcow2';
> + }else{
> + $fmt = 'raw';
> + }
> + my $volid = PVE::Storage::vdisk_alloc($storecfg, $storeid, $vmid, $fmt, $name, $cloudinit_iso_size*1024);
>
> - # vdisk_alloc size is in K
> - my $iso_volid = PVE::Storage::vdisk_alloc($storecfg, $storeid, $vmid, 'qcow2', $iso_name, $cloudinit_iso_size*1024);
> - return $iso_path;
> + my $drive = {};
> + $drive->{file} = $volid;
> + $drive->{media} = 'cdrom';
> + $conf->{cloudinitdrive0} = PVE::QemuServer::print_drive($vmid, $drive);
> + update_config_nolock($vmid, $conf);
> }
>
> # FIXME: also in LXCCreate.pm => move to pve-common
> @@ -6407,10 +6411,10 @@ sub next_free_nbd_dev {
> }
>
> sub commit_cloudinit_disk {
> - my ($file_path, $iso_path) = @_;
> + my ($file_path, $iso_path, $format) = @_;
>
> my $nbd_dev = next_free_nbd_dev();
> - run_command(['qemu-nbd', '-c', $nbd_dev, $iso_path]);
> + run_command(['qemu-nbd', '-c', $nbd_dev, $iso_path, '-f', $format]);
>
> eval {
> run_command(['genisoimage',
> @@ -6439,8 +6443,18 @@ sub generate_cloudinitconfig {
> . generate_cloudinit_network($conf, $path);
> generate_cloudinit_metadata($conf, $path, $digest_data);
>
> - my $iso_path = prepare_cloudinit_disk($vmid, $storeid);
> - commit_cloudinit_disk("$path/drive", $iso_path);
> + #fix me : remove old drive of if cloudinitdrive0 storeid change
> + prepare_cloudinit_disk($vmid, $conf, $storeid) if !$conf->{cloudinitdrive0};
> +
> + my $drive = parse_drive('cloudinitdrive0', $conf->{cloudinitdrive0});
> +
> + my $storecfg = PVE::Storage::config();
> + my (undef, $volname) = PVE::Storage::parse_volume_id($drive->{file}, 1);
> + my $iso_path = PVE::Storage::path($storecfg, $drive->{file});
> + my $scfg = PVE::Storage::storage_config($storecfg, $storeid);
> + my $format = qemu_img_format($scfg, $volname);
> +
> + commit_cloudinit_disk("$path/drive", $iso_path, $format);
> rmtree("$path/drive");
> }
>
> --
> 2.1.4
>
> _______________________________________________
> pve-devel mailing list
> pve-devel at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>
_______________________________________________
pve-devel mailing list
pve-devel at pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
More information about the pve-devel
mailing list