[pve-devel] LXC volumes on ZFS over iSCSI

[Alexandre DERUMIER]

>>This is because the Lun is persisted through the scsi bus so the 
>>following should do it: 
>>echo 1 > /sys/bus/scsi/devices/${H:B:T:L}/delete (Where H = host:B = bus:T = target:L = lun) 

yes, but you need to do it on all nodes to be clean.
For example you remove a lun on node1, if you don't remove it from others nodes, you'll have timeout, or multipath errors on theses nodes.

In past, when I had my nexenta zfs san with iscsi luns, I had a hacky cronjob with rescan each 5minute to cleanup removed luns.
But I have problem with scan all, adding 500luns to each nodes, and multipath daemon going cpu crazy with all theses luns.

That's why I suggest to only add lun when needed (vm start) and remove them when vm is stopped.


According to redhat doc, 

it's possible to scan only 1 lun


# echo "c t l" > /sys/class/scsi_host/hosth/scan
In the previous command, h is the HBA number, c is the channel on the HBA, t is the SCSI target ID, and l is the LUN.


I never use it, don't known if it's working fine.




----- Mail original -----
De: "datanom.net" <mir at datanom.net>
À: "pve-devel" <pve-devel at pve.proxmox.com>
Envoyé: Lundi 10 Octobre 2016 19:48:32
Objet: Re: [pve-devel] LXC volumes on ZFS over iSCSI

On Mon, 10 Oct 2016 19:32:28 +0200 (CEST) 
Alexandre DERUMIER <aderumier at odiso.com> wrote: 

> 
> But, if you delete a lun, rescan is not removing it. 
> and if you remove then add a new lun on same lunid, this is where problems begins. 
> 
This is because the Lun is persisted through the scsi bus so the 
following should do it: 
echo 1 > /sys/bus/scsi/devices/${H:B:T:L}/delete (Where H = host:B = bus:T = target:L = lun) 

-- 
Hilsen/Regards 
Michael Rasmussen 

Get my public GnuPG keys: 
michael <at> rasmussen <dot> cc 
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E 
mir <at> datanom <dot> net 
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C 
mir <at> miras <dot> org 
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917 
-------------------------------------------------------------- 
/usr/games/fortune -es says: 
The egg cream is psychologically the opposite of circumcision -- it 
*pleasurably* reaffirms your Jewishness. 
-- Mel Brooks 

_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel