The array OS 5.1.x and later supports iSCSI Group Scoped Target (GST) on iSCSI arrays (this is new), previous to this it was using VST Volume Scoped Targeting. GST reduces the number of individual host connections you need to configure and manage, which saves you time and also ensures you don’t hit limitations in the iSCSI implementation on the host side.<\/p>\n\n\n\n
For example, with Volume Scoped Target (VST), if you need to connect four iSCSI volumes to the host, you would need to connect each target to the host individually. With GST, if you want to connect those same four volumes, you only need to connect to the one target.<\/p>\n\n\n\n
On VMware for example, if you had a Nimble Storage array with 4 iSCSI IP addresses, and 10 datastores presented (and using VST) you’d see 4 targets for the array group, then 10 targets, one for each datastore. In this case they all appear with LUN ID 0 typically.<\/p>\n\n\n\n
Now when you swap to GST you only see the 4 iSCSI IP addresses, and then each datastore is accessible via these group scoped targets instead.<\/p>\n\n\n\n
This is a consequence of AS-117089,\u00a0the Network Affinity Zones are no longer honoured, partly due to all connections now being meshed.<\/p>\n\n\n\n
NOTE: When you perform a new installation of the array 5.1.x or later, your default target will use GST. If you upgrade to 5.1.x or later, your default target will continue to use VST. This is an important consideration, if you have an older array which was running a version pre-5.1.x then it would have come set with VST, if you’ve upgraded to 5.1.x or later you’ll still be using VST, unless of course you use the procedure below to swap it to GST.<\/p>\n\n\n\n
https:\/\/infosight.hpe.com\/InfoSight\/media\/cms\/active\/public\/pubs_CLI_Administration_Guide_5_1_x.whz\/index.html#pkd1536255247713.html<\/a><\/p>\n\n\n\n NOTE: For every volume you are changing you must offline its access, its recommended to totally drain the array of data (that’s how I did it), but if that is not possible, just ensure that there is no I\/O on the volume you are changing or it will cause an outage.<\/p>\n\n\n\n The goal of these steps is to:<\/p>\n\n\n\n 1. Disconnect all hosts (ESXi and Windows) from the volume(s) to be migrated.<\/p>\n\n\n\n 2. Connect to the group CLI.<\/p>\n\n\n\n 3. For each volume, verify the number of active connections is 0, with the following command:<\/p>\n\n\n\n 4. Take each volume to be reconfigured offline with the following command (ensure its not got any IO!)<\/p>\n\n\n\n 5. Remove the ACLs from the volume(s) For each volume, issue the command:<\/p>\n\n\n\n With this you see the list of Initiator Groups allowed access to the the volume, make note of these Initiator Groups listed, for later in the procedure.<\/p>\n\n\n\n For each Initiator group listed, issue the following command:<\/p>\n\n\n\n 6. Once all ACLs have been removed from each volume, proceed to the next step.<\/p>\n\n\n\n 7. Change the target scope: For each volume, issue:<\/p>\n\n\n\n Verify the change:<\/p>\n\n\n\n If it is correct you’ll see:<\/p>\n\n\n\n Repeat until all your existing volumes are done.<\/p>\n\n\n\n IMPORTANT: It is highly recommended to ensure that each datastore uses a unique LUN ID, much like what you have on a fibre channel storage area network, ensuring that each datastore is presented with a unique LUN ID across your whole iSCSI (and Fibre Channel) estate ensures you don’t have a clash of LUN IDs, which can cause re-signaturing of VMFS volumes and outages (on VMWare) and other issues on NTFS etc.<\/p>\n\n\n\n 8. Now change the default target scope, this ensures that all newly created and presented datastores are created with GST instead of VST.<\/p>\n\n\n\n Verify the change with:<\/p>\n\n\n\n NOTE: that the “Encryption default settings scope” being set to “volume” is as expected, this value does not need to be changed, it defines the scope of where the encryption of a volume is, i.e. scoped to the volume itself.<\/p>\n\n\n\n Change iSCSI Default Target Scope Change iSCSI Volume Scope from VST to GST Change iSCSI Volume Scope from GST to VST 9. Re-add the ACL(s) to the volume(s), refer to the previously-noted list of each volume’s Initiator Group ACLs you got earlier in step 5, remember to set the unique LUN ID!<\/p>\n\n\n\n For each Initiator Group listed, on each volume, issue the command:<\/p>\n\n\n\n NOTE: Ensure you add the VLAN ID argument to the end to ensure you are presenting the volume with the correct ID.<\/p>\n\n\n\n 10. Once all ACLs have been re-added to each volume, you can then bring them all back on line with:<\/p>\n\n\n\n 11. Re-establish connections to the volumes by performing a rescan from the host(s), in the case of VMware you’ll no longer see a target for each volume (plus the 4 for each iSCSI IP), you’ll now see only 4 targets, because they are now working behind this “group scope”.<\/p>\n","protected":false},"excerpt":{"rendered":" The array OS 5.1.x and later supports iSCSI Group Scoped Target (GST) on iSCSI arrays (this is new), previous to this it was using VST Volume Scoped Targeting. GST reduces the number of individual host connections you need to configure and manage, which saves you time and also ensures you don’t hit limitations in the … Read more<\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[33,25],"tags":[],"class_list":["post-3718","post","type-post","status-publish","format-standard","hentry","category-nimble-storage","category-vmware"],"_links":{"self":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3718","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3718"}],"version-history":[{"count":1,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3718\/revisions"}],"predecessor-version":[{"id":3719,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3718\/revisions\/3719"}],"wp:attachment":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3718"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3718"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3718"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Goal<\/h2>\n\n\n\n
\n
Procedure<\/h2>\n\n\n\n
vol --info [volumeName] | grep connections<\/code><\/pre>\n\n\n\nvol --offline [volumeName]<\/code><\/pre>\n\n\n\nvol --info [volumeName] | egrep \"Name|Initiator Group\"<\/code><\/pre>\n\n\n\nvol --removeacl [volumeName] --initiatorgrp [initiatorGroupName]<\/code><\/pre>\n\n\n\nvol --edit [volumeName] --iscsi_target_scope group<\/code><\/pre>\n\n\n\nvol --info [volumeName] | grep Scope<\/code><\/pre>\n\n\n\nNimble OS $ vol --info datastore001 | grep Scope\r\niSCSI Target Scope: iSCSI Group Target<\/code><\/pre>\n\n\n\ngroup --edit --default_iscsi_target_scope group<\/code><\/pre>\n\n\n\nNimble OS $ group --info | grep -i scope\nDefault iSCSI Target Scope: iSCSI Volume Target\nEncryption default settings scope: volume\n\n< Post Change >\n\nNimble OS $ group --info | grep -i scope\nDefault iSCSI Target Scope: iSCSI Group Target\nEncryption default settings scope: volume<\/code><\/pre>\n\n\n\n
https:\/\/infosight.hpe.com\/InfoSight\/media\/cms\/active\/public\/pubs_CLI_Administration_Guide_5_1_x.whz\/index.html#lgs1579039268104.html<\/a><\/p>\n\n\n\n
https:\/\/infosight.hpe.com\/InfoSight\/media\/cms\/active\/public\/pubs_CLI_Administration_Guide_5_1_x.whz\/index.html#hme1536256896246.html<\/a><\/p>\n\n\n\n
https:\/\/infosight.hpe.com\/InfoSight\/media\/cms\/active\/public\/pubs_CLI_Administration_Guide_5_1_x.whz\/index.html#zow1536259763236.html<\/a><\/p>\n\n\n\nvol --addacl [volumeName] --initiatorgrp [initiatorGroupName]<\/code><\/pre>\n\n\n\nvol --online [volumeName]<\/code><\/pre>\n\n\n\n