[CentOS] can't disconnec iSCSI targets, please help

Mon Feb 28 12:44:36 UTC 2011
Rudi Ahlers <Rudi at SoftDux.com>

On Mon, Feb 28, 2011 at 12:02 PM, Rudi Ahlers <Rudi at softdux.com> wrote:
> Hi,
>
> I'm trying to disconnect some iSCSI targets, but can't seem to.
>
> [root at localhost ~]# iscsiadm -m session
> tcp: [1] 192.168.2.202:3260,1 iqn.2011.01.22.freenas.nvr:500gb
> tcp: [3] 192.168.2.200:3260,1 iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba
> tcp: [4] 192.168.2.202:3260,1 iqn.2011.01.22.freenas.nvr:extent0
> tcp: [5] 192.168.2.200:3260,1
> iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb
>
> I need to disconnect all 4 of these
>
> [root at localhost ~]# iscsiadm -m node -T   192.168.2.200:3260,1
> iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb -p 196.34.136.200
> --logout
>
> The target is still there, even though I tell it to disconnect.
>
> [root at localhost ~]# iscsiadm -m session
> tcp: [1] 192.168.2.202:3260,1 iqn.2011.01.22.freenas.nvr:500gb
> tcp: [3] 192.168.2.200:3260,1 iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba
> tcp: [4] 192.168.2.202:3260,1 iqn.2011.01.22.freenas.nvr:extent0
> tcp: [5] 192.168.2.200:3260,1
> iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb
>
> I can't delete it either:
> [root at localhost ~]# iscsiadm -m node --op delete --targetname
> 192.168.2.202:3260,1 iqn.2011.01.22.freenas.nvr:500gb
> iscsiadm: no records found!
>
> Restarting iscsi gives some odd errors:
>
>
> [root at localhost ~]# /etc/init.d/iscsi restart
> Logging out of session [sid: 1, target:
> iqn.2011.01.22.freenas.nvr:500gb, portal: 192.168.2.202,3260]
> Logging out of session [sid: 3, target:
> iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
> 192.168.2.200,3260]
> Logging out of session [sid: 4, target:
> iqn.2011.01.22.freenas.nvr:extent0, portal: 192.168.2.202,3260]
> Logging out of session [sid: 5, target:
> iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
> 192.168.2.200,3260]
> Logout of [sid: 1, target: iqn.2011.01.22.freenas.nvr:500gb, portal:
> 192.168.2.202,3260]: successful
> Logout of [sid: 3, target:
> iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
> 192.168.2.200,3260]: successful
> Logout of [sid: 4, target: iqn.2011.01.22.freenas.nvr:extent0, portal:
> 192.168.2.202,3260]: successful
> Logout of [sid: 5, target:
> iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
> 192.168.2.200,3260]: successful
> Stopping iSCSI daemon:
> iscsid dead but pid file exists                            [  OK  ]
> Starting iSCSI daemon:                                     [  OK  ]
>                                                           [  OK  ]
> Setting up iSCSI targets: Logging in to [iface: default, target:
> iqn.2011.01.22.freenas.nvr:500gb, portal: 192.168.2.202,3260]
> Logging in to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.thin1.vg0.2tb, portal:
> 192.168.2.200,3260]
> Logging in to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
> 192.168.2.200,3260]
> Logging in to [iface: default, target:
> iqn.2011.01.22.freenas.nvr:extent0, portal: 192.168.2.202,3260]
> Logging in to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
> 192.168.2.200,3260]
> Logging in to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.thin2.vg0.1tb, portal:
> 192.168.2.200,3260]
> Login to [iface: default, target: iqn.2011.01.22.freenas.nvr:500gb,
> portal: 192.168.2.202,3260]: successful
> iscsiadm: Could not login to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.thin1.vg0.2tb, portal:
> 192.168.2.200,3260]:
> iscsiadm: initiator reported error (19 - encountered non-retryable
> iSCSI login failure)
> Login to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
> 192.168.2.200,3260]: successful
> Login to [iface: default, target: iqn.2011.01.22.freenas.nvr:extent0,
> portal: 192.168.2.202,3260]: successful
> Login to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
> 192.168.2.200,3260]: successful
> iscsiadm: Could not login to [iface: default, target:
> iqn.2011-2.za.co.securehosting:RAID.thin2.vg0.1tb, portal:
> 192.168.2.200,3260]:
> iscsiadm: initiator reported error (19 - encountered non-retryable
> iSCSI login failure)
> iscsiadm: Could not log into all portals. Err 19.
>
>
>
>
> Interestingly, the targets which iscsi reports as not existing, does exist:
>
> [root at localhost ~]# iscsiadm -m discovery -t sendtargets -p  192.168.2.200
> 192.168.2.200:3260,1 iqn.2011-2.za.co.securehosting:RAID.thin1.vg0.2tb
> 192.168.2.200:3260,1 iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba
> 192.168.2.200:3260,1 iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb
> 192.168.2.200:3260,1 iqn.2011-2.za.co.securehosting:RAID.thin2.vg0.1tb
>
>
>
>
>
> Is there any other way to force these disconnects, and re-connect them?
> The machine runs on CentOS 5.5 x64 + XEN:
>
> [root at localhost ~]# cat /etc/redhat-release
> CentOS release 5.5 (Final)
> [root at localhost ~]# uname -a
> Linux localhost.localdomain 2.6.18-194.el5xen #1 SMP Fri Apr 2
> 15:34:40 EDT 2010 x86_64 x86_64 x86_64 GNU/Linux
> [root at localhost ~]#
>
>
>
> --
> Kind Regards
> Rudi Ahlers
> SoftDux
>
> Website: http://www.SoftDux.com
> Technical Blog: http://Blog.SoftDux.com
> Office: 087 805 9573
> Cell: 082 554 7532
> _______________________________________________
> CentOS mailing list
> CentOS at centos.org
> http://lists.centos.org/mailman/listinfo/centos
>

This is driving me nuts! Does anyone know if this is a bug, or am I
doing something wrong?

I searched the RHEL bug list, but can't find anything related to this.
Some other people (via google search) seems to have simila problems,
but I can't see any fixes on the web.

I can logout out of all sessions, but as soon as I restart iscsi, the
sessions gets restored again:


[root at localhost ~]# fdisk -l

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          13      104391   83  Linux
/dev/sda2              14      121584   976519057+  8e  Linux LVM

Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1   *           1          13      104391   83  Linux
/dev/sdb2              14      121584   976519057+  8e  Linux LVM

Disk /dev/sdc: 1084.4 GB, 1084480290816 bytes
255 heads, 63 sectors/track, 131847 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdc doesn't contain a valid partition table

Disk /dev/sdd: 539.7 GB, 539771273216 bytes
255 heads, 63 sectors/track, 65623 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1               1       65623   527116716   fd  Linux raid autodetect

Disk /dev/sde: 536.8 GB, 536870912000 bytes
255 heads, 63 sectors/track, 65270 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sde doesn't contain a valid partition table

Disk /dev/sdf: 536.8 GB, 536870912000 bytes
255 heads, 63 sectors/track, 65270 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdf1               1       65270   524281243+  fd  Linux raid autodetect

[root at localhost ~]# iscsiadm -m node -u
Logging out of session [sid: 1, target:
iqn.2011.01.22.freenas.nvr:500gb, portal: 192.168.2.202,3260]
Logging out of session [sid: 3, target:
iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
192.168.2.200,3260]
Logging out of session [sid: 4, target:
iqn.2011.01.22.freenas.nvr:extent0, portal: 192.168.2.202,3260]
Logging out of session [sid: 5, target:
iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
192.168.2.200,3260]
Logout of [sid: 1, target: iqn.2011.01.22.freenas.nvr:500gb, portal:
192.168.2.202,3260]: successful
Logout of [sid: 3, target:
iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
192.168.2.200,3260]: successful
Logout of [sid: 4, target: iqn.2011.01.22.freenas.nvr:extent0, portal:
192.168.2.202,3260]: successful
Logout of [sid: 5, target:
iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
192.168.2.200,3260]: successful

So, iscsi logs out of the targets, and fdisk -l confirms it:
[root at localhost ~]# fdisk -l

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          13      104391   83  Linux
/dev/sda2              14      121584   976519057+  8e  Linux LVM

Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1   *           1          13      104391   83  Linux
/dev/sdb2              14      121584   976519057+  8e  Linux LVM


But as soon as I restart iscsi, it logs back-in:

[root at localhost ~]# /etc/init.d/iscsi restart
Stopping iSCSI daemon:
iscsid dead but pid file exists                            [  OK  ]
Starting iSCSI daemon:                                     [  OK  ]
                                                           [  OK  ]
Setting up iSCSI targets: Logging in to [iface: default, target:
iqn.2011.01.22.freenas.nvr:500gb, portal: 192.168.2.202,3260]
Logging in to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.thin1.vg0.2tb, portal:
192.168.2.200,3260]
Logging in to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
192.168.2.200,3260]
Logging in to [iface: default, target:
iqn.2011.01.22.freenas.nvr:extent0, portal: 192.168.2.202,3260]
Logging in to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
192.168.2.200,3260]
Logging in to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.thin2.vg0.1tb, portal:
192.168.2.200,3260]
Login to [iface: default, target: iqn.2011.01.22.freenas.nvr:500gb,
portal: 192.168.2.202,3260]: successful
iscsiadm: Could not login to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.thin1.vg0.2tb, portal:
192.168.2.200,3260]:
iscsiadm: initiator reported error (19 - encountered non-retryable
iSCSI login failure)
Login to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.thin3.vg0.1tba, portal:
192.168.2.200,3260]: successful
Login to [iface: default, target: iqn.2011.01.22.freenas.nvr:extent0,
portal: 192.168.2.202,3260]: successful
Login to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.iscsi0.vg0.500gb, portal:
192.168.2.200,3260]: successful
iscsiadm: Could not login to [iface: default, target:
iqn.2011-2.za.co.securehosting:RAID.thin2.vg0.1tb, portal:
192.168.2.200,3260]:
iscsiadm: initiator reported error (19 - encountered non-retryable
iSCSI login failure)
iscsiadm: Could not log into all portals. Err 19.



Why?
Or, how do I completely get rid of them?