----- "Steve Walsh" steve@nerdvana.net.au escreveu:

De: "Steve Walsh" steve@nerdvana.net.au Para: centos@centos.org Enviadas: Sexta-feira, 9 de Setembro de 2011 9:17:50 (GMT-0300) Auto-Detected Assunto: Re: [CentOS] CentOS5 with Dell Broadcom iSCSI Offload, does it work ?

On 09/09/2011 10:05 PM, Drew Weaver wrote:

...

Hi,

I could be wrong here but don't you go into the Broadcom NIC configuration while the server is booting and add the iSCSI target in there and then it should appear as "Just Another Volume (TM)" to the operating system?

I've never tried it but I assume thats how the 'offloading' works.

close, but not. TCP Offloading (obviously) offloads the TCP protocol processing from the server CPU onto the server adapter. This preserves valuable CPU cycles for applications processing and improves overall server performance and network efficiency, as the heavy lifting for iSCSI is done on the card, by the card.

<snip> > After finding multiples answers to this question via google, but > without making it work on my servers. Has anybody iSCSI Offload > working on a Dell Server with Broadcom NICs ?

Depending on how the Broadcom is in the server (ie - Physical Card vs onboard mezzanine card) depends on if you enable it in BIOS, or switch into the firmware when prompted at boot time to enable it.

Hi,

Well... I looked into the NICs config to make sure it's on. On BIOS I can see the 4 onboard NICs. On these I can chage from "no boot" / PXE / iSCSI boot. And the BIOS "detect" that this NICs are TOE & ISOE "capable". I had PXE on the first one and "no boot" on the other 3. From the NICs firmware menu I can see all the 8 NICs (including the 4 onboard), I can change the same options, no option to enable/disable iSCSI Offload, only iSCSI boot.

I'm trying the instructions from:

- http://www.open-iscsi.org/docs/README - http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/5/pdf/Online_Stor... - http://webpages.marshall.edu/~wolfe21/papers/rhel5-iscsi-HOWTO.pdf

All of these say almost the same, and I can configure open-iscsi to access the EMC SAN using the two broadcom NICs using dm-multipath. But when I tryed to use the second MAC on the NIC (to activate iSCSI Offload) then I can't connect on the SAN. I can discovery it using the second MAC, but can't connect.

Using "default" iface, it will conect using eth1 or eth2:

[root@vHst-153-NEAD03 ~]# iscsiadm -m discoverydb -t st -p 10.252.1.1:3260 -I default --discover -P 1 Target: iqn.1992-04.com.emc:cx.ckm00091500140.a2 Portal: 10.252.1.1:3260,1 Iface Name: default Target: iqn.1992-04.com.emc:cx.ckm00091500140.b2 Portal: 10.252.1.2:3260,2 Iface Name: default Target: iqn.1992-04.com.emc:cx.ckm00091500140.a3 Portal: 10.252.2.1:3260,3 Iface Name: default Target: iqn.1992-04.com.emc:cx.ckm00091500140.b3 Portal: 10.252.2.2:3260,4 Iface Name: default

[root@vHst-153-NEAD03 ~]# iscsiadm -m node -I default -lLogging in to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.a3, portal: 10.252.2.1,3260] Logging in to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.b2, portal: 10.252.1.2,3260] Logging in to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.b3, portal: 10.252.2.2,3260] Logging in to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.a2, portal: 10.252.1.1,3260] Login to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.a3, portal: 10.252.2.1,3260] successful. Login to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.b2, portal: 10.252.1.2,3260] successful. Login to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.b3, portal: 10.252.2.2,3260] successful. Login to [iface: default, target: iqn.1992-04.com.emc:cx.ckm00091500140.a2, portal: 10.252.1.1,3260] successful.

[root@vHst-153-NEAD03 ~]# iscsiadm -m session tcp: [5] 10.252.2.1:3260,3 iqn.1992-04.com.emc:cx.ckm00091500140.a3 tcp: [6] 10.252.1.2:3260,2 iqn.1992-04.com.emc:cx.ckm00091500140.b2 tcp: [7] 10.252.2.2:3260,4 iqn.1992-04.com.emc:cx.ckm00091500140.b3 tcp: [8] 10.252.1.1:3260,1 iqn.1992-04.com.emc:cx.ckm00091500140.a2

[root@vHst-153-NEAD03 ~]# iscsiadm -m session -P 1 Target: iqn.1992-04.com.emc:cx.ckm00091500140.a3 Current Portal: 10.252.2.1:3260,3 Persistent Portal: 10.252.2.1:3260,3 ********** Interface: ********** Iface Name: default Iface Transport: tcp Iface Initiatorname: iqn.1994-05.com.redhat:vHst-153-NEAD03 Iface IPaddress: 10.252.2.153 Iface HWaddress: <empty> Iface Netdev: <empty> SID: 5 iSCSI Connection State: LOGGED IN iSCSI Session State: LOGGED_IN Internal iscsid Session State: NO CHANGE <snip>

But, if I try the same with the eth1 offload, I get:

[root@vHst-153-NEAD03 ~]# ifconfig eth1 eth1 Link encap:Ethernet Endereço de HW BC:30:5B:FD:F7:E7 inet end.: 10.252.1.153 Bcast:10.252.1.255 Masc:255.255.255.0 endereço inet6: fe80::be30:5bff:fefd:f7e7/64 Escopo:Link UP BROADCASTRUNNING MULTICAST MTU:9000 Métrica:1 RX packets:735 errors:0 dropped:0 overruns:0 frame:0 TX packets:8 errors:0 dropped:0 overruns:0 carrier:0 colisões:0 txqueuelen:1000 RX bytes:47040 (45.9 KiB) TX bytes:620 (620.0 b) IRQ:26 Memória:d2000000-d2012800

[root@vHst-153-NEAD03 ~]# iscsiadm -m iface default tcp,<empty>,<empty>,<empty>,<empty> iser iser,<empty>,<empty>,<empty>,<empty> bnx2i.bc:30:5b:fd:f7:e8 bnx2i,bc:30:5b:fd:f7:e8,10.252.1.53,<empty>,<empty> bnx2i.bc:30:5b:fd:f7:ea bnx2i,bc:30:5b:fd:f7:ea,10.252.2.53,<empty>,<empty>

[root@vHst-153-NEAD03 ~]# iscsiadm -m iface -I bnx2i.bc:30:5b:fd:f7:e8 # BEGIN RECORD 2.0-872 iface.iscsi_ifacename = bnx2i.bc:30:5b:fd:f7:e8 iface.net_ifacename = <empty> iface.ipaddress = 10.252.1.53 iface.hwaddress = bc:30:5b:fd:f7:e8 iface.transport_name = bnx2i iface.initiatorname = <empty> # END RECORD

[root@vHst-153-NEAD03 ~]# iscsiadm -m discoverydb -t st -p 10.252.1.1:3260 -I bnx2i.bc:30:5b:fd:f7:e8 --discover -P 1 Target: iqn.1992-04.com.emc:cx.ckm00091500140.a2 Portal: 10.252.1.1:3260,1 Iface Name: bnx2i.bc:30:5b:fd:f7:e8 Target: iqn.1992-04.com.emc:cx.ckm00091500140.b2 Portal: 10.252.1.2:3260,2 Iface Name: bnx2i.bc:30:5b:fd:f7:e8 Target: iqn.1992-04.com.emc:cx.ckm00091500140.a3 Portal: 10.252.2.1:3260,3 Iface Name: bnx2i.bc:30:5b:fd:f7:e8 Target: iqn.1992-04.com.emc:cx.ckm00091500140.b3 Portal: 10.252.2.2:3260,4 Iface Name: bnx2i.bc:30:5b:fd:f7:e8

[root@vHst-153-NEAD03 ~]# iscsiadm -m node -I bnx2i.bc:30:5b:fd:f7:e8 -l Logging in to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.a3, portal: 10.252.2.1,3260] Logging in to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.b2, portal: 10.252.1.2,3260] Logging in to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.b3, portal: 10.252.2.2,3260] Logging in to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.a2, portal: 10.252.1.1,3260] iscsiadm: Could not login to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.a3, portal: 10.252.2.1,3260]. iscsiadm: initiator reported error (8 - connection timed out) iscsiadm: Could not login to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.b2, portal: 10.252.1.2,3260]. iscsiadm: initiator reported error (8 - connection timed out) iscsiadm: Could not login to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.b3, portal: 10.252.2.2,3260]. iscsiadm: initiator reported error (8 - connection timed out) iscsiadm: Could not login to [iface: bnx2i.bc:30:5b:fd:f7:e8, target: iqn.1992-04.com.emc:cx.ckm00091500140.a2, portal: 10.252.1.1,3260]. iscsiadm: initiator reported error (8 - connection timed out) iscsiadm: Could not log into all portals

Well, has anybody make this to work ? What I'm missing ?

Thanks in advance,

Antonio.