ITPub博客

首页 > 应用开发 > IT综合 > hpux 1131与EMC cx500的配置

hpux 1131与EMC cx500的配置

原创 IT综合 作者:konglingsong 时间:2010-02-17 13:48:27 0 删除 编辑
I'm currently benchmarking a RX6600.

30mins - yes - there is definately something very wrong there...

Now mine isn't on a clariion - it's on a DMX1000 and DMX3

From the output below, frame 65 is the 1000 and 52 is the DMX3.

# prealloc /tmp/bigfile 409600000

# timex cp /tmp/bigfile /v01/

real 11.95
user 0.00
sys 0.18
[@more@]

mkdir /dev/vg11
mknod /dev/vg11/group c 64 0x0b0000

vgcreate -s 32 -p 64 -e 32768 /dev/vg11 /dev/disk/disk23 /dev/disk/disk24 /dev/disk/disk25



# ioscan -m dsf
Persistent DSF Legacy DSF(s)
========================================
/dev/pt/pt1 /dev/rscsi/c1t0d0
/dev/pt/pt3 /dev/rscsi/c3t0d0
/dev/rdisk/disk4 /dev/rdsk/c0t1d0
/dev/rdisk/disk4_p3 /dev/rdsk/c0t1d0s3
/dev/rdisk/disk4_p1 /dev/rdsk/c0t1d0s1
/dev/rdisk/disk4_p2 /dev/rdsk/c0t1d0s2
/dev/pt/pt5 /dev/rscsi/c5t0d0
/dev/rdisk/disk5 /dev/rdsk/c0t0d0
/dev/rdisk/disk5_p1 /dev/rdsk/c0t0d0s1
/dev/rdisk/disk5_p2 /dev/rdsk/c0t0d0s2
/dev/rdisk/disk5_p3 /dev/rdsk/c0t0d0s3
/dev/pt/pt7 /dev/rscsi/c7t0d0
/dev/rdisk/disk7 /dev/rdsk/c2t0d0
/dev/rdisk/disk9 /dev/rdsk/c4t0d0
/dev/rdisk/disk18 /dev/rdsk/c4t9d0
/dev/rdisk/disk19 /dev/rdsk/c4t9d1
/dev/rdisk/disk20 /dev/rdsk/c4t9d2
/dev/rdisk/disk21 /dev/rdsk/c4t9d3
/dev/rdisk/disk22 /dev/rdsk/c2t9d0
/dev/rdisk/disk23 /dev/rdsk/c2t9d1
/dev/rdisk/disk24 /dev/rdsk/c2t9d2
/dev/rdisk/disk25 /dev/rdsk/c2t9d3
/dev/rdisk/disk27 /dev/rdsk/c6t0d0
/dev/rdisk/disk29 /dev/rdsk/c8t0d0
/dev/rdisk/disk38 /dev/rdsk/c8t4d0
/dev/rdisk/disk39 /dev/rdsk/c8t4d2
/dev/rdisk/disk40 /dev/rdsk/c8t3d7
/dev/rdisk/disk41 /dev/rdsk/c8t4d1
/dev/rdisk/disk42 /dev/rdsk/c6t4d0
/dev/rdisk/disk43 /dev/rdsk/c6t3d7
/dev/rdisk/disk44 /dev/rdsk/c6t4d1
/dev/rdisk/disk45 /dev/rdsk/c6t4d2



# inq
Inquiry utility, Version V7.3-771 (Rev 0.0) (SIL Version V6.3.0.0 (Edit Level 771)
Copyright (C) by EMC Corporation, all rights reserved.
For help type inq -h.

............................

-----------------------------------------------------------------------------
DEVICE :VEND :PROD :REV :SER NUM :CAP(kb)
-----------------------------------------------------------------------------
/dev/rdsk/c0t0d0 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t0d0s1 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t0d0s2 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t0d0s3 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t1d0 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c0t1d0s1 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c0t1d0s2 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c0t1d0s3 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c2t9d0 :EMC :SYMMETRIX :5670 :6500780000 : 35354880
/dev/rdsk/c2t9d1 :EMC :SYMMETRIX :5670 :650079c000 : 35354880
/dev/rdsk/c2t9d2 :EMC :SYMMETRIX :5670 :6500774000 : 35354880
/dev/rdsk/c2t9d3 :EMC :SYMMETRIX :5670 :650077c000 : 35354880
/dev/rdsk/c4t9d0 :EMC :SYMMETRIX :5670 :6500780000 : 35354880
/dev/rdsk/c4t9d1 :EMC :SYMMETRIX :5670 :650079c000 : 35354880
/dev/rdsk/c4t9d2 :EMC :SYMMETRIX :5670 :6500774000 : 35354880
/dev/rdsk/c4t9d3 :EMC :SYMMETRIX :5670 :650077c000 : 35354880
/dev/rdsk/c6t0d0 :EMC :SYMMETRIX :5771 :5200022000 : 5760
/dev/rdsk/c6t3d7 :EMC :SYMMETRIX :5771 :52000e3000 : 77760000
/dev/rdsk/c6t4d0 :EMC :SYMMETRIX :5771 :52000e7000 : 77760000
/dev/rdsk/c6t4d1 :EMC :SYMMETRIX :5771 :52000eb000 : 77760000
/dev/rdsk/c6t4d2 :EMC :SYMMETRIX :5771 :52000ef000 : 77760000
/dev/rdsk/c8t0d0 :EMC :SYMMETRIX :5771 :5200022000 : 5760
/dev/rdsk/c8t3d7 :EMC :SYMMETRIX :5771 :52000e3000 : 77760000
/dev/rdsk/c8t4d0 :EMC :SYMMETRIX :5771 :52000e7000 : 77760000
/dev/rdsk/c8t4d1 :EMC :SYMMETRIX :5771 :52000eb000 : 77760000
/dev/rdsk/c8t4d2 :EMC :SYMMETRIX :5771 :52000ef000 : 77760000


# vgdisplay -v vg11
--- Volume groups ---
VG Name /dev/vg11
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 1
Open LV 1
Max PV 64
Cur PV 3
Act PV 3
Max PE per PV 32768
VGDA 6
PE Size (Mbytes) 32
Total PE 3234
Alloc PE 3234
Free PE 0
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg11/lvdata01
LV Status available/syncd
LV Size (Mbytes) 103488
Current LE 3234
Allocated PE 3234
Used PV 3


--- Physical volumes ---
PV Name /dev/disk/disk23
PV Status available
Total PE 1078
Free PE 0
Autoswitch On

PV Name /dev/disk/disk24
PV Status available
Total PE 1078
Free PE 0
Autoswitch On

PV Name /dev/disk/disk25
PV Status available
Total PE 1078
Free PE 0
Autoswitch On

We're just checking the Clariion initiator setting... for DMP if I have understood correctly it seems that it should be "No Auto-Trespass" + "Failover Mode"=2.

11iv3 native multipathing supports active-active arrays transparently without needing any vendor supplied plug-ins.

Active-passive arrays need to either support ALUA (See Section 5.8 of
http://t10.org/f
tp/t10/drafts/s
pc3/spc3r23.pdf)
or the active-passive array vendor needs to supply an apsw plug-in for their array. See : http://h21007.
www2.hp.com/p
ortal/download
/files/unprot/d
dk/APSWWPAPER.pdf


Okay everone, here goes with our home-brewed, unsupported configuration... which works for now.

Config for Clariion-side CX700:
-------------------------------
- We must first configure the two 2 initiators for our server in the following way on the Clariion:

============
Initiator Type: HP No Auto Trespass
Failover Mode: 2
============

Config for Server-side (HP-UX 11.31):
--------------------------------------
In our current configuration, we have 2 HBAs: the first is hooked up to SP-A on the Clariion and the second, SP-B. As already established, it's not possible to perform load-balancing, because the Clariion CX700 fonctions in "Active/Passive" mode. Therefore we have to change the load-balancing policy for each LUN in order to replicate a basic failover mode (hot spare if you like).

To do that we need to use the "preferred_path" argument for scsimgr.

First though we need the hardware adress in hex... ugh!

To get that we run ioscan with the following args.
==========
==========
==========
==========
=========
==========
=======
# ioscan -fnNkCdisk
Class I H/W Path Driver S/W State H/W Type Description
==========
=========
==========
=========
=========
=========
===========
disk 13 64000/0xfa00/0x1 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk13 /dev/rdisk/disk13
disk 14 64000/0xfa00/0x2 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk14 /dev/rdisk/disk14
disk 15 64000/0xfa00/0x3 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk15 /dev/rdisk/disk15
disk 16 64000/0xfa00/0x4 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk16 /dev/rdisk/disk16
disk 20 64000/0xfa00/0x8 esdisk CLAIMED DEVICE HP 146 GMAT3147NC
/dev/disk/disk20 /dev/rdisk/disk20
disk 21 64000/0xfa00/0x9 esdisk CLAIMED DEVICE TEAC DV-28E-N
/dev/disk/disk21 /dev/rdisk/disk21
disk 26 64000/0xfa00/0xc esdisk CLAIMED DEVICE HP 146 GMAT3147NC
/dev/disk/disk26 /dev/rdisk/disk26
disk 24 64000/0xfa00/0xd esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk24 /dev/rdisk/disk24
==================================

Then we fix the so called "load-balancing" policy...
==================================
/usr/sbin/scsimgr save_attr -H 64000/0xfa00/0xd -a load_bal_policy="preferred_path"
==================================

To find out the exact hardware path to "fix" as "preferred" you need to use the following command....
==================================
# /usr/sbin/scsimgr lun_map -D /dev/rdisk/disk24

LUN PATH INFORMATION FOR LUN : /dev/rdisk/disk24

Total number of LUN paths = 2
World Wide Identifier(WWID) = 0x60060160ce0b1600a242ce17f917dc11

LUN path : lunpath16
Class = lunpath
Instance = 16
Hardware path = 0/3/1/0/4/0.0x
5006016930600
f94.0x4007000
000000000
SCSI transport protocol = fibre_channel
State = ACTIVE
Last Open or Close state = ACTIVE

LUN path : lunpath15
Class = lunpath
Instance = 15
Hardware path = 0/4/1/0/4/0.0x
5006016130600
f94.0x4007000
000000000
SCSI transport protocol = fibre_channel
State = ACTIVE
Last Open or Close state = ACTIVE
=================================

After activating that policy we now force the path for the LUN to be point to the corresponding SP on the Clariion. Like so:
=================================
/usr/sbin/scsimgr save_attr -D /dev/rdisk/disk24 -a preferred_path=
0/3/1/0/4/0.0x
5006016930600
f94.0x4007000
000000000
=================================

We have now tested this with some large file copies and it performs just as well as on other machines connected with a single HBA (was not the case before).

We have also tested the failover of HBAs by forcing a trespass on the Clariion (in both directions)... no adverse effects were perceived

"HPUX 11.31 will only work with active/active arrays. CLARiiON arrays are active/passive. We already support native MPIO for Sun and Windows. For HP/UX, we can't promise anything since the ball is mostly in HP's court. We hope so but looks like it will be a patch to 11iv3 to enable it.......along with release 26 on the CLARiiON.

Lastly, let me say this. I've been told if you move ahead (ie above) on anything other than R26, you will have data corruption issues. "
EMC rep is only partially correct.

HP-UX 11.31 does support active/passive as well as asymmetric active-active arrays. However, it requires the array vendor to support ALUA or to provide the apsw plug-in. ALUA is already supported by a number of the well known mid-range asymmetric active-active arrays. The reference to upcoming rev 26 should be enabling ALUA and with that, the Clariion will work transparently with HP-UX 11.31.

You should see transparent support for the Clariion once ALUA is out in a couple of months. In the meantime, the use of preferred path as previously described on this thread is a reasonable solution as long as you are using a single host configuration (i.e. not in a SG cluster, not having multiple host OS' connected to the same luns). To use the interim solution with preferred path, you will need to configure the Clariion in Auto Tresspass mode.

Another option is to use the legacy device files only on 11.31, set the leg_mpath_enable attribute to 0 and configure/use pvlinks.

scsimgr get_attr -a leg_mpath_enable
scsimgr set_attr -a leg_mpath_enable=0
scsimgr get_attr -a leg_mpath_enable
http://forums13.itrc.hp.com/service/forums/questionanswer.do?threadId=1135213&admit=109447627+1266296662472+28353475

来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/806953/viewspace-1031268/,如需转载,请注明出处,否则将追究法律责任。

上一篇: 没有了~
下一篇: 2010年的春节
请登录后发表评论 登录
全部评论
  • 博文量
    5
  • 访问量
    4874