Problem Summary
---------------------------------------------------
4 nodes 11g rac (asm) can not start CRS error prompt :CRS-2800 CRS-4000

Problem Description
---------------------------------------------------
(1) HP disk arry hang because overheating
(2) HP engineer come , correct all error , we can access the disk arry .
(3) on 4 nodes hosts, we can not start crs .
(4) shutdown 3of all hots, only start one host.
(5) login in grid , su du root, execute crsctl start cluster
(6) we get error ,like this :
# crsctl start cluster
CRS-2800: Cannot start resource 'ora.asm' as it is already in the INTERMEDIATE state on server 'hzsz-hrm-db-r1'
CRS-4000: Command Start failed, or completed with errors.

Error Codes
---------------------------------------------------
CRS-2800 crs-4000

Problem Category/Subcategory
---------------------------------------------------
Oracle Clusterware/CRS/GI startup

Uploaded Files
---------------------------------------------------


Template Question Responses
---------------------------------------------------
1) ### NUMBER OF INSTANCES/NODES ###
4 nodes

2) ### CLUSTERWARE ###
Oracle_Clusterware_without_any

3) ### CLUSTER INTERCONNECT DETAILS ###
###RAC 4 nodes IP and hostname

10.197.10.99 hzsz-hrm-db-r1
#10.197.10.193 hzsz-hrm-db-r1-vip
10.197.10.100 hzsz-hrm-db-r1-vip
192.168.11.21 hzsz-hrm-db-r1-priv

10.197.10.98 hzsz-hrm-db-r2
10.197.10.112 hzsz-hrm-db-r2-vip
192.168.11.22 hzsz-hrm-db-r2-priv

10.197.10.101 hzsz-hrm-db-r3
10.197.10.195 hzsz-hrm-db-r3-vip
192.168.11.23 hzsz-hrm-db-r3-priv

10.197.10.102 hzsz-hrm-db-r4
10.197.10.196 hzsz-hrm-db-r4-vip
192.168.11.24 hzsz-hrm-db-r4-priv

10.197.10.110 hzsz-hr-cluster-scan


4) ### OCR, VOTING/QUORUM DISK LOCATION ###
Raw_Volumes_Partitions

5) ### OCR, VOTING/QUORUM DISK LOCATION DETAILS ###
(1) storage HP P6300
(2) 2 SAN switch
(3) interconnect with 2 network switch
(4) vdisk manager by ASM
(5)vdisk mapping to OS using udev