asm日志<br /> /u01/app/grid/diag/asm/+asm/+ASM1/trace<br /> <br /> <br /> Thu Jul 30 02:10:46 2015<br /> WARNING: Waited 15 secs for write IO to PST disk 0 in group 1.<br /> WARNING: Waited 15 secs for write IO to PST disk 1 in group 1.<br /> WARNING: Waited 15 secs for write IO to PST disk 2 in group 1.<br /> WARNING: Waited 15 secs for write IO to PST disk 0 in group 1.<br /> WARNING: Waited 15 secs for write IO to PST disk 1 in group 1.<br /> WARNING: Waited 15 secs for write IO to PST disk 2 in group 1.<br /> Thu Jul 30 02:10:47 2015<br /> NOTE: process _b000_+asm1 (38695) initiating offline of disk 0.3915941304 (DATA2_0000) with mask 0x7e in group 1<br /> NOTE: process _b000_+asm1 (38695) initiating offline of disk 1.3915941302 (DATA2_0001) with mask 0x7e in group 1<br /> NOTE: process _b000_+asm1 (38695) initiating offline of disk 2.3915941303 (DATA2_0002) with mask 0x7e in group 1<br /> NOTE: checking PST: grp = 1<br /> GMON checking disk modes for group 1 at 12 for pid 28, osid 38695<br /> ERROR: no read quorum in group: required 2, found 0 disks<br /> .............<br /> Dirty Detach Reconfiguration complete<br /> Thu Jul 30 02:10:47 2015<br /> WARNING: dirty detached from domain 1<br /> NOTE: cache dismounted group 1/0xB368755B (DATA2) &nbsp; &lt;--自己dismounted了<br /> SQL&gt; alter diskgroup DATA2 dismount force /* ASM SERVER:3009967451 */&nbsp;<br /> .............<br /> Thu Jul 30 02:11:24 2015<br /> NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 1<br /> SUCCESS: diskgroup DATA2 was mounted &nbsp; &nbsp;&lt;---自己又mounted了<br /> SUCCESS: ALTER DISKGROUP DATA2 MOUNT &nbsp;/* asm agent *//* {0:31:15779} */ &nbsp; &nbsp;&nbsp;<br /> <br /> <br /> <br /> 参考文档<br /> ASM diskgroup dismount with "Waited 15 secs for write IO to PST" (文档 ID 1581684.1)<br /> <br /> alert可以看到ASM磁盘dismount，并且是错误“Waited 15 secs for write IO to PST”的问题，这是ASM特有的心跳超时检测，<br /> ASM instance会定期检查每个asm disk是不是能正常反馈<br /> <br /> <br /> Generally this kind messages comes in ASM alertlog file on below situations,<br /> Delayed ASM PST heart beats on ASM disks in normal or high redundancy diskgroup,<br /> thus the ASM instance dismount the diskgroup.By default, it is 15 seconds.<br /> By the way the heart beat delays are sort of ignored for external redundancy diskgroup.<br /> ASM instance stop issuing more PST heart beat until it succeeds PST revalidation,<br /> but the heart beat delays do not dismount external redundancy diskgroup directly.<br /> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~<br /> 上面描述，可以理解为下面几点：<br /> 1. ASM实例会定期检查每一个磁盘组的磁盘状态，是否通信正常；<br /> 2. 这个检查，只是针对normal和high冗余模式，对于external冗余，不会遇到这个错误；<br /> 3. 默认情况是15s超时，也就是说15s磁盘组还是没有对ASM实例响应的话，就会dismount磁盘组。<br /> <br /> <br /> 在存储网络出现问题的情况下，会引发这个错误的出现。也就是说，在ASM定期发出检查信息的时候，如果磁盘没有在15s内反馈的话，就认为磁盘已经无法访问。<br /> <br /> <br /> 实际情况是上面的凌晨2:10时间点正好是做全库备份时间,估计大量的写入导致io响应慢<br /> <br /> 在11.2.0.3.0之后才有这个参数出现，也就是说ASM实例对磁盘超时的检测是在11.2.0.3之后才出现的<br /> <br /> <br /> set pages 9999;<br /> <br /> SELECT x.ksppinm NAME, y.ksppstvl VALUE, x.ksppdesc describ<br /> FROM SYS.x$ksppi x, SYS.x$ksppcv y<br /> WHERE x.inst_id = USERENV ('Instance')<br /> AND y.inst_id = USERENV ('Instance')<br /> AND x.indx = y.indx<br /> AND upper(x.ksppinm) like '%ASM_H%';<br /> 显示如下:<br /> _asm_hbeatiowait<br /> 15<br /> number of secs to wait for PST Async Hbeat IO return<br /> _asm_hbeatwaitquantum<br /> 2<br /> quantum used to compute time-to-wait for a PST Hbeat check<br /> <br /> <br /> 在存储网络条件不是很好的情况下可以设置检查时间长点,其实在12.1.0.2默认就是120秒了<br /> <br /> alter system set "_asm_hbeatiowait"=120 scope=spfile;<br /> <br /> 重启asm 继续观察<br />