<p align="left"> <b><span style="font-size:19.5pt;font-family:微软雅黑, sans-serif;">Oracle RAC</span></b><b><span style="font-size:19.5pt;font-family:微软雅黑, sans-serif;">构建之——<span>openfiler</span>的配置</span></b><b><span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;&nbsp;</span></b> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">http://blog.163.com/donfang_jianping/blog/static/136473951201311111384468/<br /> http://cache.baiducontent.com/c?m=9f65cb4a8c8507ed4fece763104bc0666f05d3226b9cc7150884cd15c6735b364462e2ac275541598cd82c395cfa541daca37029661e24b090c98349dbbe922a2c892437701f854214d312aecb4538d565cd1abfa059b4ebe732e2f39084830008940445&amp;p=882a9645d6985db342be9b7c475794&amp;newp=847fcc15d9c041af0cacc12d021483231610db2151d3d0413e81&amp;user=baidu&amp;fm=sc&amp;query=rac+openfiler&amp;qid=d1b394ca0002276e&amp;p1=2<br /> openfiler</span><span style="font-size:12pt;font-family:宋体;">是基于</span><span style="font-size:12pt;font-family:Arial, sans-serif;">linux</span><span style="font-size:12pt;font-family:宋体;">内核的一个操作系统，它提供了</span><span style="font-size:12pt;font-family:Arial, sans-serif;">iscsi</span><span style="font-size:12pt;font-family:宋体;">服务。我们可以选择它作为</span><span style="font-size:12pt;font-family:Arial, sans-serif;">RAC</span><span style="font-size:12pt;font-family:宋体;">的存储服务器。</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">下载地址：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"><a href="http://www.openfiler.com/community/download"><span style="color:blue;">http://www.openfiler.com/community/download</span></a></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">关于该系统的安装，非常类似于</span><span style="font-size:12pt;font-family:Arial, sans-serif;">Red Hat</span><span style="font-size:12pt;font-family:宋体;">，我这里就不进行介绍了。下面我列出该系统安装的主要配置：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">网卡：类似</span><span style="font-size:12pt;font-family:Arial, sans-serif;">rac</span><span style="font-size:12pt;font-family:宋体;">，一块外网一块内网</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">etho</span><span style="font-size:12pt;font-family:宋体;">：</span><span style="font-size:12pt;font-family:Arial, sans-serif;">192.168.17.230/255.255.255.0 &nbsp; //</span><span style="font-size:12pt;font-family:宋体;">用于外网</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">eth1</span><span style="font-size:12pt;font-family:宋体;">：</span><span style="font-size:12pt;font-family:Arial, sans-serif;">10.0.0.3/255.255.255.0 &nbsp; &nbsp; //</span><span style="font-size:12pt;font-family:宋体;">用于存储连接，内网</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">hostname</span><span style="font-size:12pt;font-family:宋体;">：</span><span style="font-size:12pt;font-family:Arial, sans-serif;">openfile</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">下面，我主要介绍</span><span style="font-size:12pt;font-family:Arial, sans-serif;">iscsi</span><span style="font-size:12pt;font-family:宋体;">的配置。</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">安装完成后，我们可以看到如下的界面：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">该操作系统，</span><span style="font-size:12pt;font-family:Arial, sans-serif;"> </span><span style="font-size:12pt;font-family:宋体;">我们可以通过浏览器进行访问操作。我们在浏览中输入上述地址会看到如下访问界面：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span><span style="font-size:12pt;font-family:宋体;">这是进行管理的界面。这里注意一下，用户名不是</span><span style="font-size:12pt;font-family:Arial, sans-serif;">root</span><span style="font-size:12pt;font-family:宋体;">，而</span><span style="font-size:12pt;font-family:Arial, sans-serif;">openfiler</span><span style="font-size:12pt;font-family:宋体;">。用如下信息登录：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">username</span><span style="font-size:12pt;font-family:宋体;">：</span><span style="font-size:12pt;font-family:Arial, sans-serif;">openfiler</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">password</span><span style="font-size:12pt;font-family:宋体;">：</span><span style="font-size:12pt;font-family:Arial, sans-serif;">password</span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span><span style="font-size:12pt;font-family:宋体;">这里列出一此不同功能的菜单，我们可以进行不同的操作。</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">下面，我们介绍人一下</span><span style="font-size:12pt;font-family:Arial, sans-serif;">iscsi</span><span style="font-size:12pt;font-family:宋体;">服务的配置。</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">1</span><span style="font-size:12pt;font-family:宋体;">、启用</span><span style="font-size:12pt;font-family:Arial, sans-serif;">iscsi</span><span style="font-size:12pt;font-family:宋体;">服务。</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;2</span><span style="font-size:12pt;font-family:宋体;">、网络访问配置</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span><span style="font-size:12pt;font-family:宋体;">配置后，我们会看到如下信息：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;3</span><span style="font-size:12pt;font-family:宋体;">、磁盘配置</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;<br /> &nbsp;<br /> &nbsp;4</span><span style="font-size:12pt;font-family:宋体;">、创建逻辑卷组</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;5</span><span style="font-size:12pt;font-family:宋体;">、创建逻辑卷</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;<br /> &nbsp;<br /> &nbsp;<br /> &nbsp;</span><span style="font-size:12pt;font-family:宋体;">重复上述步骤，分别创建</span><span style="font-size:12pt;font-family:Arial, sans-serif;">ocrvdisk2,ocrvdisk3,dbfile1,fra1</span><span style="font-size:12pt;font-family:宋体;">逻辑卷，创建后，如下图所示：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;6</span><span style="font-size:12pt;font-family:宋体;">、创建</span><span style="font-size:12pt;font-family:Arial, sans-serif;">ISCSI Target</span> </p> <p align="left"> <br /> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">&nbsp;<br /> &nbsp;<br /> &nbsp;<br /> &nbsp;</span><span style="font-size:12pt;font-family:宋体;">重复上述步骤，完成</span><span style="font-size:12pt;font-family:Arial, sans-serif;">ocrvdisk2,ocrvdisk3,dbfile1,fra1</span><span style="font-size:12pt;font-family:宋体;">的</span><span style="font-size:12pt;font-family:Arial, sans-serif;">iscsi target</span><span style="font-size:12pt;font-family:宋体;">的创建。</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">到这里，我们已经创建完成。下面，我们在另一台机器上进行一个探测：</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">[root@djp ~]# iscsiadm -m discovery -t sendtargets -p 10.0.0.3:3260</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">10.0.0.3:3260,1 iqn.2006-01.com.openfiler:rac_ocrvdisk3</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">192.168.17.230:3260,1 iqn.2006-01.com.openfiler:rac_ocrvdisk3</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">10.0.0.3:3260,1 iqn.2006-01.com.openfiler:rac_ocrvdisk2</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">192.168.17.230:3260,1 iqn.2006-01.com.openfiler:rac_ocrvdisk2</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">10.0.0.3:3260,1 iqn.2006-01.com.openfiler:rac_fra1</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">192.168.17.230:3260,1 iqn.2006-01.com.openfiler:rac_fra1</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">10.0.0.3:3260,1 iqn.2006-01.com.openfiler:rac_dbfile1</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">192.168.17.230:3260,1 iqn.2006-01.com.openfiler:rac_dbfile1</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">10.0.0.3:3260,1 iqn.2006-01.com.openfiler:rac_ocrvdisk1</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">192.168.17.230:3260,1 iqn.2006-01.com.openfiler:rac_ocrvdisk1</span> </p> <p align="left"> <span style="font-size:12pt;font-family:Arial, sans-serif;">[root@djp ~]#</span> </p> <p align="left"> <span style="font-size:12pt;font-family:宋体;">成功创建。</span><span style="font-size:12pt;font-family:Arial, sans-serif;"></span> </p> <p align="left"> <br /> </p> <p> <span>&nbsp;</span> </p> <p> <br /> </p> <p> <br /> </p> <p> <span>&nbsp;</span> </p> <p> <br /> </p> <p> <span>&nbsp;</span> </p> <p> <span>&nbsp;</span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">11.</span><span style="font-size:12.0pt;font-family:宋体;">安装<span>iscsi</span>探测器<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">两个节点分别安装<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">yum install iscsi-initiator-utils scsi-target-utils</span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;"></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">安装<b><span style="background-color:#A0FFFF;">openfiler</span></b><span>,</span>安装时注意留出空闲空间。进入<span>web</span>界面，添加网络连接节点，新建<span>block device</span>，划分磁盘分区请确定单个磁盘对应一个独立的<span>iscsi-target</span>，确定<span>target</span>网络通信是<span>allow</span>模式<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">注：可以将所有磁盘<span>map</span>在一个<span>iscsi-target</span>下，个人觉得看跟管理起来不方便<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;"></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">启动探测器<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">service iscsi status &nbsp; &nbsp;//****</span><span style="font-size:12.0pt;font-family:宋体;">查看状态，如为<span>stop</span>，执行下面命令<span>****//</span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">service iscsi start &nbsp; &nbsp; //****</span><span style="font-size:12.0pt;font-family:宋体;">打开<span>iscsi</span>服务<span>****//</span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">查看运行级别，确定<span>iscsi</span>是否启动<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">chkconfig --list | grep scsi</span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">chkconfig --level 5 iscsi on //***</span><span style="font-size:12.0pt;font-family:宋体;">开启开机自动加载，<span>level</span>也可为<span>3****//</span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;"></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">探测存储服务器磁盘<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">iscsiadm -m discovery -t sendtargets -p <b><span style="background-color:#A0FFFF;">openfiler</span></b>1</span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">//*****</span><span style="font-size:12.0pt;font-family:宋体;">此部分如果探测不到<span>iscsi-target</span>，且显示<span>iscsiadm: No portals found******//</span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">//*****</span><span style="font-size:12.0pt;font-family:宋体;">解决方法如下：<span>*********//</span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">//*****</span><span style="font-size:12.0pt;font-family:宋体;">到<b><span style="background-color:#A0FFFF;">openfiler</span></b>系统下<span>*********//</span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">//*****cat /etc/initiators.deny*********//</span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">//*****</span><span style="font-size:12.0pt;font-family:宋体;">屏蔽里面所有内容。<span>*********//</span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">&nbsp;</span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">挂载存储盘到两个节点（全部可用磁盘挂载）<span></span></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">iscsiadm -m node -p 192.168.33.119:3260 -l</span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;"></span> </p> <p align="left"> <span style="font-size:12.0pt;font-family:宋体;">查看：<span>fdisk -l</span></span> </p> <p> <span>&nbsp;</span> </p> <p> <span>&nbsp;</span> </p> <p> 图片没法上传，转存到百度盘了。<br /> http://pan.baidu.com/s/1i3mzbMl </p> <p> <span>&nbsp;</span> </p> <p> <span>&nbsp;</span> </p> <p> <span>&nbsp;</span> </p> <p> <span>&nbsp;</span> </p> <p> <span>&nbsp;</span> </p>