ITPub博客

首页 > Linux操作系统 > Linux操作系统 > 网关不通导致vip漂移

网关不通导致vip漂移

原创 Linux操作系统 作者:frog-qs 时间:2012-02-16 15:41:36 0 删除 编辑
同事安装rac的时候,发现节点2的vip漂到节点1上面,远程连接上去处理过程如下:
rac1:~ # cd /oracle/crs/bin/
rac1:/oracle/crs/bin # ./crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora.rac1.gsd   application    ONLINE    ONLINE    rac1       
ora.rac1.ons   application    ONLINE    ONLINE    rac1       
ora.rac1.vip   application    ONLINE    ONLINE    rac1       
ora.rac2.gsd   application    ONLINE    ONLINE    rac2       
ora.rac2.ons   application    ONLINE    ONLINE    rac2       
ora.rac2.vip   application    ONLINE    ONLINE    rac1       
rac1:/oracle/crs/bin # ./crsctl stop crs
Stopping resources.
This could take several minutes.
Successfully stopped Oracle Clusterware resources
Stopping Cluster Synchronization Services.
Shutting down the Cluster Synchronization Services daemon.
Shutdown request successfully issued.
rac1:/oracle/crs/bin # ps -ef | grep crs
root     23277     1  0 11:08 ?        00:00:00 /bin/sh /etc/init.d/init.crsd run
root     23632 22309  0 11:09 pts/5    00:00:00 grep crs
rac1:/oracle/crs/bin # ./crsctl start crs
Attempting to start Oracle Clusterware stack
The CRS stack will be started shortly
rac1:/oracle/crs/bin # ./crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.
rac1:/oracle/crs/bin # ./oifcfg getif
rac1:/oracle/crs/bin # ./oifcfg
Name:
        oifcfg - Oracle Interface Configuration Tool.
Usage:  oifcfg iflist [-p [-n]]
        oifcfg setif {-node | -global} {/:}...
        oifcfg getif [-node | -global] [ -if [/] [-type ] ]
        oifcfg delif [-node | -global] [[/]]
        oifcfg [-help]
        - name of the host, as known to a communications network
          - name by which the interface is configured in the system
           - subnet address of the interface
          - type of the interface { cluster_interconnect | public | storage }
rac1:/oracle/crs/bin # ./oifcfg iflist
eth0  192.168.0.0
eth1  10.0.0.0
rac1:/oracle/crs/bin # ./oifcfg getif
rac1:/oracle/crs/bin # ./oifcfg getif
rac1:/oracle/crs/bin # ./crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora.rac1.gsd   application    ONLINE    ONLINE    rac1       
ora.rac1.ons   application    ONLINE    ONLINE    rac1       
ora.rac1.vip   application    ONLINE    ONLINE    rac1       
ora.rac2.gsd   application    ONLINE    OFFLINE              
ora.rac2.ons   application    ONLINE    OFFLINE              
ora.rac2.vip   application    ONLINE    ONLINE    rac1       
rac1:/oracle/crs/bin # ./oifcfg getif
rac1:/oracle/crs/bin # ./oifcfg iflist
eth0  192.168.0.0
eth1  10.0.0.0
rac1:/oracle/crs/bin # ./crsctl stop crs
Stopping resources.
This could take several minutes.
Successfully stopped Oracle Clusterware resources
Stopping Cluster Synchronization Services.
Shutting down the Cluster Synchronization Services daemon.
Shutdown request successfully issued.
rac1:/oracle/crs/bin # route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
10.0.0.0        *               255.255.255.0   U     0      0        0 eth1
192.168.0.0     *               255.255.255.0   U     0      0        0 eth0
link-local      *               255.255.0.0     U     0      0        0 eth0
loopback        *               255.0.0.0       U     0      0        0 lo
default         192.168.0.12    0.0.0.0         UG    0      0        0 eth0
rac1:/oracle/crs/bin # ping 192.168.0.12   网关不通
PING 192.168.0.12 (192.168.0.12) 56(84) bytes of data.
From 192.168.0.221: icmp_seq=1 Destination Host Unreachable
From 192.168.0.221 icmp_seq=1 Destination Host Unreachable
From 192.168.0.221 icmp_seq=2 Destination Host Unreachable
--- 192.168.0.12 ping statistics ---
137 packets transmitted, 0 received, +103 errors, 100% packet loss, time 136019ms
, pipe 3            
rac2:/oracle/crs/log/rac2 # cd racg/
rac2:/oracle/crs/log/rac2/racg # ls
evtf.log  ora.rac1.vip.log  ora.rac2.ons.log  ora.rac2.vip.log  racgeut  racgevtf  racgmain
rac2:/oracle/crs/log/rac2/racg #
rac2:/oracle/crs/log/rac2/racg # ls
evtf.log  ora.rac1.vip.log  ora.rac2.ons.log  ora.rac2.vip.log  racgeut  racgevtf  racgmain
rac2:/oracle/crs/log/rac2/racg # tail -100 ora.rac1.vip.log |more
Oracle Database 11g CRS Release 11.1.0.6.0 - Production Copyright 1996, 2007 Oracle. All rights reserved.
2012-02-16 11:09:13.022: [    RACG][3054347952] [16591][3054347952][ora.rac1.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
2012-02-16 11:12:51.243: [    RACG][3054257840] [19612][3054257840][ora.rac1.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
2012-02-16 11:13:09.552: [    RACG][3053811376] [19877][3053811376][ora.rac1.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
Interface eth0 checked failed (host=rac2)
Invalid parameters, or failed to bring up VIP (host=rac2)
2012-02-16 11:13:09.552: [    RACG][3053811376] [19877][3053811376][ora.rac1.vip]: clsrcexecut: cmd = /oracle/crs/bin/racgeut -e _US
R_ORA_DEBUG=0 54 /oracle/crs/bin/racgvip check rac1
2012-02-16 11:13:09.552: [    RACG][3053811376] [19877][3053811376][ora.rac1.vip]: clsrcexecut: rc = 1, time = 3.220s
2012-02-16 11:13:09.552: [    RACG][3053811376] [19877][3053811376][ora.rac1.vip]: end for resource = ora.rac1.vip, action = check,
status = 1, time = 3.260s
rac2:/oracle/crs/log/rac2/racg # more ora.rac2.vip.log
Oracle Database 11g CRS Release 11.1.0.6.0 - Production Copyright 1996, 2007 Oracle. All rights reserved.
2012-02-16 11:01:04.009: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
Interface eth0 checked failed (host=rac2)
Invalid parameters, or failed to bring up VIP (host=rac2)
2012-02-16 11:01:04.009: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: cmd = /oracle/crs/bin/racgeut -e _US
R_ORA_DEBUG=0 54 /oracle/crs/bin/racgvip start rac2
2012-02-16 11:01:04.009: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: rc = 1, time = 6.230s
2012-02-16 11:01:07.221: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: cmd = /oracle/crs/bin/racgeut -e _US
R_ORA_DEBUG=0 54 /oracle/crs/bin/racgvip check rac2
2012-02-16 11:01:07.221: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: rc = 1, time = 3.210s
2012-02-16 11:01:07.221: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: end for resource = ora.rac2.vip, action = start,
status = 1, time = 9.560s
2012-02-16 11:09:03.529: [    RACG][3053881008] [16454][3053881008][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
2012-02-16 11:12:40.702: [    RACG][3054515888] [19461][3054515888][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
Interface eth0 checked failed (host=rac2)
Invalid parameters, or failed to bring up VIP (host=rac2)
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: clsrcexecut: cmd = /oracle/crs/bin/racgeut -e _US
R_ORA_DEBUG=0 54 /oracle/crs/bin/racgvip check rac2
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: clsrcexecut: rc = 1, time = 3.190s
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: end for resource = ora.rac2.vip, action = check,
rac2:/oracle/crs/log/rac2/racg # route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
10.0.0.0        *               255.255.255.0   U     0      0        0 eth1
192.168.0.0     *               255.255.255.0   U     0      0        0 eth0
link-local      *               255.255.0.0     U     0      0        0 eth0
loopback        *               255.0.0.0       U     0      0        0 lo
default         192.168.0.12    0.0.0.0         UG    0      0        0 eth0
rac2:/oracle/crs/log/rac2/racg # ping 192.168.0.12
PING 192.168.0.12 (192.168.0.12) 56(84) bytes of data.
From 192.168.0.223: icmp_seq=1 Destination Host Unreachable
From 192.168.0.223 icmp_seq=1 Destination Host Unreachable
From 192.168.0.223 icmp_seq=2 Destination Host Unreachable
From 192.168.0.223 icmp_seq=3 Destination Host Unreachable
--- 192.168.0.12 ping statistics ---
32 packets transmitted, 0 received, +28 errors, 100% packet loss, time 31041ms
, pipe 3
rac2:/oracle/crs/log/rac2/racg # ping 192.168.0.12
PING 192.168.0.12 (192.168.0.12) 56(84) bytes of data.
From 192.168.0.223: icmp_seq=2 Destination Host Unreachable
From 192.168.0.223 icmp_seq=2 Destination Host Unreachable
From 192.168.0.223 icmp_seq=3 Destination Host Unreachable
--- 192.168.0.12 ping statistics ---
62 packets transmitted, 0 received, +46 errors, 100% packet loss, time 61003ms
, pipe 3
rac2:/oracle/crs/log/rac2/racg #
rac2:/oracle/crs/log/rac2/racg # ls
evtf.log  ora.rac1.vip.log  ora.rac2.ons.log  ora.rac2.vip.log  racgeut  racgevtf  racgmain
rac2:/oracle/crs/log/rac2/racg # more ora.rac2.vip.log
Oracle Database 11g CRS Release 11.1.0.6.0 - Production Copyright 1996, 2007 Oracle. All rights reserved.
2012-02-16 11:01:04.009: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
Interface eth0 checked failed (host=rac2)
Invalid parameters, or failed to bring up VIP (host=rac2)
2012-02-16 11:01:04.009: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: cmd = /oracle/crs/bin/racgeut -e _US
R_ORA_DEBUG=0 54 /oracle/crs/bin/racgvip start rac2
2012-02-16 11:01:04.009: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: rc = 1, time = 6.230s
2012-02-16 11:01:07.221: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: cmd = /oracle/crs/bin/racgeut -e _US
R_ORA_DEBUG=0 54 /oracle/crs/bin/racgvip check rac2
2012-02-16 11:01:07.221: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: clsrcexecut: rc = 1, time = 3.210s
2012-02-16 11:01:07.221: [    RACG][3053835952] [13741][3053835952][ora.rac2.vip]: end for resource = ora.rac2.vip, action = start,
status = 1, time = 9.560s
2012-02-16 11:09:03.529: [    RACG][3053881008] [16454][3053881008][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
2012-02-16 11:12:40.702: [    RACG][3054515888] [19461][3054515888][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: ping to 192.168.0.12 via eth0 failed, rc = 1 (hos
t=rac2)
ping to 192.168.0.12 via eth0 failed, rc = 1 (host=rac2)
Interface eth0 checked failed (host=rac2)
Invalid parameters, or failed to bring up VIP (host=rac2)
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: clsrcexecut: cmd = /oracle/crs/bin/racgeut -e _US
R_ORA_DEBUG=0 54 /oracle/crs/bin/racgvip check rac2
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: clsrcexecut: rc = 1, time = 3.190s
2012-02-16 11:14:54.592: [    RACG][3054581424] [20767][3054581424][ora.rac2.vip]: end for resource = ora.rac2.vip, action = check,
status = 1, time = 3.220s
让他们将网关调通,重新启动crs
rac2:~ # ping 192.168.0.12
PING 192.168.0.12 (192.168.0.12) 56(84) bytes of data.
64 bytes from 192.168.0.12: icmp_seq=1 ttl=64 time=0.144 ms
--- 192.168.0.12 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms
rac2:~ # cd /oracle/crs/bin/
rac2:/oracle/crs/bin # ./crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora.rac1.gsd   application    ONLINE    OFFLINE              
ora.rac1.ons   application    ONLINE    OFFLINE              
ora.rac1.vip   application    ONLINE    OFFLINE              
ora.rac2.gsd   application    ONLINE    ONLINE    rac2       
ora.rac2.ons   application    ONLINE    ONLINE    rac2       
ora.rac2.vip   application    ONLINE    OFFLINE              
rac2:/oracle/crs/bin #
rac2:/oracle/crs/bin # ./crsctl stop crs
Stopping resources.
This could take several minutes.
Successfully stopped Oracle Clusterware resources
Stopping Cluster Synchronization Services.
Shutting down the Cluster Synchronization Services daemon.
Shutdown request successfully issued.
rac2:/oracle/crs/bin # ./crsctl start crs
Attempting to start Oracle Clusterware stack
The CRS stack will be started shortly
rac2:/oracle/crs/bin # ./crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.
rac2:/oracle/crs/bin # ./crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora.rac1.gsd   application    ONLINE    OFFLINE              
ora.rac1.ons   application    ONLINE    OFFLINE              
ora.rac1.vip   application    ONLINE    OFFLINE              
ora.rac2.gsd   application    ONLINE    ONLINE    rac2       
ora.rac2.ons   application    ONLINE    ONLINE    rac2       
ora.rac2.vip   application    ONLINE    ONLINE    rac2       
rac2:/oracle/crs/bin # ./crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora.rac1.gsd   application    ONLINE    ONLINE    rac1       
ora.rac1.ons   application    ONLINE    ONLINE    rac1       
ora.rac1.vip   application    ONLINE    ONLINE    rac1       
ora.rac2.gsd   application    ONLINE    ONLINE    rac2       
ora.rac2.ons   application    ONLINE    ONLINE    rac2       
ora.rac2.vip   application    ONLINE    ONLINE    rac2       
rac2:/oracle/crs/bin #
 
 

 

来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/22779291/viewspace-716595/,如需转载,请注明出处,否则将追究法律责任。

请登录后发表评论 登录
全部评论

注册时间:2009-10-27

  • 博文量
    132
  • 访问量
    241333