昨天在安装bcard 10g RAC的crs的时候，在进行安装前检查的时候老是检查不过，报错是” User equivalence unavailable on all the nodes.”但是检查两个节点之间的信任关系是没有问题的，ssh能通，报错信息如下，整个处理过程记录如下其它同学如果有类似情况可以参考。

g3bi1120:bcard1 > ./runcluvfy.sh stage -pre crsinst -n g3bi1110,g3bi1120 -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "g3bi1120"
  Destination Node                   Reachable?
  ------------------------------------  ------------------------
  g3bi1110                            yes
  g3bi1120                            yes
Result: Node reachability check passed from node "g3bi1120".
Checking user equivalence...
Check: User equivalence for user "opbcard"
  Node Name                            Comment
  ------------------------------------  ------------------------
  g3bi1110                            failed
  g3bi1120                            failed
Result: User equivalence check failed for user "opbcard".
ERROR:
User equivalence unavailable on all the nodes.
Verification cannot proceed.
Pre-check for cluster services setup was unsuccessful on all the nodes.

网上和metalink上的解决方法都试过一遍，这两个命令也都执行过exec /usr/bin/ssh-agent $SHELL和/usr/bin/ssh-add还是不行，执行检查还是报这样的错误。这个时候其实最想看到的是能有详细的报错trace，但是用truss去做trace是看也看不到任何报错的内容。

后来看到在执行检查的时候会自动在/tmp目录下生成一个数字开头的目录，目录里面保存了类似下面的目录结构，出错的时候会出现log目录，里面有一个log：cvutrace.log.0

$ pwd

/tmp/1581058

$ ls -l

total 0

drwxrwxr-x 2 opbcard dba 256 Jul 19 2005 bin

drwxr-xr-x 5 opbcard dba 256 Jul 16 2005 cv

drwxrwxr-x 2 opbcard dba 256 Aug 16 2005 jlib

drwxr-xr-x 4 opbcard dba 256 Aug 25 19:19 jre

drwxrwxr-x 2 opbcard dba 256 Jul 19 2005 lib

drwxrwxr-x 2 opbcard dba 256 Jul 19 2005 lib32

drwxrwxr-x 2 opbcard dba 256 Jul 19 2005 log

检查cvutrace.log.0里面的内容发现错误出现在，ssh连接成功显示banner的地方，所以问题找到了，应该是banner作怪。当时看到metalink上300548.1说disable banner是在/etc/banner里面设置，aix上没有这个文件以为就没有关系了，结果搞了很久。

[Worker 0] [10:36:31:487] [UnixSystem.isNodeAccessible:821] Checking accessibility of node: g3bi1110; Wed Au

g 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:487] [UnixSystem.isNodeAccessible:821] Checking accessibility of node: g3bi1120; Wed Au

g 24 10:36:31 GMT+08:00 2011

[main] [10:36:31:488] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Ac

quire called by thread main m_count=0; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:489] [UnixSystem.checkRemoteExecutionSetup:1819] checkRemoteExecutionSetup:: Checking u

ser equivalence using Secured Shell '/usr/bin/ssh'; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:489] [UnixSystem.checkRemoteExecutionSetup:1819] checkRemoteExecutionSetup:: Checking u

ser equivalence using Secured Shell '/usr/bin/ssh'; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:991] [UnixSystem.checkRemoteExecutionSetup:1821] checkRemoteExecutionSetup:: Running Un

ix command: /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o

NumberOfPasswordPrompts=0 g3bi1120 /usr/bin/true; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:992] [UnixSystem.checkRemoteExecutionSetup:1821] checkRemoteExecutionSetup:: Running Un

ix command: /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o

NumberOfPasswordPrompts=0 g3bi1110 /usr/bin/true; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:992] [RuntimeExec.runCommand:74] Calling Runtime.exec() with the command ; Wed Aug 24 1

0:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:993] [RuntimeExec.runCommand:74] Calling Runtime.exec() with the command ; Wed Aug 24 1

0:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:993] [RuntimeExec.runCommand:76] /usr/bin/ssh ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:994] [RuntimeExec.runCommand:76] /usr/bin/ssh ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:994] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:995] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:996] [RuntimeExec.runCommand:76] FallBackToRsh=no ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:996] [RuntimeExec.runCommand:76] FallBackToRsh=no ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:997] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:997] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:31:998] [RuntimeExec.runCommand:76] PasswordAuthentication=no ; Wed Aug 24 10:36:31 GMT+08

:00 2011

[Worker 0] [10:36:31:998] [RuntimeExec.runCommand:76] PasswordAuthentication=no ; Wed Aug 24 10:36:31 GMT+08

:00 2011

[Worker 2] [10:36:31:999] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 0] [10:36:31:999] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:31 GMT+08:00 2011

[Worker 2] [10:36:32:0] [RuntimeExec.runCommand:76] StrictHostKeyChecking=yes ; Wed Aug 24 10:36:32 GMT+08:0

0 2011

[Worker 0] [10:36:32:0] [RuntimeExec.runCommand:76] StrictHostKeyChecking=yes ; Wed Aug 24 10:36:32 GMT+08:0

0 2011

[Worker 2] [10:36:32:1] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:32 GMT+08:00 2011

[Worker 0] [10:36:32:1] [RuntimeExec.runCommand:76] -o ; Wed Aug 24 10:36:32 GMT+08:00 2011

[Worker 2] [10:36:32:247] [RuntimeExec.runCommand:76] NumberOfPasswordPrompts=0 ; Wed Aug 24 10:36:32 GMT+08

:00 2011

[Worker 0] [10:36:32:247] [RuntimeExec.runCommand:76] NumberOfPasswordPrompts=0 ; Wed Aug 24 10:36:32 GMT+08

:00 2011

[Worker 2] [10:36:32:248] [RuntimeExec.runCommand:76] g3bi1120 ; Wed Aug 24 10:36:32 GMT+08:00 2011

[Worker 0] [10:36:32:248] [RuntimeExec.runCommand:76] g3bi1110 ; Wed Aug 24 10:36:32 GMT+08:00 2011

[Worker 2] [10:36:32:249] [RuntimeExec.runCommand:76] /usr/bin/true ; Wed Aug 24 10:36:32 GMT+08:00 2011

[Worker 0] [10:36:32:249] [RuntimeExec.runCommand:76] /usr/bin/true ; Wed Aug 24 10:36:32 GMT+08:00 2011

[Worker 2] [10:36:33:135] [RuntimeExec.runCommand:131] runCommand: Waiting for the process; Wed Aug 24 10:36

:33 GMT+08:00 2011

[Worker 0] [10:36:33:548] [RuntimeExec.runCommand:131] runCommand: Waiting for the process; Wed Aug 24 10:36

:33 GMT+08:00 2011

[Thread-6] [10:36:33:550] [StreamReader.run:61] In StreamReader.run ; Wed Aug 24 10:36:33 GMT+08:00 2011

[Thread-4] [10:36:33:548] [StreamReader.run:61] In StreamReader.run ; Wed Aug 24 10:36:33 GMT+08:00 2011

[Thread-7] [10:36:33:138] [StreamReader.run:61] In StreamReader.run ; Wed Aug 24 10:36:33 GMT+08:00 2011

[Thread-5] [10:36:33:549] [StreamReader.run:61] In StreamReader.run ; Wed Aug 24 10:36:33 GMT+08:00 2011

[Thread-7] [10:36:35:706] [StreamReader.run:65] ERROR>******************************************************

*************************; Wed Aug 24 10:36:35 GMT+08:00 2011

[Thread-7] [10:36:35:706] [StreamReader.run:65] ERROR>*