Step-By-Step Installation of 9.2.0.5 RAC on Linux

1. Configuring the Clusters Hardware. 2

1.1 Minimal Hardware list / System Requirements. 2

1.1.1 Hardware. 2

1.1.2 Software. 2

1.2 Installing the Shared Disk Subsystem.. 2

1.3 Configuring the Cluster Interconnect and Public Network Hardware. 2

2. Creating a Cluster 3

2.1 UNIX Pre-installation tasks. 3

2.2 Configuring the Shared Disks. 7

2.3 Run the Oracle Universal Installer to install the 9.2.0.4 ORACM (Oracle Cluster Manager) 7

2.4 Configure the hangcheck-timer 8

2.5 Install Version 10.1.0.2 of the Oracle Universal Installer 10

2.6 Run the 10.1.0.2 Oracle Universal Installer to patch the Oracle Cluster Manager (ORACM) to 9.2.0.5. 11

2.7 Modify the ORACM configuration files to utilize the hangcheck-timer. 12

2.8 Start the ORACM (Oracle Cluster Manager) 13

3. Installing RAC.. 13

3.1 Install 9.2.0.4 RAC.. 13

3.2 Patch the RAC Installation to 9.2.0.5. 14

3.3 Start the GSD (Global Service Daemon) 15

3.4 Create a RAC Database using the Oracle Database Configuration Assistant 15

4.Administering Real Application Clusters Instances. 17

5. References. 17

1. Configuring the Clusters Hardware

1.1 Minimal Hardware list / System Requirements

Please check the RAC/Linux certification matrix for information on currently supported hardware/software.

1.1.1 Hardware

• Requirements:

• Refer to the RAC/Linux certification matrix for information on supported configurations.  Ensure that the system has at least the following resources:
• /    7G

• /boot    500M

• /opt/oracle 7G

• /opt/web 124M

• /dev/shm 1.5G

• 3G of Physical Memory (RAM)
  
  
• Automatically partition->Remove all partitions on this system ->Swap (Fill all space up to 1536M)
• uwsapdb1.united.com.cn  192.168.0.221 255.255.255.0 192.168.0.0 192.168.0.255
• No firewall -> Asia/Taipei -> root pwd (prodsap)
• Customize the set of packages to be installed(X Window System, GNOME Desktop Environment, Server Configuration Tools, Development Tools, Kernel Development, GNOME Software Development, Administration Tools)
• uwsapdb2.united.com.cn    192.168.0.222 255.255.255.0 192.168.0.0 192.168.0.255

1.1.2 Software

• For RAC on Linux support, consult the operating system vendor and see the RAC/Linux certification matrix.  

·         Linux kernel version would be 2.4.21-4.EL   (uname –r)

·         Upgrade kernel

$ rpm -ivh kernel-2.4.9-e.48.i686.rpm

$ rpm -ivh kernel-smp-2.4.9-e.48.i686.rpm

$ rpm -Uvh kernel-headers-2.4.9-e.48.i386.rpm(直接upgrade 舊的不存在)

$ vi /etc/lilo.conf

image=/boot/vmlinuz-2.4.9-e.48

                    label=linux

                     initrd=/boot/initrd-2.4.9-e.48.img

                    read-only

                   root=/dev/sda1

              lilo –v –v –v

                shutdown –r now

        /boot/grub/menu.lst

        default=1

·         Glibc Version Number glibc 2.3.2-95.3   (rpm –qa |grep glibc)

·         Required OS Components (第二片CD)

·         $rpm –qa |grep compat

compat-glibc-6.2-2.1.3.2

compat-egcs-objc-6.2-1.1.2.16

compat-libstdc++-6.2-2.9.0.16

compat-egcs-6.2-1.1.2.16

compat-egcs-g77-6.2-1.1.2.16

compat-libs-6.2-3

compat-egcs-c++-6.2-1.1.2.16

• $rpm –qa |grep openmotif

openmotif-2.1.30-11

           $ rpm -q gcc cpp compat-libstdc++ glibc-devel kernel-headers binutils vnc-server

        $ rpm –ivh unzip-5.50-2 (第一片)

• Make sure you have make and rsh-server packages installed, check with:

$rpm –q rsh  make
rsh-0.17-5

make-3.79.1-8
 

1.2 Installing the Shared Disk Subsystem

This is highly dependent on the subsystem you have chosen. Please refer to your hardware documentation for installation and configuration instructions on Linux. Additional drivers and patches might be required. In this article we assume that the shared disk subsystem is correctly installed and that the shared disks are visible to all nodes in the cluster.  

1.3 Configuring the Cluster Interconnect and Public Network Hardware

[oracle@opcbrh1 oracle]$ more /etc/hosts

192.168.0.221          uwsapdb1.united.com.cn

192.168.0.222          uwsapdb2.united.com.cn

192.168.0.223          uwsapap1.united.com.cn

192.168.0.224          uwsapap2.united.com.cn

192.168.0.227          uwsapweb.united.com.cn

192.168.0.228          uwsapdb.united.com.cn

10.0.0.1                          int-uwsapdb1.united.com.cn

10.0.0.2                         int-uwsapdb2.united.com.cn
Use your favorite tool to configure these adapters. Make sure your public network is the primary (eth0). 

/etc/sysctl.conf

kernel.core_uses_pid = 1

net.core.rmem_default= 262144

net.core.rmem_max= 262144

net.core.wmem_default= 262144

net.core.wmem_max= 262144

net.ipv4.ip_forward = 0

net.ipv4.conf.default.rp_filter = 1

kernel.sysrq = 1

kernel.domainname = wintek.com.tw

kernel.sem = 250 32000 100 150

kernel.shmmax = 4294967295

kernel.shmmni = 4096

kernel.shmseg = 4096

kernel.shmall = 3279547

fs.file-max = 327679

kernel.msgmni = 2878

kernel.msgmnb = 30000

net.ipv4.ip_local_port_range = 1024 65536

/etc/security/limits.conf

oracle           soft    nofile          4096 

oracle           hard    nofile          63536

oracle           soft    nproc           2047

oracle           hard    nproc           16384

$shutdown –r now

2. Creating a Cluster

On Linux, the cluster software required to run Real Application Clusters is included in the Oracle distribution.  

The Oracle Cluster Manager (ORACM) installation process includes eight major tasks.

1. UNIX pre-installation tasks.

2. Configuring the shared disks

3. Run the Oracle Universal Installer to install the 9.2.0.4 ORACM (Oracle Cluster Manager) 

4. Configure the hangcheck-timer.

5. Install version 10.1.0.2 of the Oracle Universal Installer

6. Run the 10.1.0.2 Oracle Universal Installer to patch the Oracle Cluster Manager (ORACM) to 9.2.0.5

7. Modify the ORACM configuration files to utilize the hangcheck-timer.

8. Start the ORACM (Oracle Cluster Manager)

2.1 UNIX Pre-installation tasks

These steps need to be performed on ALL nodes. 

$groupadd dba

$useradd -g dba oracle

$passwd oracle

$vi /etc/xinetd.d/rsh

disable = no

$ /etc/rc.d/init.d/xinetd restart

$vi .rhosts    (oracle user)

uwsapdb1

int-uwsapdb1

int-uwsapdb2

uwsapdb2

$vi /etc/securetty

rsh

• As oracle user, check for user equivalence for the oracle account by performing a remote copy (rcp) to each node (public and private) in the cluster.  Example:

       uwsapdb1

        $ touch /home/oracle/test
        $ rcp /home/oracle/test sapdbrac2:/home/oracle/test1
        $ rcp /home/oracle/test int-sapdbrac2:/home/oracle/test2

        uwsapdb2

        $ touch /opt/test
        $ rcp /home/oracle/test sapdbrac1:/home/oracle/test1
        $ rcp /home/oracle/test int-sapdbrac1:/home/oracle/test2
        $ ls /opt/test*
        /home/oracle/test /home/oracle/test1 /home/oracle/test2

       uwsapdb1:

        $ ls /home/oracle/test*
        /home/oracle/test /home/oracle/test1 /home/oracle/test2

Establish Oracle environment variables: Set the following Oracle environment variables:

export CRS_HOME=/opt/oracle/product/9.2.0/oracm

export ORACLE_BASE=/opt//oracle

export ORACLE_HOME=/opt/oracle/product/9.2.0

export ORACLE_SID=sapprod

export ORACLE_TERM=xterm

export NLS_LANG=AMERICAN;

export ORA_NLS33=$ORACLE_HOME/ocommon/nls/admin/data

LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib

LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib

export LD_LIBRARY_PATH

export THREADS_FLAG=native

PATH=$PATH:$HOME/bin:$ORACLE_HOME/bin:/usr/bin:/opt/oracle/OPatch:/sbin

export PATH

unset USERNAME

ulimit -n 63536

ulimit -u 16384

cd $ORACLE_HOME

It is best to save these in a .login or .profile file so that you do not have to set the environment every time you log in.

• Create the directory /var/opt/oracle and set ownership to the oracle user.  Example:

        $ mkdir /var/opt/oracle
        $ chown oracle.dba /var/opt/oracle

• Set the oracle user's umask to "022" in you ".profile" or ".login" file. Example:

        $ umask 022

2.2 Configuring the Shared Disks 

For more information on setting up OCFS for RAC on Linux, see the following MetaLink Note: