{"id":1176,"date":"2009-06-06T20:02:42","date_gmt":"2009-06-07T00:02:42","guid":{"rendered":"http:\/\/onlineappsdba.com\/index.php\/2009\/06\/06\/oracle-rac-clusterware-installation-overview\/"},"modified":"2009-06-06T20:12:16","modified_gmt":"2009-06-07T00:12:16","slug":"oracle-rac-clusterware-installation-overview","status":"publish","type":"post","link":"https:\/\/onlineappsdba.com\/index.php\/2009\/06\/06\/oracle-rac-clusterware-installation-overview\/","title":{"rendered":"Oracle RAC – Clusterware Installation Overview"},"content":{"rendered":"

This post covers overview of Oracle Clusterware Installation<\/strong>, for step by step guide on How to install Clusterware\u00a0using VMware 2.0<\/strong> (including steps to configuring multiple linux machine\/network card\/hard disk\/raw device\u00a0for OCR\/Voting Disk\u00a0on one Windows Machine)\u00a0 register for online Oracle RAC DBA training (499 USD)<\/a><\/p>\n

.<\/p>\n

Requirement for Oracle Clusterware
\n<\/u><\/strong><\/p>\n

1.<\/strong> External Shared Disk to store Oracle Clusterware file (Voting Disk<\/strong> and Oracle Cluster Registry<\/strong> – OCR<\/strong>)\u00a0 To know more about OCR & Voting Disk click here<\/a><\/p>\n

2.<\/strong> Two netwrok cards on each clusterware node (and three set of IP address) –
\nNetwork Card 1 (with IP address set 1) for public network<\/strong>
\nNetwork Card 2 (with IP address set 2) for private network<\/strong> (for inter node communication between rac nodes used by clusterware and rac database)<\/p>\n

IP address set 3 for Virtual IP<\/strong> (VIP) (used as Virtual IP address for client connection and for connection failover)<\/p>\n

3.<\/strong> Storage Option for OCR and Voting Disk – RAW<\/strong>, OCFS2<\/strong> (Oracle Cluster File System),\u00a0NFS, …..<\/strong>
\n.<\/p>\n

Preinstall Steps\/Check<\/u><\/strong>
\n
\n1.<\/strong> Create group<\/strong> and user<\/strong> for clusterware installation (for ex. oracle:dba) on all nodes<\/p>\n

2.<\/strong> Configure ssh<\/strong> on all nodes so that oracle user on one node can login to other nodes without password prompt (In Oracle Clusterware\/RAC terminology this is called as User Equivalency<\/strong>)<\/p>\n

3.<\/strong> Configure Network card (public and private network) and ensure that all nodes can ping each other on public & private nodes.
\nEnsure that VIP (Virtual IP) is not in use by any system on network including cluster nodes .<\/p>\n

4.<\/strong> Ensure all O.S. packages (RPMs) are installed on system as mentioned in installation Guide (for ease select all RPM’s during O.S. installation)<\/p>\n

5.<\/strong> Ensure that directory for voting disk<\/strong> and OCR<\/strong> are shared on all nodes of RAC.
\n\u00a0OCR<\/strong> should be owned by root:dba where as Voting Disk<\/strong> should be owned by oracle:dba<\/p>\n

6.<\/strong> Create Oracle Clusterware Home Directory (Clusterware HOME a.k.a. $CRS_HOME) on all nodes and change owner as oracle:dba\u00a0 (This could be on shared\/nonshared (local) storage)<\/p>\n

7.<\/strong> Run Cluster Verification Utility<\/strong> (Utility to check system prerequisites for clusterware, rac db installation)<\/p>\n

\/mountpoint\/crs\/Disk1\/cluvfy\/runcluvfy.sh stage -pre crsinst -n node_list\u00a0\u00a0 (It is safe to ignore issues related to packages\/rpms and VIPCA)<\/p>\n

338924.1\u00a0 <\/strong>CLUVFY Fails With Error: Could not find a suitable set of interfaces for VIPs<\/p>\n

.\u00a0<\/p>\n

Clusterware Installation<\/u><\/strong><\/p>\n

1.<\/strong> Start Clusterware installation using .\/runInstaller<\/p>\n

2.<\/strong> Specify Clusterware Home (directory created on step 6 above – preinstall checks)<\/p>\n

3.<\/strong> Specify Cluster Nodes – node1, node2<\/p>\n

<\/a><\/p>\n

4.<\/strong> Specify location of Voting Disk<\/strong> & OCR<\/strong> (step 5\/6 in preinstall steps)<\/p>\n

5.<\/strong> Click on Install<\/p>\n

6.<\/strong> Run root.sh<\/strong> on all nodes when prompted (root.sh will call rootinstall<\/strong> & rootconfig<\/strong> explained below)<\/p>\n

While running root.sh<\/strong> on last node, If you see error message like – “The given interface(s), “eth0” is not public. Public interfaces should be used to configure virtual IPs<\/strong>”<\/p>\n

run vipca<\/strong> (from $CRS_HOME\/bin as root<\/strong> user)<\/p>\n

7.<\/strong> Return to clusterware installation screen and click OK , Installer will automatically configure ONS, Private Interconnect ($CRS_HOME\/cfgtoollogs\/configToolAllCommands<\/strong>)<\/p>\n

8.<\/strong> Finally you should see successful clusterware installation<\/strong> screen.<\/p>\n

.
\nOracle Clusterware Installation Stages<\/u> (what goes in the background)
\n<\/strong>
\nThere are three stages of Oracle RAC clusterware installation<\/p>\n

A. Stage 1
\n<\/strong>
\nIn this stage you provide –
\na)<\/strong> CRS Home details (Directory to install clusterware)
\nb)<\/strong> Provide VIP, PRIC and Public node details
\nc)<\/strong> Location of voting disk and OCR<\/p>\n

Installer copies Clusterware software (binaries) for CRS Home<\/p>\n

.
\nB. Stage 2<\/strong><\/p>\n

In this stage Installer prompts you to run root.sh<\/strong>\u00a0as root user on all nodes
\nroot.sh<\/strong> – This script calls rootinstall<\/strong> & rootconfig<\/strong> from CRS_HOME\/install<\/strong> directory<\/p>\n

rootconfig<\/strong> – This is important script which does following task (plus some additional task)
\n– Creates the directory structure for scls_scr<\/strong> in \/etc\/oracle (Linux) or \/var\/opt\/oracle (Solaris)
\n– Populates the ocr.loc<\/strong> file\u00a0 in above directory
\n– Creates the log directories for the clusterware daemons in CRS_HOME\/logs<\/strong>
\n– Initialize OCR <\/strong>(Oracle Cluster Registry) device for cluster configuration details
\n– Setup OCR (Oracle Cluster Registry) to run CRS <\/strong>(Cluster Ready Service<\/strong>), CSS<\/strong> (Cluster Synchronization Service<\/strong>)
\n– Copy the CRS init script to init.d <\/strong>for init<\/strong> process to start\u00a0at boot time
\n– Add entry in \/etc\/inittab<\/strong> file and set the appropriate links in \/etc\/rc.d\/rc*.d<\/strong> folder
\n– Start the CRS stack\u00a0
\n– calls VIPCA<\/strong> to configure Virtual IP address for each node
\n– Configure NodeApps<\/strong> if CRS is up and running on all nodes
\n.\u00a0<\/strong><\/p>\n

C. Stage 3
\n<\/strong>
\nIn this stage installer runs $CRS_HOME\/cfgtoollogs\/configToolAllCommands<\/p>\n

.\u00a0<\/p>\n

References\/Related<\/u><\/strong><\/p>\n