Contents


		\| TOC \| Index \| Next >

Contents

Section 1 SF Oracle RAC concepts and requirements

Chapter 1 Introducing SF Oracle RAC

About SF Oracle RAC

How SF Oracle RAC works (High-level perspective)

Component products and processes of SF Oracle RAC

Communication infrastructure

Cluster interconnect communication channel

Low-level communication: Port relationship between
GAB and processes

Cluster volume manager

Cluster file system

Oracle disk manager

Veritas Cluster Server

About I/O fencing

Preventing data corruption with I/O fencing

SCSI-3 persistent reservations

I/O fencing components

I/O fencing operations

I/O fencing communication

Additional features of SF Oracle RAC

Chapter 2 Planning SF Oracle RAC installation and configuration

Important pre-installation information

About SF Oracle RAC component features

Symantec Product Authentication Service

Veritas Cluster Management Console

Notification for VCS events

Global Clusters

Veritas Volume Replicator

Installation requirements

Hardware requirements

Supported software

Supported operating systems

Supported HP-UX operating environments

Required HP patches

Typical SF Oracle RAC cluster setup

Preparing SF Oracle RAC cluster setup for optional features

About CVM and CFS in an SF Oracle RAC environment

Coordinating CVM and CFS configurations

About shared disk groups

About raw volumes versus CFS for data files

Overview of SF Oracle RAC installation and configuration tasks

Preparing to install and configure SF Oracle RAC

Installing SF Oracle RAC and configuring its components

Installing Oracle RAC and creating Oracle RAC database

Setting up VCS to manage RAC resources

Setting up disaster recovery in SF Oracle RAC
environment (optional)

Setting up backup and recovery feature
for SF Oracle RAC (optional)

Section 2 SF Oracle RAC installation and upgrade

Chapter 3 Preparing to install and configure SF Oracle RAC

About preparing to install and configure SF 5.0 for Oracle RAC

Preparing to install SF 5.0 for Oracle RAC

Obtaining SF Oracle RAC license keys

Synchronizing time settings on cluster nodes

Setting up inter-system communication

Mounting the product disc

Setting the PATH variable

Setting the MANPATH variable

Setting up shared storage

Removing pre-existing license keys

Verifying the systems before installation

Gathering information to install and configure SF Oracle RAC

Chapter 4 Installing and configuring SF Oracle RAC components

About installing and configuring SF Oracle RAC

Overview of installation and configuration tasks

Invoking SF Oracle RAC installation program

Mounting the product disc

Starting software installation

Specifying systems for installation

Installing SF 5.0 for Oracle RAC

Licensing SF Oracle RAC

Installing SF Oracle RAC depots

Rebooting the nodes after installation

Invoking SF Oracle RAC configuration program

Mounting the product disc

Starting software configuration

Specifying systems for configuration

Choosing the configuration task

Performing basic system checks

Preparing private interconnects for LLT

Checking shared disks for I/O fencing

Configuring SF Oracle RAC components

Configuring the Veritas Cluster Server and optional features

Setting permissions for database administration

Configuring the cluster volume manager

Configuring VVR on each node

Starting the VAILAgent

Creating SF Oracle RAC configuration files

Configuring standalone hosts for Storage Foundation

Starting SF Oracle RAC

Setting up I/O fencing for SF Oracle RAC

Verifying the SF Oracle RAC configuration

Initializing disks

Setting up coordinator disk groups

Stopping SF Oracle RAC on all nodes

Configuring /etc/vxfendg disk group for I/O fencing

Updating /etc/vxfenmode file

Starting I/O fencing

Modifying VCS configuration to enable I/O fencing

Starting SF Oracle RAC on all nodes

Verifying I/O fencing configuration

Removing permissions for communication

Unmounting the product disc

Verifying SF Oracle RAC installation using VCS configuration file

About VCS configuration file after SF Oracle RAC installation

Sample main.cf file after SF Oracle RAC installation

Chapter 5 Upgrading SF Oracle RAC

About upgrading SF Oracle RAC to version 5.0

Supported SF 5.0 for Oracle RAC upgrade

Upgrading SF Oracle RAC using installsfrac program

Upgrading SF Oracle RAC to 5.0

Upgrading CVM protocol and disk group version

Upgrading Veritas DBE/AC manually

Uninstalling DBE/AC for Oracle RAC

Backing up and removing configuration files

Upgrading the HP-UX operating system

Installing and configuring SF 5.0 for Oracle RAC

Installing license key for new features in 5.0

Copying the VCS configuration file

Editing the VCS configuration file

Verifying and copying the main.cf to cluster nodes

Starting VCS, CVM, and CFS on all nodes

Upgrading the disk layout

Linking SF Oracle RAC Libraries with Oracle

Section 3 Setting up SF Oracle RAC with Oracle9i R2

Chapter 6 Preparing to install Oracle9i RAC

About preparing to install Oracle9i RAC

About Oracle9i RAC in a Veritas SF Oracle RAC environment

Oracle RAC infrastructure requirements

Oracle RAC in an SF Oracle RAC environment

Identifying storage for Oracle9i RAC components

Getting the information to create Oracle user and group id

Identifying storage for SRVM component

Identifying storage for Oracle9i binaries

Getting the information to configure
Oracle user's environment

Performing the Oracle9i preinstallation tasks

Preparing to configure the Oracle Server
Management (SRVM) component

Preparing storage for Oracle binary and data files

Setting Oracle environment variables and invoking
the Oracle installer

Chapter 7 Installing Oracle9i RAC

About installing Oracle9i RAC

Installing Oracle9i binaries

Completing Oracle9i post-installation tasks

Adding Oracle9i R2 patches

Relinking the SF Oracle RAC libraries to Oracle9i

Disabling ODM library (optional) for
databases using raw devices

Creating the Oracle database

Checking cluster_database flag in Oracle9i parameter file

Testing the configuration

Configuring Oracle9i service group in a VCS configuration

Chapter 8 Upgrading and migrating Oracle9i software

Before you upgrade and migrate Oracle9i

Migrating the database from Oracle9i to Oracle 10g

Applying Oracle patchsets

Chapter 9 Configuring VCS service groups for Oracle9i

About service groups in SF Oracle RAC

About the CVM service group

About Oracle service group

About configuring the Oracle resource

Typical configurations for Oracle and CVM service groups

Configuring CVM and Oracle service groups

Configuring CVM and Oracle service groups manually

Configuring the service groups using the wizard

Chapter 10 Adding and removing SF Oracle RAC nodes for Oracle9i

Adding a node to an Oracle9i cluster

Checking system requirements for new node

Physically adding a new node to the cluster

Installing SF Oracle RAC on the new node

Running vxinstall to start VxVM

Configuring LLT, GAB, VCSMM, ODM, and VXFEN drivers

Configuring CVM to reflect the new node

Installing Oracle on the new node

Configuring new Oracle instance on the new node

Removing a node from an Oracle9i cluster

Stopping applications using CFS outside of VCS control

Uninstalling Oracle if installed locally (optional)

Unlinking the Oracle binary from Veritas libraries

Removing SF Oracle RAC using the uninstallsfrac utility

Editing VCS configuration files on existing nodes

Chapter 11 Uninstalling SF Oracle RAC 5.0 with Oracle9i

About uninstalling SF 5.0 for Oracle RAC from Oracle9i cluster

Preparing to uninstall SF Oracle RAC from Oracle9i cluster

Stopping the gsd processes

Taking the Oracle and Netlsnr resources offline

Removing the Oracle database (optional)

Uninstalling Oracle9i (optional)

Unlinking the Oracle binary from Veritas libraries

Stopping applications using CFS (outside of VCS control)

Unmounting CFS file systems (outside of VCS control)

Removing SF Oracle RAC 5.0

Removing the SF Oracle RAC depots

Removing other configuration files (optional)

Section 4 Setting up SF Oracle RAC with Oracle 10g R1 and R2

Chapter 12 Preparing to install Oracle 10g RAC

About preparing to install Oracle 10g RAC

About Oracle 10g RAC in a Veritas SF Oracle RAC environment

Cluster Ready Services

Oracle Cluster Registry

Application Resources

Identifying storage for Oracle 10g RAC components

Getting the information to create Oracle user and group id

Identifying storage for CRS component

Identifying storage for OCR and Vote-disk

Identifying storage for Oracle 10g binaries

Identifying storage for CRS component

Getting the information to configure
Oracle user's environment

Getting the path information of the installer

Performing the Oracle 10g preinstallation tasks

Creating Oracle user and group id

Creating disk groups, volumes, and mount points for Oracle

Configuring private IP addresses for CRS

Editing the VCS configuration for additional CRS resources

Creating public virtual IP addresses for Oracle

Starting VCS, CVM, and CFS on all nodes

Verifying GAB port membership

Chapter 13 Installing Oracle 10g RAC

About installing Oracle 10g RAC

Setting Oracle environment variables and invoking
the Oracle installer

Installing Oracle 10g Binaries

Completing Oracle 10g post-installation tasks

Adding Oracle 10g patches

Relinking the SF Oracle RAC libraries to Oracle 10g

Creating Oracle 10g database

Configuring Oracle 10g service group in a VCS configuration

Chapter 14 Upgrading and migrating Oracle 10g software

Before you upgrade and migrate Oracle 10g

Migrating the database from Oracle 10g R1 to Oracle 10g R2

Applying Oracle patchsets

Chapter 15 Configuring VCS service groups for Oracle 10g

About VCS service group for Oracle 10g dependencies

Configuring CVM and Oracle service groups

Configuring CVM service group for Oracle 10g manually

Configuring the service groups using the wizard

Location of VCS log files

Chapter 16 Adding and removing SF Oracle RAC nodes for Oracle 10g

Adding a node to an Oracle 10g cluster

Checking system requirements for new node

Physically adding a new system to the cluster

Installing SF Oracle RAC on the new system

Running vxinstall to start VxVM

Configuring LLT, GAB, VCSMM, ODM, and VXFEN drivers

Configuring the new node

Using the Oracle add node procedure

Removing a node from an Oracle 10g cluster

Using the Oracle remove node procedure

Removing SF 5.0 for Oracle RAC

Chapter 17 Uninstalling SF Oracle RAC 5.0 with Oracle 10g

About uninstalling SF 5.0 for Oracle RAC from Oracle 10g cluster

Preparing to uninstall SF Oracle RAC from Oracle 10g cluster

Taking the Oracle resources offline

Removing the Oracle database (Optional)

Uninstalling Oracle 10g (optional)

Unlinking the Oracle Binary From Veritas Libraries

Stopping applications using CFS (outside of VCS control)

Unmounting CFS file systems (outside of VCS control)

Removing SF Oracle RAC 5.0

Removing the SF Oracle RAC depots

Removing other configuration files (optional)

Section 5 Disaster Recovery with SF Oracle RAC

Chapter 18 Preparing for global clustering

About preparing for global clustering

About global clustering

Global clustering for Oracle RAC

Replication in a shared disk environment

Setting up a secondary site

Obtaining and installing license keys for VVR

Installing SF Oracle RAC on the secondary site

Installing Oracle on the secondary site

Configuring VCS service groups for the secondary site

Chapter 19 Configuring global clustering

About configuring global clustering

Preparing clusters for replication

Adding the VVR resource types to the VCS configuration

Configuring global clustering

Defining the remote cluster and heartbeat Cluster Objects

Setting up replication

Creating the SRL volume on the primary site

Setting up replication objects on the primary site

Configuring replication for the secondary site

Starting replication of Oracle database volume

Configuring VCS to replicate the database volume

Modifying the VCS configuration for replication

Starting VCS on all nodes in both clusters

Migration and takeover of primary replication role

Migrating the role of primary site to the remote site

Taking over the primary role by the remote cluster

Section 6 Backup and recovery for SF Oracle RAC

Chapter 20 Configuring the repository database for Oracle

About configuring the repository database for Oracle

Creating and configuring the repository database for Oracle

Setting administrative permissions

Chapter 21 Using Storage Checkpoints and Storage Rollback

About Storage Checkpoints and Storage
Rollback in SF Oracle RAC

Using Storage Checkpoints and Storage Rollback
for backup and restore

About Storage Checkpoints and Storage Rollback

Determining Space Requirements for Storage Checkpoints

Performance of Storage Checkpoints

Backing up and recovering the database using Storage Checkpoints

Verifying a Storage Checkpoint using the command line

Backing up using a Storage Checkpoint

Recovering a database using a Storage Checkpoint

Guidelines for Oracle Recovery

Using the Storage Checkpoint Command Line Interface (CLI)

Overview of Commands

Examples of using the Command Line Interface

Creating or updating the repository using dbed_update

Creating Storage Checkpoints using dbed_ckptcreate

Displaying Storage Checkpoints using dbed_ckptdisplay

Mounting Storage Checkpoints using dbed_ckptmount

Unmounting Storage Checkpoints using dbed_ckptumount

Performing Storage Rollback using dbed_ckptrollback

Removing Storage Checkpoints using dbed_ckptremove

Cloning the Oracle instance using dbed_clonedb

Chapter 22 Using FlashSnap for backup and recovery

About Veritas Database FlashSnap

Solving typical database problems with Database FlashSnap

About Database FlashSnap applications

Using Database FlashSnap

Using Database FlashSnap commands

Using Database FlashSnap options

Planning to use Database FlashSnap

Selecting the snapshot mode

Selecting one or two hosts

Preparing hosts and storage for Database FlashSnap

Setting up hosts

Creating a snapshot mirror of a volume or volume set
used by the database

Upgrading existing volumes to use
Veritas Volume Manager 5.0

Upgrading from Veritas Database Edition 3.5 for Oracle
with Database FlashSnap

Summary of database snapshot steps

Creating a snapplan (dbed_vmchecksnap)

Creating multi-mirror snapshots

Validating a snapplan (dbed_vmchecksnap

Displaying, copying, and removing a
snapplan (dbed_vmchecksnap)

Displaying a snapplan

Copying a snapplan

Removing a snapplan

Creating a snapshot (dbed_vmsnap)

Backing up the database from snapshot
volumes (dbed_vmclonedb)

Mounting the snapshot volumes and backing up

Cloning a database (dbed_vmclonedb)

Using Database FlashSnap to Clone a Database

Shutting down the clone database and
unmounting file systems

Restarting a Clone Database

Recreating Oracle tempfiles

Resynchronizing the snapshot to your database

Removing a snapshot volume

Section 7 Troubleshooting SF Oracle RAC and optimizing I/O performance

Chapter 23 Investigating I/O performance for SF Oracle RAC: Storage Mapping

About Storage Mapping in SF Oracle RAC

Understanding Storage Mapping

Verifying Veritas Storage Mapping setup

Using vxstorage_stats

Displaying Storage Mapping information

Displaying I/O statistics information

Using dbed_analyzer

Obtaining Storage Mapping information for
a list of tablespaces

Oracle File Mapping (ORAMAP)

Mapping components

Storage Mapping views

Verifying Oracle file mapping setup

Enabling Oracle file mapping

Accessing dynamic performance views

Using Oracle Enterprise Manager

About arrays for Storage Mapping and statistics

Chapter 24 Troubleshooting SF Oracle RAC

About troubleshooting SF Oracle RAC

Running scripts for engineering support analysis

Troubleshooting tips

Troubleshooting Oracle

Oracle log files

Oracle troubleshooting topics

Troubleshooting fencing

Node is unable to join cluster while another
node is being ejected

vxfentsthdw fails when SCSI TEST
UNIT READY command fails

Removing existing keys from disks

System panics to prevent potential data corruption

Clearing keys after split brain using vxfenclearpre command

Adding or removing coordinator disks

Troubleshooting ODM

File system configured incorrectly for ODM shuts down Oracle

Troubleshooting VCSIPC

VCSIPC wait warning messages in Oracle trace/log files

VCSIPC errors in Oracle trace/log files

Troubleshooting CVM

Shared disk group cannot be imported

CVMVolDg does not go online even though
CVMCluster is online

Troubleshooting interconnects

Restoring communication between host and disks
after cable disconnection

Troubleshooting SF Oracle RAC checkpoint

SF Oracle RAC checkpoint feature requires DBA group
to have MLOCK privileges

Section 8 SF Oracle RAC Reference

Appendix A Sample SF Oracle RAC installation and configuration output

Sample installation output for SF Oracle RAC

Start the installation program

Specify system names

License SF Oracle RAC

Choose to install all or required depots

Installer installs depots

Sample configuration output for SF Oracle RAC

Start the configuration program

Specify system names

View main menu of configuration program

Perform system check

Configure SF Oracle RAC stack

Configure VCS, CVM, and CFS

Configure I/O fencing feature

Sample uninstallation output for SF Oracle RAC

Sample output for Oracle9i RAC installation

Perform Oracle9i preinstallation tasks

Invoke Oracle9i installation through
the configuration program

Relinking Oracle9i binaries to use Veritas libraries
after adding patches

Sample output for Oracle 10g RAC installation

Perform Oracle 10g preinstallation tasks

Invoke Oracle 10g installation through the configuration program

Relinking Oracle 10g binaries to use Veritas libraries
after adding patches

Appendix B Sample VCS configuration files for SF Oracle RAC

About sample main.cf files

Sample main.cf for Oracle9i

Sample main.cf for Oracle 10g without Oracle agent

Sample main.cf for Oracle 10g with Oracle agent

Sample main.cf for Oracle 10g for CVM/VVR primary site

Sample main.cf for Oracle 10g for CVM/VVR secondary site

Appendix C SF Oracle RAC agents

About configuring the VCS agents in SF Oracle RAC

About CVMCluster agent

Entry points for CVMCluster agent

Attribute definition for CVMCluster agent

Resource type definition for CVMCluster agent

Sample configuration for CVMCluster agent

About CVMVxconfigd agent

Entry points for CVMVxconfigd agent

Attribute definition for CVMVxconfigd agent

Resource type definition for CVMVxconfigd agent

Sample configuration for CVMVxconfigd agent

About the CVMVolDg agent

Entry points for CVMVolDg agent

Attribute definition for CVMVolDg agent

Resource type definition for CVMVolDg agent

Sample configuration for CVMVolDg agent

About the CFSMount agent

Entry points for CFSMount agent

Attribute definition for CFSMount agent

Resource type Definition for CFSMount agent

Sample configuration for CFSMount agent

About PrivNIC agent

Entry point for PrivNIC agent

Attribute definition for PrivNIC agent

Resource type definition for PrivNIC agent

Sample configuration for PrivNIC agent

About CSSD agent

Appendix D Creating a starter database

About creating a starter database

Creating a starter database for Oracle9i

Creating Oracle9i database on raw volumes

Creating Oracle9i database on CFS

Creating a starter database for Oracle 10g

Creating Oracle 10g database on raw volumes

Creating Oracle 10g database on CFS

Appendix E I/O fencing testing and scenarios

I/O fencing of shared storage

Verifying data storage arrays using the vxfentsthdw utility

General guidelines for using vxfentsthdw

vxfentsthdw options

How I/O fencing works in different event scenarios

About vxfenadm utility

Registration key formatting

Appendix F Configuring the Symantec License Inventory Agent

About the Symantec License Inventory Manager

When the Symantec License Inventory Agent is installed

When the server and access points are installed

What you can do with the agent after it is installed

How to remove the agent

How to order the Symantec License Inventory
Manager license and media kit

Appendix G Tunable kernel driver parameters

About tunable parameters

About LMX tunable parameters

About VXFEN tunable parameters

Configuring the module parameters

Appendix H Error messages

About error messages

LMX error messages

LMX critical error messages

LMX non-critical error messages

VxVM error messages

VXFEN driver error messages

VXFEN driver informational message

Node ejection informational messages

Glossary 579

Glossary 583


^ Return to Top	\| TOC \| Index \| Next >