Configuring the CNFS server for Oracle

You can use the following procedure to configure a Clustered Network File System (CNFS) server for Oracle databases. The following example procedure assumes a two node Veritas Storage Foundation Cluster File System (CFS) 6.0 cluster with host names cnfs-1 and cnfs-2.

To configure a CNFS server for Oracle database

  1. Configure a shared disk group for Oracle.
    [cnfs-1]#  vxdg -s init oradg disk1 disk2 disk3 disk4
  2. Create volumes for data files, archive logs, and CNFS locks.
    [cnfs-1]# vxassist -g oradg make oranfsdata 100g  \
    layout=stripe ncolumn=4 st_width=1m disk1 disk2 disk3 disk4
    [cnfs-1]# vxassist -g oradg make oranfsarch 10g 
    [cnfs-1]# vxassist -g oradg make cnfs_locks 2g 
    

    Note:

    Symantec recommends a stripe volume with a stripe width of 1 MB for Oracle data files.

  3. Create file systems for CNFS locks, data files, and archive logs.
    [cnfs-1]# mkfs -t vxfs -o version=9,bsize=8192 \
    /dev/vx/rdsk/oradg/oranfsdata
    [cnfs-1]# mkfs -t vxfs /dev/vx/rdsk/oradg/oranfsarch
    [cnfs-1]# mkfs -t vxfs /dev/vx/rdsk/oradg/cnfs_locks

    Note:

    Symantec recommends a file system block size of 8 KB for Oracle data files.

    Note:

    To use the FileSnap feature, the file system must be disk layout Version 8 or later.

  4. Configure Clustered NFS.
    [cnfs-1]# cfsshare config -p nfs oranfsdg /cnfs_locks
  5. Configure /oranfadata and /oranfsarch for NFS sharing.
    [cnfs-1]# cfsshare add -p nfs -N "rw,no_wdelay,no_root_squash" \
    oradg oranfsdata /oranfsdata all= 
    [cnfs-1]# cfsshare add -p nfs -N "rw,no_wdelay,no_root_squash" \
    oradg oranfsarch /oranfssarch all=
  6. Add virtual IP (VIP).
    [cnfs-1]# cfsshare addvip eth2 virtual_IP subnet_mask

    Note:

    Symantec recommends adding one VIP for each node in the CNFS cluster to load balance the I/O among all the nodes in the cluster.

  7. Display the CNFS configuration details.
    [cnfs-1]# cfsshare display
    
      SHARE RESOURCE        MOUNTPOINT      SHARE OPTIONS
      share1                /oranfsarch     rw,wdelay,no_root_squash
      share2                /oranfsdata     rw,wdelay,no_root_squash
    
  8. Display the VCS resource details.
    [cnfs-1]# hastatus
    
    group           	resource             	system             message
                                         		cnfs-2             RUNNING
                                         		cnfs-1             RUNNING
    cfsnfssg                             		cnfs-1             ONLINE
    cfsnfssg                             		cnfs-2             ONLINE
    cfsnfssg_dummy                       		cnfs-1             OFFLINE
    cfsnfssg_dummy                       		cnfs-2             OFFLINE
    cvm                                  		cnfs-1             ONLINE
    cvm                                  		cnfs-2             ONLINE
    vip1                                 		cnfs-1             OFFLINE
    vip1                                 		cnfs-2             ONLINE
    vip2                                 		cnfs-1             ONLINE
    vip2                                 		cnfs-2             OFFLINE
    
                   	 app                  	cnfs-1             ONLINE
                    	app                  	cnfs-2             ONLINE
    
                    	cfsmount1           	 cnfs-1             ONLINE
                    	cfsmount1            	cnfs-2             ONLINE
    
                    	cfsmount2            	cnfs-1             ONLINE
                    	cfsmount2            	cnfs-2             ONLINE
    
                    	cfsnfs_locks         	cnfs-1             ONLINE
                    	cfsnfs_locks         	cnfs-2             ONLINE
    
    
                    	cvmvoldg1            	cnfs-1             ONLINE
                    	cvmvoldg1            	cnfs-2             ONLINE
                      nfs                  cnfs-2             ONLINE
                    	 nfs                  cnfs-2             ONLINE
                     share1                cnfs-1             ONLINE
                    	share1               	cnfs-2             ONLINE
                    	
                    	share2               	cnfs-1             ONLINE
                    	share2               	cnfs-2             ONLINE
    
                    	vxfsckd              	cnfs-1             ONLINE
                    	vxfsckd              	cnfs-2             ONLINE
    
                    	cvm_clus             	cnfs-1             ONLINE
                    	cvm_clus             	cnfs-2             ONLINE
    
                    	cvm_vxconfigd        	cnfs-1             ONLINE
                    	cvm_vxconfigd        	cnfs-2             ONLINE
    
                    	vip1                 	cnfs-1             OFFLINE
                    	vip1                 	cnfs-2             ONLINE
    
                    	nic1                		cnfs-1             ONLINE
                    	nic1                 	cnfs-2             ONLINE
    
                    	vip2                 	cnfs-1             ONLINE
                    	vip2                 	cnfs-2             OFFLINE
    
                    	nic2                		cnfs-1             ONLINE
                    	nic2                 	cnfs-2             ONLINE
    
  9. Verify that the NFS service is configured on all the nodes.
    [cnfs-1]# chkconfig --list  nfs
    nfs   0:off   1:off  2:on  3:on  4:on  5:on  6:off
    
  10. Verify that the NFS service is running on all the nodes.
    [cnfs-1]# service nfs  status 
    rpc.mountd (pid 4530) is running...
    nfsd (pid 4527 4526 4525 4524 .........) is running...
    rpc.rquotad (pid 4474) is running...