How to Change Interconnect network interface in 11gR2 RAC

[root@rac1 ~]# oifcfg getif
eth0  147.43.0.0  global  public
eth1  172.16.0.0  global  cluster_interconnect

srvctl stop database -d DB_NAME

[root@rac1 ~]# srvctl stop nodeapps -n rac1 -f

[root@rac2 ~]# srvctl stop nodeapps -n rac2 -f

[root@rac1 ~]# oifcfg setif -global eth2/192.168.0.0:cluster_interconnect

[root@rac1 ~]# oifcfg delif -global eth1

[root@rac1 ~]# oifcfg getif

eth0  147.43.0.0  global  public

eth2  192.168.0.0  global  cluster_interconnect

Modify /etc/hosts file on each node.

Delete entry of old private interconnect and add new private interconnect on each node.

[root@rac1 ~]# cat /etc/hosts

#Private

192.168.0.10         rac1-priv.pavan.com        rac1-priv

192.168.0.11         rac2-priv.pavan.com        rac2-priv

Read More

Change Cluster Interconnect Adapter IP Address in 11gR2 RAC

Cluster interconnect: It’s a private interface used for the cluster-ware to provide inter-instance or
Cache Fusion communication. This is also called as private IP address.

Step 1: Determine private IP address and Ethernet card name

[oracle@rac1 ~]$ oifcfg getif
eth0  147.43.0.0  global  public
eth1  192.168.0.0  global  cluster_interconnect

Step 2: Add new interface Subnet ID specification:

[oracle@rac1 ~]$ oifcfg setif -global eth1/172.16.0.0:cluster_interconnect

Step 3 : Verify the changes:

[oracle@rac1 ~]$ oifcfg getif
eth0  147.43.0.0  global  public
eth1  192.168.0.0  global  cluster_interconnect
eth1  172.16.0.0  global  cluster_interconnect

Step 4: Stop cluster on all node:

[root@rac1 ~]# crsctl stop cluster -all

Step 5: Modify netwrok address on network adapter of each box:

[root@rac1 ~]# ifconfig eth1 172.16.0.10 netmask 255.255.0.0 broadcast 172.16.255.255

[root@rac2 ~]# ifconfig eth1 172.16.0.11 netmask 255.255.0.0 broadcast 172.16.255.255

Step 6: Modify /etc/hosts file on each node.

Delete entry of old private interconnect and add new private interconnect on each node.

[root@rac1 ~]# cat /etc/hosts

#Private

172.16.0.10         rac1-priv.pavan.com        rac1-priv

172.16.0.11         rac2-priv.pavan.com        rac2-priv

Step 7: Start cluster on each node

[root@rac1 ~]# crsctl start cluster -all

Step 8: Delete old entry of private interconnect from cluster registry

[root@rac1 ~]# oifcfg delif -global eth1/192.168.0.0:cluster_interconnect

Step 9: Verify the changes:

[root@rac1 ~]# oifcfg getif

eth0  147.43.0.0  global  public

eth1  172.16.0.0  global  cluster_interconnect

You can also verify:

[root@rac1 ~]# ifconfig eth1

eth1      Link encap:Ethernet  HWaddr 00:0C:29:1F:C8:9B  

          inet addr:172.16.0.10  Bcast:172.16.255.255  Mask:255.255.0.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:233241 errors:0 dropped:0 overruns:0 frame:0

          TX packets:191677 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000 

          RX bytes:131223995 (125.1 MiB)  TX bytes:91090699 (86.8 MiB)

[root@rac1 ~]# ping rac2-priv

PING rac2-priv.pavan.com (172.16.0.11) 56(84) bytes of data.

64 bytes from rac2-priv.pavan.com (172.16.0.11): icmp_seq=1 ttl=64 time=0.263 ms

64 bytes from rac2-priv.pavan.com (172.16.0.11): icmp_seq=2 ttl=64 time=0.230 ms

^C

--- rac2-priv.pavan.com ping statistics ---

2 packets transmitted, 2 received, 0% packet loss, time 999ms

rtt min/avg/max/mdev = 0.230/0.246/0.263/0.022 ms

Read More

Identify your Oracle RAC Network details.

[root@rac1 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1           localhost.localdomain       localhost

# Public
147.43.0.1          rac1.pavan.com             rac1
147.43.0.2          rac2.pavan.com             rac2

#Private
192.168.0.1         rac1-priv.pavan.com        rac1-priv
192.168.0.2         rac2-priv.pavan.com        rac2-priv

#Vip
147.43.0.3          rac1-vip.pavan.com         rac1-vip
147.43.0.4          rac2-vip.pavan.com         rac2-vip

#Scan
147.43.0.5          scan.pavan.com             scan

::1                 localhost6.localdomain6    localhost6
[root@rac1 ~]#


[root@rac1 ~]# olsnodes -c
cluster

[root@rac1 ~]# olsnodes -n -i

rac1    1       rac1-vip

rac2    2       rac2-vip

[root@rac1 ~]# srvctl config nodeapps -a

Network exists: 1/147.43.0.0/255.255.0.0/eth0, type static

VIP exists: /rac1-vip/147.43.0.3/147.43.0.0/255.255.0.0/eth0, hosting node rac1

VIP exists: /rac2-vip/147.43.0.4/147.43.0.0/255.255.0.0/eth0, hosting node rac2

[root@rac1 ~]# crsctl stat res ora.rac1.vip -p |egrep 'NAME|TYPE|USR_ORA_VIP|START_DEPENDENCIES|SCAN_NAME|VERSION'

NAME=ora.rac1.vip

TYPE=ora.cluster_vip_net1.type

AGENT_FILENAME=%CRS_HOME%/bin/orarootagent%CRS_EXE_SUFFIX%

GEN_USR_ORA_VIP=

START_DEPENDENCIES=hard(ora.net1.network) pullup(ora.net1.network)

TYPE_VERSION=2.1

USR_ORA_VIP=rac1-vip

VERSION=11.2.0.3.0

[root@rac1 ~]# olsnodes -n -i -l -p

rac1    1       192.168.0.1     rac1-vip

[root@rac1 ~]# oifcfg getif

eth0  147.43.0.0  global  public

eth1  192.168.0.0  global  cluster_interconnect

[root@rac1 ~]# ifconfig -a 

eth0      Link encap:Ethernet  HWaddr 00:0C:29:1F:C8:91  

          inet addr:147.43.0.1  Bcast:147.43.255.255  Mask:255.255.0.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:210731 errors:0 dropped:0 overruns:0 frame:0

          TX packets:2309578 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000 

          RX bytes:15560956 (14.8 MiB)  TX bytes:3433451752 (3.1 GiB)

eth0:1    Link encap:Ethernet  HWaddr 00:0C:29:1F:C8:91  

          inet addr:147.43.0.3  Bcast:147.43.255.255  Mask:255.255.0.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

eth0:2    Link encap:Ethernet  HWaddr 00:0C:29:1F:C8:91  

          inet addr:147.43.0.5  Bcast:147.43.255.255  Mask:255.255.0.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

eth1      Link encap:Ethernet  HWaddr 00:0C:29:1F:C8:9B  

          inet addr:192.168.0.1  Bcast:192.168.0.255  Mask:255.255.255.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:63580 errors:0 dropped:0 overruns:0 frame:0

          TX packets:46764 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000 

          RX bytes:30372897 (28.9 MiB)  TX bytes:23087850 (22.0 MiB)

eth1:1    Link encap:Ethernet  HWaddr 00:0C:29:1F:C8:9B  

          inet addr:169.254.239.192  Bcast:169.254.255.255  Mask:255.255.0.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

lo        Link encap:Local Loopback  

          inet addr:127.0.0.1  Mask:255.0.0.0

          UP LOOPBACK RUNNING  MTU:16436  Metric:1

          RX packets:20767 errors:0 dropped:0 overruns:0 frame:0

          TX packets:20767 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0 

          RX bytes:14172845 (13.5 MiB)  TX bytes:14172845 (13.5 MiB)

virbr0    Link encap:Ethernet  HWaddr 4E:13:2C:D3:DA:E9  

          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:0 errors:0 dropped:0 overruns:0 frame:0

          TX packets:357 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0 

          RX bytes:0 (0.0 b)  TX bytes:36042 (35.1 KiB)

[root@rac1 ~]# oifcfg iflist -p -n

eth0  147.43.0.0  UNKNOWN  255.255.0.0

eth1  192.168.0.0  PRIVATE  255.255.255.0

eth1  169.254.0.0  UNKNOWN  255.255.0.0

virbr0  192.168.122.0  PRIVATE  255.255.255.0

[root@rac1 ~]# ps -ef |grep d.bin |wc -l

21

^C[root@rac1 ~]# srvctl config scan
SCAN name: scan.pavan.com, Network: 1/147.43.0.0/255.255.0.0/eth0
SCAN VIP name: scan1, IP: /scan.pavan.com/147.43.0.5

[root@rac1 ~]# cat /etc/hosts |grep -i scan

#Scan

147.43.0.5          scan.pavan.com             scan

[root@rac1 ~]# srvctl config scan_listener

SCAN Listener LISTENER_SCAN1 exists. Port: TCP:1521

[root@rac1 ~]# crsctl stat res ora.scan1.vip -p |egrep 'NAME|TYPE|USR_ORA_VIP|START_DEPENDENCIES|SCAN_NAME|VERSION'

NAME=ora.scan1.vip

TYPE=ora.scan_vip.type

AGENT_FILENAME=%CRS_HOME%/bin/orarootagent%CRS_EXE_SUFFIX%

GEN_USR_ORA_VIP=

SCAN_NAME=scan.pavan.com

START_DEPENDENCIES=hard(ora.net1.network) dispersion:active(type:ora.scan_vip.type) pullup(global:ora.net1.network)

TYPE_VERSION=1.1

USR_ORA_VIP=147.43.0.5

VERSION=11.2.0.3.0

Read More