Home » Server Options » RAC & Failsafe » How to switch to another NIC adapter in RAC automatically? (Oracle 10g R2 RAC, HP-UX 11.23)
How to switch to another NIC adapter in RAC automatically? [message #458816] Wed, 02 June 2010 00:30 Go to next message
cuijin
Messages: 15
Registered: June 2010
Junior Member
Hi all,
i have installed Oracle10g R2 RAC successfully in HP-UX 11.23. both of my servers has three nic adapters. first one for private network, second for public network. now i want to add third nic adapter to RAC for public network. when one public network card failed, another one will switch to work automatically. i have configured serviceguard with none packge and run it on. so HP-UX can alternate nic adapter to another automatically. but in Oracle10g R2 RAC, it do not works.
how to do it?
what need i to do ?

[Updated on: Wed, 02 June 2010 00:57]

Report message to a moderator

Re: How to switch to another NIC adapter in RAC automatically? [message #458898 is a reply to message #458816] Wed, 02 June 2010 07:25 Go to previous messageGo to next message
John Watson
Messages: 8965
Registered: January 2010
Location: Global Village
Senior Member
I would usually do this with NIC bonding (or "port trunking", some people call it). So it looks like this:
bond0     Link encap:Ethernet  HWaddr 00:11:22:33:44:55
          inet addr:192.168.56.201  Bcast:192.168.56.255  Mask:255.255.255.0
          inet6 addr: fe80::211:22ff:fe33:4455/64 Scope:Link
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:417 errors:0 dropped:0 overruns:0 frame:0
          TX packets:147 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:76420 (74.6 KiB)  TX bytes:30912 (30.1 KiB)

bond0:0   Link encap:Ethernet  HWaddr 00:11:22:33:44:55
          inet addr:192.168.56.211  Bcast:192.168.56.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1

eth0      Link encap:Ethernet  HWaddr 08:00:27:33:1B:60
          inet addr:192.168.56.101  Bcast:192.168.56.255  Mask:255.255.255.0
          inet6 addr: fe80::a00:27ff:fe33:1b60/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:437 errors:0 dropped:0 overruns:0 frame:0
          TX packets:260 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:64592 (63.0 KiB)  TX bytes:35057 (34.2 KiB)
          Base address:0xd010 Memory:f0000000-f0020000

eth1      Link encap:Ethernet  HWaddr 00:11:22:33:44:55
          inet6 addr: fe80::211:22ff:fe33:4455/64 Scope:Link
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:215 errors:0 dropped:0 overruns:0 frame:0
          TX packets:75 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:39255 (38.3 KiB)  TX bytes:16200 (15.8 KiB)
          Base address:0xd240 Memory:f0820000-f0840000

eth2      Link encap:Ethernet  HWaddr 00:11:22:33:44:55
          inet6 addr: fe80::211:22ff:fe33:4455/64 Scope:Link
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:202 errors:0 dropped:0 overruns:0 frame:0
          TX packets:72 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:37165 (36.2 KiB)  TX bytes:14712 (14.3 KiB)
          Base address:0xd248 Memory:f0840000-f0860000

You can see that I've defined bond0 as the master, with eth1 and eth2 as slaves. Then you tell RAC that bond0 is the public interface on which VIPs should be started, and let the operating system do the load balancing and fault tolerance across the physical NICs. The RAC doesn't need to know anything about it.

Report message to a moderator

Re: How to switch to another NIC adapter in RAC automatically? [message #460080 is a reply to message #458898] Wed, 09 June 2010 08:59 Go to previous messageGo to next message
cuijin
Messages: 15
Registered: June 2010
Junior Member
John Watson: thank you very much.
my company has no license for using HP ADA software to bond nic. so i must lookup another method to solve the problem.
how do you bond nic ?
i have read the document that say Oracle10g RAC use only one nic for private network. whether does Oracle10g RAC use only one nic for public network too?

Report message to a moderator

Re: How to switch to another NIC adapter in RAC automatically? [message #460105 is a reply to message #460080] Wed, 09 June 2010 11:52 Go to previous messageGo to next message
John Watson
Messages: 8965
Registered: January 2010
Location: Global Village
Senior Member
The document you read is rubbish, you can define as many NICs as you want, for both interconnect and public. OUI will detect them, and prompt you for what each one. Or you can add more later. I just find it easier to use NIC bonding to provide a layer of abstraction between the RAC and hardware. On Linux, I do it like this (no idea what the HP-UX equivalent is) but really your sys admins should know:
modprobe bonding mode=0 miimon=100 # load bonding module, with mode 0
ifconfig eth1 down	# bring down eth1 
ifconfig eth2 down	# bring down eth2 
ifconfig bond0 hw ether 00:11:22:33:44:55	# give bond0 a fictitious MAC address
ifconfig bond0 192.168.55.55 up			# give bond0 an IP address
ifenslave bond0 eth1	# make eth1 a slave for bond0
ifenslave bond0 eth2	# make eth2 a slave for bond0
The mode specifies the fault tolerance, 0 is round robin load balancing with failover, 1 would be active/passive failover, there are a few others.

Report message to a moderator

Re: How to switch to another NIC adapter in RAC automatically? [message #461674 is a reply to message #460105] Sun, 20 June 2010 21:14 Go to previous messageGo to next message
mkounalis
Messages: 147
Registered: October 2009
Location: Dallas, TX
Senior Member
I read this, and I think there is some confusion.

CRS uses only one logical nic for communication. If you want it to be redundant, you need to using nic bonding as CRS does not (yet) have the ability to do nic failover. RAC is able to use more than one logical nic for communication, but if one failes, you are looking at the instance going off-line. Really, nic bonding at the OS level is what you need to implement to allow a single physical nic failure from causing a node failure. Right now Oracle 10g only supports a single VIP address for failover. By definition, that would also mean that your public network needs to be on a nic-bonded network setup as well.

So yes - you can use all three nics in your system - one for public, one for CRS, and one for RAC - but then you have three points of failure . . . .

Report message to a moderator

Re: How to switch to another NIC adapter in RAC automatically? [message #463355 is a reply to message #461674] Wed, 30 June 2010 20:42 Go to previous message
cuijin
Messages: 15
Registered: June 2010
Junior Member
mkounalis: thank you very much.
after reading your words, i think i see. now the only method seems to bonding nic on OS level, so two nics can failover automatically in RAC. John Watson's method on Linux can not be used on HP-UX. because HP-UX v11.23 have no similar commands for that. i will work on bonding nic on HP-UX. maybe i need to connect to my boss and HP for using ADA software.
thank you two very much for my question!

[Updated on: Wed, 30 June 2010 20:56]

Report message to a moderator

Previous Topic: RAC Database - Waiting for smon to disable tx recovery
Next Topic: RAC with ASM or GPFS on IBM AIX machine ?
Goto Forum:
  

[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Mon Feb 17 02:30:36 CST 2025
.:: Forum Home :: Blogger Home :: Wiki Home :: Contact :: Privacy ::.