11gR2 RAC on VMWare ESXi V4.0

From: Tony Adolph <tony.adolph.dba_at_gmail.com>
Date: Tue, 12 Jan 2010 09:06:28 +1300
Message-ID: <4a38d9061001111206g61940176pafd9b0f0d713dc4_at_mail.gmail.com>

Hi Folks,

I've been trying to build myself an RHEL 5.3 32-bit 11gR2 2 node RAC on ESXi V4.0

Its only to play with to learn the new features.

It all goes well until the root.sh script on node 2 is run,
/u01/app/oraInventory/orainstRoot.sh runs fine on both.

/u01/app/11.2.0/grid/root.sh runs without error on node1, then fails at
octssd:

.
.

CRS-2672: Attempting to start 'ora.diskmon' on 'vmnode2'
CRS-2676: Start of 'ora.diskmon' on 'vmnode2' succeeded
CRS-2676: Start of 'ora.cssd' on 'vmnode2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'vmnode2'

Start action for octssd aborted

CRS-2676: Start of 'ora.ctssd' on 'vmnode2' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'vmnode2'
CRS-2672: Attempting to start 'ora.asm' on 'vmnode2'
CRS-2676: Start of 'ora.drivers.acfs' on 'vmnode2' succeeded
CRS-2676: Start of 'ora.asm' on 'vmnode2' succeeded
CRS-2664: Resource 'ora.ctssd' is already running on 'vmnode2'
CRS-4000: Command Start failed, or completed with errors.

Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl start resource ora.asm -init
Start of resource "ora.asm -init" failed Failed to start ASM
Failed to start Oracle Clusterware stack

I have tried with NTP configured and working correctly, putting octssd into observer mode, and also with /etc/ntpd.conf moved putting octssd into active mode. Both ways fails on node2.

With octssd in Active mode (not using NTP) this is what I get in node 2's octssd.log

2010-01-12 08:31:28.735: [ CTSS][3009731472]sclsctss_gvss8: Return [0] and NTP status [1].
2010-01-12 08:31:28.735: [ CTSS][3009731472]ctss_check_vendor_sw: Vendor time sync software is not detected. status [1]. 2010-01-12 08:31:57.659: [ CTSS][2978261904]ctss_checkcb: clsdm requested check alive. Returns [40]
2010-01-12 08:31:58.735: [ CTSS][3009731472]sclsctss_gvss2: NTP default pid file not found
2010-01-12 08:31:58.735: [ CTSS][3009731472]sclsctss_gvss8: Return [0] and NTP status [1].
2010-01-12 08:31:58.735: [ CTSS][3009731472]ctss_check_vendor_sw: Vendor time sync software is not detected. status [1]. 2010-01-12 08:32:27.657: [ CTSS][2978261904]ctss_checkcb: clsdm requested check alive. Returns [40]
2010-01-12 08:32:28.737: [ CTSS][3009731472]sclsctss_gvss2: NTP default pid file not found
2010-01-12 08:32:28.737: [ CTSS][3009731472]sclsctss_gvss8: Return [0] and NTP status [1].
2010-01-12 08:32:28.737: [ CTSS][3009731472]ctss_check_vendor_sw: Vendor time sync software is not detected. status [1].

On node1 all looks good (I think):

[oracle_at_vmnode1 bin]$ ./cluvfy comp clocksync -verbose

Verifying Clock Synchronization across the cluster nodes

Checking if Clusterware is installed on all nodes... Check of Clusterware install passed

Checking if CTSS Resource is running on all nodes... Check: CTSS Resource running on all nodes

  Node Name                             Status
  ------------------------------------  ------------------------
  vmnode1                               passed

Result: CTSS resource check passed

Querying CTSS for time offset on all nodes... Result: Query of CTSS for time offset passed

Check CTSS state started...
Check: CTSS state

  Node Name                             State
  ------------------------------------  ------------------------
  vmnode1                               Active

CTSS is in Active state. Proceeding with check of clock time offsets on all nodes...
Reference Time Offset Limit: 1000.0 msecs Check: Reference Time Offset
  Node Name Time Offset Status

• ------------------------ ------------------------ vmnode1 0.0 passed

Time offset is within the specified limits on the following set of nodes: "[vmnode1]"
Result: Check of clock time offsets passed

Oracle Cluster Time Synchronization Services check passed

Verification of Clock Synchronization across the cluster nodes was successful.

I can't find anything out there about this.... one link that looked promising about ctssd was
http://www.rachelp.nl/index_kb.php?menu=articles&actie=show&id=60 but I'm still stuck :-(

Any help would be much appreciated.

Regards
Tony

--
http://www.freelists.org/webpage/oracle-l

Received on Mon Jan 11 2010 - 14:06:28 CST