RAC install - - - ASM and OCR file error [message #266387] |
Mon, 10 September 2007 12:30 |
shaseeb
Messages: 113 Registered: April 2007 Location: Madison, WI
|
Senior Member |
|
|
Hi All,
Environment: Oracle10gR2 on RHEL 4 AS 64-bit
I would like to summarize my issue.
I just finished creating the ASM instance with OUI. However, at the end I got the following error messages from OUI:
Could not start +ASM1 on node1
Could not start +ASM2 on node2
ORA-insufficient privileges
Could not mount the diskgroup on node NODE2. The ASM instance is not started.
After the installer finished I did a crs_stat -t and saw the following:
Name Type Target State Host
------------------------------------------------------------
ora....SM1.asm application ONLINE OFFLINE
ora....OS.lsnr application ONLINE ONLINE galapagos
ora....gos.gsd application ONLINE ONLINE galapagos
ora....gos.ons application ONLINE ONLINE galapagos
ora....gos.vip application ONLINE ONLINE galapagos
ora....SM2.asm application ONLINE OFFLINE
ora....DT.lsnr application ONLINE ONLINE humboldt
ora....ldt.gsd application ONLINE ONLINE humboldt
ora....ldt.ons application ONLINE ONLINE humboldt
ora....ldt.vip application ONLINE ONLINE humboldt
Now I am wondering why this happened because upto this point the whole RAC install was going smoothly.
Next I decided to check the logs for both nodes and found the following:
Node 1
[oracle@galapagos galapagos]$ more alertgalapagos.log
2007-09-06 19:13:04.543
[client(29103)]CRS-1006:The OCR location /opt/crs/ocrfile is inaccessible. Details in /crs/home/log/galapagos/client/ocrconfig_29103.log.
2007-09-06 19:13:04.544
[client(29103)]CRS-1006:The OCR location /opt/crs/ocrfile is inaccessible. Details in /crs/home/log/galapagos/client/ocrconfig_29103.log.
2007-09-06 19:13:04.544
[client(29103)]CRS-1006:The OCR location /opt/crs/ocrfile is inaccessible. Details in /crs/home/log/galapagos/client/ocrconfig_29103.log.
2007-09-06 19:13:04.557
[client(29103)]CRS-1001:The OCR was formatted using version 2.
2007-09-06 19:13:11.525
[client(29146)]CRS-1801:Cluster FPRCDBCLUST configured with nodes galapagos humboldt .
2007-09-06 19:15:30.078
[cssd(29708)]CRS-1605:CSSD voting file is online: /opt/crs/cssfile. Details in /crs/home/log/galapagos/cssd/ocssd.log.
2007-09-06 19:15:31.157
[cssd(29708)]CRS-1601:CSSD Reconfiguration complete. Active nodes are galapagos .
2007-09-06 19:18:52.690
[cssd(29708)]CRS-1601:CSSD Reconfiguration complete. Active nodes are galapagos humboldt .
2007-09-06 19:18:53.852
[crsd(29301)]CRS-1012:The OCR service started on node galapagos.
2007-09-06 19:18:53.865
[evmd(29558)]CRS-1401:EVMD started on node galapagos.
2007-09-06 19:18:54.228
[crsd(29301)]CRS-1201:CRSD started on node galapagos.
Node 2
[oracle@humboldt humboldt]$ more alerthumboldt.log
2007-09-06 19:18:48.807
[cssd(11492)]CRS-1605:CSSD voting file is online: /opt/crs/cssfile. Details in /crs/home/log/humboldt/cssd/ocssd.log.
2007-09-06 19:18:52.690
[cssd(11492)]CRS-1601:CSSD Reconfiguration complete. Active nodes are galapagos humboldt .
2007-09-06 19:18:53.009
[crsd(11086)]CRS-1012:The OCR service started on node humboldt.
2007-09-06 19:18:53.768
[evmd(11342)]CRS-1401:EVMD started on node humboldt.
2007-09-06 19:18:54.637
[crsd(11086)]CRS-1201:CRSD started on node humboldt
Then I went to Node1's log that it mentioned (ocrconfig_29103.log) and saw the following:
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
2007-09-06 19:13:04.542: [ OCRCONF][2538053312]ocrconfig starts...
2007-09-06 19:13:04.543: [ OCRCONF][2538053312]Upgrading OCR data
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 512 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 512 retval 0 phy_offset 102400 retry 1
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 512 retval 0 phy_offset 102400 retry 2
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 512 retval 0 phy_offset 102400 retry 3
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 512 retval 0 phy_offset 102400 retry 4
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 1
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 2
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 3
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 4
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCRRAW][2538053312]propriogid:1: INVALID FORMAT
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 1
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 2
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 3
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:3: problem reading buffer 5b7000 buflen 4096 retval 0 phy_offset 102400 retry 4
2007-09-06 19:13:04.543: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 0 errstring Success
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]ibctx:1:ERROR: INVALID FORMAT
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]proprinit:problem reading the bootblock or superbloc 22
2007-09-06 19:13:04.544: [ default][2538053312]a_init:7!: Backend init unsuccessful : [22]
2007-09-06 19:13:04.544: [ OCRCONF][2538053312]Exporting OCR data to [OCRUPGRADEFILE]
2007-09-06 19:13:04.544: [ OCRAPI][2538053312]a_init:7!: Backend init unsuccessful : [33]
2007-09-06 19:13:04.544: [ OCRCONF][2538053312]There was no previous version of OCR. error:[PROC-33: Oracle Cluster Registry is not config
ured]
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 512 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 4096 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]propriogid:1: INVALID FORMAT
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 4096 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]ibctx:1:ERROR: INVALID FORMAT
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]proprinit:problem reading the bootblock or superbloc 22
2007-09-06 19:13:04.544: [ default][2538053312]a_init:7!: Backend init unsuccessful : [22]
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 512 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 4096 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]propriogid:1: INVALID FORMAT
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 4096 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]ibctx:1:ERROR: INVALID FORMAT
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]proprinit:problem reading the bootblock or superbloc 22
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 512 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:3: problem reading buffer 5b8000 buflen 4096 retval 0 phy_offset 102400 retry 0
2007-09-06 19:13:04.544: [ OCROSD][2538053312]utread:4: problem reading the buffer errno 2 errstring No such file or directory
2007-09-06 19:13:04.544: [ OCRRAW][2538053312]propriogid:1: INVALID FORMAT
2007-09-06 19:13:04.550: [ OCRRAW][2538053312]propriowv: Vote information on disk 0 [/opt/crs/ocrfile] is adjusted from [0/0] to [2/2]
2007-09-06 19:13:04.557: [ OCRRAW][2538053312]propriniconfig:No 92 configuration
2007-09-06 19:13:04.557: [ OCRAPI][2538053312]a_init:6a: Backend init successful
2007-09-06 19:13:04.595: [ OCRCONF][2538053312]Initialized DATABASE keys in OCR
2007-09-06 19:13:04.607: [ OCRCONF][2538053312]Successfully set skgfr block 0
2007-09-06 19:13:04.608: [ OCRCONF][2538053312]Exiting [status=success]...
I am stuck and don't know how to proceed. This is my first RAC install. I have checked all the daemons and they are all healthy. Should I go on? I was told sometimes the ASM instances come up after you install the Oracle database software and create the database instance. I would rather not proceed just in case I have to re-install everything again.
So my questions are:
1. Why didn't the ASM instances come up? What is the error here?
2. Is there anything wrong with the OCR file? Maybe is wasn't cleaned out when I did a re-install?
Any help or guidance would be greatly appreciated.
|
|
|
|