Home » Server Options » RAC & Failsafe » Oracle CRS failure. Rebooting for cluster integrity. (Solaris 10)
icon9.gif  Oracle CRS failure. Rebooting for cluster integrity. [message #595129] Sat, 07 September 2013 08:15 Go to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Hello,

I got following error on Oracle 10.2.0.4.0 RAC on solaris 10

Oracle clsomon failed with fatal status 12.
Oracle CRS failure. Rebooting for cluster integrity.

I think this problem in 11g but I am using 10g.
how to solve this problem...please help.

Regards,
Dushyant

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595130 is a reply to message #595129] Sat, 07 September 2013 08:45 Go to previous messageGo to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Also find the following logs:

[cssd(2474)]CRS-1605:CSSD voting file is online: /dev/rdsk/c4t600A0B800067E686000003B74C2843F3d0s0. Details in /u02/app/crs/log/nr-del-racdb2-mts/cssd/ocssd.log.

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595131 is a reply to message #595130] Sat, 07 September 2013 09:03 Go to previous messageGo to next message
Lalit Kumar B
Messages: 3174
Registered: May 2013
Location: World Wide on the Web
Senior Member
Is it single-node or multi-node? If yes, do you get error on all nodes?

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595132 is a reply to message #595131] Sat, 07 September 2013 09:11 Go to previous messageGo to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Hello Lalit,

It is two nodes, and I got error in both the nodes.

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595133 is a reply to message #595132] Sat, 07 September 2013 09:12 Go to previous messageGo to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Also cssd showing 50% heartbeat fatal, eviction in 0.000 seconds

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595134 is a reply to message #595132] Sat, 07 September 2013 09:13 Go to previous messageGo to next message
Lalit Kumar B
Messages: 3174
Registered: May 2013
Location: World Wide on the Web
Senior Member
First thing, can you check the date and time on both the nodes are similar or not?

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595135 is a reply to message #595134] Sat, 07 September 2013 09:13 Go to previous messageGo to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
yes both server have same date and time.

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595136 is a reply to message #595135] Sat, 07 September 2013 09:18 Go to previous messageGo to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Is it possible because of heartbeat fail?

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595138 is a reply to message #595136] Sat, 07 September 2013 09:23 Go to previous messageGo to next message
Lalit Kumar B
Messages: 3174
Registered: May 2013
Location: World Wide on the Web
Senior Member
What is the DB version in 4 decimals? What's the Glibc package version? check if it can be upgraded.

dushyantmdave wrote on Sat, 07 September 2013 19:42
Also cssd showing 50% heartbeat fatal, eviction in 0.000 seconds

dushyantmdave wrote on Sat, 07 September 2013 19:48
Is it possible because of heartbeat fail?


If heartbeat doesn't complete within the limited specified CSS misscount, then a node eviction event is triggered. Please post the error log content of the ocssd.log file.

There are several other possibilities. It's more important to know on doing what you got the error?

You can have a look at this pdf and got o the CRS reboot troubleshooting section.

[Updated on: Mon, 03 March 2014 08:32] by Moderator

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595139 is a reply to message #595135] Sat, 07 September 2013 09:30 Go to previous messageGo to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Version 10.2.0.4.0 - 64bit solaris
how to check glibc version on solaris?

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595140 is a reply to message #595139] Sat, 07 September 2013 09:36 Go to previous messageGo to next message
Lalit Kumar B
Messages: 3174
Registered: May 2013
Location: World Wide on the Web
Senior Member
dushyantmdave wrote on Sat, 07 September 2013 20:00

how to check glibc version on solaris?


Do you have access to /bin? You will find the library version there.

I just updated my previous post, please have a look and come back with the details.

[Updated on: Sat, 07 September 2013 09:42]

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595141 is a reply to message #595140] Sat, 07 September 2013 09:50 Go to previous messageGo to next message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Dear Lalit,

Please find attached logs for both the nodes.
  • Attachment: nodes.log
    (Size: 6.49KB, Downloaded 2630 times)

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595145 is a reply to message #595141] Sat, 07 September 2013 12:32 Go to previous messageGo to next message
Lalit Kumar B
Messages: 3174
Registered: May 2013
Location: World Wide on the Web
Senior Member
Ok, let me analyze the log file. It's weekend, so expect some delay in replies. Meanwhile can you find the glibc version in /bin.

Report message to a moderator

Re: Oracle CRS failure. Rebooting for cluster integrity. [message #595222 is a reply to message #595145] Mon, 09 September 2013 08:23 Go to previous message
dushyantmdave
Messages: 9
Registered: January 2013
Location: India
Junior Member
Dear Lalit,

Please find here glibc version:
-bash-3.00$ pvs /usr/sbin/usermod
libsecdb.so.1 (SUNW_1.1);
libproject.so.1 (SUNW_1.1);
libtsol.so.2 (SUNW_2.1);
libc.so.1 (SUNW_1.22.2, SUNWprivate_1.1);


Also find alert logs:

2013-08-07 06:11:58.188
[cssd(2474)]CRS-1605:CSSD voting file is online: /dev/rdsk/c4t600A0B800067E686000003B74C2843F3d0s0. Details in /u02/app/crs/log/nr-del-racdb2-mts/cssd/ocssd.log.
[cssd(2474)]CRS-1601:CSSD Reconfiguration complete. Active nodes are nr-del-racdb1-mts nr-del-racdb2-mts .
2013-08-07 06:12:03.634
[crsd(2232)]CRS-1012:The OCR service started on node nr-del-racdb2-mts.
2013-08-07 06:12:03.691
[evmd(2198)]CRS-1401:EVMD started on node nr-del-racdb2-mts.

Report message to a moderator

Previous Topic: RMAN Backup
Next Topic: ksfdopn:2 Failed to open file +FLASH_RECOVERY_AREA
Goto Forum:
  

[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Sat Jan 04 16:37:15 CST 2025
.:: Forum Home :: Blogger Home :: Wiki Home :: Contact :: Privacy ::.