Oracle FAQ Your Portal to the Oracle Knowledge Grid
HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US
 

Home -> Community -> Mailing Lists -> Oracle-L -> RE: very odd problem....oracle support has been no help so far.

RE: very odd problem....oracle support has been no help so far.

From: Sinardy Xing <SinardyXing_at_bkgcomsvc.com>
Date: Mon, 24 May 2004 11:50:41 +0800
Message-ID: <7534CC34CD1D9F49BB05A00B9C6F20F40138DC25@antares.bcsgroup.com.sg>


relax, dude...

-----Original Message-----
From: oracle-l-bounce_at_freelists.org
[mailto:oracle-l-bounce_at_freelists.org]On Behalf Of Chris Stephens Sent: 24 May 2004 11:38
To: 'oracle-l_at_freelists.org'
Subject: RE: very odd problem....oracle support has been no help so far.

Funny you should ask.

Luckily (to some extent) ..it was a reporting database that was = generated
from another. The database was on a machine with 3 other highly = critical
db's that were unaffected. I spent Friday attempting to get that db = (sbcr
(guess the client)) to work correctly. I've never seen anything like = it.
There were processes attached to the instance that root could not kill = after
2 reboots and several instance restarts. When we restarted the machine = I
could get in but when I attempted to refresh the mv's it would hang = again
and eventually generate an ora-600. I worked (or didn't) with oracle support who claimed it was a known bug but the work around didn't help. = I
got tired of working with them (as documented by my last 42 posts) and decided that I had the weekend to recreate the database and upgrade in = the
process to 9204. When I attempted to deleted the db through dbassist it failed. So I went out to the mount point (we have the entire db on a = single
mp because I've been assured by both sa's that the san is intelligent = enough
to distribute the io on its own) and attempted to delete all the files. Once I issued an rm -f * the sh!t hit the fan. I couldn't ls/bdf/rm, everything was 'hanging'. At that point the sa, that vehemently denied = a
problem with the san from the time they had a drive failurek, all of a sudden was driving the 1hr commute back to work because 'this ain't = good'.
He then rebooted the server. Everything came up ok, I could 'touch' a = file
on the mount point and have been spending much of my weekend rebuilding = the
instance (and upgrading from 8172 to 9204) so that reports can run for a company that is currently on strike due to the mass movement of American labor overseas.=20

If much of this does not make sense, I make no apologies, I am creating = my
own Saturday and plan to show up tomorrow hoarse and sick pleading for comp-time on Tuesday so I can take care of the things I should have accomplished (seriously) this weekend but couldn't due to the fact that = I'm
the only one at the company that can do what I do after several rounds = of
layoffs. ...anyone work in Charlottesville, va?...i'm moving there with = or
without a job in September (and am headed there on wed to find a place = to
stay)....and am having a hard time finding employment. I am young, ignorant, energetic, and realize that I'm worth nothing more that what I = can
contribute to the bottom line! :) ...people at work tell me on a daily = basis
that I help them get their job done.

Anyways...uh...one more Saturday night!!!!

...."once in a while you get shown the light in the strangest of places = if
you look at it right."=20
J. Garcia.........pardon the sermon! :)

-----Original Message-----
From: Sinardy Xing [mailto:SinardyXing_at_bkgcomsvc.com]=20 Sent: Sunday, May 23, 2004 9:49 PM
To: oracle-l_at_freelists.org
Subject: RE: very odd problem....oracle support has been no help so far.

hi Chris,

is your db ok now?

I had same (similar) problem long ago unix zombie processes got to =3D reboot (power off/on) Sun Solaris box, permission ok but when I tried to =
=3D

"touch" a file in those mount point that contain datafile it was fail, =
=3D

the reason is because my hardware (EMC) I/O Card problem. but I can see =
=3D

those mount point when I do df -k, and ls -l can see the files and size.

Since you said the timestamp of those data files are freeze at certain =
=3D

point...
why don't you try to create test file in those mount points log in as db =
=3D

owner

good luck

Sinardy

-----Original Message-----
From: oracle-l-bounce_at_freelists.org
[mailto:oracle-l-bounce_at_freelists.org]On Behalf Of Chris Stephens Sent: 21 May 2004 23:16
To: 'oracle-l_at_freelists.org'
Subject: RE: very odd problem....oracle support has been no help so far.

Permissions are fine. Nothing has changed there.

I'm having the sysadmin run fuser now....but I believe it will only show =
=3D

the
processes that will not go away. ..i'll post the results

-----Original Message-----
From: Goulet, Dick [mailto:DGoulet_at_vicr.com]=3D20 Sent: Friday, May 21, 2004 9:55 AM
To: oracle-l_at_freelists.org
Subject: RE: very odd problem....oracle support has been no help so far.

Chris,

        Two things come to mind,

  1. What are the permissions on the database files? Has their ownership =3D3D and/or group changed?
  2. Try getting the sysadmins to run an fuser command on the files when =3D3D the database is known to be down.

Dick Goulet
Senior Oracle DBA
Oracle Certified 8i DBA

-----Original Message-----
From: Chris Stephens [mailto:ChrisStephens_at_affina.com] Sent: Friday, May 21, 2004 10:40 AM
To: oracle-l_at_freelists.org
Subject: very odd problem....oracle support has been no help so far.

8.1.7.2 on HP 11

Two days ago we had a problem with our san that crashed a few of our databases. I was told failed drives but I don't know how to validate =
=3D
=3D3D

that
and communication on the issue has been sketchy.

Everything seems to be fine except for one database. It is a reporting database that contains replicated data from a remote site. =3D3D20 The refresh of the materialized views is scheduled for every 2 hours. =
=3D
=3D3D

When
the job runs we receive a 600 error with the following arguments: ORA-00600: internal error code, arguments: [6731], [1], [0], [3], [], =
=3D
=3D3D

[],
[], []
ORA-00600: internal error code, arguments: [17090], [], [], [], [], [], =
=3D
=3D3D

[],
[]
ORA-12012: error on auto execute of job 41 ORA-12008: error in snapshot refresh path

And it gets worse. I tried shutting down the database with 'shutdown immediate'...nothing. 'Shutdown abort'..ok. Startup returns:

SQL> conn / as sysdba
Connected to an idle instance.
SQL> startup
ORACLE instance started.
Total System Global Area 87521768 bytes
Fixed Size 104936 bytes
Variable Size 38092800 bytes
Database Buffers 49152000 bytes
Redo Buffers 172032 bytes
ORA-01102: cannot mount database in EXCLUSIVE mode SQL> I then shutdown abort and ps -ef | grep SID. There are several =3D3D processes
out there. I try to kill -9 them but they won't go away. =3D3D20

Sysadmins can't kill the processes either. We reboot the machine, =3D3D processes
are gone. Startup the database. Run the refresh.....it 'hangs' for =
=3D3D

hours
and hours. Shutdown the database after trying to figure out what is =
=3D3D

going
on (possibly rollback from crash?...but no) and the try to restart but receive the same unable to mount error with associated processes. The =
=3D
=3D3D

other
weird thing is that the majority of datafiles in the database have not =
=3D
=3D3D

been
touched or updated by oracle in some time. =3D3D20

I don't know what to do.

I opened a tar from oracle but have received no help so far. Anyone have any ideas?

Thanks
chris



Please see the official ORACLE-L FAQ: http://www.orafaq.com

To unsubscribe send email to: oracle-l-request_at_freelists.org put 'unsubscribe' in the subject line.
--
Archives are at http://www.freelists.org/archives/oracle-l/
FAQ is at http://www.freelists.org/help/fom-serve/cache/1.html
-----------------------------------------------------------------
----------------------------------------------------------------
Please see the official ORACLE-L FAQ: http://www.orafaq.com
----------------------------------------------------------------
To unsubscribe send email to:  oracle-l-request_at_freelists.org
put 'unsubscribe' in the subject line.
--
Archives are at http://www.freelists.org/archives/oracle-l/
FAQ is at http://www.freelists.org/help/fom-serve/cache/1.html
-----------------------------------------------------------------
----------------------------------------------------------------
Please see the official ORACLE-L FAQ: http://www.orafaq.com
----------------------------------------------------------------
To unsubscribe send email to:  oracle-l-request_at_freelists.org
put 'unsubscribe' in the subject line.
--
Archives are at http://www.freelists.org/archives/oracle-l/
FAQ is at http://www.freelists.org/help/fom-serve/cache/1.html
-----------------------------------------------------------------

----------------------------------------------------------------
Please see the official ORACLE-L FAQ: http://www.orafaq.com
----------------------------------------------------------------
To unsubscribe send email to:  oracle-l-request_at_freelists.org
put 'unsubscribe' in the subject line.
--
Archives are at http://www.freelists.org/archives/oracle-l/
FAQ is at http://www.freelists.org/help/fom-serve/cache/1.html
-----------------------------------------------------------------
----------------------------------------------------------------
Please see the official ORACLE-L FAQ: http://www.orafaq.com
----------------------------------------------------------------
To unsubscribe send email to:  oracle-l-request_at_freelists.org
put 'unsubscribe' in the subject line.
--
Archives are at http://www.freelists.org/archives/oracle-l/
FAQ is at http://www.freelists.org/help/fom-serve/cache/1.html
-----------------------------------------------------------------

----------------------------------------------------------------
Please see the official ORACLE-L FAQ: http://www.orafaq.com
----------------------------------------------------------------
To unsubscribe send email to:  oracle-l-request_at_freelists.org
put 'unsubscribe' in the subject line.
--
Archives are at http://www.freelists.org/archives/oracle-l/
FAQ is at http://www.freelists.org/help/fom-serve/cache/1.html
-----------------------------------------------------------------
Received on Sun May 23 2004 - 22:47:34 CDT

Original text of this message

HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US