Oracle-L: RE: Prod problem, please help!!!

From: Arun Chakrapani <ArunC_at_1800FLOWERS.com>
Date: Tue, 30 Apr 2002 12:18:35 -0800
Message-ID: <F001.0045413E.20020430121835@fatcity.com>

If nothing works and when u know the database has frozen u can run the following command
to take dump of the database so that u can send it to oracle for analyzing or u can analyze it too.
As jared says keep querying the session_Wait u will defnetly bound to catch the guy who might be causing the database to kneel down. Are u flushing shared pool quite frequently. check this out(this was one of the cause which was bringing the database down and was fixed in 7.2 or 7.3 i think.
Best bet is to keep querying the session_wait and catch the event which is causing the probs.
IF YOU HAVE 9I OEM CLIENT INSTALLED USE THE RECORDING THRO PERFORMANCE MANAGER WHICH WILL LET U KNOW LATER ON WHAT HAPPENED. Please do check with the other DBA'S in this group before running of what i say

Do systemstate dump 3 times in a row.

$ svrmgrl

      connect internal
      oradebug setmypid(process_id)
      oradebug unlimit
      oradebug dump systemstate 10 or
	oradebug dump errorstack 3

-----Original Message-----
Sent: Tuesday, April 30, 2002 3:39 PM
To: Multiple recipients of list ORACLE-L

Tracy,

You can start by using the query below to determine what the sessions are actually waiting on:

select

   s.username username,
   e.event event,
   s.sid,
   e.p1text,
   e.p1,
   e.p2text,
   e.p2,
   e.wait_time,
   e.seconds_in_wait,
   e.state

from v$session s, v$session_wait e
where s.username is not null

and s.sid = e.sid

skip sqlnet idle session messages and e.event not like '%message%client' order by s.username, upper(e.event);

Jared

"Tracy Rahmlow" <tracy.rahmlow_at_aexp.com> Sent by: root_at_fatcity.com
04/30/2002 12:21 PM
Please respond to ORACLE-L

        To:     Multiple recipients of list ORACLE-L <ORACLE-L_at_fatcity.com>
        cc: 
        Subject:        Prod problem, please help!!!

I have opened a TAR with Oracle and am waiting a resolution. In the meantime,
I am wondering if anybody else has any ideas while I wait.

Specifics:

   IBM AIX 4.3
   Rdms 8.1.7.3
   Database ~75g
   OLTP database with approximately 500 dedicated connections and 500 shared connections with Oracle's MTS.

Problem:
The database hangs, and no user is able to connect to the instance, except locally through srvmgrl. Even within svrmgrl, we are unable to select anything from
the
database without the query hanging. However, we can abort the instance (shutdown abort) and start it up again just fine. This has happened on 4-22, 4-29 &
4-30 in the
early afternoon. Usually, this is also our peak busy rate for the week. We are executing MTS for 4 applications, all other applications connect through
dedicated server.
The alert log contains a message unable to start a shared server process. This week it was #41 and last week it was #25. Normally, we do not exceed 5 shared
servers. Another thing I noticed is that there is no time allocated to any of the newly created shared servers. It is as if, it can not process any work
through existing shared
servers and decides to allocate another one, until finally it freezes. I am not sure if this is a MTS problem because I would suspect that I should be able
to establish
a dedicated server connection. And I can not. I think that this is just a symptom of the underlying problem. It would appear to me that we are running out
of a resource,
however our sysadms do not see any resource problems. Does anybody have any ideas how to debug this? Thanks

--

Please see the official ORACLE-L FAQ: http://www.orafaq.com
--

Author: Tracy Rahmlow
INET: tracy.rahmlow_at_aexp.com

Fat City Network Services    -- (858) 538-5051  FAX: (858) 538-5051
San Diego, California        -- Public Internet access / Mailing Lists
--------------------------------------------------------------------

To REMOVE yourself from this mailing list, send an E-Mail message to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).

--

Please see the official ORACLE-L FAQ: http://www.orafaq.com
--

Author:
INET: Jared.Still_at_radisys.com

Fat City Network Services    -- (858) 538-5051  FAX: (858) 538-5051
San Diego, California        -- Public Internet access / Mailing Lists
--------------------------------------------------------------------

Fat City Network Services    -- (858) 538-5051  FAX: (858) 538-5051
San Diego, California        -- Public Internet access / Mailing Lists
--------------------------------------------------------------------