ORA-03113: end-of-file on communication channel (merged) [message #418421] |
Sat, 15 August 2009 00:09 |
saifurshaon
Messages: 29 Registered: December 2007 Location: Dhaka
|
Junior Member |
|
|
Dear Friends,
Facing a problem couple of days but havn't reached to any solution.
Try all the possible way found in net. Like
http://www.idevelopment.info/data/Oracle/DBA_tips/Linux/LINUX_4.shtml
http://dbaspot.com/ora-03113-end-of-file-on-communication-channel.html
etc.
When I tried to startup the database which is in idle instance this error shows every time. I have tried with identifying pfile but the result is same.
SQL*Plus: Release 9.2.0.7.0 - Production on Sat Aug 15 11:56:34 2009
Copyright (c) 1982, 2002, Oracle Corporation. All rights reserved.
Connected to an idle instance.
SQL> startup
ORA-03113: end-of-file on communication channel
The last few lines of my alertlog is like below
tail -100 alert_EBISARC.log |more
user_dump_dest = /oradata2/EBISARC/admin/udump
core_dump_dest = /oradata2/EBISARC/admin/cdump
sort_area_size = 524288
db_name = EBISARC
open_cursors = 300
star_transformation_enabled= FALSE
query_rewrite_enabled = FALSE
pga_aggregate_target = 25165824
PMON started with pid=2
DBW0 started with pid=3
LGWR started with pid=4
CKPT started with pid=5
SMON started with pid=6
RECO started with pid=7
Tue Aug 4 16:01:35 2009
ALTER DATABASE MOUNT
Tue Aug 4 16:01:39 2009
Successful mount of redo thread 1, with mount id 2515093407
Tue Aug 4 16:01:39 2009
Database mounted in Exclusive Mode.
Completed: ALTER DATABASE MOUNT
Tue Aug 4 16:01:39 2009
ALTER DATABASE OPEN
Tue Aug 4 16:01:39 2009
Thread 1 opened at log sequence 7
Current log# 1 seq# 7 mem# 0: /oradata2/EBISARC/oradata/REDO/redo01.log
Successful open of redo thread 1
Tue Aug 4 16:01:39 2009
SMON: enabling cache recovery
Tue Aug 4 16:01:40 2009
Successfully onlined Undo Tablespace 1.
Tue Aug 4 16:01:40 2009
SMON: enabling tx recovery
Tue Aug 4 16:01:40 2009
Database Characterset is WE8ISO8859P1
.........
Tue Aug 11 18:25:33 2009
Shutting down instance: further logons disabled
Shutting down instance (immediate)
License high water mark = 3
Tue Aug 11 18:25:34 2009
ALTER DATABASE CLOSE NORMAL
Tue Aug 11 18:25:35 2009
SMON: disabling tx recovery
SMON: disabling cache recovery
Tue Aug 11 18:25:35 2009
Shutting down archive processes
Archiving is disabled
Archive process shutdown avoided: 0 active
Thread 1 closed at log sequence 7
Successful close of redo thread 1
Tue Aug 11 18:25:35 2009
Completed: ALTER DATABASE CLOSE NORMAL
Tue Aug 11 18:25:35 2009
ALTER DATABASE DISMOUNT
Completed: ALTER DATABASE DISMOUNT
ARCH: Archiving is disabled
Shutting down archive processes
Archiving is disabled
Archive process shutdown avoided: 0 active
ARCH: Archiving is disabled
Shutting down archive processes
Archiving is disabled
Archive process shutdown avoided: 0 active
I need your precious suggestion to overcome this sort of problem.
Thanks in advance.
|
|
|
|
|
|
Re: ORA-03113: end-of-file on communication channel [message #418430 is a reply to message #418421] |
Sat, 15 August 2009 03:16 |
saifurshaon
Messages: 29 Registered: December 2007 Location: Dhaka
|
Junior Member |
|
|
The database was up till 11th aug. At 12th it shows the ora-03113 error. the OS has been rebooted in 12th Aug but still the problem persists.
In udump the latest trace file generated in 4th Aug contains the below information
Oracle9i Enterprise Edition Release 9.2.0.7.0 - Production
With the Partitioning, OLAP and Oracle Data Mining options
JServer Release 9.2.0.7.0 - Production
ORACLE_HOME = /oradata1/app/oracle/product/9.2.0
System name: Linux
Node name: ebis1.tmib.net.bd
Release: 2.4.21-40.ELsmp
Version: #1 SMP Thu Feb 2 22:22:39 EST 2006
Machine: i686
Instance name: EBISARC
Redo thread mounted by this instance: 1
Oracle process number: 8
Unix process pid: 29946, image: oracle@ebis1.tmib.net.bd (TNS V1-V3)
*** SESSION ID:(7.3) 2009-08-04 09:18:27.218
Thread checkpoint rba:0x000006.0000f446.0010 scn:0x02c4.44e3ab56
On-disk rba:0x000006.00018b37.0000 scn:0x02c4.6aa0d545
Use incremental checkpoint cache-low RBA
Thread 1 recovery from rba:0x000006.00018b2f.0000 scn:0x0000.00000000
----- Redo read statistics for thread 1 -----
Read rate (ASYNC): 4Kb in 0.20s => 0.00 Mb/sec
Longest record: 0Kb, moves: 0/9 (0%)
Change moves: 0/1 (0%), moved: 0Mb
----------------------------------------------
----- Recovery Hash Table Statistics ---------
Hash table buckets = 32768
Longest hash chain = 1
Average hash chain = 7/7 = 1.0
Max compares per lookup = 1
Avg compares per lookup = 9/20 = 0.5
----------------------------------------------
*** 2009-08-04 09:18:27.509
KCRA: start recovery claims for 7 data blocks
*** 2009-08-04 09:18:27.533
KCRA: buffers claimed = 7/7, eliminated = 0
*** 2009-08-04 09:18:27.533
Recovery of Online Redo Log: Thread 1 Group 3 Seq 6 Reading mem 0
----- Recovery Hash Table Statistics ---------
Hash table buckets = 32768
Longest hash chain = 1
Average hash chain = 7/7 = 1.0
Max compares per lookup = 1
Avg compares per lookup = 16/16 = 1.0
----------------------------------------------
From this si any clue found?
|
|
|
|
Re: ORA-03113: end-of-file on communication channel [message #418470 is a reply to message #418421] |
Sat, 15 August 2009 21:14 |
saifurshaon
Messages: 29 Registered: December 2007 Location: Dhaka
|
Junior Member |
|
|
@BlackSwan,
Please go through the alert log as there are some entries for 11th Aug there. Particularly which parameter you wanted to see from env.
The output of your query
SQL*Plus: Release 9.2.0.7.0 - Production on Sun Aug 16 09:08:16 2009
Copyright (c) 1982, 2002, Oracle Corporation. All rights reserved.
Connected to an idle instance.
SQL> shutdown abort
ORACLE instance shut down.
SQL> startup
ORA-03113: end-of-file on communication channel
|
|
|
|
Re: ORA-03113: end-of-file on communication channel [message #418474 is a reply to message #418421] |
Sun, 16 August 2009 00:27 |
saifurshaon
Messages: 29 Registered: December 2007 Location: Dhaka
|
Junior Member |
|
|
Hi BlackSwan, for your suggestion find your query
$ env|sort
_=/bin/env
CLASSPATH=/oradata1/app/oracle/product/9.2.0/JRE:/oradata1/app/oracle/product/9.2.0/jlib:/oradata1/app/oracle/product/9.2.0/rdbms/jlib:/oradata1/app/oracle/product/9.2.0/network/jlib
G_BROKEN_FILENAMES=1
HISTSIZE=1000
HOME=/home/oracle
INPUTRC=/etc/inputrc
LAMHELPFILE=/etc/lam/lam-helpfile
LANG=en_US.UTF-8
LD_ASSUME_KERNEL=2.4.1
LD_LIBRARY_PATH=/oradata1/app/oracle/product/9.2.0/lib:/lib:/usr/lib:/usr/local/lib
LESSOPEN=|/usr/bin/lesspipe.sh %s
LOGNAME=oracle
LS_COLORS=no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=01;32:*.cmd=01;
32:*.exe=01;32:*.com=01;32:*.btm=01;32:*.bat=01;32:*.sh=01;32:*.csh=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;
31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tz=01;31:*.rpm=01;31:*.cpio=01;31:*.jpg=01;35:*.gif=01;
35:*.bmp=01;35:*.xbm=01;35:*.xpm=01;35:*.png=01;35:*.tif=01;35:
MAIL=/var/spool/mail/oracle
NLS_LANG=AMERICAN
OLDPWD=/oradata2/EBISARC/admin/cdump
ORACLE_BASE=/oradata1/app/oracle
ORACLE_HOME=/oradata1/app/oracle/product/9.2.0
ORACLE_SID=EBISARC
ORACLE_TERM=xterm
ORA_NLS33=/oradata1/app/oracle/product/9.2.0/ocommon/nls/admin/data
PATH=/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/home/oracle/bin:/oradata1/app/oracle/product/9.2.0/bin
PWD=/oradata2/EBISARC/admin/udump
QTDIR=/usr/lib/qt-3.1
SHELL=/bin/bash
SHLVL=1
SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
SSH_TTY=/dev/pts/2
TERM=vt100
USER=oracle
[Updated on: Mon, 17 August 2009 00:44] by Moderator Report message to a moderator
|
|
|
|
Re: ORA-03113: end-of-file on communication channel [message #418512 is a reply to message #418421] |
Sun, 16 August 2009 21:14 |
saifurshaon
Messages: 29 Registered: December 2007 Location: Dhaka
|
Junior Member |
|
|
$ ls -lart /oradata2/EBISARC/admin/udump | tail -40
total 116
drwxr-xr-x 6 oracle oinstall 4096 Jun 4 2008 ..
-rw-r----- 1 oracle oinstall 984 Jun 4 2008 ebisarc_ora_16052.trc
-rw-r----- 1 oracle oinstall 943 Jul 23 2008 ebisarc_ora_30005.trc
-rw-r----- 1 oracle oinstall 20616 Sep 30 2008 ebisarc_ora_17087.trc
-rw-r----- 1 oracle oinstall 23388 Dec 15 2008 ebisarc_ora_30074.trc
-rw-r----- 1 oracle oinstall 1755 Mar 26 13:39 ebisarc_ora_29568.trc
-rw-r----- 1 oracle oinstall 661 Apr 22 16:27 ebisarc_ora_9021.trc
-rw-r----- 1 oracle oinstall 1329 May 7 13:56 ebisarc_ora_12126.trc
-rw-r----- 1 oracle oinstall 1329 May 7 13:56 ebisarc_ora_14345.trc
-rw-r----- 1 oracle oinstall 27599 May 7 14:07 ebisarc_ora_14666.trc
-rw-r----- 1 oracle oinstall 989 Aug 3 19:14 ebisarc_ora_16557.trc
-rw-r----- 1 oracle oinstall 1756 Aug 4 09:18 ebisarc_ora_29946.trc
$ ls -lart /oradata2/EBISARC/admin/bdump | tail -40
total 8848
drwxr-xr-x 6 oracle oinstall 4096 Jun 4 2008 ..
-rw-r----- 1 oracle oinstall 636 Jun 4 2008 ebisarc_lgwr_16045.trc
-rw-r----- 1 oracle oinstall 636 Jul 24 2008 ebisarc_lgwr_16127.trc
-rw-r----- 1 oracle oinstall 664 Sep 28 2008 ebisarc_lgwr_18235.trc
-rw-r----- 1 oracle oinstall 19508 Sep 29 2008 ebisarc_dbw0_25616.trc
-rw-r----- 1 oracle oinstall 664 Sep 29 2008 ebisarc_lgwr_25618.trc
-rw-r----- 1 oracle oinstall 10076 Sep 30 2008 ebisarc_dbw0_21193.trc
-rw-r----- 1 oracle oinstall 664 Sep 30 2008 ebisarc_lgwr_21195.trc
-rw-r----- 1 oracle oinstall 64440 Sep 30 2008 ebisarc_dbw0_16907.trc
-rw-r----- 1 oracle oinstall 636 Oct 8 2008 ebisarc_lgwr_16909.trc
-rw-r----- 1 oracle oinstall 636 Oct 12 2008 ebisarc_lgwr_26527.trc
-rw-r----- 1 oracle oinstall 636 Nov 11 2008 ebisarc_lgwr_26456.trc
-rw-r----- 1 oracle oinstall 636 Dec 28 2008 ebisarc_lgwr_28027.trc
-rw-r----- 1 oracle oinstall 636 Jan 13 2009 ebisarc_lgwr_29019.trc
-rw-r----- 1 oracle oinstall 636 Jan 28 2009 ebisarc_lgwr_25379.trc
-rw-r----- 1 oracle oinstall 636 Mar 26 13:40 ebisarc_lgwr_29558.trc
-rw-r----- 1 oracle oinstall 11054 Apr 22 16:30 ebisarc_lgwr_2134.trc
-rw-r----- 1 oracle oinstall 3815114 Apr 25 00:42 ebisarc_smon_2138.trc
-rw-r----- 1 oracle oinstall 25789 May 7 12:30 ebisarc_dbw0_10108.trc
-rw-r----- 1 oracle oinstall 664 May 7 12:38 ebisarc_lgwr_10110.trc
-rw-r----- 1 oracle oinstall 52969 May 7 14:01 ebisarc_dbw0_12117.trc
-rw-r----- 1 oracle oinstall 636 May 7 14:07 ebisarc_lgwr_12119.trc
-rw-r----- 1 oracle oinstall 636 May 13 19:31 ebisarc_lgwr_14682.trc
-rw-r----- 1 oracle oinstall 636 May 16 02:20 ebisarc_lgwr_29275.trc
-rw-r----- 1 oracle oinstall 636 Jun 19 23:00 ebisarc_lgwr_31633.trc
-rw-r----- 1 oracle oinstall 636 Aug 4 09:26 ebisarc_lgwr_29938.trc
-rw-r----- 1 oracle oinstall 634 Aug 11 18:25 ebisarc_lgwr_5861.trc
drwxr-xr-x 2 oracle oinstall 4096 Aug 11 18:25 .
-rw-r--r-- 1 oracle oinstall 4939319 Aug 11 18:25 alert_EBISARC.log
|
|
|
|
Re: ORA-03113: end-of-file on communication channel [message #418523 is a reply to message #418421] |
Mon, 17 August 2009 00:38 |
saifurshaon
Messages: 29 Registered: December 2007 Location: Dhaka
|
Junior Member |
|
|
Its very amazing that two alert logs persist in my database.
575179 8 -rw-r--r-- 1 oracle oinstall 6079 Aug 16 15:10 /oradata1/app/oracle/product/9.2.0/rdbms/log/alert_EBISARC.log
98306 4836 -rw-r--r-- 1 oracle oinstall 4939319 Aug 11 18:25 /oradata2/EBISARC/admin/bdump/alert_EBISARC.log
Here I have attached the last 100 lines of above alert log
]$ tail -300 /oradata1/app/oracle/product/9.2.0/rdbms/log/alert_EBISARC.log|more
Tue Aug 11 18:25:42 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_14438.trc:
ORA-07445: exception encountered: core dump [skgfrvldtrq()+72] [SIGSEGV] [Address not mapped to object] [0xBF5FFFE4] [] []
Tue Aug 11 18:49:57 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15164.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFDEC] [] []
Tue Aug 11 18:50:50 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15228.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFD8C] [] []
Tue Aug 11 18:51:56 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15284.trc:
ORA-07445: exception encountered: core dump [_IO_vfprintf_internal()+39] [SIGSEGV] [Address not mapped to object] [0xBF5FFFD8] [] []
Tue Aug 11 18:59:15 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15463.trc:
ORA-07445: exception encountered: core dump [slnrm()+39] [SIGSEGV] [Address not mapped to object] [0xBF5FFED8] [] []
Tue Aug 11 19:02:23 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15607.trc:
ORA-07445: exception encountered: core dump [slnrm()+39] [SIGSEGV] [Address not mapped to object] [0xBF5FFEA8] [] []
Tue Aug 11 19:10:16 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15652.trc:
ORA-07445: exception encountered: core dump [ksfd_allfib()+398] [SIGSEGV] [Address not mapped to object] [0x108] [] []
Wed Aug 12 15:06:32 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15408.trc:
ORA-07445: exception encountered: core dump [sslpathi()+42] [SIGSEGV] [Address not mapped to object] [0xBF5FFE7C] [] []
Wed Aug 12 15:07:54 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15426.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFE5C] [] []
Wed Aug 12 15:14:05 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_15597.trc:
ORA-07445: exception encountered: core dump [sslpathi()+42] [SIGSEGV] [Address not mapped to object] [0xBF5FFFA0] [] []
Wed Aug 12 15:31:13 2009
Shutting down instance (abort)
Wed Aug 12 15:33:12 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_16121.trc:
ORA-07445: exception encountered: core dump [slnrm()+39] [SIGSEGV] [Address not mapped to object] [0xBF5FFE98] [] []
Wed Aug 12 15:46:40 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_16626.trc:
ORA-07445: exception encountered: core dump [skgfqio()+39] [SIGSEGV] [Address not mapped to object] [0xBF5FFFC4] [] []
Wed Aug 12 16:10:08 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_17417.trc:
ORA-07445: exception encountered: core dump [_IO_vfprintf_internal()+27] [SIGSEGV] [Address not mapped to object] [0xBF5FFF94] [] []
Wed Aug 12 17:28:44 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_19972.trc:
ORA-07445: exception encountered: core dump [sslpathi()+42] [SIGSEGV] [Address not mapped to object] [0xBF5FFFFC] [] []
Wed Aug 12 17:33:21 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_20117.trc:
ORA-07445: exception encountered: core dump [sltln()+6] [SIGSEGV] [Address not mapped to object] [0xBF5FFFD4] [] []
Wed Aug 12 17:50:19 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_29251.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFF9C] [] []
Wed Aug 12 17:51:20 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_29300.trc:
ORA-07445: exception encountered: core dump [__GI___errno_location()+4] [SIGSEGV] [Address not mapped to object] [0xBF5FFFFC] [] []
Wed Aug 12 19:10:05 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_31875.trc:
ORA-07445: exception encountered: core dump [sslpathi()+42] [SIGSEGV] [Address not mapped to object] [0xBF5FFFBC] [] []
Thu Aug 13 20:50:22 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_13249.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFE6C] [] []
Sat Aug 15 11:01:39 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_11274.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFF9C] [] []
Sat Aug 15 11:10:59 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_11608.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFE5C] [] []
Sat Aug 15 11:14:25 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_11735.trc:
ORA-07445: exception encountered: core dump [slnrm()+39] [SIGSEGV] [Address not mapped to object] [0xBF5FFECC] [] []
Sat Aug 15 11:24:10 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_12088.trc:
ORA-07445: exception encountered: core dump [_IO_vfprintf_internal()+27] [SIGSEGV] [Address not mapped to object] [0xBF5FFF94] [] []
Sat Aug 15 11:56:40 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_13101.trc:
ORA-07445: exception encountered: core dump [skgfifi()+44] [SIGSEGV] [Address not mapped to object] [0xBF5FFECC] [] []
Sun Aug 16 09:08:23 2009
Shutting down instance (abort)
Sun Aug 16 09:08:36 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_5215.trc:
ORA-07445: exception encountered: core dump [sslpath()+42] [SIGSEGV] [Address not mapped to object] [0xBF5FFFFC] [] []
Sun Aug 16 15:10:02 2009
Errors in file /oradata1/app/oracle/product/9.2.0/rdbms/log/ebisarc_ora_16304.trc:
ORA-07445: exception encountered: core dump [_IO_vfprintf_internal()+39] [SIGSEGV] [Address not mapped to object] [0xBF5FFE98] [] []
|
|
|
|
|
|