Server crashed. Is there any hope????? [message #452973] |
Mon, 26 April 2010 11:35 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
I apologize in advance for my ignorance. My server crashed early Sat morning. It is a RAID 5 with 6 disks (2 FAILED) and I was able to force 1 disk back on-line and reboot. Now server is up and running but oracle is down. Getting this error at OEM screen:ORA-01033: ORACLE initialization or shutdown in progress (DBD ERROR: OCISessionBegin) Same when I try to log in in SQL. Is the data gone? What do I do next? Don't know much about Oracle. Someone else installed it. I know a little about creating tables, ect. As far as I know there hasn't been any backups. It was on my list to do. I can see the .dbf files and tried to copy everything in that folder in case the disk fails again(REDO03.log failed to copy). I figure I am going to loose this disk soon so if at all possible I would like to recover the data in the tables, and the table configurations if possible. Tried to restart oracle but it doesn't like the OS user-name and password. Any Suggestions?
|
|
|
|
|
|
Re: Server crashed. Is there any hope????? [message #452979 is a reply to message #452973] |
Mon, 26 April 2010 11:48 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
RESULTS:
Microsoft Windows [Version 5.2.3790]
(C) Copyright 1985-2003 Microsoft Corp.
C:\Documents and Settings\POLCID>set
a21=C:\Program Files\AspenTech\InfoPlus.21\c21\a21
ALLUSERSPROFILE=C:\Documents and Settings\All Users
APPDATA=C:\Documents and Settings\POLCID\Application Data
ATVN=C:\Program Files\AspenTech\Role-based Visualization\Navigation\conf\
ATVNBPC=C:\Program Files\AspenTech\Role-based Visualization\Navigation\conf\
c21=C:\Program Files\AspenTech\InfoPlus.21\c21
C21BASE=C:\Program Files\AspenTech\InfoPlus.21\c21
CIM21_CONFIG=C:\Program Files\AspenTech\InfoPlus.21\c21\etc\c21_config
CIMIODEF=C:\Program Files\AspenTech\CIM-IO\etc
CIMIOROOT=C:\Program Files\AspenTech\CIM-IO\
CIMIOROOTQ=C:\PROGRA~1\ASPENT~1\CIM-IO
CLASSPATH=C:\PROGRA~1\COMMON~1\ASPENT~1\AliasingComponent.jar;C:\PROGRA~1\COMMON
~1\ASPENT~1\AtbpoUOM.jar;C:\PROGRA~1\COMMON~1\ASPENT~1\util.jar
CLIENTNAME=Console
ClusterLog=C:\WINDOWS\Cluster\cluster.log
CommonProgramFiles=C:\Program Files\Common Files
COMPRESS_SOURCE=C:\Program Files\AspenTech\InfoPlus.21\db21\group200\sql
COMPUTERNAME=ASPEN
ComSpec=C:\WINDOWS\system32\cmd.exe
e21=C:\Program Files\AspenTech\InfoPlus.21\c21\e21
FP_NO_HOST_CHECK=NO
h21=C:\Program Files\AspenTech\InfoPlus.21\c21\h21
HOMEDRIVE=C:
HOMEPATH=\Documents and Settings\POLCID
INFOPLUS21_BASE=C:\Program Files\AspenTech\InfoPlus.21
INFOPLUS21_HELP=C:\Program Files\AspenTech\IP21Admin\bin
INFOPLUS21_LICENSE=C:\Program Files\AspenTech\InfoPlus.21\db21\etc
INFOPLUS21_VERSION=10.0
k21=C:\Program Files\AspenTech\InfoPlus.21\c21\k21
LD_LIBRARY_PATH=C:\Program Files\DataDirect\ODBC32v53;D:\wwr\Oracle\BIN;
LOGONSERVER=\\ASPEN
n21=C:\Program Files\AspenTech\InfoPlus.21\c21\n21
NUMBER_OF_PROCESSORS=2
odbc21=C:\Program Files\AspenTech\InfoPlus.21\c21\odbc21
OS=Windows_NT
Path=D:\wwr\instantclient11_1;D:\wwr\Oracle\bin;C:\wwr\instantclient11_1;C:\Prog
ram Files\Rockwell Software\RSCommon;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\S
ystem32\Wbem;C:\Program Files\Common Files\AspenTech Shared\;C:\Program Files\As
penTech\AEP\EnterpriseConnect\IntegrationPacks\InfoPlus21\Adapter\Bin;C:\Program
Files\AspenTech\AEP\EnterpriseConnect\bin\;D:\wwr\PHP;D:\wwr\Oracle\BIN;C:\Prog
ram Files\DataDirect\ODBC32v53\Drivers
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH
PROCESSOR_ARCHITECTURE=x86
PROCESSOR_IDENTIFIER=x86 Family 6 Model 15 Stepping 11, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=0f0b
ProgramFiles=C:\Program Files
PROMPT=$P$G
r21=C:\Program Files\AspenTech\InfoPlus.21\c21\r21
s21=C:\Program Files\AspenTech\InfoPlus.21\c21\s21
SESSIONNAME=Console
SETCIM=C:\Program Files\AspenTech\InfoPlus.21\db21
SETCIMCODE=C:\Program Files\AspenTech\InfoPlus.21\db21\code
SETCIMCOM=C:\Program Files\AspenTech\InfoPlus.21\db21\commands
SETCIMETC=C:\Program Files\AspenTech\InfoPlus.21\db21\etc
SETCIMLINKS=C:\Program Files\AspenTech\InfoPlus.21\db21\sql\links.dat
SETCIMTEMP=C:\Program Files\AspenTech\InfoPlus.21\db21\temp
SETCIM_GROUP_NAME=group200
SystemDrive=C:
SystemRoot=C:\WINDOWS
TEMP=C:\DOCUME~1\POLCID\LOCALS~1\Temp
TMP=C:\DOCUME~1\POLCID\LOCALS~1\Temp
TNS_ADMIN=D:\wwr\instantclient11_1
USERDOMAIN=ASPEN
USERNAME=POLCID
USERPROFILE=C:\Documents and Settings\POLCID
windir=C:\WINDOWS
C:\Documents and Settings\POLCID>sqlplus
SQL*Plus: Release 11.1.0.6.0 - Production on Mon Apr 26 12:43:28 2010
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Enter user-name: / as sysdba
Connected to:
Oracle Database 11g Release 11.1.0.6.0 - Production
SQL> shutdown abort
ORACLE instance shut down.
SQL> startup
ORACLE instance started.
Total System Global Area 535662592 bytes
Fixed Size 1334380 bytes
Variable Size 339739540 bytes
Database Buffers 188743680 bytes
Redo Buffers 5844992 bytes
Database mounted.
ORA-00333: redo log read error block 19373 count 8192
SQL>
|
|
|
|
|
|
|
|
|
|
Re: Server crashed. Is there any hope????? [message #453004 is a reply to message #452973] |
Mon, 26 April 2010 13:27 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
It was a large file so I saved as old and run script from above. Here is output:
Mon Apr 26 14:23:19 2010
Shutting down instance (abort)
License high water mark = 2
USER (ospid: 4560): terminating the instance
Instance terminated by USER, pid = 4560
Mon Apr 26 14:23:20 2010
Instance shutdown complete
Mon Apr 26 14:23:20 2010
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 2
Using LOG_ARCHIVE_DEST_1 parameter default value as D:\wwr\Oracle\RDBMS
Using LOG_ARCHIVE_DEST_10 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =18
LICENSE_MAX_USERS = 0
SYS auditing is disabled
Starting up ORACLE RDBMS Version: 11.1.0.6.0.
Using parameter settings in server-side spfile D:\WWR\ORACLE\DATABASE\SPFILEWWR.ORA
System parameters with non-default values:
processes = 150
memory_target = 820M
control_files = "D:\WWR\ORACLE\ORADATA\WWR\CONTROL01.CTL"
control_files = "D:\WWR\ORACLE\ORADATA\WWR\CONTROL02.CTL"
control_files = "D:\WWR\ORACLE\ORADATA\WWR\CONTROL03.CTL"
db_block_size = 8192
compatible = "11.1.0.0.0"
db_recovery_file_dest = "D:\wwr\Oracle\flash_recovery_area"
db_recovery_file_dest_size= 2G
undo_tablespace = "UNDOTBS1"
remote_login_passwordfile= "EXCLUSIVE"
db_domain = ""
dispatchers = "(PROTOCOL=TCP) (SERVICE=wwrXDB)"
audit_file_dest = "D:\WWR\ORACLE\ADMIN\WWR\ADUMP"
audit_trail = "DB"
db_name = "wwr"
open_cursors = 300
diagnostic_dest = "D:\WWR\ORACLE"
Mon Apr 26 14:23:20 2010
PMON started with pid=2, OS id=1968
Mon Apr 26 14:23:20 2010
VKTM started with pid=3, OS id=6696 at elevated priority
VKTM running at (20)ms precision
Mon Apr 26 14:23:20 2010
DIAG started with pid=4, OS id=8032
Mon Apr 26 14:23:20 2010
DBRM started with pid=5, OS id=4512
Mon Apr 26 14:23:20 2010
PSP0 started with pid=6, OS id=6944
Mon Apr 26 14:23:20 2010
DSKM started with pid=7, OS id=1748
Mon Apr 26 14:23:20 2010
DIA0 started with pid=8, OS id=6208
Mon Apr 26 14:23:20 2010
MMAN started with pid=7, OS id=7044
Mon Apr 26 14:23:20 2010
DBW0 started with pid=9, OS id=7852
Mon Apr 26 14:23:20 2010
LGWR started with pid=10, OS id=7996
Mon Apr 26 14:23:20 2010
CKPT started with pid=11, OS id=6672
Mon Apr 26 14:23:20 2010
SMON started with pid=12, OS id=524
Mon Apr 26 14:23:20 2010
RECO started with pid=13, OS id=5240
Mon Apr 26 14:23:20 2010
MMON started with pid=14, OS id=4912
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
Mon Apr 26 14:23:20 2010
MMNL started with pid=15, OS id=408
starting up 1 shared server(s) ...
Oracle Data Guard is not available in this edition of Oracle.
ORACLE_BASE from environment = D:\wwr\Oracle
Mon Apr 26 14:23:20 2010
ALTER DATABASE MOUNT
Setting recovery target incarnation to 2
Successful mount of redo thread 1, with mount id 236681051
Database mounted in Exclusive Mode
Lost write protection disabled
Completed: ALTER DATABASE MOUNT
Mon Apr 26 14:23:27 2010
ALTER DATABASE OPEN
Beginning crash recovery of 1 threads
Started redo scan
Errors in file d:\wwr\oracle\diag\rdbms\wwr\wwr\trace\wwr_ora_4664.trc:
ORA-00333: redo log read error block 21421 count 6144
ORA-00312: online log 3 thread 1: 'D:\WWR\ORACLE\ORADATA\WWR\REDO03.LOG'
ORA-27070: async read/write failed
OSD-04016: Error queuing an asynchronous I/O request.
O/S-Error: (OS 1) Incorrect function.
Errors in file d:\wwr\oracle\diag\rdbms\wwr\wwr\trace\wwr_ora_4664.trc:
ORA-00333: redo log read error block 19373 count 8192
ORA-00312: online log 3 thread 1: 'D:\WWR\ORACLE\ORADATA\WWR\REDO03.LOG'
ORA-27070: async read/write failed
OSD-04006: ReadFile() failure, unable to read from file
O/S-Error: (OS 1) Incorrect function.
Aborting crash recovery due to error 333
Errors in file d:\wwr\oracle\diag\rdbms\wwr\wwr\trace\wwr_ora_4664.trc:
ORA-00333: redo log read error block 19373 count 8192
ORA-333 signalled during: ALTER DATABASE OPEN...
|
|
|
|
|
Re: Server crashed. Is there any hope????? [message #453020 is a reply to message #452973] |
Mon, 26 April 2010 14:30 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
Results:
SQL> select * from v$log;
GROUP# THREAD# SEQUENCE# BYTES MEMBERS ARC STATUS
---------- ---------- ---------- ---------- ---------- --- ----------------
FIRST_CHANGE# FIRST_TIM
------------- ---------
1 1 1306 52428800 1 NO INACTIVE
54407457 23-APR-10
3 1 1308 52428800 1 NO CURRENT
54495621 24-APR-10
2 1 1307 52428800 1 NO INACTIVE
54472245 23-APR-10
SQL> select a.member,b.*
2 from v$logfile a, v$log b
3 where a.group#=b.group#;
MEMBER
--------------------------------------------------------------------------------
GROUP# THREAD# SEQUENCE# BYTES MEMBERS ARC STATUS
---------- ---------- ---------- ---------- ---------- --- ----------------
FIRST_CHANGE# FIRST_TIM
------------- ---------
D:\WWR\ORACLE\ORADATA\WWR\REDO01.LOG
1 1 1306 52428800 1 NO INACTIVE
54407457 23-APR-10
D:\WWR\ORACLE\ORADATA\WWR\REDO02.LOG
2 1 1307 52428800 1 NO INACTIVE
54472245 23-APR-10
MEMBER
--------------------------------------------------------------------------------
GROUP# THREAD# SEQUENCE# BYTES MEMBERS ARC STATUS
---------- ---------- ---------- ---------- ---------- --- ----------------
FIRST_CHANGE# FIRST_TIM
------------- ---------
D:\WWR\ORACLE\ORADATA\WWR\REDO03.LOG
3 1 1308 52428800 1 NO CURRENT
54495621 24-APR-10
SQL>
|
|
|
|
Re: Server crashed. Is there any hope????? [message #453023 is a reply to message #452973] |
Mon, 26 April 2010 14:36 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
Result:
SQL> alter database clear logfile group 3;
alter database clear logfile group 3
*
ERROR at line 1:
ORA-01624: log 3 needed for crash recovery of instance wwr (thread 1)
ORA-00312: online log 3 thread 1: 'D:\WWR\ORACLE\ORADATA\WWR\REDO03.LOG'
|
|
|
|
Re: Server crashed. Is there any hope????? [message #453025 is a reply to message #452973] |
Mon, 26 April 2010 14:42 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
Same thing:
SQL> shutdown abort;
ORACLE instance shut down.
SQL> startup mount;
ORACLE instance started.
Total System Global Area 535662592 bytes
Fixed Size 1334380 bytes
Variable Size 339739540 bytes
Database Buffers 188743680 bytes
Redo Buffers 5844992 bytes
Database mounted.
SQL> alter database clear logfile group 3;
alter database clear logfile group 3
*
ERROR at line 1:
ORA-01624: log 3 needed for crash recovery of instance wwr (thread 1)
ORA-00312: online log 3 thread 1: 'D:\WWR\ORACLE\ORADATA\WWR\REDO03.LOG'
|
|
|
|
|
Re: Server crashed. Is there any hope????? [message #453029 is a reply to message #452973] |
Mon, 26 April 2010 15:03 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
SQL> recover database until cancel;
ORA-00279: change 54495621 generated at 04/24/2010 01:00:09 needed for thread 1
ORA-00289: suggestion :
D:\WWR\ORACLE\FLASH_RECOVERY_AREA\WWR\ARCHIVELOG\2010_04_26\O1_MF_1_1308_%U_.ARC
ORA-00280: change 54495621 for thread 1 is in sequence #1308
Specify log: {<RET>=suggested | filename | AUTO | CANCEL}
ORA-00308: cannot open archived log
'D:\WWR\ORACLE\FLASH_RECOVERY_AREA\WWR\ARCHIVELOG\2010_04_26\O1_MF_1_1308_%U_.AR
C'
ORA-27041: unable to open file
OSD-04002: unable to open file
O/S-Error: (OS 2) The system cannot find the file specified.
ORA-01547: warning: RECOVER succeeded but OPEN RESETLOGS would get error below
ORA-01194: file 1 needs more recovery to be consistent
ORA-01110: data file 1: 'D:\WWR\ORACLE\ORADATA\WWR\SYSTEM01.DBF'
|
|
|
|
|
|
Re: Server crashed. Is there any hope????? [message #453038 is a reply to message #452973] |
Mon, 26 April 2010 15:58 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
sorry for the delay, trying to get oracle support.
Result:
SQL> alter database open resetlogs;
alter database open resetlogs
*
ERROR at line 1:
ORA-01194: file 1 needs more recovery to be consistent
ORA-01110: data file 1: 'D:\WWR\ORACLE\ORADATA\WWR\SYSTEM01.DBF'
I hit enter when it asked.
Specify log: {<RET>=suggested | filename | AUTO | CANCEL}
|
|
|
|
Re: Server crashed. Is there any hope????? [message #453040 is a reply to message #452973] |
Mon, 26 April 2010 16:05 |
jwm81274
Messages: 14 Registered: April 2010 Location: Newberry, Fl. USA
|
Junior Member |
|
|
do I need to type cancel or cancel; then <return>?
This is cancel <return>
result:
SQL> recover database until cancel;
ORA-00279: change 54495621 generated at 04/24/2010 01:00:09 needed for thread 1
ORA-00289: suggestion :
D:\WWR\ORACLE\FLASH_RECOVERY_AREA\WWR\ARCHIVELOG\2010_04_26\O1_MF_1_1308_%U_.ARC
ORA-00280: change 54495621 for thread 1 is in sequence #1308
Specify log: {<RET>=suggested | filename | AUTO | CANCEL}
cancel
ORA-01547: warning: RECOVER succeeded but OPEN RESETLOGS would get error below
ORA-01194: file 1 needs more recovery to be consistent
ORA-01110: data file 1: 'D:\WWR\ORACLE\ORADATA\WWR\SYSTEM01.DBF'
ORA-01112: media recovery not started
|
|
|
|