Home » RDBMS Server » Server Administration » Few Cluster services are down.Why (ORACLE 11.2.0.1 RAC of two nodes on solaris 10 platform)
Few Cluster services are down.Why [message #563020] |
Tue, 07 August 2012 22:54 |
janakors
Messages: 232 Registered: September 2009
|
Senior Member |
|
|
hi,
on 6th of August at 02:36 our following cluster services were down,i see the logs and found that ASM is down and disk group are not accessible and ASMb process is terminated and both instances was restarted, i checked the cluster services so five services were down and these areQuote:ora_OCR_DG.DG, ora_fedb96.asm2.asm, ora_fedb96.gsd, ora_fedb96.ons and ora_fedb96.oc4j
i restarted the services and they were successfully up and application become available . What can be the reason of the service failure? following is the alert log and crs.log, so kindly someone can help me out why this happened?
alert.log
ORA-03113: end-of-file on communication channel
Process ID:
Session ID: 157 Serial number: 6655
ASMB (ospid: 23903): terminating the instance due to error 15064
Mon Aug 06 02:36:38 2012
NOTE: Deferred communication with ASM instance
Errors in file /u01/app/oracle/diag/rdbms/grid12/grid91/trace/grid91_ora_25856.trc:
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
NOTE: deferred map free for map id 713881
Mon Aug 06 02:36:38 2012
System state dump is made for local instance
System State dumped to trace file /u01/app/oracle/diag/rdbms/grid12/grid91/trace/grid91_diag_23704.trc
Mon Aug 06 02:36:40 2012
ORA-1092 : opitsk aborting process
Mon Aug 06 02:36:40 2012
ORA-1092 : opitsk aborting process
Mon Aug 06 02:36:41 2012
License high water mark = 182
Mon Aug 06 02:36:42 2012
ORA-1092 : opitsk aborting process
Instance terminated by ASMB, pid = 23903
USER (ospid: 26655): terminating the instance
Instance terminated by USER, pid = 26655
Mon Aug 06 02:37:48 2012
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 nxge7 192.x.x.x configured from GPnP Profile for use as a cluster interconnect
Interface type 1 bge0 10.x.x.x configured from GPnP Profile for use as a public interface
Picked latch-free SCN scheme 3
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
Starting up:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options.
Using parameter settings in server-side pfile /u01/app/oracle/product/11.2.0/dbhome/dbs/initgrid91.ora
System parameters with non-default values:
processes = 1500
sessions = 2272
spfile = "+SG1/grid12/spfilegrid12.ora"
memory_target = 15G
control_files = "+SG1/grid12/control01.ctl"
control_files = "+DG1/grid12/control02.ctl"
db_block_size = 8192
compatible = "11.2.0.0.0"
log_archive_dest_1 = "LOCATION=+FG1"
log_archive_format = "%t_%s_%r.dbf"
cluster_database = TRUE
db_recovery_file_dest = "+FG1"
db_recovery_file_dest_size= 10G
thread = 1
undo_tablespace = "UNDOTBS1"
undo_retention = 160000
instance_number = 1
remote_login_passwordfile= "EXCLUSIVE"
db_domain = "xx.x"
dispatchers = "(PROTOCOL=TCP) (SERVICE=grid91DB)"
remote_listener = "grid12-scan.XXX.XX:1521"
audit_file_dest = "/u01/app/oracle/admin/grid12/adump"
audit_trail = "DB"
db_name = "grid12"
open_cursors = 3000
diagnostic_dest = "/u01/app/oracle"
Cluster communication is configured to use the following interface(s) for this instance
192.x.x.x
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
Mon Aug 06 02:37:51 2012
crs.log
2012-08-06 02:36:13.274: [UiServer][65] S(104e70f10): set Properties ( oracle,104f18790)
2012-08-06 02:36:13.284: [UiServer][64] processMessage called
2012-08-06 02:36:13.284: [UiServer][64] Sending message to PE. ctx= 1026bcf90
2012-08-06 02:36:13.285: [ CRSPE][62] Processing PE command id=422041. Description: [Stat Resource : 1055c66d0]
2012-08-06 02:36:13.287: [ CRSPE][62] PE Command [ Stat Resource : 1055c66d0 ] has completed
2012-08-06 02:36:13.287: [ CRSPE][62] UI Command [Stat Resource : 1055c66d0] is replying to sender.
2012-08-06 02:36:13.289: [UiServer][64] Done for ctx=1026bcf90
2012-08-06 02:36:13.306: [UiServer][65] S(104e70f10): set Properties ( oracle,104f18e50)
2012-08-06 02:36:13.316: [UiServer][64] processMessage called
2012-08-06 02:36:13.316: [UiServer][64] Container [ Name: UI_CHECK
CLIENT:
TextMessage[]
DELAY_SECS:
TextMessage[0]
HOST:
TextMessage[fedb96]
HOST_TAG:
TextMessage[1]
LOCALE:
TextMessage[AMERICAN_AMERICA.WE8ISO8859P1]
RESOURCE:
TextMessage[ora.asm]
]
2012-08-06 02:36:13.316: [UiServer][64] Sending message to PE. ctx= 10338d0d0
2012-08-06 02:36:13.317: [ CRSPE][62] Cmd : 1055c66d0 : flags: HOST_TAG
2012-08-06 02:36:13.345: [ CRSPE][62] Processing PE command id=422042. Description: [Check Resource : 1055c66d0]
2012-08-06 02:36:13.375: [ CRSPE][62] PE Command [ Check Resource : 1055c66d0 ] has completed
2012-08-06 02:36:13.375: [ CRSPE][62] UI Command [Check Resource : 1055c66d0] is replying to sender.
2012-08-06 02:36:13.376: [UiServer][64] Container [ Name: UI_DATA
ora.asm:
TextMessage[0]
]
2012-08-06 02:36:13.376: [UiServer][64] Done for ctx=10338d0d0
2012-08-06 02:36:13.380: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985347
2012-08-06 02:36:13.380: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985347 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.474: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914490
2012-08-06 02:36:13.480: [ AGFW][57] Received state change for ora.grid12.db 2 1 [old state = ONLINE, new state = FAILED]
2012-08-06 02:36:13.480: [ AGFW][57] Received state LABEL change for ora.grid12.db 2 1 [old label = Open, new label = Abnormal Termination]
2012-08-06 02:36:13.481: [ AGFW][57] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Inval
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985352]
2012-08-06 02:36:13.481: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914490
2012-08-06 02:36:13.481: [ CRSPE][62] State change received from fedb96 for ora.grid12.db 2 1
2012-08-06 02:36:13.492: [ CRSPE][62] Processing PE command id=422043. Description: [Resource State Change (ora.grid12.db 2 1) : 1055c66d0]
2012-08-06 02:36:13.493: [ CRSPE][62] RI [ora.grid12.db 2 1] new external state [UNKNOWN] old value: [ONLINE] on fedb96 label = [Abnormal Termination] over
ride:OFFLINE
2012-08-06 02:36:13.493: [ CRSPE][62] Set State Details to [Abnormal Termination] from [ Open] for [ora.grid12.db 2 1]
2012-08-06 02:36:13.499: [ CRSPE][62] Resource Resource Instance ID[ora.grid12.db 2 1]. Values:
STATE=UNKNOWN
TARGET=ONLINE
LAST_SERVER=fedb96
CURRENT_RCOUNT=0
LAST_RESTART=1322930156
FAILURE_COUNT=0
FAILURE_HISTORY=
STATE_DETAILS=Abnormal Termination
INCARNATION=3
STATE_CHANGE_VERS=5
LAST_FAULT=0
DEGREE_ID=1
ID=ora.grid12.db 2 1
CARDINALITY_ID=2
Lock Info:
Write Locks:none
ReadLocks:External state override: OFFLINE|STATE INITED||INITIAL CHECK DONE| has failed!
2012-08-06 02:36:13.511: [ CRSPE][62] Processing unplanned state change for [ora.grid12.db 2 1]
2012-08-06 02:36:13.512: [ CRSPE][62] ora.grid12.db 2 1: uptime exceeds uptime threshold , resetting restart count
2012-08-06 02:36:13.516: [ CRSRPT][63] Publishing event: Cluster Resource State Change Event for ora.grid12.db:fedb96 : 104d5c310
2012-08-06 02:36:13.516: [ CRSRPT][63] Publish to eons buffered event : 104d5c310
2012-08-06 02:36:13.533: [ CRSPE][62] Local Recovery picked for [ora.grid12.db 2 1]
2012-08-06 02:36:13.545: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.oas_srv.domain.xx.svc 2 1] ID 4097:10985356
2012-08-06 02:36:13.545: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.oas_srv.domain.xx.svc 2 1] ID 4097:10985356 to the a
gent /u01/app/11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.551: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914502
2012-08-06 02:36:13.551: [ AGFW][57] Received state change for ora.grid12.oas_srv.domain.xx.svc 2 1 [old state = ONLINE, new state = OFFLINE]
2012-08-06 02:36:13.552: [ AGFW][57] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Inval
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985361]
2012-08-06 02:36:13.552: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914502
2012-08-06 02:36:13.607: [ CRSPE][62] Sending message to agfw: id = 10985363
--More--
2012-08-06 02:36:13.607: [ CRSPE][62] Sending message to agfw: id = 10985363
2012-08-06 02:36:13.607: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_CLEAN[ora.grid12.db 2 1] ID 4100:10985363
2012-08-06 02:36:13.607: [ CRSPE][62] CRS-2679: Attempting to clean 'ora.grid12.db' on 'fedb96'
2012-08-06 02:36:13.608: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_CLEAN[ora.grid12.db 2 1] ID 4100:10985363 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.608: [ CRSPE][62] State change received from fedb96 for ora.grid12.oas_srv.domain.xx.svc 2 1
2012-08-06 02:36:13.608: [ CRSPE][62] Processing PE command id=422044. Description: [Resource State Change (ora.grid12.oas_srv.domain.xx.svc 2 1) : 104dd8f90]
2012-08-06 02:36:13.608: [ CRSPE][62] RI [ora.grid12.oas_srv.domain.xx.svc 2 1] new external state [OFFLINE] old value: [ONLINE] on fedb96 label = []
2012-08-06 02:36:13.613: [ AGFW][57] Received the reply to the message: RESOURCE_PROBE[ora.grid12.oas_srv.domain.xx.svc 2 1] ID 4097:10985357 from the agent
/u01/app/11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.613: [ AGFW][57] ora.grid12.oas_srv.domain.xx.svc 2 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2012-08-06 02:36:13.613: [ AGFW][57] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.grid12.oas_srv.domain.xx.svc 2 1] ID 4097:
10985356
2012-08-06 02:36:13.615: [ CRSPE][62] Resource Resource Instance ID[ora.grid12.oas_srv.domain.xx.svc 2 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=fedb96
CURRENT_RCOUNT=0
LAST_RESTART=1322930218
FAILURE_COUNT=0
FAILURE_HISTORY=
STATE_DETAILS=
INCARNATION=3
STATE_CHANGE_VERS=5
LAST_FAULT=0
DEGREE_ID=1
ID=ora.grid12.oas_srv.domain.xx.svc 2 1
CARDINALITY_ID=2
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
2012-08-06 02:36:13.615: [ CRSRPT][63] Publishing event: Cluster Resource State Change Event for ora.grid12.oas_srv.domain.xx.svc:fedb96 : 105953490
2012-08-06 02:36:13.615: [ CRSRPT][63] Publish to eons buffered event : 105953490
2012-08-06 02:36:13.615: [ CRSPE][62] Processing unplanned state change for [ora.grid12.oas_srv.domain.xx.svc 2 1]
2012-08-06 02:36:13.615: [ CRSPE][62] ora.grid12.oas_srv.domain.xx.svc 2 1: uptime exceeds uptime threshold , resetting restart count
2012-08-06 02:36:13.616: [ CRSPE][62] No Local Restart of [ora.grid12.oas_srv.domain.xx.svc 2 1], restart attempt exhausted
2012-08-06 02:36:13.620: [ CRSPE][62] Will try to failover [ora.grid12.oas_srv.domain.xx.svc 2 1]
2012-08-06 02:36:13.620: [ CRSRPT][63] Publishing event: Cluster Resource Not Restarting Event : 105952d90
2012-08-06 02:36:13.620: [ CRSRPT][63] Publish to eons buffered event : 105952d90
2012-08-06 02:36:13.621: [ CRSPE][62] Placement impossible for[ora.grid12.oas_srv.domain.xx.svc 2 1] as all possible servers are occupied
2012-08-06 02:36:13.622: [ CRSPE][62] Placement impossible for[ora.grid12.oas_srv.domain.xx.svc 2 1] as all possible servers are occupied
2012-08-06 02:36:13.622: [ CRSPE][62] Placement impossible for[ora.grid12.oas_srv.domain.xx.svc 2 1] as all possible servers are occupied
2012-08-06 02:36:13.622: [ CRSPE][62] Recovery impossible, stopping :ora.grid12.oas_srv.domain.xx.svc 2 1
2012-08-06 02:36:13.622: [ CRSPE][62] Failover cannot be completed for [ora.grid12.oas_srv.domain.xx.svc 2 1]. Stopping it and the resource tree
2012-08-06 02:36:13.624: [ CRSPE][62] PE Command [ Resource State Change (ora.grid12.oas_srv.domain.xx.svc 2 1) : 104dd8f90 ] has completed
2012-08-06 02:36:13.624: [ AGFW][57] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:10985372
2012-08-06 02:36:13.624: [ AGFW][57] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:10985372
2012-08-06 02:36:13.624: [UiServer][65] S(104e70f10): set Properties ( oracle,104dd2490)
2012-08-06 02:36:13.624: [ AGFW][57] Agfw received reply from PE for resource state change for ora.grid12.oas_srv.domain.xx.svc 2 1
2012-08-06 02:36:13.635: [UiServer][64] processMessage called
2012-08-06 02:36:13.635: [UiServer][64] Sending message to PE. ctx= 104b98710
2012-08-06 02:36:13.636: [ CRSPE][62] Processing PE command id=422045. Description: [Stat Resource : 103b7e6d0]
2012-08-06 02:36:13.639: [ CRSPE][62] PE Command [ Stat Resource : 103b7e6d0 ] has completed
2012-08-06 02:36:13.640: [ CRSPE][62] UI Command [Stat Resource : 103b7e6d0] is replying to sender.
2012-08-06 02:36:13.642: [UiServer][64] Done for ctx=104b98710
2012-08-06 02:36:13.661: [UiServer][65] S(104e70f10): set Properties ( oracle,104f84650)
2012-08-06 02:36:13.671: [UiServer][64] processMessage called
2012-08-06 02:36:13.672: [UiServer][64] Container [ Name: UI_CHECK
--More--
2012-08-06 02:36:13.672: [UiServer][64] Container [ Name: UI_CHECK
CLIENT:
TextMessage[]
DELAY_SECS:
TextMessage[0]
HOST:
TextMessage[fedb96]
HOST_TAG:
TextMessage[1]
LOCALE:
TextMessage[AMERICAN_AMERICA.WE8ISO8859P1]
RESOURCE:
TextMessage[ora.asm]
]
2012-08-06 02:36:13.672: [UiServer][64] Sending message to PE. ctx= 105070910
2012-08-06 02:36:13.672: [ CRSPE][62] Cmd : 103b7e6d0 : flags: HOST_TAG
2012-08-06 02:36:13.673: [ CRSPE][62] Processing PE command id=422046. Description: [Check Resource : 103b7e6d0]
2012-08-06 02:36:13.674: [ CRSPE][62] PE Command [ Check Resource : 103b7e6d0 ] has completed
2012-08-06 02:36:13.674: [ CRSPE][62] UI Command [Check Resource : 103b7e6d0] is replying to sender.
2012-08-06 02:36:13.674: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985382
2012-08-06 02:36:13.674: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985382 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.674: [UiServer][64] Container [ Name: UI_DATA
ora.asm:
TextMessage[0]
]
2012-08-06 02:36:13.674: [UiServer][64] Done for ctx=105070910
2012-08-06 02:36:13.688: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914510
2012-08-06 02:36:13.689: [ AGFW][57] Received state change for ora.asm fedb96 1 [old state = ONLINE, new state = OFFLINE]
2012-08-06 02:36:13.689: [ AGFW][57] Received state LABEL change for ora.asm fedb96 1 [old label = Started, new label = Abnormal Termination]
2012-08-06 02:36:13.690: [ AGFW][57] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Inval
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985387]
2012-08-06 02:36:13.690: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914510
2012-08-06 02:36:13.690: [ CRSPE][62] State change received from fedb96 for ora.asm fedb96 1
2012-08-06 02:36:13.690: [ CRSPE][62] Processing PE command id=422047. Description: [Resource State Change (ora.asm fedb96 1) : 103b7e6d0]
2012-08-06 02:36:13.690: [ CRSPE][62] RI [ora.asm fedb96 1] new external state [OFFLINE] old value: [ONLINE] on fedb96 label = [Abnormal Termination]
2012-08-06 02:36:13.690: [ CRSPE][62] Set State Details to [Abnormal Termination] from [ Started] for [ora.asm fedb96 1]
2012-08-06 02:36:13.691: [ CRSRPT][63] Publishing event: Cluster Resource State Change Event for ora.asm:fedb96 : 105953590
2012-08-06 02:36:13.691: [ CRSPE][62] Resource Resource Instance ID[ora.asm fedb96 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=fedb96
CURRENT_RCOUNT=0
LAST_RESTART=0
FAILURE_COUNT=0
FAILURE_HISTORY=
STATE_DETAILS=Abnormal Termination
INCARNATION=1
STATE_CHANGE_VERS=0
LAST_FAULT=0
DEGREE_ID=1
ID=ora.asm fedb96 1
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED| has failed!
2012-08-06 02:36:13.691: [ CRSRPT][63] Publish to eons buffered event : 105953590
2012-08-06 02:36:13.695: [ CRSPE][62] Processing unplanned state change for [ora.asm fedb96 1]
2012-08-06 02:36:13.697: [ CRSPE][62] Scheduled local recovery for [ora.asm fedb96 1]
2012-08-06 02:36:13.701: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985391
--More--
2012-08-06 02:36:13.701: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985391
2012-08-06 02:36:13.702: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985391 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.702: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985393
2012-08-06 02:36:13.702: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985393 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.702: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.TG1.dg fedb96 1] ID 4097:10985395
2012-08-06 02:36:13.703: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.TG1.dg fedb96 1] ID 4097:10985395 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.703: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985398
2012-08-06 02:36:13.703: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985398 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.703: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.DG3.dg fedb96 1] ID 4097:10985400
2012-08-06 02:36:13.704: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.DG3.dg fedb96 1] ID 4097:10985400 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.704: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985403
2012-08-06 02:36:13.704: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985403 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.704: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985406
2012-08-06 02:36:13.705: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985406 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.705: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.DG4.dg fedb96 1] ID 4097:10985409
2012-08-06 02:36:13.705: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.DG4.dg fedb96 1] ID 4097:10985409 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.705: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.FG1.dg fedb96 1] ID 4097:10985411
2012-08-06 02:36:13.705: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.FG1.dg fedb96 1] ID 4097:10985411 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.706: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.DG2.dg fedb96 1] ID 4097:10985413
2012-08-06 02:36:13.706: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.DG2.dg fedb96 1] ID 4097:10985413 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.706: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985416
2012-08-06 02:36:13.706: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985416 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.707: [ AGFW][57] Received the reply to the message: RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985348 from the agent /u01/app/11.2.0/g
rid/bin/oraagent_oracle
2012-08-06 02:36:13.707: [ AGFW][57] ora.asm fedb96 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2012-08-06 02:36:13.707: [ AGFW][57] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985347
2012-08-06 02:36:13.707: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985421
2012-08-06 02:36:13.707: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985421 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.707: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985424
2012-08-06 02:36:13.707: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985424 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.708: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985427
2012-08-06 02:36:13.708: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985427 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.709: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.DG1.dg fedb96 1] ID 4097:10985430
2012-08-06 02:36:13.709: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.DG1.dg fedb96 1] ID 4097:10985430 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.709: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.OCR_DG.dg fedb96 1] ID 4097:10985433
2012-08-06 02:36:13.709: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.OCR_DG.dg fedb96 1] ID 4097:10985433 to the agent /u01/a
pp/11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.710: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.SG1.dg fedb96 1] ID 4097:10985435
2012-08-06 02:36:13.710: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.SG1.dg fedb96 1] ID 4097:10985435 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.710: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.DG5.dg fedb96 1] ID 4097:10985438
2012-08-06 02:36:13.710: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.DG5.dg fedb96 1] ID 4097:10985438 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.714: [ CRSPE][62] Sending message to agfw: id = 10985443
2012-08-06 02:36:13.714: [ CRSPE][62] Sending message to agfw: id = 10985443
2012-08-06 02:36:13.714: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_START[ora.asm fedb96 1] ID 4098:10985443
2012-08-06 02:36:13.715: [ CRSPE][62] CRS-2672: Attempting to start 'ora.asm' on 'fedb96'
2012-08-06 02:36:13.715: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.asm fedb96 1] ID 4098:10985443 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:13.780: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914534
2012-08-06 02:36:13.780: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914534
2012-08-06 02:36:13.780: [ AGFW][57] Received the reply to the message: RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985383 from the agent /u01/app/11.2.0/g
rid/bin/oraagent_oracle
2012-08-06 02:36:13.780: [ AGFW][57] ora.asm fedb96 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2012-08-06 02:36:13.780: [ AGFW][57] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.asm fedb96 1] ID 4097:10985382
2012-08-06 02:36:14.282: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914546
2012-08-06 02:36:14.282: [ AGFW][57] Received state change for ora.TG1.dg fedb96 1 [old state = ONLINE, new state = OFFLINE]
2012-08-06 02:36:14.282: [ AGFW][57] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Inval
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985456]
2012-08-06 02:36:14.282: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914546
2012-08-06 02:36:14.283: [ CRSPE][62] State change received from fedb96 for ora.TG1.dg fedb96 1
2012-08-06 02:36:14.283: [ AGFW][57] Received the reply to the message: RESOURCE_PROBE[ora.TG1.dg fedb96 1] ID 4097:10985404 from the agent /u01/app/11.2.
0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.283: [ AGFW][57] ora.TG1.dg fedb96 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2012-08-06 02:36:14.283: [ CRSPE][62] Processing PE command id=422048. Description: [Resource State Change (ora.TG1.dg fedb96 1) : 104dd8f90]
2012-08-06 02:36:14.283: [ AGFW][57] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.TG1.dg fedb96 1] ID 4097:10985395
2012-08-06 02:36:14.283: [ CRSPE][62] RI [ora.TG1.dg fedb96 1] new external state [OFFLINE] old value: [ONLINE] on fedb96 label = []
2012-08-06 02:36:14.283: [ CRSRPT][63] Publishing event: Cluster Resource State Change Event for ora.TG1.dg:fedb96 : 104d5c010
2012-08-06 02:36:14.283: [ CRSRPT][63] Publish to eons buffered event : 104d5c010
2012-08-06 02:36:14.283: [ CRSPE][62] Resource Resource Instance ID[ora.TG1.dg fedb96 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=fedb96
CURRENT_RCOUNT=0
LAST_RESTART=1322727648
FAILURE_COUNT=0
FAILURE_HISTORY=
STATE_DETAILS=
INCARNATION=1
STATE_CHANGE_VERS=1
LAST_FAULT=0
DEGREE_ID=1
ID=ora.TG1.dg fedb96 1
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
2012-08-06 02:36:14.284: [ CRSPE][62] Processing unplanned state change for [ora.TG1.dg fedb96 1]
2012-08-06 02:36:14.284: [ CRSPE][62] ora.TG1.dg fedb96 1: uptime exceeds uptime threshold , resetting restart count
2012-08-06 02:36:14.284: [ CRSPE][62] Scheduled local recovery for [ora.TG1.dg fedb96 1]
2012-08-06 02:36:14.286: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985462
2012-08-06 02:36:14.286: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985462 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.288: [ CRSPE][62] Sending message to agfw: id = 10985465
2012-08-06 02:36:14.288: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_START[ora.TG1.dg fedb96 1] ID 4098:10985465
2012-08-06 02:36:14.288: [ CRSPE][62] CRS-2672: Attempting to start 'ora.TG1.dg' on 'fedb96'
2012-08-06 02:36:14.289: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.TG1.dg fedb96 1] ID 4098:10985465 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.318: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914566
2012-08-06 02:36:14.318: [ AGFW][57] Received state change for ora.DG3.dg fedb96 1 [old state = ONLINE, new state = OFFLINE]
2012-08-06 02:36:14.319: [ AGFW][57] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Inval
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985472]
--More--
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985472]
2012-08-06 02:36:14.319: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914566
2012-08-06 02:36:14.319: [ AGFW][57] Received the reply to the message: RESOURCE_PROBE[ora.DG3.dg fedb96 1] ID 4097:10985414 from the agent /u01/app/11.2.
0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.319: [ CRSPE][62] State change received from fedb96 for ora.DG3.dg fedb96 1
2012-08-06 02:36:14.319: [ AGFW][57] ora.DG3.dg fedb96 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2012-08-06 02:36:14.319: [ CRSPE][62] Processing PE command id=422049. Description: [Resource State Change (ora.DG3.dg fedb96 1) : 103b7fad0]
2012-08-06 02:36:14.319: [ AGFW][57] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.DG3.dg fedb96 1] ID 4097:10985400
2012-08-06 02:36:14.319: [ CRSPE][62] RI [ora.DG3.dg fedb96 1] new external state [OFFLINE] old value: [ONLINE] on fedb96 label = []
2012-08-06 02:36:14.320: [ CRSRPT][63] Publishing event: Cluster Resource State Change Event for ora.DG3.dg:fedb96 : 104fb7c90
2012-08-06 02:36:14.320: [ CRSRPT][63] Publish to eons buffered event : 104fb7c90
2012-08-06 02:36:14.320: [ CRSPE][62] Resource Resource Instance ID[ora.DG3.dg fedb96 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=fedb96
CURRENT_RCOUNT=0
LAST_RESTART=1322727614
FAILURE_COUNT=0
FAILURE_HISTORY=
STATE_DETAILS=
INCARNATION=1
STATE_CHANGE_VERS=1
LAST_FAULT=0
DEGREE_ID=1
ID=ora.DG3.dg fedb96 1
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
2012-08-06 02:36:14.320: [ CRSPE][62] Processing unplanned state change for [ora.DG3.dg fedb96 1]
2012-08-06 02:36:14.320: [ CRSPE][62] ora.DG3.dg fedb96 1: uptime exceeds uptime threshold , resetting restart count
2012-08-06 02:36:14.321: [ CRSPE][62] Scheduled local recovery for [ora.DG3.dg fedb96 1]
2012-08-06 02:36:14.322: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985476
2012-08-06 02:36:14.322: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985476 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.325: [ CRSPE][62] Sending message to agfw: id = 10985479
2012-08-06 02:36:14.325: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_START[ora.DG3.dg fedb96 1] ID 4098:10985479
2012-08-06 02:36:14.325: [ CRSPE][62] CRS-2672: Attempting to start 'ora.DG3.dg' on 'fedb96'
2012-08-06 02:36:14.325: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.DG3.dg fedb96 1] ID 4098:10985479 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.354: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914582
2012-08-06 02:36:14.354: [ AGFW][57] Received state change for ora.DG4.dg fedb96 1 [old state = ONLINE, new state = OFFLINE]
2012-08-06 02:36:14.354: [ AGFW][57] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Inval
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985486]
2012-08-06 02:36:14.354: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914582
2012-08-06 02:36:14.354: [ CRSPE][62] State change received from fedb96 for ora.DG4.dg fedb96 1
2012-08-06 02:36:14.354: [ AGFW][57] Received the reply to the message: RESOURCE_PROBE[ora.DG4.dg fedb96 1] ID 4097:10985425 from the agent /u01/app/11.2.
0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.354: [ AGFW][57] ora.DG4.dg fedb96 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2012-08-06 02:36:14.354: [ CRSPE][62] Processing PE command id=422050. Description: [Resource State Change (ora.DG4.dg fedb96 1) : 104d9cdd0]
2012-08-06 02:36:14.355: [ AGFW][57] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.DG4.dg fedb96 1] ID 4097:10985409
2012-08-06 02:36:14.355: [ CRSPE][62] RI [ora.DG4.dg fedb96 1] new external state [OFFLINE] old value: [ONLINE] on fedb96 label = []
2012-08-06 02:36:14.355: [ CRSRPT][63] Publishing event: Cluster Resource State Change Event for ora.DG4.dg:fedb96 : 104fa8850
2012-08-06 02:36:14.355: [ CRSPE][62] Resource Resource Instance ID[ora.DG4.dg fedb96 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=fedb96
CURRENT_RCOUNT=0
LAST_RESTART=1322727621
LAST_RESTART=1322727621
FAILURE_COUNT=0
FAILURE_HISTORY=
STATE_DETAILS=
INCARNATION=1
STATE_CHANGE_VERS=1
LAST_FAULT=0
DEGREE_ID=1
ID=ora.DG4.dg fedb96 1
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
2012-08-06 02:36:14.355: [ CRSRPT][63] Publish to eons buffered event : 104fa8850
2012-08-06 02:36:14.356: [ CRSPE][62] Processing unplanned state change for [ora.DG4.dg fedb96 1]
2012-08-06 02:36:14.356: [ CRSPE][62] ora.DG4.dg fedb96 1: uptime exceeds uptime threshold , resetting restart count
2012-08-06 02:36:14.356: [ CRSPE][62] Scheduled local recovery for [ora.DG4.dg fedb96 1]
2012-08-06 02:36:14.357: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985490
2012-08-06 02:36:14.357: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.grid12.db 2 1] ID 4097:10985490 to the agent /u01/app/11.
2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.360: [ CRSPE][62] Sending message to agfw: id = 10985493
2012-08-06 02:36:14.360: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_START[ora.DG4.dg fedb96 1] ID 4098:10985493
2012-08-06 02:36:14.360: [ CRSPE][62] CRS-2672: Attempting to start 'ora.DG4.dg' on 'fedb96'
2012-08-06 02:36:14.360: [ AGFW][57] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.DG4.dg fedb96 1] ID 4098:10985493 to the agent /u01/app/
11.2.0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.412: [ AGFW][57] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:197914598
2012-08-06 02:36:14.412: [ AGFW][57] Received state change for ora.FG1.dg fedb96 1 [old state = ONLINE, new state = OFFLINE]
2012-08-06 02:36:14.413: [ AGFW][57] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Inval
id|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:10985500]
2012-08-06 02:36:14.413: [ AGFW][57] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:197914598
2012-08-06 02:36:14.413: [ CRSPE][62] State change received from fedb96 for ora.FG1.dg fedb96 1
2012-08-06 02:36:14.413: [ AGFW][57] Received the reply to the message: RESOURCE_PROBE[ora.FG1.dg fedb96 1] ID 4097:10985428 from the agent /u01/app/11.2.
0/grid/bin/oraagent_oracle
2012-08-06 02:36:14.413: [ AGFW][57] ora.FG1.dg fedb96 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2012-08-06 02:36:14.413: [ CRSPE][62] Processing PE command id=422051. Description: [Resource State Change (ora.FG1.dg fedb96 1) : 10592f410]
2012-08-06 02:36:14.413: [ AGFW][57] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.FG1.dg fedb96 1] ID 4097:10985411
2012-08-06 02:36:14.413: [ CRSPE][62] RI [ora.FG1.dg fedb96 1] new external state [OFFLINE] old value: [ONLINE] on fedb96 label = []
2012-08-06 02:36:14.414: [ CRSRPT][63] Publishing event: Cluster Resource State Change Event for ora.FG1.dg:fedb96 : 105953290
2012-08-06 02:36:14.414: [ CRSRPT][63] Publish to eons buffered event : 105953290
2012-08-06 02:36:14.414: [ CRSPE][62] Resource Resource Instance ID[ora.FG1.dg fedb96 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=fedb96
CURRENT_RCOUNT=0
LAST_RESTART=1322727634
FAILURE_COUNT=0
FAILURE_HISTORY=
STATE_DETAILS=
INCARNATION=1
STATE_CHANGE_VERS=1
LAST_FAULT=0
DEGREE_ID=1
ID=ora.FG1.dg fedb96 1
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
2012-08-06 02:36:14.414: [ CRSPE][62] Processing unplanned state change for [ora.FG1.dg fedb96 1]
2012-08-06 02:36:14.414: [ CRSPE][62] ora.FG1.dg fedb96 1: uptime exceeds uptime threshold , resetting restart count
2012-08-06 02:36:14.415: [ CRSPE][62] Scheduled local recovery for [ora.FG1.dg fedb96 1]
Regards
[EDITED by LF: applied [spoiler] tags]
[Updated on: Wed, 08 August 2012 02:56] by Moderator Report message to a moderator
|
|
|
Re: Few Cluster services are down.Why [message #563050 is a reply to message #563020] |
Wed, 08 August 2012 01:58 |
John Watson
Messages: 8962 Registered: January 2010 Location: Global Village
|
Senior Member |
|
|
Hi - I really don't think there is any point in trying to investigate this. 11.2.0.1 is long out of date, there are major changes between that and the current release (11.2.0.3). Even if you don't want to upgrade the database, I think you must get your GriD infrastructure up to a more reliable release before trying to diagnose and fix anything.
|
|
|
Goto Forum:
Current Time: Sun Jan 12 20:57:45 CST 2025
|