RMAN duplicate issue

Not sure if anyone is using ODAs..just trying my luck .Sorry about the long email..

I am trying to create standby database in ODA (Oracle Database Appliance) using RMAN duplicate and running into the error as below. Opened a SR and waiting for them to respond.. Hope to find some help in here soon.

This is RACone Node set up.

Target side :

ODA X5-2 server running Oracle DB 11.2.0.4.0 (acfs,asm disk layout). This server is located in local data center with all the required firewall rules. Enabled and set up all the DG parameters on the Target DB. Copied pwd file to standby side.
Made sure able to do tnsping on both sides. Tested with few file transfers (non .dbf) between servers and it's working fine.

Aux side:
 ODA V1 server running Oracle DB 11.2.0.4.0 (acfs,asm disk layout). This server is located in a remote data center with 3 level of Firewall rules.

Issue:

  Unable to run RMAN duplicate successfully.

Here is the rman script:
run
{
allocate channel prmy1 type disk;
allocate channel prmy2 type disk;
allocate auxiliary channel stby1 type disk; allocate auxiliary channel stby2 type disk; duplicate target database for standby from active database dorecover
spfile
parameter_value_convert='/kfsdevn','/kfsdevng' set db_unique_name='kfsdevng'
set cluster_database='false'
set audit_file_dest='/u01/app/oracle/admin/kfsdevng/adump' set db_create_file_Dest='/u01/app/oracle/oradata/datastore' set log_archive_config='dg_config=(kfsdevn,kfsdevng)' set diagnostic_dest="/u01/app/oracle"
set db_recovery_file_dest="/u01/app/oracle/fast_recovery_area/datastore" set db_create_online_log_dest_1="/u01/app/oracle/oradata/datastore" set control_files="/u01/app/oracle/oradata/datastore/kfsdevng/control01.ctl" set log_archive_dest_2='service=kfsdevn ASYNC valid_for=(ONLINE_LOGFILE,PRIMARY_ROLE) db_unique_name=kfsdevn' set fal_server='kfsdevn'
set remote_listener='odastby-scan:1521'
set db_flash_cache_file ='+RECO/kfsdevndgflash.devn'  nofilenamecheck;
}

Here is the init.ora file on the standby side (kfsdevng):

*.audit_file_dest='/u01/app/oracle/admin/kfsdevng/adump'
*.cluster_database=false
*.compatible='11.2.0.4.0'
*.db_name='kfsdevng'
*.remote_login_passwordfile='exclusive'
*.sga_target=17179869184
*.undo_retention=900

--

Here is the RMAN run error:


Recovery Manager: Release 11.2.0.4.0 - Production on Thu Apr 28 15:47:08 2016

Copyright (c) 1982, 2011, Oracle and/or its affiliates.  All rights reserved.

ORACLE_HOME = /u01/app/oracle/product/11.2.0.4/dbhome_1
System name:        Linux
Node name:           odastbya
Release: 2.6.39-400.264.13.el6uek.x86_64
Version:  #1 SMP Thu Jan 7 15:49:50 PST 2016
Machine: x86_64

Starting with debugging turned off

connected to target database: KFSDEVN (DBID=4168072494)
connected to auxiliary database: KFSDEVNG (not mounted)

RMAN> 2> 3> 4> 5> 6> 7> 8> 9> 10> 11> 12> 13> 14> 15> 16> 17> 18> 19> 20> 21> 22> 23> 24> 25>
using target database control file instead of recovery catalog
allocated channel: prmy1
channel prmy1: SID=7 instance=kfsdevn_2 device type=DISK

allocated channel: prmy2
channel prmy2: SID=161 instance=kfsdevn_2 device type=DISK

allocated channel: stby1
channel stby1: SID=74 device type=DISK

allocated channel: stby2
channel stby2: SID=146 device type=DISK

Starting Duplicate Db at 28-APR-16

contents of Memory Script:
{
   backup as copy reuse
   targetfile  '/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/orapwkfsdevn' auxiliary format
 '/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/orapwkfsdevng'   targetfile
 '/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/kfsdevn/spfilekfsdevn.ora' auxiliary format
 '/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/spfilekfsdevng.ora'   ;
   sql clone "alter system set spfile= ''/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/spfilekfsdevng.ora''";
}
executing Memory Script

Starting backup at 28-APR-16
Finished backup at 28-APR-16

sql statement: alter system set spfile= ''/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/spfilekfsdevng.ora''

contents of Memory Script:
{
   sql clone "alter system set  db_unique_name =
 ''kfsdevng'' comment=


'''' scope=spfile";

   sql clone "alter system set  cluster_database =
 false comment=


'''' scope=spfile";

   sql clone "alter system set  audit_file_dest =
 ''/u01/app/oracle/admin/kfsdevng/adump'' comment=


'''' scope=spfile";

   sql clone "alter system set  db_create_file_Dest =
 ''/u01/app/oracle/oradata/datastore'' comment=


'''' scope=spfile";

   sql clone "alter system set  log_archive_config =
 ''dg_config=(kfsdevn,kfsdevng)'' comment=


'''' scope=spfile";

   sql clone "alter system set  diagnostic_dest =
 ''/u01/app/oracle'' comment=


'''' scope=spfile";

   sql clone "alter system set  db_recovery_file_dest =
 ''/u01/app/oracle/fast_recovery_area/datastore'' comment=


'''' scope=spfile";

   sql clone "alter system set  db_create_online_log_dest_1 =
 ''/u01/app/oracle/oradata/datastore'' comment=


'''' scope=spfile";

   sql clone "alter system set  control_files =
 ''/u01/app/oracle/oradata/datastore/kfsdevng/control01.ctl'' comment=


'''' scope=spfile";

   sql clone "alter system set  log_archive_dest_2 =
 ''service=kfsdevn ASYNC valid_for=(ONLINE_LOGFILE,PRIMARY_ROLE) db_unique_name=kfsdevn'' comment=


'''' scope=spfile";

   sql clone "alter system set  fal_server =
 ''kfsdevn'' comment=


'''' scope=spfile";

   sql clone "alter system set  remote_listener =
 ''odastby-scan:1521'' comment=


'''' scope=spfile";

   sql clone "alter system set  db_flash_cache_file =
 ''+RECO/kfsdevndgflash.devn'' comment=


'''' scope=spfile";

   shutdown clone immediate;
   startup clone nomount;
}
executing Memory Script

sql statement: alter system set  db_unique_name =  ''kfsdevng'' comment= '''' scope=spfile

sql statement: alter system set  cluster_database =  false comment= '''' scope=spfile

sql statement: alter system set  audit_file_dest =  ''/u01/app/oracle/admin/kfsdevng/adump'' comment= '''' scope=spfile

sql statement: alter system set  db_create_file_Dest =  ''/u01/app/oracle/oradata/datastore'' comment= '''' scope=spfile

sql statement: alter system set  log_archive_config =  ''dg_config=(kfsdevn,kfsdevng)'' comment= '''' scope=spfile

sql statement: alter system set  diagnostic_dest =  ''/u01/app/oracle'' comment= '''' scope=spfile

sql statement: alter system set  db_recovery_file_dest =  ''/u01/app/oracle/fast_recovery_area/datastore'' comment= '''' scope=spfile

sql statement: alter system set  db_create_online_log_dest_1 =  ''/u01/app/oracle/oradata/datastore'' comment= '''' scope=spfile

sql statement: alter system set  control_files =  ''/u01/app/oracle/oradata/datastore/kfsdevng/control01.ctl'' comment= '''' scope=spfile

sql statement: alter system set  log_archive_dest_2 =  ''service=kfsdevn ASYNC valid_for=(ONLINE_LOGFILE,PRIMARY_ROLE) db_unique_name=kfsdevn'' comment= '''' scope=spfile

sql statement: alter system set  fal_server =  ''kfsdevn'' comment= '''' scope=spfile

sql statement: alter system set  remote_listener =  ''odastby-scan:1521'' comment= '''' scope=spfile

sql statement: alter system set  db_flash_cache_file =  ''+RECO/kfsdevndgflash.devn'' comment= '''' scope=spfile

Oracle instance shut down

connected to auxiliary database (not started)
Oracle instance started

Total System Global Area   17103163392 bytes

Fixed Size                     2270360 bytes
Variable Size               2516585320 bytes
Database Buffers           14529069056 bytes
Redo Buffers                  55238656 bytes
allocated channel: stby1
channel stby1: SID=922 device type=DISK
allocated channel: stby2
channel stby2: SID=1072 device type=DISK

contents of Memory Script:
{
   backup as copy current controlfile for standby auxiliary format  '/u01/app/oracle/oradata/datastore/kfsdevng/control01.ctl';
}
executing Memory Script

Starting backup at 28-APR-16
channel prmy1: starting datafile copy
copying standby control file
output file name=/u01/app/oracle/fast_recovery_area/datastore/kfsdevn/snapcf_kfsdevn.f tag=TAG20160428T154747 RECID=12 STAMP=910367269
channel prmy1: datafile copy complete, elapsed time: 00:00:03
Finished backup at 28-APR-16

contents of Memory Script:
{
   sql clone 'alter database mount standby database';
}
executing Memory Script

sql statement: alter database mount standby database
RMAN-05538: WARNING: implicitly using DB_FILE_NAME_CONVERT

contents of Memory Script:
{
   set newname for tempfile  1 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_temp_ckwpfgf8_.tmp";
   switch clone tempfile all;
   set newname for datafile  1 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_system_ckwpf218_.dbf";
   set newname for datafile  2 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_sysaux_ckwpf7jj_.dbf";
   set newname for datafile  3 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_undotbs1_ckwpfd4h_.dbf";
   set newname for datafile  4 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_undotbs2_ckwpfnfn_.dbf";
   set newname for datafile  5 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_users_ckwpfprl_.dbf";
   set newname for datafile  6 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx8xlh_.dbf";
   set newname for datafile  7 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx98yn_.dbf";
   set newname for datafile  8 to
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx9v7d_.dbf";
   backup as copy reuse
   datafile  1 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_system_ckwpf218_.dbf"   datafile
 2 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_sysaux_ckwpf7jj_.dbf"   datafile
 3 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_undotbs1_ckwpfd4h_.dbf"   datafile
 4 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_undotbs2_ckwpfnfn_.dbf"   datafile
 5 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_users_ckwpfprl_.dbf"   datafile
 6 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx8xlh_.dbf"   datafile
 7 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx98yn_.dbf"   datafile
 8 auxiliary format
 "/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx9v7d_.dbf"   ;
   sql 'alter system archive log current';
}
executing Memory Script

executing command: SET NEWNAME

renamed tempfile 1 to /u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_temp_ckwpfgf8_.tmp in control file

executing command: SET NEWNAME

executing command: SET NEWNAME

executing command: SET NEWNAME

executing command: SET NEWNAME

executing command: SET NEWNAME

executing command: SET NEWNAME

executing command: SET NEWNAME

executing command: SET NEWNAME

Starting backup at 28-APR-16
channel prmy1: starting datafile copy
input datafile file number=00007 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx98yn_.dbf
channel prmy2: starting datafile copy
input datafile file number=00006 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx8xlh_.dbf
RMAN-03009: failure of backup command on prmy1 channel at 04/28/2016 15:47:58
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
continuing other job steps, job failed will not be re-run
channel prmy1: starting datafile copy
input datafile file number=00008 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_kfsn_ckwx9v7d_.dbf
RMAN-03009: failure of backup command on prmy2 channel at 04/28/2016 15:47:59
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
continuing other job steps, job failed will not be re-run
channel prmy2: starting datafile copy
input datafile file number=00001 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_system_ckwpf218_.dbf
RMAN-03009: failure of backup command on prmy1 channel at 04/28/2016 15:47:59
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
continuing other job steps, job failed will not be re-run
channel prmy1: starting datafile copy
input datafile file number=00002 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_sysaux_ckwpf7jj_.dbf
RMAN-03009: failure of backup command on prmy2 channel at 04/28/2016 15:47:59
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
continuing other job steps, job failed will not be re-run
channel prmy2: starting datafile copy
input datafile file number=00004 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_undotbs2_ckwpfnfn_.dbf
RMAN-03009: failure of backup command on prmy1 channel at 04/28/2016 15:47:59
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
continuing other job steps, job failed will not be re-run
channel prmy1: starting datafile copy
input datafile file number=00003 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_undotbs1_ckwpfd4h_.dbf
RMAN-03009: failure of backup command on prmy2 channel at 04/28/2016 15:48:00
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
continuing other job steps, job failed will not be re-run
channel prmy2: starting datafile copy
input datafile file number=00005 name=/u02/app/oracle/oradata/datastore/.ACFS/snaps/kfsdevn/KFSDEVN/datafile/o1_mf_users_ckwpfprl_.dbf
RMAN-03009: failure of backup command on prmy1 channel at 04/28/2016 15:48:00
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
continuing other job steps, job failed will not be re-run
released channel: prmy1
released channel: prmy2
released channel: stby1
released channel: stby2
Calling krmmpem from krmmexe
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of Duplicate Db command at 04/28/2016 15:48:01
RMAN-05501: aborting duplication of target database
RMAN-03015: error occurred in stored script Memory Script
RMAN-03009: failure of backup command on prmy2 channel at 04/28/2016 15:48:01
RMAN-10035: exception raised in RPC:
ORA-19583: conversation terminated due to error
ORA-17628: Oracle error 19505 returned by remote Oracle server
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1381
RMAN-10031: RPC Error: ORA-19583  occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE

RMAN>

Recovery Manager complete.





Thanks,

Nisha Riyaj



--
http://www.freelists.org/webpage/oracle-l