RE: RMAN backups of SAP database
Date: Mon, 24 Feb 2020 20:23:13 +0000
Message-ID: <YTBPR01MB257555617EC42A51416F0242F1EC0_at_YTBPR01MB2575.CANPRD01.PROD.OUTLOOK.COM>
I would check the RC_RMAN_BACKUP_JOB_DETAIL and RC_RMAN_BACKUP_SUBJOB_DETAILS views for the read and write performance form the db prespective.
From: oracle-l-bounce_at_freelists.org <oracle-l-bounce_at_freelists.org> On Behalf Of Sandra Becker
Sent: Monday, February 24, 2020 11:21 AM
To: gogala.mladen_at_gmail.com
Cc: oracle-l <oracle-l_at_freelists.org>
Subject: Re: RMAN backups of SAP database
CAUTION: This email originated from outside of the University of Saskatchewan. Do not click links or open attachments unless you recognize the sender and know the content is safe. If in doubt, please forward suspicious emails to phishing_at_usask.ca<mailto:phishing_at_usask.ca>
So now the Basis admin tells me that backup log is from a different database. He no longer has the log from the database where it causes problems. He has several hosts and RMAN runs just fine on all the others. Helps to get all the pertinent information. I told him it sounds more like a server/disk issue than anything to do with RMAN.
input datafile file number=00023 name=/oracle/XXX/yyyyyyy5/sr3_20/sr3.data20 input datafile file number=00012 name=/oracle/XXX/yyyyyyy4/sr3_9/sr3.data9 input datafile file number=00014 name=/oracle/XXX/yyyyyyy1/sr3_11/sr3.data11 input datafile file number=00011 name=/oracle/XXX/yyyyyyy3/sr3_8/sr3.data8channel c3: starting piece 1 at 16-FEB-20 channel c4: finished piece 1 at 16-FEB-20
piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200215_35699_1_FULL tag=ORCL_FULL comment=NONE channel c4: backup set complete, elapsed time: 11:08:38channel c4: starting full datafile backup set channel c4: specifying datafile(s) in backup set
input datafile file number=00017 name=/oracle/XXX/yyyyyyy4/sr3_14/sr3.data14 input datafile file number=00019 name=/oracle/XXX/yyyyyyy1/sr3_16/sr3.data16 input datafile file number=00016 name=/oracle/XXX/yyyyyyy3/sr3_13/sr3.data13 input datafile file number=00020 name=/oracle/XXX/yyyyyyy2/sr3_17/sr3.data17channel c4: starting piece 1 at 16-FEB-20 channel c1: finished piece 1 at 16-FEB-20
piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200215_35696_1_FULL tag=ORCL_FULL comment=NONE channel c1: backup set complete, elapsed time: 20:00:10channel c1: starting full datafile backup set channel c1: specifying datafile(s) in backup set
input datafile file number=00022 name=/oracle/XXX/yyyyyyy4/sr3_19/sr3.data19 input datafile file number=00024 name=/oracle/XXX/yyyyyyy1/sr3_21/sr3.data21 input datafile file number=00021 name=/oracle/XXX/yyyyyyy3/sr3_18/sr3.data18channel c1: starting piece 1 at 16-FEB-20 channel c2: finished piece 1 at 16-FEB-20
piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200215_35697_1_FULL tag=ORCL_FULL comment=NONE channel c2: backup set complete, elapsed time: 20:19:31channel c2: starting full datafile backup set channel c2: specifying datafile(s) in backup set including current control file in backup set channel c2: starting piece 1 at 16-FEB-20 channel c2: finished piece 1 at 16-FEB-20
piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200216_35703_1_FULL tag=ORCL_FULL comment=NONE channel c2: backup set complete, elapsed time: 00:00:35channel c2: starting full datafile backup set channel c2: specifying datafile(s) in backup set including current SPFILE in backup set
channel c2: starting piece 1 at 16-FEB-20 channel c2: finished piece 1 at 16-FEB-20
piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200216_35704_1_FULL tag=ORCL_FULL comment=NONE channel c2: backup set complete, elapsed time: 00:00:45 channel c3: finished piece 1 at 16-FEB-20 piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200216_35700_1_FULL tag=ORCL_FULL comment=NONE channel c3: backup set complete, elapsed time: 09:34:04 channel c4: finished piece 1 at 16-FEB-20 piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200216_35701_1_FULL tag=ORCL_FULL comment=NONE channel c4: backup set complete, elapsed time: 09:33:36 channel c1: finished piece 1 at 16-FEB-20 piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200216_35702_1_FULL tag=ORCL_FULL comment=NONE channel c1: backup set complete, elapsed time: 02:54:09Finished backup at 16-FEB-20
Starting backup at 16-FEB-20
current log archived
channel c1: starting archived log backup set
channel c1: specifying archived log(s) in backup set
input archived log thread=1 sequence=37974 RECID=18955 STAMP=1032496773
channel c1: starting piece 1 at 16-FEB-20 channel c2: starting archived log backup set channel c2: specifying archived log(s) in backup setinput archived log thread=1 sequence=37975 RECID=18956 STAMP=1032532861
channel c2: starting piece 1 at 16-FEB-20 channel c3: starting archived log backup set channel c3: specifying archived log(s) in backup setinput archived log thread=1 sequence=37976 RECID=18957 STAMP=1032548784 channel c3: starting piece 1 at 16-FEB-20 channel c1: finished piece 1 at 16-FEB-20
piece handle=/oracle/XXX/oraflash/XXX/backupset/2020_02_16/o1_mf_annnn_TAG20200216T192139_h4m5l6cj_.bkp tag=TAG20200216T 192139 comment=NONEchannel c1: backup set complete, elapsed time: 00:00:03 channel c2: finished piece 1 at 16-FEB-20
piece handle=/oracle/XXX/oraflash/XXX/backupset/2020_02_16/o1_mf_annnn_TAG20200216T192139_h4m5l6f5_.bkp tag=TAG20200216T 192139 comment=NONEchannel c2: backup set complete, elapsed time: 00:00:03 channel c3: finished piece 1 at 16-FEB-20
piece handle=/oracle/XXX/oraflash/XXX/backupset/2020_02_16/o1_mf_annnn_TAG20200216T192139_h4m5l7sx_.bkp tag=TAG20200216T 192139 comment=NONEchannel c3: backup set complete, elapsed time: 00:00:03 Finished backup at 16-FEB-20
Starting backup at 16-FEB-20
channel c1: starting full datafile backup set
channel c1: specifying datafile(s) in backup set
including current control file in backup set
channel c1: starting piece 1 at 16-FEB-20
channel c1: finished piece 1 at 16-FEB-20
piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200216_35708_1_CONTROL tag=ORCL_CONTROL comment=NONE channel c1: backup set complete, elapsed time: 00:00:01Finished backup at 16-FEB-20
RMAN retention policy will be applied to the command RMAN retention policy is set to recovery window of 4 days Deleting the following obsolete backups and copies:
Type Key Completion Time Filename/Handle -------------------- ------ ------------------ -------------------- Control File Copy 24619 22-FEB-18 /oracle/XXX/YYYreorg/sexwtcxc/cntrlXXX.old Control File Copy 24620 22-FEB-18 /oracle/XXX/YYYreorg/sexwtcxc/cntrlXXX.new Control File Copy 24621 22-FEB-18 /oracle/XXX/YYYreorg/sexwtnsl/cntrlXXX.old Control File Copy 24622 22-FEB-18 /oracle/XXX/YYYreorg/sexwtnsl/cntrlXXX.new Control File Copy 24623 22-FEB-18 /oracle/XXX/YYYreorg/sexwtthh/cntrlXXX.old Control File Copy 24624 22-FEB-18 /oracle/XXX/YYYreorg/sexwtthh/cntrlXXX.new Control File Copy 24625 22-FEB-18 /oracle/XXX/YYYreorg/sexwttjx/cntrlXXX.old Control File Copy 24626 22-FEB-18 /oracle/XXX/YYYreorg/sexwttjx/cntrlXXX.new Control File Copy 24627 22-FEB-18 /oracle/XXX/YYYreorg/sexwuasu/cntrlXXX.old Control File Copy 24628 22-FEB-18 /oracle/XXX/YYYreorg/sexwuasu/cntrlXXX.new Control File Copy 24629 23-FEB-18 /oracle/XXX/YYYreorg/sexwuqtu/cntrlXXX.old Control File Copy 24630 23-FEB-18 /oracle/XXX/YYYreorg/sexwuqtu/cntrlXXX.new Control File Copy 24631 08-MAR-18 /oracle/XXX/YYYreorg/sexzjthw/cntrlXXX.old Control File Copy 24632 08-MAR-18 /oracle/XXX/YYYreorg/sexzjthw/cntrlXXX.new Control File Copy 24633 11-MAY-18 /tmp/control01.ctl Control File Copy 24634 14-MAY-18 /oracle/XXX/112_64/dbs/snapcf_XXX.f Control File Copy 24635 22-APR-19 /oracle/XXX/YYYreorg/sfaywtzs/cntrlXXX.old Control File Copy 24636 22-APR-19 /oracle/XXX/YYYreorg/sfaywtzs/cntrlXXX.new Control File Copy 24637 22-APR-19 /oracle/XXX/YYYreorg/sfaywukz/cntrlXXX.old Control File Copy 24638 22-APR-19 /oracle/XXX/YYYreorg/sfaywukz/cntrlXXX.new Control File Copy 24639 26-SEP-19 /oracle/XXX/YYYbackup/cntrlXXX.dbf Backup Set 3276340 02-FEB-20 Backup Piece 3276351 02-FEB-20 /backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200202_35669_1_FULL deleted backup piece backup piece handle=/backup_new/YYY_Backups/xxxxxxxxxxxxx/XXX/rman/XXX_20200202_35669_1_FULL RECID=23483 STAMP=103132361 4Deleted 1 objects
RMAN-06207: WARNING: 21 objects could not be deleted for DISK channel(s) due RMAN-06208: to mismatched status. Use CROSSCHECK command to fix status RMAN-06210: List of Mismatched objects RMAN-06211: ========================== RMAN-06212: Object Type Filename/Handle RMAN-06213: --------------- --------------------------------------------------- RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwtcxc/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwtcxc/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwtnsl/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwtnsl/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwtthh/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwtthh/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwttjx/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwttjx/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwuasu/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwuasu/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwuqtu/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexwuqtu/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexzjthw/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sexzjthw/cntrlXXX.new RMAN-06214: Datafile Copy /tmp/control01.ctl RMAN-06214: Datafile Copy /oracle/XXX/112_64/dbs/snapcf_XXX.f RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sfaywtzs/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sfaywtzs/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sfaywukz/cntrlXXX.old RMAN-06214: Datafile Copy /oracle/XXX/YYYreorg/sfaywukz/cntrlXXX.new RMAN-06214: Datafile Copy /oracle/XXX/YYYbackup/cntrlXXX.dbf
released channel: c1
released channel: c2
released channel: c3
released channel: c4
Recovery Manager complete.
On Sun, Feb 23, 2020 at 9:15 PM Mladen Gogala <gogala.mladen_at_gmail.com<mailto:gogala.mladen_at_gmail.com>> wrote:
BR*Tools do leave a log file and have several methods. One of them is UTL_FILE, the other one is RMAN. UTL_FILE is basially, version 7 style backup of files with the database in the backup mode. Another brbackup method is RMAN, with some twists. BR*Tools can't utilize catalog. I wander what method is used by BR*Tools. BR*Tools, as opposed to RMAN, can also utilize snapshots. The phrase "SAP backup" doesn't mean much without the exact configuration of brbackup. BR*backup is also backing up the SAP configuration files, which are ignored by usual RMAN backups. SAP only certifies BR*Tools for SAP R3 backup. RMAN backup is not certified. There are many nuances here, and discussing BR*Tools without knowing the details is pointless. On 2/23/20 9:23 PM, Jack van Zanen wrote: First question: Can they prove it is your backup causing the Performance issue. You may be on a wild goose chase
Even SAP backups most likely leave a log file behind somewhere that should tell you what the SAP backup is doing (is it actually making a backup?) . Don't they use RMAN under the hood anyway?
Regards
Jack van Zanen
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient. If you are not the intended recipient, please be aware that any disclosure, copying, distribution or use of this e-mail or any attachment is prohibited. If you have received this e-mail in error, please contact the sender and delete all copies. Thank you for your cooperation
On Sat, Feb 22, 2020 at 6:22 AM Sandra Becker <sbecker6925_at_gmail.com<mailto:sbecker6925_at_gmail.com>> wrote: Oracle EE v11.2
The Basis admin from another team has asked if I can help him find out why RMAN backups of his SAP database cause severe performance issues in the database with only two channels. Yet the SAP backup method runs with 6 parallel processes in about 4-5 hours. I know nothing about how the SAP backups are configured and don't have access to any of that information, so I'm not sure you'll be able to provide much help to us. I do know the following:
- they don't use ASM
- all files are on the same NFS mount, including the datafiles, binaries, logs, audit files, etc.
- archivelogs are kept for 3 days and written to another NFS mounted drive
- SAP backup method uses 6 channels, backup completes in 4-5 hours
- RMAN backup was set for 2 channels, backup tool over 12 hours and caused significant performance degradation (so I was told, I can't prove it) Any suggestions on what they should look at to see what's going on or adjustments they should look into? I've looked at their RMAN configuration and it's actually pretty close to what I use in my production databases, just minor differences for path names and the like.
--
Sandy B.
--
Mladen Gogala
Database Consultant
Tel: (347) 321-1217
--
Sandy B.
--
Sandy B.
-- http://www.freelists.org/webpage/oracle-lReceived on Mon Feb 24 2020 - 21:23:13 CET