Oracle - PDB$SEED
Can I have more than one PDB$SEED?
No, one CDB can have and only have one PDB$SEED. But, we can put a database to read only as SEED database, and clone from it.
Can I close PDB$SEED?
By default, PDB$SEED cannot be modified and close
SQL> alter pluggable database PDB$SEED close;
alter pluggable database PDB$SEED close
*
ERROR at line 1:
ORA-65017: seed pluggable database may not be dropped or altered
SQL> alter pluggable database all close;
Pluggable database altered.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
3 HR MOUNTED
But, with dbms_pdb.exec_as_oracle_script, we can do this:
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
3 HR MOUNTED
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED close');
PL/SQL procedure successfully completed.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED MOUNTED
3 HR MOUNTED
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED open');
PL/SQL procedure successfully completed.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ WRITE NO
3 HR MOUNTED
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED close');
PL/SQL procedure successfully completed.
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED open read only');
PL/SQL procedure successfully completed.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
3 HR MOUNTED
How to modify PDB$SEED?
How To Modify the Common Profile Limit in Multitenant Database? (Doc ID 2328994.1)
alter session set "_oracle_script"=true;
SQL> alter session set container=pdb$seed;
Session altered.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
SQL> alter session set "_oracle_script"=true;
Session altered.
SQL> shutdown immediate;
Pluggable Database closed.
SQL> startup
Pluggable Database opened.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ WRITE NO
SQL> create tablespace test datafile size 10M;
Tablespace created.
SQL> shutdown immediate;
Pluggable Database closed.
SQL> startup open read only;
Pluggable Database opened.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
-- after reconnect to cdb
SQL> startup force;
ORACLE instance started.
Total System Global Area 713031680 bytes
Fixed Size 2928488 bytes
Variable Size 520093848 bytes
Database Buffers 184549376 bytes
Redo Buffers 5459968 bytes
Database mounted.
Database opened.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
3 HR MOUNTED
What will happen if the datafile of PDB$SEED missing and how to recreate without backup?
CDB can open, PDB$SEED can open read only if the missing datafile is not SYSTEM/UNDO.
SQL> select file_name from dba_data_files;
select file_name from dba_data_files
*
ERROR at line 1:
ORA-01157: cannot identify/lock data file 13 - see DBWR trace file
ORA-01110: data file 13: '/opt/oracle/oradata/O12102/7DE2B53C634D1689E053291010532345/datafile/o1_mf_test_g6pwnokd_.dbf'
If you don’t clone an new PDB, there is no impact.
There is no simple way to create PDB$SEED with some scripts.
The standard way is recreate a new CDB and unplug from the old cdb and plug into the new one.
Missing PDB$SEED's Datafiles with no backup (Doc ID 2104370.1)
How to create a new PDB$SEED from an existing PDB?
We can use dbms_pdb.exec_as_oracle_script to drop PDB$SEED and clone a new one from an existing PDB
But it is not an documented way.
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED close');
PL/SQL procedure successfully completed.
SQL> exec dbms_pdb.exec_as_oracle_script('drop pluggable database PDB$SEED including datafiles');
PL/SQL procedure successfully completed.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
3 HR MOUNTED
SQL> alter pluggable database hr open;
Pluggable database altered.
SQL> create pluggable database PDB$SEED FROM HR;
Pluggable database created.
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED MOUNTED
3 HR READ WRITE NO
SQL> alter pluggable database PDB$SEED open;
alter pluggable database PDB$SEED open
*
ERROR at line 1:
ORA-65017: seed pluggable database may not be dropped or altered
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED open');
PL/SQL procedure successfully completed.
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED close');
PL/SQL procedure successfully completed.
SQL> exec dbms_pdb.exec_as_oracle_script('alter pluggable database PDB$SEED open read only');
PL/SQL procedure successfully completed.
Do I need to patch PDB$SEED manually?
Patching the PDB$SEED (Doc ID 2038564.1)
PDB$SEED patching is automatically handled through datapatch so we shouldn’t have to manually patch the PDB$SEED.
What can I redefine when create a new PDB from PDB$SEED?
create pluggable database pdb1 admin user ctais2 identified by oracle roles=(dba) parallel 2 default tablespace test datafile size 10M storage unlimited tempfile reuse logging -- file_name_convert # useful is we don't use OMF -- create_file_dest # useful is we don't use OMF -- service_name_convert # there is no other service in the PDB$SEED -- path_prefix # used to restrict the path of directory objects -- standbys # used to exclude this PDB in the standby side -- user_tablespaces # not useful, PDB$SEED doesn't have other tablespaces -- host= port= # not useful, we create from PDB locally. /
Oracle - Set up automate oracle database startup/shutdown on RHEL7
If we are using chkconfig / init.d for the automate Oracle database shutdown, it will be failed in RHEL7
check the $ORACLE_HOME/shutdown.log, we can find that there is an error for database shutdown by service.
SQL*Plus: Release 12.1.0.2.0 Production on Wed Feb 6 10:29:15 2019 Copyright (c) 1982, 2014, Oracle. All rights reserved. SQL> Connected to an idle instance. SQL> ERROR: ORA-01034: ORACLE not available ORA-27101: shared memory realm does not exist Linux-x86_64 Error: 2: No such file or directory Additional information: 3651 Additional information: -1916159033 Process ID: 0 Session ID: 0 Serial number: 0 SQL> Disconnected Database instance "PPRD3" shut down.
Also check the Alert log, we can see there was no action of database shutdown.
Wed Feb 06 04:15:03 2019 Thread 1 cannot allocate new log, sequence 4438 Private strand flush not complete Current log# 8 seq# 4437 mem# 0: /t03/app/oracle/oradata/PPRD3/redo_AIR_8a.rdo Current log# 8 seq# 4437 mem# 1: /t03/app/oracle/oradata/PPRD3/redo_AIR_8b.rdo Wed Feb 06 04:15:06 2019 Thread 1 advanced to log sequence 4438 (LGWR switch) Current log# 9 seq# 4438 mem# 0: /t03/app/oracle/oradata/PPRD3/redo_AIR_9a.rdo Current log# 9 seq# 4438 mem# 1: /t03/app/oracle/oradata/PPRD3/redo_AIR_9b.rdo Wed Feb 06 10:32:59 2019 Starting ORACLE instance (normal) (OS id: 2266) Wed Feb 06 10:32:59 2019 CLI notifier numLatches:29 maxDescs:2393 Wed Feb 06 10:32:59 2019 ********************************************************************** Wed Feb 06 10:32:59 2019 Dump of system resources acquired for SHARED GLOBAL AREA (SGA) Wed Feb 06 10:32:59 2019 Per process system memlock (soft) limit = 35G Wed Feb 06 10:32:59 2019 Expected per process system memlock (soft) limit to lock SHARED GLOBAL AREA (SGA) into memory: 35G
That means the database is not shutdown gracefully during the machine reboot.
We were using chkconfig to configure service, and in RHEL7, it is converted to systemd internally.
[root@zoro ~]# cat /run/systemd/generator.late/dbora.service # Automatically generated by systemd-sysv-generator [Unit] Documentation=man:systemd-sysv-generator(8) SourcePath=/etc/rc.d/init.d/dbora Description=LSB: Starts the databases on system reboot Before=runlevel3.target Before=runlevel4.target Before=runlevel5.target Before=shutdown.target Before=gcstartup.service Before=lockgcstartup.service After=network-online.target Conflicts=shutdown.target [Service] Type=forking Restart=no TimeoutSec=5min IgnoreSIGPIPE=no KillMode=process GuessMainPID=no RemainAfterExit=yes ExecStart=/etc/rc.d/init.d/dbora start ExecStop=/etc/rc.d/init.d/dbora stop
And in /etc/rc.d/init.d/dbora. it is use “su - oracle -c” to shutdown database.
su - $ORA_OWNER -c "$ORA_HOME/bin/dbshut"
Follow this article:
Automatic Stop of Database (dbshut) not working in OL 7 with systemd (Doc ID 2229679.1)
This is because in RHEL7, init.d is no longer used for the service startup, and it actually be replaced by systemctl. The service which we use chkconfig to create will convert to systemd internally. And dbora script uses su to oracle owner and systemd is not able to keep track of that process.
We can follow
Automate Startup/Shutdown Of Oracle Database 12.2.0.1 On RHEL 7 (Doc ID 2417429.1)
to set up
First, remove chkconfig
# chkconfig --del dbora # systemctl stop dbora.service # systemctl disable dbora.service # systemctl daemon-reload # systemctl reset-failed # systemctl -l|grep dbora <== no entry here
Next, create systemd service
# mkdir /l01/app/oracle/scripts # touch /l01/app/oracle/scripts/start_all.sh #!/bin/bash export ORACLE_SID=12CR1 export ORAENV_ASK=NO . oraenv export ORAENV_ASK=YES lsnrctl start TEST_LISTENER lsnrctl start EXTPROC_LISTENER dbstart # touch /l01/app/oracle/scripts/stop_all.sh #!/bin/bash export ORACLE_SID=12CR1 export ORAENV_ASK=NO . oraenv export ORAENV_ASK=YES lsnrctl stop TEST_LISTENER lsnrctl stop EXTPROC_LISTENER dbshut # chown -R oracle.dba /l01/app/oracle/scripts # chmod u+x /l01/app/oracle/scripts/*.sh # use oracle for testing $ /l01/app/oracle/scripts/start_all.sh $ /l01/app/oracle/scripts/stop_all.sh # touch /lib/systemd/system/dbora.service [Unit] Description=The Oracle Database Service After=syslog.target network.target [Service] # systemd ignores PAM limits, so set any necessary limits in the service. # Not really a bug, but a feature. # https://bugzilla.redhat.com/show_bug.cgi?id=754285 LimitMEMLOCK=infinity LimitNOFILE=65535 LimitNPROC=16384 LimitCORE=0 #Type=simple # idle: similar to simple, the actual execution of the service binary is delayed # until all jobs are finished, which avoids mixing the status output with shell output of services. RemainAfterExit=yes User=oracle Group=dba ExecStart=/l01/app/oracle/scripts/start_all.sh ExecStop=/l01/app/oracle/scripts/stop_all.sh [Install] WantedBy=multi-user.target
before testing, record the setting of limit of SMON process
$ cat /proc/110456/limits Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 33554432 unlimited bytes Max core file size 0 0 bytes Max resident set unlimited unlimited bytes Max processes 16384 16384 processes Max open files 65536 65536 files Max locked memory 37316722688 37316722688 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 2015514 2015514 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us
# systemctl daemon-reload # systemctl start dbora.service # systemctl enable dbora.service
after testing
- check $ORACLE_HOME/startup.log
- check $ORACLE_HOME/shutdown.log
- check alert log
- compare the ulimit setting.
Oracle - Application Failover
Many DBAs may never pay attentions on this topic. I talked with some of my friends about how to make the application failover smoothly, the answer is TAF.
Actually, TAF is a failover mechanism for type 2 driver, like OCI. It is not working on JDBC Thin which is a type 4 driver.
Now, I want to talk a little bit about this TOPIC on RAC
There are four goals of failover:
- a connect strings, can connect to alive node without any change.
- a way to reconnect automatically.
- a method to detect the node failure ASAP.
- a way to handle uncommit transaction after reconnect to alive nodes.
For the first goal, we have at least the following three ways:
- use DNS, but how DNS know the node/database failure is a little hard to archive.
- put the IP addresses of all instances into connection strings.
- use scan-ip after 11.2
I don’t want to talk method 1, it is uncommon with Oracle RAC. The following is the configuration of method 2 and 3.
orcl-vip =
(DESCRIPTION=
(FAILOVER=on)
(ADDRESS_LIST=
(LOAD_BALANCE=off)(CONNECT_TIMEOUT=3)(RETRY_COUNT=3)
(ADDRESS=(PROTOCOL=TCP)(HOST=database01-vip)(PORT=1521))
(ADDRESS=(PROTOCOL=TCP)(HOST=database02-vip)(PORT=1521))
)
(CONNECT_DATA=(SERVICE_NAME=orcl))
)
-- or
orcl-scan =
(DESCRIPTION=
(FAILOVER=on)
(ADDRESS_LIST=
(LOAD_BALANCE=on)(CONNECT_TIMEOUT=3)(RETRY_COUNT=3)
(ADDRESS=(PROTOCOL=TCP)(HOST=rac-scan.rac.database.zhangqiaoc.com)(PORT=1521))
)
(CONNECT_DATA=(SERVICE_NAME=orcl))
)
Be aware, FAILOVER here is not TAF, it means if the first IP is not available, try next. It is ON by default. If set FAILOVER and LOAD_BALANCE to OFF, if the first IP is not available, a error will be reported:
$ sqlplus system/oracle@orcl-vip SQL*Plus: Release 18.0.0.0.0 - Production on Mon Feb 4 15:15:51 2019 Version 18.3.0.0.0 Copyright (c) 1982, 2018, Oracle. All rights reserved. ERROR: ORA-12514: TNS:listener does not currently know of service requested in connect descriptor
Now, our fisrt goal is accomplished.
Next, how to reconnect to survive nodes without intervention or application try.
There are three ways:
- TAF (transparent Application Failover), is for type 2 drivers, such of OCI, JDBC OCI, and .NET except ODP.
- FCF (Fast Connection Failover), is for type 4 drivers, such of JDBC Thin, ODP.net, but it is also working for OCI.
For TAF, both client side and server side are available.
The connection strings “orcl-vip” I used above is not client TAF on, so, after the fail of the instance 1
SQL> select instance_number from v$instance; INSTANCE_NUMBER --------------- 1 -- after shutdown node 2 SQL> / select instance_number from v$instance * ERROR at line 1: ORA-03135: connection lost contact Process ID: 1099 Session ID: 25 Serial number: 48031 SQL> / ERROR: ORA-03114: not connected to ORACLE
We turn client TAF on by using FAILOVER_MODE:
orcl-vip =
(DESCRIPTION=
(FAILOVER=on)
(ADDRESS_LIST=
(LOAD_BALANCE=on)(CONNECT_TIMEOUT=3)(RETRY_COUNT=3)
(ADDRESS=(PROTOCOL=TCP)(HOST=database01-vip.database.zhangqiaoc.com)(PORT=1521))
(ADDRESS=(PROTOCOL=TCP)(HOST=database02-vip.database.zhangqiaoc.com)(PORT=1521))
)
(CONNECT_DATA=(SERVICE_NAME=orcl)
(FAILOVER_MODE = (TYPE=SELECT)(METHOD=BASIC))
)
)
SQL> select instance_number from v$instance; INSTANCE_NUMBER --------------- 1 -- after shutdown node 2 SQL> / INSTANCE_NUMBER --------------- 2
TAF server side, should use a new created service name to connect.
$ srvctl add service -d orcl -s taf -r orcl1,orcl2 -e select -m basic -w 10 -z 150 $ srvctl start service -d orcl -s taf
For JDBC Thin mode, we need to use FCF. FCF doesn’t work with a service which TAF is on, so we need to create a separate service for FCF which TAF is off.
$ srvctl add service -d orcl -s fcf -r orcl1,orcl2 -e none -m none -w 0 -z 0 $ srvctl start service -d orcl -s fcf
When we enable server side TAF / FCF, the connection string should be the same as STEP 1, which is client TAF disabled.
Next, we needs a way to notify the application when the node is out of work ASAP.
Oracle affords FAN(Fast Application Notification) for this, and a lot of clients has integrated FAN with:
- OCI Session Pools
- Universal Connection Pool for JAVA
- Thin JDBC Driver (12.2 and later)
- ODP.NET managed and unmanaged providers.
- All Weblogic Server data sources, and Oracle Tuxedo.
- PHP
- Global Data Services
- Data Guard Broker
- OEM
- Tomcat / Websphere with UCP
Let’s first take a look at how the FAN works when the nodes down.
When the FAN is not properly configured, the session cannot break the following “select” due to there is no further data communication. After I shut down the host 2 by killing SMON, the sqlplus session is still there until I kill it directly after two hours.
[2/5/2019 11:58:02 AM] INSTANCE_NUMBER
[2/5/2019 11:58:02 AM] ---------------
[2/5/2019 11:58:02 AM] 2
[2/5/2019 11:58:02 AM]
[2/5/2019 11:58:04 AM] SQL>
[2/5/2019 11:58:04 AM] SQL>
[2/5/2019 11:58:25 AM] SQL> select count(*) from dba_objects, dba_objects;
-- shutdown node 2
[2/5/2019 1:50:00 PM]
[2/5/2019 1:50:00 PM]
[2/5/2019 1:59:59 PM]
[2/5/2019 1:59:59 PM]
[2/5/2019 1:59:59 PM]
-- after 2.5 hours
[2/5/2019 2:33:33 PM] Killed
After I set up FAN for SQLPLUS:
$ srvctl modify service -d orcl -s taf -notification true
SQLPLUS can break the connection and reconnect to alive node almost 30 seconds.
[2/5/2019 2:49:46 PM] INSTANCE_NUMBER
[2/5/2019 2:49:46 PM] ---------------
[2/5/2019 2:49:46 PM] 2
[2/5/2019 2:49:46 PM]
[2/5/2019 2:50:12 PM] SQL> select count(*) from dba_objects, dba_objects;
-- shutdown node 2
[2/5/2019 2:50:49 PM]
[2/5/2019 2:50:49 PM]
-- only after 30 seconds
[2/5/2019 2:51:18 PM] select count(*) from dba_objects, dba_objects
[2/5/2019 2:51:18 PM] *
[2/5/2019 2:51:18 PM] ERROR at line 1:
[2/5/2019 2:51:18 PM] ORA-25408: can not safely replay call
On this example, ORA-25408 is reported, it is an expected error. If we want to SELECT failover, we should set the failover_mode to SELECT
$ srvctl modify service -d orcl -s taf -e select
FAN is only a set of defined event, so, there are some mechanism to send out the event of node down, database down, and etc.
Two method for this:
- AQ HA notification, for OCI and ODP.NET unmanaged client before 12.1
- ONS(Oracle Notification Service), for JDBC, and OCI and ODP.NET after 12.1
The followed graphic shows that the mechanisms the different drivers use in 10,11,and 12.
Fast Application Notification (FAN) Includes fanWatcher: A utility to subscribe to ONS and view FAN events
https://www.oracle.com/technetwork/database/options/clustering/applicationcontinuity/learnmore/fastapplicationnotification12c-2538999.pdf
With the installation of GRID, we only need to create a dynamic service for clients.
Nothing needed to be set on the server side, except for OCI and ODP.NET
The notification attribute of the service has to be set to TRUE for them.
$ srvctl modify service -d orcl -s taf -notification true
But for the client side, it is extremely complicated.
You can read the following document to figure out how to set up:
- Fast Application Notification (FAN) Includes fanWatcher: A utility to subscribe to ONS and view FAN events
- Client Failover Best Practices for Highly Available Oracle Databases Oracle Database 12c
- Client Failover Best Practices for Highly Available Oracle Databases: Oracle Database 11g Release 2
For example:
JDBC with UCP
- code
pds = PoolDataSourceFactory.getPoolDataSource(); pds.setConnectionPoolName("FCFSamplePool"); pds.setFastConnectionFailoverEnabled(true); // pds.setONSConfiguration("propertiesfile=/usr/ons/ons.properties"); Properties prop = new Properties(); prop.put(oracle.net.ns.SQLnetDef.TCP_CONNTIMEOUT_STR, ""+3000); // 3000ms prop.put("oracle.jdbc.thinForceDNSLoadBalancing","true"); pds.setConnectionProperties(prop); pds.setConnectionFactoryClassName("oracle.jdbc.pool.OracleDataSource"); pds.setUser("system"); pds.setPassword("oracle"); pds.setURL("jdbc:oracle:thin@((CONNECT_TIMEOUT=4)(RETRY_COUNT=30)(RETRY_DELAY=3) "+ " (ADDRESS_LIST = "+ " (LOAD_BALANCE=on) "+ " ( ADDRESS = (PROTOCOL = TCP)(HOST=RAC-SCAN)(PORT=1521))) "+ " (ADDRESS_LIST = "+ " (LOAD_BALANCE=on) "+ "( ADDRESS = (PROTOCOL = TCP)(HOST=DG-SCAN)(PORT=1521)))"+ "(CONNECT_DATA=(SERVICE_NAME=service_name)))"); - jar ons.jar, ucp.jar ,and the jdbc driver jar file should in the CLASSPATH
Now, we know what is TAF, FCF, FAN, and ONS, and our application can survive from the node / instance failure. But there is still a lot of side effect of failover we should be dealing with. for example: the nls setting is not the same if we don’t implement callback function.
INSTANCE_NUMBER --------------- 2 SQL> alter session set nls_date_format = 'yyyymmdd hh24miss'; Session altered. SQL> select sysdate from dual; SYSDATE --------------- 20190208 160028 -- kill the instance 2 SQL> / SYSDATE --------------- 08-FEB-19
And, the transaction have to be rollback after failover.
INSTANCE_NUMBER
---------------
1
SQL> truncate table test1;
Table truncated.
SQL> select * from test1;
no rows selected
SQL> insert into test1 values(1);
1 row created.
-- shutdown abort instance 1;
SQL> @i.sql
select instance_number from v$instance
*
ERROR at line 1:
ORA-25402: transaction must roll back
SQL> rollback;
Rollback complete.
SQL> @i.sql
INSTANCE_NUMBER
---------------
2
From 12.1, Oracle affords Application Continuity to handle callback automatically and transaction failover.
For 12.1, AC is only supported on Java, from 12.2, AC can be used on OCI, ODP.net
How to enable Application Continuity on Service?
-failovertype transaction – AC
-commit_outcome TRUE – TG
srvctl add service -d orcl -pdb hr -s ac -failovertype transaction -failovermethod basic \
-commit_outcome TRUE -preferred orcl1,orcl2
And, the REMOTE_LISTENER setting for the database must include the addresses in the ADDRESS_LISTs for all URL used for client connection, SCAN or VIPs
Application Continuity has to be enabled with Transaction Guard which I will take it later.
[oracle@database01 ~]$ srvctl modify service -d orcl -pdb hr -s ac -failovertype select -failovermethod basic -commit_outcome TRUE [oracle@database01 ~]$ srvctl modify service -d orcl -pdb hr -s ac -failovertype transaction -failovermethod basic -commit_outcome FALSE PRCD-1083 : Failed to modify service ac PRCD-1271 : Failed to unset commit outcome because the failover type is set to TRANSACTION
I tested with sqlplus, but AC is not working, the ORA-41412 is always reported, and the failover failed.
But, it is working fine with JDBC
How To Test Application Continuity Using A Standalone Java Program (Doc ID 1602233.1)
However, the code has some problems, I modified it a little bit to demo NLS_DATE_FORMAT replay, transaction failover, and the replay of mutable SYS_GUID().
The sql we want to protect should be in between beginRequest() and endRequest() functions.
The database user must be grant “keep sysguid” for the mutable GUID replay to get the original GUID, otherwise, a new GUID will be used in replay.
SQL> grant keep sysguid to ctais2;
// AcTest.java
import java.sql.*;
import oracle.jdbc.*;
public class AcTest
{
public static void main(String[] args) throws SQLException,java.lang.InterruptedException
{
oracle.jdbc.replay.OracleDataSource AcDatasource = oracle.jdbc.replay.OracleDataSourceFactory.getOracleDataSource();
AcDatasource.setURL("jdbc:oracle:thin:@rac-scan.rac.database.zhangqiaoc.com:1521/ac");
AcDatasource.setUser("CTAIS2");
AcDatasource.setPassword("oracle");
Connection conn = AcDatasource.getConnection();
conn.setAutoCommit(false);
PreparedStatement stmt = conn.prepareStatement("select instance_name from v$instance");
ResultSet rset = stmt.executeQuery();
while (rset.next()){
System.out.println("You are Connected to RAC Instance - "+ rset.getString(1));
}
stmt = conn.prepareStatement("select sys_guid() from dual");
rset = stmt.executeQuery();
while (rset.next()){
System.out.println("GUID: "+rset.getString(1));
}
// the code you want to protected should in between begin and end
((oracle.jdbc.replay.ReplayableConnection)conn).beginRequest();
stmt = conn.prepareStatement("alter session set nls_date_format='yyyymmdd hh24miss'");
stmt.execute();
stmt = conn.prepareStatement("insert into test1 values(1)");
stmt.execute();
stmt = conn.prepareStatement("insert into test2 values(sys_guid())");
stmt.execute();
Thread.currentThread().sleep(60000);
// shutdown the pdb here
PreparedStatement stmt1 = conn.prepareStatement("select instance_name from v$instance");
ResultSet rset1 = stmt1.executeQuery();
while (rset1.next()){
System.out.println("After Replay Connected to RAC Instance - "+rset1.getString(1));
}
// NLS_DATE_FORMAT is replayed.
stmt1 = conn.prepareStatement("select value from v$nls_parameters where parameter='NLS_DATE_FORMAT'");
rset1 = stmt1.executeQuery();
while (rset1.next()){
System.out.println("NLS_DATE_FORMAT: "+rset1.getString(1));
}
stmt1 = conn.prepareStatement("select sys_guid() from dual");
rset1 = stmt1.executeQuery();
while (rset1.next()){
System.out.println("GUID: "+rset1.getString(1));
}
// finally, we can see the new record
conn.commit();
rset.close();
stmt.close();
rset1.close();
stmt1.close();
conn.close();
((oracle.jdbc.replay.ReplayableConnection)conn).endRequest();
}
}
Compile and Test
$ export PATH=/u01/app/18.3.0/grid/jdk/bin:$PATH
$ export CLASSPATH=.:$CLASSPATH
$ javac -Djava.ext.dirs=/u01/app/oracle/product/18.3/db_1/jdbc/lib AcTest.java
$ java -Djava.ext.dirs=/u01/app/oracle/product/18.3/db_1/jdbc/lib:/u01/app/oracle/product/12.1/db_1/oc4j/lib AcTest
[oracle@database01 ~]$ java -Djava.ext.dirs=/u01/app/oracle/product/18.3/db_1/jdbc/lib:/u01/app/oracle/product/12.1/db_1/oc4j/lib AcTest
You are Connected to RAC Instance - orcl1
GUID: 81D23D34DF307041E0532910105314FE <== original GUID
<== shutdown instance 1
After Replay Connected to RAC Instance - orcl2 <== failover successful
NLS_DATE_FORMAT: yyyymmdd hh24miss <== nls_date_format has been replayed.
GUID: 81D240EFA652587FE0532A101053BBA8 <== new GUID
SQL> select * from test1;
ID
----------
1 <== transaction replay successful
SQL> select * from test2;
ID
--------------------------------
81D23D34DF317041E0532910105314FE <== with transaction replay, the GUID is still the original value.
And, there is also a great advantage of AC is that it can notify the event of network down.
$ sqlplus -ac ctais2/oracle@rac-scan.rac.database.zhangqiaoc.com:1521/ac @i.sql INSTANCE_NUMBER --------------- 2 -- take the network of node 2 down -- # ifconfig net0 down SQL> select count(*) from dba_objects, dba_objects; select count(*) from dba_objects, dba_objects * ERROR at line 1: ORA-12153: TNS:not connected Process ID: 2795 Session ID: 254 Serial number: 59658 SQL> @i.sql ERROR: ORA-03114: not connected to ORACLE
There is a problem of connection failover of AC for SQLPLUS. But it actually shows that the connection can be broken.
Compare with TAF, the session will be there almost forever.
Moreover, in 12c, discconect with service stop become my graceful, and there is no AC needed
Let’s see at first how switchover working in 11.2.0.4
SQL> @i INSTANCE_NUMBER --------------- 2 -- $ srvctl stop service -d orcl -s taf -i orcl2 -f SQL> / select instance_number from v$instance * ERROR at line 1: ORA-03113: end-of-file on communication channel Process ID: 27272 Session ID: 99 Serial number: 123 -- an error is reported, it is not graceful SQL> / INSTANCE_NUMBER --------------- 1
In 12c, -f is working very similar to drain-out, no error will be reported. That makes swithover more graceful.
INSTANCE_NUMBER --------------- 2 -- $ srvctl stop service -d orcl -s taf -i orcl2 -f SQL> / INSTANCE_NUMBER --------------- 1
But it will still lead a problem that even kill -9 the session, this session will failover to the other instance gracefully.
If it is working with AC, the SQL and transaction will be replayed on the new instance, in this situation, we may needs to use the following SQL to disconnect session.
alter system kill session 'sid, serial#, @inst' noreplay; alter system disconnect session 'sid, serial#, @inst' noreplay; execute DBMS_SERVICE.DISCONNECT_SESSION(‘[service name]’, DBMS_SERVICE.NOREPLAY) ;
or stop service with noreplay
srvctl stop service -db orcl -instance orcl2 -service orcl_pdb38 -force -stop_option immediate -noreplay
By the way, the different in between “kill session” and “disconnect session” is that “kill session” marks session as killed and the session will be not disconnected until the user issues a new call. But “disconnect session” is a little like “kill -9” and the session will not be in v$session almost immediately.
For the session which is killed, cannot be failover to the new instance.
But, for the session which is disconnected or “kill -9” will be failover to the new instance, and the killed session is not failover and must be proactively reconnect.
With AC
- All common database calls are replayed - SELECT, PL/SQL, ALTER SESSION, DML, DDL, COMMIT, ROLLBACK, SAVEPOINT, JDBC and OCI RPCs, and local JDBC and OCI calls.
- All common database transaction types are replayed - local, parallel, remote, distributed, and transactions embedded within PL/SQL.
- The mutable objects - sequence, date/time, GUIDs - are kept by “Grant Keep”
The information which can be replayed is stored by driver on client, so the more cpu and memory are needed on client. It is recommended to allocate 4 to 8GB or more to JVM
With Failover, normally, we don’t need to deal with Connection Errors any more, but we should handle Failover-related Errors.
Database Connection and Failover Errors Recognized by DBService (Doc ID 2268932.1)
Connection errors
ORA-1012 Not logged on
ORA-1092 Instance terminated - likely via shutdown abort
ORA-03113 End-of-file on communication channel
ORA-3114 Not connected to ORACLE
ORA-3135 Connection lost contact
ORA-25403 Could not reconnect
ORA-19755 Could not open change tracking file
Failover-related errors
ORA-25401 Can not continue fetches
ORA-25402 Transaction must roll back
ORA-25405 Transaction status unknown
ORA-25408 Can not safely replay call
ORA-25409 Failover happened during the network operation (lost on fetching a LOB column)
ORA-25425 Connection lost during rollback
The four goal can be archived by the ways I talked above.
But we ignored one thing - Transaction Guard
Transaction Guard is used to handle the situation that the commit is successful on the server, but, before the response returns to the driver/client, the instance down. So, after failover, a failure will be returned to client, it will make a lot of confusing
Without TG, in this situation, the application needs to search data to distinguish whether the commit is successful or failed.
For TG, it uses an object named Logical Transaction Identifier (LTXID) which is stored in the OCI session handle and in a connection object for the JDBC Thin and ODP.NET drivers.
The drivers can use LTXID to retrive related information to determine whether the commit is success.
With TG, AC can offer the failover of transaction.
Oracle - How to check whether RMAN can restore the database to a specific time?
Restore database preview can be used to achieve this goal. It can be done on the local database, but it is also can be done with catalog on the another box.
On the source database
- Get the dbid from v$database
On a different box
- Create pwd file, password doesn’t need to be the same with the source.
- Create pfile , only one parameter is needed, *.db_name=xxxx
- Set ORACLE_SID, start instance to nomount.
- Run script below, using “set dbid” to set database id and “set until time” to set your target.
rman target /
connect catalog rman/xxxxx@CATALOG_DB
run {
set DBID 451988051;
set until time "to_date('Jan 7 2019 17:30:00','Mon DD YYYY HH24:MI:SS')";
restore database preview;
}
But there is no guarantee that all backup pieces are there, it would be better to check it with CROSSCHECK
CROSSCHECK BACKUP DEVICE TYPE DISK COMPLETED BETWEEN '07-JAN-19' AND '08-JAN-19'; CROSSCHECK BACKUPSET 1338, 1339, 1340;
Before Restore, we can use RESTORE DATABASE VALIDATE to make sure the recoverable of backup pieces. We can also use VALIDATE BACKUPSET to check a particular backup piece.
The output of RESTORE DATABASE PREVIEW below.
The all backup pieces this restore needs are list, including LEVEL0, LEVEL2, and Archive log.
RMAN> run {
set dbid 451988051;
set until time "to_date('Jan 7 2019 17:30:00','Mon DD YYYY HH24:MI:SS')";
restore database preview;
}
2> 3> 4> 5>
executing command: SET DBID
database name is "XXX" and DBID is 451988051
executing command: SET until clause
Starting restore at 29-JAN-19
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=1923 device type=DISK
allocated channel: ORA_DISK_2
channel ORA_DISK_2: SID=1985 device type=DISK
List of Backup Sets
===================
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723040 Incr 0 25.79G DISK 00:09:50 07-JAN-19
BP Key: 425723070 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139758_piece1_20190107_fetmmi2j_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723040
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
1 0 Incr 143493006556 07-JAN-19 /l06/app/oracle/oradata/ORCL/system01.dbf
39 0 Incr 143493006556 07-JAN-19 /l06/app/oracle/oradata/ORCL/faisndx_ORCL_01.dbf
99 0 Incr 143493006556 07-JAN-19 /l07/app/oracle/oradata/ORCL/satundx_ORCL_05.dbf
147 0 Incr 143493006556 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_07.dbf
167 0 Incr 143493006556 07-JAN-19 /l07/app/oracle/oradata/ORCL/workflow_ORCL_06.dbf
198 0 Incr 143493006556 07-JAN-19 /l06/app/oracle/oradata/ORCL/sysaux07.dbf
223 0 Incr 143493006556 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_18.dbf
230 0 Incr 143493006556 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfndx_ORCL_04.dbf
236 0 Incr 143493006556 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_08.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723044 Incr 0 27.52G DISK 00:10:37 07-JAN-19
BP Key: 425723074 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139762_piece1_20190107_fitmmjdi_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723044
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
2 0 Incr 143493256991 07-JAN-19 /l06/app/oracle/oradata/ORCL/sysaux01.dbf
38 0 Incr 143493256991 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_01.dbf
51 0 Incr 143493256991 07-JAN-19 /l07/app/oracle/oradata/ORCL/fimsdata_ORCL_01.dbf
95 0 Incr 143493256991 07-JAN-19 /l07/app/oracle/oradata/ORCL/satundx_ORCL_01.dbf
124 0 Incr 143493256991 07-JAN-19 /l06/app/oracle/oradata/ORCL/payrdata_ORCL_05.dbf
140 0 Incr 143493256991 07-JAN-19 /l06/app/oracle/oradata/ORCL/fimsdata_ORCL_06.dbf
166 0 Incr 143493256991 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_21.dbf
218 0 Incr 143493256991 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_04.dbf
229 0 Incr 143493256991 07-JAN-19 /l07/app/oracle/oradata/ORCL/fimsdata_ORCL_07.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723039 Incr 0 14.85G DISK 00:06:17 07-JAN-19
BP Key: 425723069 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139757_piece1_20190107_fdtmmhvj_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723039
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
3 0 Incr 143492996067 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_01.dbf
92 0 Incr 143492996067 07-JAN-19 /l07/app/oracle/oradata/ORCL/satudata_ORCL_04.dbf
109 0 Incr 143492996067 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtdata_ORCL_05.dbf
141 0 Incr 143492996067 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_11.dbf
161 0 Incr 143492996067 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_18.dbf
194 0 Incr 143492996067 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_06.dbf
220 0 Incr 143492996067 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_16.dbf
225 0 Incr 143492996067 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_33.dbf
256 0 Incr 143492996067 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_36.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723046 Incr 0 20.13G DISK 00:09:56 07-JAN-19
BP Key: 425723076 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139765_piece1_20190107_fltmmk1q_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723046
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
4 0 Incr 143493345254 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_02.dbf
22 0 Incr 143493345254 07-JAN-19 /l06/app/oracle/oradata/ORCL/banproxy_ORCL_01.dbf
46 0 Incr 143493345254 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtrnd_acctndx_ORCL_01.dbf
54 0 Incr 143493345254 07-JAN-19 /l07/app/oracle/oradata/ORCL/fimsdata_ORCL_04.dbf
87 0 Incr 143493345254 07-JAN-19 /l06/app/oracle/oradata/ORCL/RMS_DATA_03.dbf
114 0 Incr 143493345254 07-JAN-19 /l06/app/oracle/oradata/ORCL/taisdata_ORCL_03.dbf
155 0 Incr 143493345254 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_15.dbf
173 0 Incr 143493345254 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_08.dbf
244 0 Incr 143493345254 07-JAN-19 /l06/app/oracle/oradata/ORCL/devl_ORCL_23.dbf
249 0 Incr 143493345254 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_34.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723048 Incr 0 16.87G DISK 00:09:52 07-JAN-19
BP Key: 425723078 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139767_piece1_20190107_fntmmkks_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723048
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
5 0 Incr 143493408784 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_03.dbf
48 0 Incr 143493408784 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtrnd_glacndx_ORCL_01.dbf
57 0 Incr 143493408784 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_01.dbf
88 0 Incr 143493408784 07-JAN-19 /l06/app/oracle/oradata/ORCL/RMS_DATA_04.dbf
115 0 Incr 143493408784 07-JAN-19 /l06/app/oracle/oradata/ORCL/taisndx_ORCL_01.dbf
120 0 Incr 143493408784 07-JAN-19 /l06/app/oracle/oradata/ORCL/users_ORCL_01.dbf
160 0 Incr 143493408784 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_17.dbf
176 0 Incr 143493408784 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_25.dbf
245 0 Incr 143493408784 07-JAN-19 /l06/app/oracle/oradata/ORCL/devl_ORCL_24.dbf
251 0 Incr 143493408784 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_35.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723037 Incr 0 26.24G DISK 00:09:53 07-JAN-19
BP Key: 425723067 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139755_piece1_20190107_fbtmmhcm_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723037
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
6 0 Incr 143492923974 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_04.dbf
66 0 Incr 143492923974 07-JAN-19 /l06/app/oracle/oradata/ORCL/legandx_ORCL_02.dbf
81 0 Incr 143492923974 07-JAN-19 /l06/app/oracle/oradata/ORCL/posnndx_ORCL_01.dbf
91 0 Incr 143492923974 07-JAN-19 /l07/app/oracle/oradata/ORCL/satudata_ORCL_03.dbf
108 0 Incr 143492923974 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtdata_ORCL_07.dbf
144 0 Incr 143492923974 07-JAN-19 /l07/app/oracle/oradata/ORCL/axiom_ORCL_04.dbf
159 0 Incr 143492923974 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_04.dbf
213 0 Incr 143492923974 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_32.dbf
222 0 Incr 143492923974 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_17.dbf
224 0 Incr 143492923974 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_07.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723049 Incr 0 17.22G DISK 00:10:54 07-JAN-19
BP Key: 425723079 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139766_piece1_20190107_fmtmmkkq_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723049
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
7 0 Incr 143493408505 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_05.dbf
9 0 Incr 143493408505 07-JAN-19 /l06/app/oracle/oradata/ORCL/atsdata_ORCL_01.dbf
32 0 Incr 143493408505 07-JAN-19 /l06/app/oracle/oradata/ORCL/emdata_ORCL_03.dbf
37 0 Incr 143493408505 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_02.dbf
93 0 Incr 143493408505 07-JAN-19 /l07/app/oracle/oradata/ORCL/satudata_ORCL_05.dbf
153 0 Incr 143493408505 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_08.dbf
164 0 Incr 143493408505 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_19.dbf
228 0 Incr 143493408505 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_08.dbf
241 0 Incr 143493408505 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_13.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723050 Incr 0 22.91G DISK 00:09:23 07-JAN-19
BP Key: 425723080 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139768_piece1_20190107_fotmml7i_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723050
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
8 0 Incr 143493466122 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_06.dbf
49 0 Incr 143493466122 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtrnd_keyndx_ORCL_01.dbf
58 0 Incr 143493466122 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_02.dbf
69 0 Incr 143493466122 07-JAN-19 /l06/app/oracle/oradata/ORCL/odsdata_ORCL_01.dbf
121 0 Incr 143493466122 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_01.dbf
163 0 Incr 143493466122 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_09.dbf
177 0 Incr 143493466122 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_26.dbf
246 0 Incr 143493466122 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_25.dbf
255 0 Incr 143493466122 07-JAN-19 /l06/app/oracle/oradata/ORCL/posnndx_ORCL_03.dbf
258 0 Incr 143493466122 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_38.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723051 Incr 0 27.54G DISK 00:10:45 07-JAN-19
BP Key: 425723081 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139769_piece1_20190107_fptmml9k_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723051
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
10 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/atsndx_ORCL_01.dbf
17 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/axiom_ORCL_01.dbf
68 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/mlogdata_ORCL_02.dbf
71 0 Incr 143493471961 07-JAN-19 /l07/app/oracle/oradata/ORCL/payrdata_ORCL_02.dbf
101 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_02.dbf
119 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/traveldata_ORCL_01.dbf
137 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_10.dbf
191 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfndx_ORCL_03.dbf
192 0 Incr 143493471961 07-JAN-19 /l06/app/oracle/oradata/ORCL/devl_ORCL_13.dbf
260 0 Incr 143493471961 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_30.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723053 Incr 0 24.96G DISK 00:12:12 07-JAN-19
BP Key: 425723083 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139771_piece1_20190107_frtmmlu2_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723053
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
11 0 Incr 143493547427 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_01.dbf
50 0 Incr 143493547427 07-JAN-19 /l06/app/oracle/oradata/ORCL/fimscol_ORCL_01.dbf
52 0 Incr 143493547427 07-JAN-19 /l07/app/oracle/oradata/ORCL/fimsdata_ORCL_02.dbf
59 0 Incr 143493547427 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_03.dbf
118 0 Incr 143493547427 07-JAN-19 /l06/app/oracle/oradata/ORCL/tools_ORCL_01.dbf
123 0 Incr 143493547427 07-JAN-19 /l06/app/oracle/oradata/ORCL/payrdata_ORCL_04.dbf
170 0 Incr 143493547427 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_10.dbf
181 0 Incr 143493547427 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_09.dbf
247 0 Incr 143493547427 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_26.dbf
259 0 Incr 143493547427 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_39.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723052 Incr 0 20.64G DISK 00:07:53 07-JAN-19
BP Key: 425723082 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139770_piece1_20190107_fqtmmlpf_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723052
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
12 0 Incr 143493526642 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_02.dbf
21 0 Incr 143493526642 07-JAN-19 /l06/app/oracle/oradata/ORCL/baniam_ORCL_01.dbf
33 0 Incr 143493526642 07-JAN-19 /l06/app/oracle/oradata/ORCL/emdata_ORCL_04.dbf
53 0 Incr 143493526642 07-JAN-19 /l07/app/oracle/oradata/ORCL/fimsdata_ORCL_03.dbf
60 0 Incr 143493526642 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_04.dbf
126 0 Incr 143493526642 07-JAN-19 /l06/app/oracle/oradata/ORCL/system02.dbf
174 0 Incr 143493526642 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_23.dbf
186 0 Incr 143493526642 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_10.dbf
248 0 Incr 143493526642 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_27.dbf
262 0 Incr 143493526642 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_09.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723054 Incr 0 17.96G DISK 00:10:39 07-JAN-19
BP Key: 425723084 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139772_piece1_20190107_fstmmm8j_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723054
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
13 0 Incr 143493590003 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_03.dbf
56 0 Incr 143493590003 07-JAN-19 /l06/app/oracle/oradata/ORCL/flexdata_ORCL_01.dbf
61 0 Incr 143493590003 07-JAN-19 /l06/app/oracle/oradata/ORCL/genndx_ORCL_01.dbf
83 0 Incr 143493590003 07-JAN-19 /l06/app/oracle/oradata/ORCL/rbs_ORCL_01.dbf
96 0 Incr 143493590003 07-JAN-19 /l07/app/oracle/oradata/ORCL/satundx_ORCL_02.dbf
127 0 Incr 143493590003 07-JAN-19 /l06/app/oracle/oradata/ORCL/system03.dbf
175 0 Incr 143493590003 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_24.dbf
187 0 Incr 143493590003 07-JAN-19 /l07/app/oracle/oradata/ORCL/workflow_ORCL_11.dbf
250 0 Incr 143493590003 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_28.dbf
266 0 Incr 143493590003 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfndx_ORCL_05.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723055 Incr 0 18.25G DISK 00:06:25 07-JAN-19
BP Key: 425723085 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139773_piece1_20190107_fttmmmla_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723055
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
14 0 Incr 143493636887 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_04.dbf
30 0 Incr 143493636887 07-JAN-19 /l06/app/oracle/oradata/ORCL/emdata_ORCL_01.dbf
62 0 Incr 143493636887 07-JAN-19 /l06/app/oracle/oradata/ORCL/genndx_ORCL_02.dbf
84 0 Incr 143493636887 07-JAN-19 /l06/app/oracle/oradata/ORCL/rbsbat_ORCL_01.dbf
97 0 Incr 143493636887 07-JAN-19 /l07/app/oracle/oradata/ORCL/satundx_ORCL_03.dbf
128 0 Incr 143493636887 07-JAN-19 /l06/app/oracle/oradata/ORCL/system04.dbf
182 0 Incr 143493636887 07-JAN-19 /l06/app/oracle/oradata/ORCL/axiom_ORCL_05.dbf
188 0 Incr 143493636887 07-JAN-19 /l07/app/oracle/oradata/ORCL/workflow_ORCL_12.dbf
253 0 Incr 143493636887 07-JAN-19 /l06/app/oracle/oradata/ORCL/fimsdata_ORCL_08.dbf
267 0 Incr 143493636887 07-JAN-19 /l07/app/oracle/oradata/ORCL/genndx_ORCL_08.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723038 Incr 0 21.26G DISK 00:07:13 07-JAN-19
BP Key: 425723068 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139756_piece1_20190107_fctmmhko_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723038
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
15 0 Incr 143492955664 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_05.dbf
47 0 Incr 143492955664 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtrnd_encdndx_ORCL_01.dbf
63 0 Incr 143492955664 07-JAN-19 /l06/app/oracle/oradata/ORCL/legadata_ORCL_01.dbf
98 0 Incr 143492955664 07-JAN-19 /l07/app/oracle/oradata/ORCL/satundx_ORCL_04.dbf
131 0 Incr 143492955664 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_07.dbf
162 0 Incr 143492955664 07-JAN-19 /l07/app/oracle/oradata/ORCL/workflow_ORCL_05.dbf
184 0 Incr 143492955664 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_11.dbf
189 0 Incr 143492955664 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_12.dbf
254 0 Incr 143492955664 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_29.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723043 Incr 0 18.61G DISK 00:07:07 07-JAN-19
BP Key: 425723073 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139761_piece1_20190107_fhtmmj66_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723043
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
16 0 Incr 143493219128 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_06.dbf
67 0 Incr 143493219128 07-JAN-19 /l06/app/oracle/oradata/ORCL/mlogdata_ORCL_01.dbf
100 0 Incr 143493219128 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_01.dbf
111 0 Incr 143493219128 07-JAN-19 /l06/app/oracle/oradata/ORCL/streamsdata_ORCL_01.dbf
135 0 Incr 143493219128 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_09.dbf
185 0 Incr 143493219128 07-JAN-19 /l06/app/oracle/oradata/ORCL/devl_ORCL_12.dbf
190 0 Incr 143493219128 07-JAN-19 /l06/app/oracle/oradata/ORCL/genndx_ORCL_05.dbf
200 0 Incr 143493219128 07-JAN-19 /l07/app/oracle/oradata/ORCL/sysaux08.dbf
257 0 Incr 143493219128 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_37.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723028 Incr 0 23.95G DISK 00:11:33 07-JAN-19
BP Key: 425723058 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139746_piece1_20190107_f2tmmerr_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723028
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
18 0 Incr 143491310070 07-JAN-19 /l06/app/oracle/oradata/ORCL/axiom_ORCL_02.dbf
45 0 Incr 143491310070 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtndx_ORCL_01.dbf
70 0 Incr 143491310070 07-JAN-19 /l07/app/oracle/oradata/ORCL/payrdata_ORCL_01.dbf
72 0 Incr 143491310070 07-JAN-19 /l07/app/oracle/oradata/ORCL/payrdata_ORCL_03.dbf
122 0 Incr 143491310070 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_03.dbf
129 0 Incr 143491310070 07-JAN-19 /l06/app/oracle/oradata/ORCL/system05.dbf
142 0 Incr 143491310070 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_12.dbf
193 0 Incr 143491310070 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_12.dbf
196 0 Incr 143491310070 07-JAN-19 /l06/app/oracle/oradata/ORCL/sysaux05.dbf
261 0 Incr 143491310070 07-JAN-19 /l07/app/oracle/oradata/ORCL/axiom_ORCL_06.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723029 Incr 0 24.87G DISK 00:11:54 07-JAN-19
BP Key: 425723059 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139747_piece1_20190107_f3tmmers_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723029
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
19 0 Incr 143491310807 07-JAN-19 /l06/app/oracle/oradata/ORCL/axiom_ORCL_03.dbf
55 0 Incr 143491310807 07-JAN-19 /l06/app/oracle/oradata/ORCL/fimsndx_ORCL_01.dbf
73 0 Incr 143491310807 07-JAN-19 /l07/app/oracle/oradata/ORCL/payrdata_ORCL_04.dbf
74 0 Incr 143491310807 07-JAN-19 /l06/app/oracle/oradata/ORCL/payrndx_ORCL_01.dbf
125 0 Incr 143491310807 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_05.dbf
143 0 Incr 143491310807 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfndx_ORCL_02.dbf
165 0 Incr 143491310807 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_20.dbf
202 0 Incr 143491310807 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_13.dbf
203 0 Incr 143491310807 07-JAN-19 /l07/app/oracle/oradata/ORCL/workflow_ORCL_13.dbf
263 0 Incr 143491310807 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_31.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723047 Incr 0 19.79G DISK 00:10:00 07-JAN-19
BP Key: 425723077 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139764_piece1_20190107_fktmmk1m_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723047
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
20 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/banaq_ORCL_01.dbf
36 0 Incr 143493344742 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_05.dbf
44 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtdata_ORCL_03.dbf
86 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/RMS_DATA_02.dbf
113 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/taisdata_ORCL_02.dbf
152 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_14.dbf
172 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/bansdata_ORCL_02.dbf
232 0 Incr 143493344742 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_22.dbf
240 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/undo_ORCL_11.dbf
243 0 Incr 143493344742 07-JAN-19 /l06/app/oracle/oradata/ORCL/genndx_ORCL_07.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723041 Incr 0 25.82G DISK 00:13:58 07-JAN-19
BP Key: 425723071 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139759_piece1_20190107_fftmmibh_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723041
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
23 0 Incr 143493043450 07-JAN-19 /l06/app/oracle/oradata/ORCL/bansdata_ORCL_01.dbf
41 0 Incr 143493043450 07-JAN-19 /l06/app/oracle/oradata/ORCL/faisndx_ORCL_03.dbf
102 0 Incr 143493043450 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfndx_ORCL_01.dbf
148 0 Incr 143493043450 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_10.dbf
168 0 Incr 143493043450 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_07.dbf
199 0 Incr 143493043450 07-JAN-19 /l07/app/oracle/oradata/ORCL/sysaux07.dbf
226 0 Incr 143493043450 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_19.dbf
233 0 Incr 143493043450 07-JAN-19 /l06/app/oracle/oradata/ORCL/mlogdata_ORCL_03.dbf
237 0 Incr 143493043450 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_09.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723031 Incr 0 29.48G DISK 00:12:22 07-JAN-19
BP Key: 425723061 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139748_piece1_20190107_f4tmmfhl_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723031
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
24 0 Incr 143491842792 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_01.dbf
75 0 Incr 143491842792 07-JAN-19 /l06/app/oracle/oradata/ORCL/payrndx_ORCL_02.dbf
79 0 Incr 143491842792 07-JAN-19 /l07/app/oracle/oradata/ORCL/posndata_ORCL_02.dbf
80 0 Incr 143491842792 07-JAN-19 /l07/app/oracle/oradata/ORCL/posndata_ORCL_03.dbf
130 0 Incr 143491842792 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_07.dbf
145 0 Incr 143491842792 07-JAN-19 /l06/app/oracle/oradata/ORCL/genndx_ORCL_03.dbf
178 0 Incr 143491842792 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_27.dbf
204 0 Incr 143491842792 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_13.dbf
205 0 Incr 143491842792 07-JAN-19 /l06/app/oracle/oradata/ORCL/genndx_ORCL_06.dbf
264 0 Incr 143491842792 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_32.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723030 Incr 0 19.21G DISK 00:08:58 07-JAN-19
BP Key: 425723060 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139749_piece1_20190107_f5tmmfih_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723030
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
25 0 Incr 143491850503 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_02.dbf
76 0 Incr 143491850503 07-JAN-19 /l06/app/oracle/oradata/ORCL/payrndx_ORCL_03.dbf
94 0 Incr 143491850503 07-JAN-19 /l07/app/oracle/oradata/ORCL/satudata_ORCL_06.dbf
116 0 Incr 143491850503 07-JAN-19 /l06/app/oracle/oradata/ORCL/taisndx_ORCL_02.dbf
132 0 Incr 143491850503 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_08.dbf
146 0 Incr 143491850503 07-JAN-19 /l06/app/oracle/oradata/ORCL/sysaux02.dbf
197 0 Incr 143491850503 07-JAN-19 /l06/app/oracle/oradata/ORCL/sysaux06.dbf
206 0 Incr 143491850503 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_14.dbf
207 0 Incr 143491850503 07-JAN-19 /l06/app/oracle/oradata/ORCL/satundx_ORCL_05.dbf
265 0 Incr 143491850503 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_34.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723032 Incr 0 27.00G DISK 00:10:31 07-JAN-19
BP Key: 425723062 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139750_piece1_20190107_f6tmmg3k_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723032
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
26 0 Incr 143491921115 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_03.dbf
77 0 Incr 143491921115 07-JAN-19 /l06/app/oracle/oradata/ORCL/payrndx_ORCL_04.dbf
103 0 Incr 143491921115 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtdata_ORCL_01.dbf
117 0 Incr 143491921115 07-JAN-19 /l06/app/oracle/oradata/ORCL/taisndx_ORCL_03.dbf
133 0 Incr 143491921115 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_05.dbf
150 0 Incr 143491921115 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_02.dbf
201 0 Incr 143491921115 07-JAN-19 /l07/app/oracle/oradata/ORCL/sysaux09.dbf
208 0 Incr 143491921115 07-JAN-19 /l06/app/oracle/oradata/ORCL/payrndx_ORCL_05.dbf
209 0 Incr 143491921115 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_14.dbf
268 0 Incr 143491921115 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_33.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723033 Incr 0 23.51G DISK 00:09:06 07-JAN-19
BP Key: 425723063 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139751_piece1_20190107_f7tmmg95_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723033
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
27 0 Incr 143491951966 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_04.dbf
78 0 Incr 143491951966 07-JAN-19 /l07/app/oracle/oradata/ORCL/posndata_ORCL_01.dbf
104 0 Incr 143491951966 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtdata_ORCL_02.dbf
134 0 Incr 143491951966 07-JAN-19 /l06/app/oracle/oradata/ORCL/devl_ORCL_08.dbf
154 0 Incr 143491951966 07-JAN-19 /l06/app/oracle/oradata/ORCL/workflow_ORCL_03.dbf
179 0 Incr 143491951966 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_28.dbf
210 0 Incr 143491951966 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_30.dbf
211 0 Incr 143491951966 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_15.dbf
212 0 Incr 143491951966 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_31.dbf
269 0 Incr 143491951966 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_35.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723034 Incr 0 20.32G DISK 00:07:57 07-JAN-19
BP Key: 425723064 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139752_piece1_20190107_f8tmmgnf_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723034
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
28 0 Incr 143492027925 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_05.dbf
82 0 Incr 143492027925 07-JAN-19 /l06/app/oracle/oradata/ORCL/posnndx_ORCL_02.dbf
105 0 Incr 143492027925 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtdata_ORCL_03.dbf
136 0 Incr 143492027925 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_09.dbf
156 0 Incr 143492027925 07-JAN-19 /l06/app/oracle/oradata/ORCL/faisdata_ORCL_06.dbf
180 0 Incr 143492027925 07-JAN-19 /l07/app/oracle/oradata/ORCL/auditdata_ORCL_29.dbf
214 0 Incr 143492027925 07-JAN-19 /l07/app/oracle/oradata/ORCL/undo_ORCL_07.dbf
216 0 Incr 143492027925 07-JAN-19 /l06/app/oracle/oradata/ORCL/bansdata_ORCL_03.dbf
235 0 Incr 143492027925 07-JAN-19 /l06/app/oracle/oradata/ORCL/mlogdata_ORCL_05.dbf
270 0 Incr 143492027925 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_36.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723035 Incr 0 24.67G DISK 00:09:30 07-JAN-19
BP Key: 425723065 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139753_piece1_20190107_f9tmmgqg_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723035
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
29 0 Incr 143492321405 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_06.dbf
64 0 Incr 143492321405 07-JAN-19 /l06/app/oracle/oradata/ORCL/legadata_ORCL_02.dbf
89 0 Incr 143492321405 07-JAN-19 /l07/app/oracle/oradata/ORCL/satudata_ORCL_01.dbf
106 0 Incr 143492321405 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtdata_ORCL_04.dbf
138 0 Incr 143492321405 07-JAN-19 /l07/app/oracle/oradata/ORCL/gendata_ORCL_06.dbf
157 0 Incr 143492321405 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_07.dbf
183 0 Incr 143492321405 07-JAN-19 /l06/app/oracle/oradata/ORCL/sysaux03.dbf
215 0 Incr 143492321405 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_15.dbf
219 0 Incr 143492321405 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_08.dbf
271 0 Incr 143492321405 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_37.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723045 Incr 0 16.79G DISK 00:07:28 07-JAN-19
BP Key: 425723075 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139763_piece1_20190107_fjtmmjjn_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723045
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
31 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/emdata_ORCL_02.dbf
35 0 Incr 143493299019 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_04.dbf
43 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtdata_ORCL_02.dbf
85 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/RMS_DATA_01.dbf
112 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/taisdata_ORCL_01.dbf
151 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_13.dbf
171 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_22.dbf
231 0 Incr 143493299019 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_21.dbf
239 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/undo_ORCL_12.dbf
242 0 Incr 143493299019 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_09.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723042 Incr 0 21.87G DISK 00:12:49 07-JAN-19
BP Key: 425723072 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139760_piece1_20190107_fgtmmild_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723042
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
34 0 Incr 143493151807 07-JAN-19 /l07/app/oracle/oradata/ORCL/faisdata_ORCL_03.dbf
42 0 Incr 143493151807 07-JAN-19 /l06/app/oracle/oradata/ORCL/fgbtdata_ORCL_01.dbf
110 0 Incr 143493151807 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtndx_ORCL_01.dbf
149 0 Incr 143493151807 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_11.dbf
169 0 Incr 143493151807 07-JAN-19 /l06/app/oracle/oradata/ORCL/genndx_ORCL_04.dbf
227 0 Incr 143493151807 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_20.dbf
234 0 Incr 143493151807 07-JAN-19 /l06/app/oracle/oradata/ORCL/mlogdata_ORCL_04.dbf
238 0 Incr 143493151807 07-JAN-19 /l06/app/oracle/oradata/ORCL/undo_ORCL_10.dbf
252 0 Incr 143493151807 07-JAN-19 /l06/app/oracle/oradata/ORCL/sfrfdata_ORCL_10.dbf
BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
425723036 Incr 0 21.19G DISK 00:07:30 07-JAN-19
BP Key: 425723066 Status: AVAILABLE Compressed: NO Tag: BACKUP_LEVEL0_WEEKLY
Piece Name: /oraclebackup/rman/ddw/ORCL/backup_ORCL_set139754_piece1_20190107_fatmmh6j_1_1.bus
Keep: LOGS Until: 11-FEB-19
List of Datafiles in backup set 425723036
File LV Type Ckp SCN Ckp Time Name
---- -- ---- ---------- --------- ----
40 0 Incr 143492896006 07-JAN-19 /l06/app/oracle/oradata/ORCL/faisndx_ORCL_02.dbf
65 0 Incr 143492896006 07-JAN-19 /l06/app/oracle/oradata/ORCL/legandx_ORCL_01.dbf
90 0 Incr 143492896006 07-JAN-19 /l07/app/oracle/oradata/ORCL/satudata_ORCL_02.dbf
107 0 Incr 143492896006 07-JAN-19 /l06/app/oracle/oradata/ORCL/shrtdata_ORCL_06.dbf
139 0 Incr 143492896006 07-JAN-19 /l07/app/oracle/oradata/ORCL/fimsdata_ORCL_05.dbf
158 0 Incr 143492896006 07-JAN-19 /l06/app/oracle/oradata/ORCL/auditdata_ORCL_16.dbf
195 0 Incr 143492896006 07-JAN-19 /l06/app/oracle/oradata/ORCL/sysaux04.dbf
217 0 Incr 143492896006 07-JAN-19 /l07/app/oracle/oradata/ORCL/devl_ORCL_16.dbf
221 0 Incr 143492896006 07-JAN-19 /l06/app/oracle/oradata/ORCL/faisndx_ORCL_04.dbf
272 0 Incr 143492896006 07-JAN-19 /l07/app/oracle/oradata/ORCL/axiom_ORCL_07.dbf
using channel ORA_DISK_1
using channel ORA_DISK_2
List of Backup Sets
===================
BS Key Size
------- ----------
425723456 882.47M
List of Archived Logs in backup set 425723456
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1117959 143491200056 06-JAN-19 143491907280 07-JAN-19
Backup Set Copy #1 of backup set 425723456
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:29 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723456 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723523 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139787_p1_c1_20190107.log
Backup Set Copy #2 of backup set 425723456
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:29 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723456 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723524 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139787_p1_c2_20190107.log
BS Key Size
------- ----------
425723478 489.49M
List of Archived Logs in backup set 425723478
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1117960 143491907280 07-JAN-19 143493013913 07-JAN-19
1 1117961 143493013913 07-JAN-19 143493023128 07-JAN-19
1 1117962 143493023128 07-JAN-19 143493024719 07-JAN-19
1 1117963 143493024719 07-JAN-19 143493032688 07-JAN-19
1 1117964 143493032688 07-JAN-19 143493038754 07-JAN-19
1 1117965 143493038754 07-JAN-19 143493048089 07-JAN-19
1 1117966 143493048089 07-JAN-19 143493058445 07-JAN-19
1 1117967 143493058445 07-JAN-19 143493068958 07-JAN-19
1 1117968 143493068958 07-JAN-19 143493080706 07-JAN-19
1 1117969 143493080706 07-JAN-19 143493086406 07-JAN-19
Backup Set Copy #1 of backup set 425723478
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723478 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723567 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139810_p1_c1_20190107.log
Backup Set Copy #2 of backup set 425723478
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723478 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723568 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139810_p1_c2_20190107.log
BS Key Size
------- ----------
425723492 26.05M
List of Archived Logs in backup set 425723492
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1117970 143493086406 07-JAN-19 143493095621 07-JAN-19
1 1117971 143493095621 07-JAN-19 143493105774 07-JAN-19
1 1117972 143493105774 07-JAN-19 143493115684 07-JAN-19
1 1117973 143493115684 07-JAN-19 143493126042 07-JAN-19
1 1117974 143493126042 07-JAN-19 143493136713 07-JAN-19
1 1117975 143493136713 07-JAN-19 143493145982 07-JAN-19
1 1117976 143493145982 07-JAN-19 143493148167 07-JAN-19
1 1117977 143493148167 07-JAN-19 143493150240 07-JAN-19
1 1117978 143493150240 07-JAN-19 143493151991 07-JAN-19
1 1117979 143493151991 07-JAN-19 143493159029 07-JAN-19
Backup Set Copy #1 of backup set 425723492
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:01 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723492 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723595 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139824_p1_c1_20190107.log
Backup Set Copy #2 of backup set 425723492
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:01 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723492 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723596 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139824_p1_c2_20190107.log
BS Key Size
------- ----------
425723461 874.93M
List of Archived Logs in backup set 425723461
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1117980 143493159029 07-JAN-19 143493165844 07-JAN-19
1 1117981 143493165844 07-JAN-19 143493178649 07-JAN-19
1 1117982 143493178649 07-JAN-19 143493301959 07-JAN-19
1 1117983 143493301959 07-JAN-19 143493489821 07-JAN-19
Backup Set Copy #1 of backup set 425723461
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:29 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723461 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723533 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139793_p1_c1_20190107.log
Backup Set Copy #2 of backup set 425723461
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:29 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723461 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723534 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139793_p1_c2_20190107.log
BS Key Size
------- ----------
425723480 487.30M
List of Archived Logs in backup set 425723480
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1117984 143493489821 07-JAN-19 143493501566 07-JAN-19
1 1117985 143493501566 07-JAN-19 143493511880 07-JAN-19
1 1117986 143493511880 07-JAN-19 143493692073 07-JAN-19
1 1117987 143493692073 07-JAN-19 143493699894 07-JAN-19
1 1117988 143493699894 07-JAN-19 143493702060 07-JAN-19
Backup Set Copy #1 of backup set 425723480
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723480 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723571 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139812_p1_c1_20190107.log
Backup Set Copy #2 of backup set 425723480
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 07-JAN-19 NO TAG20190107T022215
List of Backup Pieces for backup set 425723480 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425723572 1 AVAILABLE /oraclebackup/rman/ddw/ORCL/archive_07_s139812_p1_c2_20190107.log
BS Key Size
------- ----------
425779419 92.24M
List of Archived Logs in backup set 425779419
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1117989 143493702060 07-JAN-19 143493715096 07-JAN-19
1 1117990 143493715096 07-JAN-19 143493717773 07-JAN-19
1 1117991 143493717773 07-JAN-19 143493724098 07-JAN-19
1 1117992 143493724098 07-JAN-19 143493727561 07-JAN-19
1 1117993 143493727561 07-JAN-19 143493732970 07-JAN-19
1 1117994 143493732970 07-JAN-19 143493737867 07-JAN-19
1 1117995 143493737867 07-JAN-19 143493741032 07-JAN-19
1 1117996 143493741032 07-JAN-19 143493744120 07-JAN-19
1 1117997 143493744120 07-JAN-19 143493745419 07-JAN-19
1 1117998 143493745419 07-JAN-19 143493746530 07-JAN-19
1 1117999 143493746530 07-JAN-19 143493747637 07-JAN-19
1 1118000 143493747637 07-JAN-19 143493748638 07-JAN-19
1 1118001 143493748638 07-JAN-19 143493749602 07-JAN-19
1 1118002 143493749602 07-JAN-19 143493750622 07-JAN-19
1 1118003 143493750622 07-JAN-19 143493751812 07-JAN-19
1 1118004 143493751812 07-JAN-19 143493752946 07-JAN-19
1 1118005 143493752946 07-JAN-19 143493754047 07-JAN-19
1 1118006 143493754047 07-JAN-19 143493755226 07-JAN-19
1 1118007 143493755226 07-JAN-19 143493756832 07-JAN-19
1 1118008 143493756832 07-JAN-19 143493758144 07-JAN-19
Backup Set Copy #1 of backup set 425779419
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:06 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779419 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779495 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139894_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779419
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:06 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779419 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779496 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139894_p1_c2_20190108.log
BS Key Size
------- ----------
425779384 1.80G
List of Archived Logs in backup set 425779384
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118009 143493758144 07-JAN-19 143493764740 07-JAN-19
1 1118010 143493764740 07-JAN-19 143493911309 07-JAN-19
1 1118011 143493911309 07-JAN-19 143494083643 07-JAN-19
1 1118012 143494083643 07-JAN-19 143494094538 07-JAN-19
1 1118013 143494094538 07-JAN-19 143494104083 07-JAN-19
1 1118014 143494104083 07-JAN-19 143494238242 07-JAN-19
1 1118015 143494238242 07-JAN-19 143494244337 07-JAN-19
Backup Set Copy #1 of backup set 425779384
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:02:45 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779384 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779425 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139858_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779384
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:02:45 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779384 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779426 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139858_p1_c2_20190108.log
BS Key Size
------- ----------
425779403 530.03M
List of Archived Logs in backup set 425779403
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118016 143494244337 07-JAN-19 143494248929 07-JAN-19
1 1118017 143494248929 07-JAN-19 143494249091 07-JAN-19
1 1118018 143494249091 07-JAN-19 143494249126 07-JAN-19
1 1118019 143494249126 07-JAN-19 143494249863 07-JAN-19
1 1118020 143494249863 07-JAN-19 143494253876 07-JAN-19
1 1118021 143494253876 07-JAN-19 143494256112 07-JAN-19
1 1118022 143494256112 07-JAN-19 143494257889 07-JAN-19
1 1118023 143494257889 07-JAN-19 143494260101 07-JAN-19
1 1118024 143494260101 07-JAN-19 143494263428 07-JAN-19
1 1118025 143494263428 07-JAN-19 143494264190 07-JAN-19
1 1118026 143494264190 07-JAN-19 143494264922 07-JAN-19
1 1118027 143494264922 07-JAN-19 143494265647 07-JAN-19
1 1118028 143494265647 07-JAN-19 143494266456 07-JAN-19
1 1118029 143494266456 07-JAN-19 143494267041 07-JAN-19
1 1118030 143494267041 07-JAN-19 143494268226 07-JAN-19
1 1118031 143494268226 07-JAN-19 143494268994 07-JAN-19
1 1118032 143494268994 07-JAN-19 143494269638 07-JAN-19
1 1118033 143494269638 07-JAN-19 143494270335 07-JAN-19
1 1118034 143494270335 07-JAN-19 143494271116 07-JAN-19
1 1118035 143494271116 07-JAN-19 143494272495 07-JAN-19
Backup Set Copy #1 of backup set 425779403
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:20 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779403 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779463 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139877_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779403
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:20 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779403 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779464 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139877_p1_c2_20190108.log
BS Key Size
------- ----------
425779398 1.72G
List of Archived Logs in backup set 425779398
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118036 143494272495 07-JAN-19 143494274513 07-JAN-19
1 1118037 143494274513 07-JAN-19 143494279119 07-JAN-19
1 1118038 143494279119 07-JAN-19 143494391685 07-JAN-19
1 1118039 143494391685 07-JAN-19 143494532511 07-JAN-19
1 1118040 143494532511 07-JAN-19 143494537168 07-JAN-19
1 1118041 143494537168 07-JAN-19 143494543197 07-JAN-19
1 1118042 143494543197 07-JAN-19 143494638996 07-JAN-19
1 1118043 143494638996 07-JAN-19 143494771244 07-JAN-19
Backup Set Copy #1 of backup set 425779398
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:54 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779398 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779453 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139872_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779398
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:54 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779398 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779454 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139872_p1_c2_20190108.log
BS Key Size
------- ----------
425779416 515.74M
List of Archived Logs in backup set 425779416
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118044 143494771244 07-JAN-19 143494971300 07-JAN-19
1 1118045 143494971300 07-JAN-19 143494978082 07-JAN-19
1 1118046 143494978082 07-JAN-19 143494979149 07-JAN-19
1 1118047 143494979149 07-JAN-19 143494983261 07-JAN-19
1 1118048 143494983261 07-JAN-19 143494986103 07-JAN-19
1 1118049 143494986103 07-JAN-19 143494989186 07-JAN-19
1 1118050 143494989186 07-JAN-19 143494992155 07-JAN-19
1 1118051 143494992155 07-JAN-19 143494995076 07-JAN-19
1 1118052 143494995076 07-JAN-19 143494999342 07-JAN-19
1 1118053 143494999342 07-JAN-19 143494999981 07-JAN-19
1 1118054 143494999981 07-JAN-19 143495000657 07-JAN-19
1 1118055 143495000657 07-JAN-19 143495001155 07-JAN-19
1 1118056 143495001155 07-JAN-19 143495001571 07-JAN-19
1 1118057 143495001571 07-JAN-19 143495002032 07-JAN-19
1 1118058 143495002032 07-JAN-19 143495002483 07-JAN-19
1 1118059 143495002483 07-JAN-19 143495002959 07-JAN-19
1 1118060 143495002959 07-JAN-19 143495003472 07-JAN-19
1 1118061 143495003472 07-JAN-19 143495003924 07-JAN-19
1 1118062 143495003924 07-JAN-19 143495004349 07-JAN-19
1 1118063 143495004349 07-JAN-19 143495004846 07-JAN-19
Backup Set Copy #1 of backup set 425779416
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:18 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779416 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779489 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139890_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779416
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:18 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779416 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779490 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139890_p1_c2_20190108.log
BS Key Size
------- ----------
425779396 1.72G
List of Archived Logs in backup set 425779396
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118064 143495004846 07-JAN-19 143495005275 07-JAN-19
1 1118065 143495005275 07-JAN-19 143495008082 07-JAN-19
1 1118066 143495008082 07-JAN-19 143495188187 07-JAN-19
1 1118067 143495188187 07-JAN-19 143495442878 07-JAN-19
1 1118068 143495442878 07-JAN-19 143495458730 07-JAN-19
1 1118069 143495458730 07-JAN-19 143495466159 07-JAN-19
1 1118070 143495466159 07-JAN-19 143495668035 07-JAN-19
1 1118071 143495668035 07-JAN-19 143495851386 07-JAN-19
Backup Set Copy #1 of backup set 425779396
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:57 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779396 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779449 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139870_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779396
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:57 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779396 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779450 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139870_p1_c2_20190108.log
BS Key Size
------- ----------
425779401 566.85M
List of Archived Logs in backup set 425779401
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118072 143495851386 07-JAN-19 143496852187 07-JAN-19
1 1118073 143496852187 07-JAN-19 143496852832 07-JAN-19
1 1118074 143496852832 07-JAN-19 143496853108 07-JAN-19
1 1118075 143496853108 07-JAN-19 143496853737 07-JAN-19
1 1118076 143496853737 07-JAN-19 143496854667 07-JAN-19
1 1118077 143496854667 07-JAN-19 143496855241 07-JAN-19
1 1118078 143496855241 07-JAN-19 143496856278 07-JAN-19
1 1118079 143496856278 07-JAN-19 143496857070 07-JAN-19
1 1118080 143496857070 07-JAN-19 143496858396 07-JAN-19
1 1118081 143496858396 07-JAN-19 143496858596 07-JAN-19
1 1118082 143496858596 07-JAN-19 143496858698 07-JAN-19
1 1118083 143496858698 07-JAN-19 143496858898 07-JAN-19
1 1118084 143496858898 07-JAN-19 143496859148 07-JAN-19
1 1118085 143496859148 07-JAN-19 143496859416 07-JAN-19
1 1118086 143496859416 07-JAN-19 143496859485 07-JAN-19
1 1118087 143496859485 07-JAN-19 143496859688 07-JAN-19
1 1118088 143496859688 07-JAN-19 143496859955 07-JAN-19
1 1118089 143496859955 07-JAN-19 143496860301 07-JAN-19
1 1118090 143496860301 07-JAN-19 143496860616 07-JAN-19
1 1118091 143496860616 07-JAN-19 143496860802 07-JAN-19
Backup Set Copy #1 of backup set 425779401
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:20 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779401 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779459 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139876_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779401
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:20 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779401 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779460 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139876_p1_c2_20190108.log
BS Key Size
------- ----------
425779383 1.81G
List of Archived Logs in backup set 425779383
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118092 143496860802 07-JAN-19 143496861058 07-JAN-19
1 1118093 143496861058 07-JAN-19 143496861784 07-JAN-19
1 1118094 143496861784 07-JAN-19 143497104620 07-JAN-19
1 1118095 143497104620 07-JAN-19 143497501693 07-JAN-19
1 1118096 143497501693 07-JAN-19 143497545648 07-JAN-19
1 1118097 143497545648 07-JAN-19 143497608327 07-JAN-19
1 1118098 143497608327 07-JAN-19 143499899786 07-JAN-19
1 1118099 143499899786 07-JAN-19 143500925443 07-JAN-19
Backup Set Copy #1 of backup set 425779383
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:02:44 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779383 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779423 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139857_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779383
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:02:44 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779383 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779424 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139857_p1_c2_20190108.log
BS Key Size
------- ----------
425779409 520.10M
List of Archived Logs in backup set 425779409
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118100 143500925443 07-JAN-19 143501235762 07-JAN-19
1 1118101 143501235762 07-JAN-19 143501257095 07-JAN-19
1 1118102 143501257095 07-JAN-19 143501259076 07-JAN-19
1 1118103 143501259076 07-JAN-19 143501267837 07-JAN-19
1 1118104 143501267837 07-JAN-19 143501282516 07-JAN-19
1 1118105 143501282516 07-JAN-19 143501312607 07-JAN-19
1 1118106 143501312607 07-JAN-19 143501355908 07-JAN-19
1 1118107 143501355908 07-JAN-19 143501402427 07-JAN-19
1 1118108 143501402427 07-JAN-19 143501450162 07-JAN-19
1 1118109 143501450162 07-JAN-19 143501469943 07-JAN-19
1 1118110 143501469943 07-JAN-19 143501470717 07-JAN-19
1 1118111 143501470717 07-JAN-19 143501471092 07-JAN-19
1 1118112 143501471092 07-JAN-19 143501472722 07-JAN-19
1 1118113 143501472722 07-JAN-19 143501484145 07-JAN-19
1 1118114 143501484145 07-JAN-19 143501489502 07-JAN-19
1 1118115 143501489502 07-JAN-19 143501490907 07-JAN-19
1 1118116 143501490907 07-JAN-19 143501493579 07-JAN-19
1 1118117 143501493579 07-JAN-19 143501495933 07-JAN-19
1 1118118 143501495933 07-JAN-19 143501497657 07-JAN-19
1 1118119 143501497657 07-JAN-19 143501498148 07-JAN-19
Backup Set Copy #1 of backup set 425779409
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:15 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779409 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779475 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139883_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779409
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:15 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779409 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779476 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139883_p1_c2_20190108.log
BS Key Size
------- ----------
425779392 1.74G
List of Archived Logs in backup set 425779392
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118120 143501498148 07-JAN-19 143501498596 07-JAN-19
1 1118121 143501498596 07-JAN-19 143501545656 07-JAN-19
1 1118122 143501545656 07-JAN-19 143502109201 07-JAN-19
1 1118123 143502109201 07-JAN-19 143502510986 07-JAN-19
1 1118124 143502510986 07-JAN-19 143502517129 07-JAN-19
1 1118125 143502517129 07-JAN-19 143502518750 07-JAN-19
1 1118126 143502518750 07-JAN-19 143502649683 07-JAN-19
1 1118127 143502649683 07-JAN-19 143502889697 07-JAN-19
Backup Set Copy #1 of backup set 425779392
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:01 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779392 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779441 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139866_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779392
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:01 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779392 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779442 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139866_p1_c2_20190108.log
BS Key Size
------- ----------
425779420 514.81M
List of Archived Logs in backup set 425779420
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118128 143502889697 07-JAN-19 143503422756 07-JAN-19
1 1118129 143503422756 07-JAN-19 143503437926 07-JAN-19
1 1118130 143503437926 07-JAN-19 143503439556 07-JAN-19
1 1118131 143503439556 07-JAN-19 143503446788 07-JAN-19
1 1118132 143503446788 07-JAN-19 143503454067 07-JAN-19
1 1118133 143503454067 07-JAN-19 143503460809 07-JAN-19
1 1118134 143503460809 07-JAN-19 143503467913 07-JAN-19
1 1118135 143503467913 07-JAN-19 143503478946 07-JAN-19
1 1118136 143503478946 07-JAN-19 143503492455 07-JAN-19
1 1118137 143503492455 07-JAN-19 143503495299 07-JAN-19
1 1118138 143503495299 07-JAN-19 143503498017 07-JAN-19
1 1118139 143503498017 07-JAN-19 143503501837 07-JAN-19
1 1118140 143503501837 07-JAN-19 143503504504 07-JAN-19
1 1118141 143503504504 07-JAN-19 143503506819 07-JAN-19
1 1118142 143503506819 07-JAN-19 143503510272 07-JAN-19
1 1118143 143503510272 07-JAN-19 143503513583 07-JAN-19
1 1118144 143503513583 07-JAN-19 143503513846 07-JAN-19
1 1118145 143503513846 07-JAN-19 143503513909 07-JAN-19
1 1118146 143503513909 07-JAN-19 143503513957 07-JAN-19
1 1118147 143503513957 07-JAN-19 143503513994 07-JAN-19
Backup Set Copy #1 of backup set 425779420
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:14 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779420 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779497 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139893_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779420
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:14 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779420 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779498 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139893_p1_c2_20190108.log
BS Key Size
------- ----------
425779388 1.75G
List of Archived Logs in backup set 425779388
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118148 143503513994 07-JAN-19 143503514046 07-JAN-19
1 1118149 143503514046 07-JAN-19 143503514906 07-JAN-19
1 1118150 143503514906 07-JAN-19 143504050808 07-JAN-19
1 1118151 143504050808 07-JAN-19 143504259687 07-JAN-19
1 1118152 143504259687 07-JAN-19 143504270447 07-JAN-19
1 1118153 143504270447 07-JAN-19 143504281910 07-JAN-19
1 1118154 143504281910 07-JAN-19 143504551446 07-JAN-19
1 1118155 143504551446 07-JAN-19 143504770049 07-JAN-19
Backup Set Copy #1 of backup set 425779388
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:01 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779388 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779433 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139862_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779388
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:01 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779388 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779434 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139862_p1_c2_20190108.log
BS Key Size
------- ----------
425779418 515.27M
List of Archived Logs in backup set 425779418
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118156 143504770049 07-JAN-19 143505052563 07-JAN-19
1 1118157 143505052563 07-JAN-19 143505076223 07-JAN-19
1 1118158 143505076223 07-JAN-19 143505081904 07-JAN-19
1 1118159 143505081904 07-JAN-19 143505083055 07-JAN-19
1 1118160 143505083055 07-JAN-19 143505090280 07-JAN-19
1 1118161 143505090280 07-JAN-19 143505098573 07-JAN-19
1 1118162 143505098573 07-JAN-19 143505109587 07-JAN-19
1 1118163 143505109587 07-JAN-19 143505112295 07-JAN-19
1 1118164 143505112295 07-JAN-19 143505115391 07-JAN-19
1 1118165 143505115391 07-JAN-19 143505117108 07-JAN-19
1 1118166 143505117108 07-JAN-19 143505118355 07-JAN-19
1 1118167 143505118355 07-JAN-19 143505119308 07-JAN-19
1 1118168 143505119308 07-JAN-19 143505120062 07-JAN-19
1 1118169 143505120062 07-JAN-19 143505120107 07-JAN-19
1 1118170 143505120107 07-JAN-19 143505120145 07-JAN-19
1 1118171 143505120145 07-JAN-19 143505120184 07-JAN-19
1 1118172 143505120184 07-JAN-19 143505120209 07-JAN-19
1 1118173 143505120209 07-JAN-19 143505120229 07-JAN-19
1 1118174 143505120229 07-JAN-19 143505120246 07-JAN-19
1 1118175 143505120246 07-JAN-19 143505121017 07-JAN-19
Backup Set Copy #1 of backup set 425779418
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779418 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779493 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139892_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779418
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779418 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779494 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139892_p1_c2_20190108.log
BS Key Size
------- ----------
425779387 1.76G
List of Archived Logs in backup set 425779387
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118176 143505121017 07-JAN-19 143505126552 07-JAN-19
1 1118177 143505126552 07-JAN-19 143505146006 07-JAN-19
1 1118178 143505146006 07-JAN-19 143505527476 07-JAN-19
1 1118179 143505527476 07-JAN-19 143505680032 07-JAN-19
1 1118180 143505680032 07-JAN-19 143505687367 07-JAN-19
1 1118181 143505687367 07-JAN-19 143505694874 07-JAN-19
1 1118182 143505694874 07-JAN-19 143506019142 07-JAN-19
1 1118183 143506019142 07-JAN-19 143506163891 07-JAN-19
Backup Set Copy #1 of backup set 425779387
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:00 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779387 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779431 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139861_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779387
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:00 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779387 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779432 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139861_p1_c2_20190108.log
BS Key Size
------- ----------
425779415 516.19M
List of Archived Logs in backup set 425779415
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118184 143506163891 07-JAN-19 143506555652 07-JAN-19
1 1118185 143506555652 07-JAN-19 143506566883 07-JAN-19
1 1118186 143506566883 07-JAN-19 143506567608 07-JAN-19
1 1118187 143506567608 07-JAN-19 143506569782 07-JAN-19
1 1118188 143506569782 07-JAN-19 143506570448 07-JAN-19
1 1118189 143506570448 07-JAN-19 143506570639 07-JAN-19
1 1118190 143506570639 07-JAN-19 143506572951 07-JAN-19
1 1118191 143506572951 07-JAN-19 143506586261 07-JAN-19
1 1118192 143506586261 07-JAN-19 143506592982 07-JAN-19
1 1118193 143506592982 07-JAN-19 143506596005 07-JAN-19
1 1118194 143506596005 07-JAN-19 143506601426 07-JAN-19
1 1118195 143506601426 07-JAN-19 143506605662 07-JAN-19
1 1118196 143506605662 07-JAN-19 143506610008 07-JAN-19
1 1118197 143506610008 07-JAN-19 143506614593 07-JAN-19
1 1118198 143506614593 07-JAN-19 143506618955 07-JAN-19
1 1118199 143506618955 07-JAN-19 143506624369 07-JAN-19
1 1118200 143506624369 07-JAN-19 143506628432 07-JAN-19
1 1118201 143506628432 07-JAN-19 143506632741 07-JAN-19
1 1118202 143506632741 07-JAN-19 143506636781 07-JAN-19
1 1118203 143506636781 07-JAN-19 143506640025 07-JAN-19
Backup Set Copy #1 of backup set 425779415
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779415 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779487 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139889_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779415
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:16 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779415 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779488 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139889_p1_c2_20190108.log
BS Key Size
------- ----------
425779390 1.75G
List of Archived Logs in backup set 425779390
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118204 143506640025 07-JAN-19 143506644418 07-JAN-19
1 1118205 143506644418 07-JAN-19 143506664698 07-JAN-19
1 1118206 143506664698 07-JAN-19 143506979275 07-JAN-19
1 1118207 143506979275 07-JAN-19 143507317293 07-JAN-19
1 1118208 143507317293 07-JAN-19 143507337144 07-JAN-19
1 1118209 143507337144 07-JAN-19 143507343780 07-JAN-19
1 1118210 143507343780 07-JAN-19 143507542293 07-JAN-19
1 1118211 143507542293 07-JAN-19 143507836530 07-JAN-19
Backup Set Copy #1 of backup set 425779390
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:00 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779390 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779437 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139864_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779390
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:00 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779390 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779438 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139864_p1_c2_20190108.log
BS Key Size
------- ----------
425779414 516.26M
List of Archived Logs in backup set 425779414
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118212 143507836530 07-JAN-19 143508146939 07-JAN-19
1 1118213 143508146939 07-JAN-19 143508155978 07-JAN-19
1 1118214 143508155978 07-JAN-19 143508157168 07-JAN-19
1 1118215 143508157168 07-JAN-19 143508160883 07-JAN-19
1 1118216 143508160883 07-JAN-19 143508164856 07-JAN-19
1 1118217 143508164856 07-JAN-19 143508168460 07-JAN-19
1 1118218 143508168460 07-JAN-19 143508172620 07-JAN-19
1 1118219 143508172620 07-JAN-19 143508176467 07-JAN-19
1 1118220 143508176467 07-JAN-19 143508179696 07-JAN-19
1 1118221 143508179696 07-JAN-19 143508180885 07-JAN-19
1 1118222 143508180885 07-JAN-19 143508182004 07-JAN-19
1 1118223 143508182004 07-JAN-19 143508183052 07-JAN-19
1 1118224 143508183052 07-JAN-19 143508184186 07-JAN-19
1 1118225 143508184186 07-JAN-19 143508185199 07-JAN-19
1 1118226 143508185199 07-JAN-19 143508187056 07-JAN-19
1 1118227 143508187056 07-JAN-19 143508188348 07-JAN-19
1 1118228 143508188348 07-JAN-19 143508189562 07-JAN-19
1 1118229 143508189562 07-JAN-19 143508190751 07-JAN-19
1 1118230 143508190751 07-JAN-19 143508192112 07-JAN-19
1 1118231 143508192112 07-JAN-19 143508193435 07-JAN-19
Backup Set Copy #1 of backup set 425779414
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:19 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779414 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779485 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139888_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779414
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:19 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779414 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779486 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139888_p1_c2_20190108.log
BS Key Size
------- ----------
425779389 1.75G
List of Archived Logs in backup set 425779389
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118232 143508193435 07-JAN-19 143508194762 07-JAN-19
1 1118233 143508194762 07-JAN-19 143508202627 07-JAN-19
1 1118234 143508202627 07-JAN-19 143508431038 07-JAN-19
1 1118235 143508431038 07-JAN-19 143508642533 07-JAN-19
1 1118236 143508642533 07-JAN-19 143508644614 07-JAN-19
1 1118237 143508644614 07-JAN-19 143508647357 07-JAN-19
1 1118238 143508647357 07-JAN-19 143508710559 07-JAN-19
1 1118239 143508710559 07-JAN-19 143508757694 07-JAN-19
Backup Set Copy #1 of backup set 425779389
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:58 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779389 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779435 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139863_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779389
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:58 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779389 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779436 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139863_p1_c2_20190108.log
BS Key Size
------- ----------
425779407 524.10M
List of Archived Logs in backup set 425779407
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118240 143508757694 07-JAN-19 143508830299 07-JAN-19
1 1118241 143508830299 07-JAN-19 143508833439 07-JAN-19
1 1118242 143508833439 07-JAN-19 143508834048 07-JAN-19
1 1118243 143508834048 07-JAN-19 143508835368 07-JAN-19
1 1118244 143508835368 07-JAN-19 143508836422 07-JAN-19
1 1118245 143508836422 07-JAN-19 143508837759 07-JAN-19
1 1118246 143508837759 07-JAN-19 143508839026 07-JAN-19
1 1118247 143508839026 07-JAN-19 143508840416 07-JAN-19
1 1118248 143508840416 07-JAN-19 143508841600 07-JAN-19
1 1118249 143508841600 07-JAN-19 143508841790 07-JAN-19
1 1118250 143508841790 07-JAN-19 143508842086 07-JAN-19
1 1118251 143508842086 07-JAN-19 143508842462 07-JAN-19
1 1118252 143508842462 07-JAN-19 143508842719 07-JAN-19
1 1118253 143508842719 07-JAN-19 143508843056 07-JAN-19
1 1118254 143508843056 07-JAN-19 143508843358 07-JAN-19
1 1118255 143508843358 07-JAN-19 143508843656 07-JAN-19
1 1118256 143508843656 07-JAN-19 143508843959 07-JAN-19
1 1118257 143508843959 07-JAN-19 143508844355 07-JAN-19
1 1118258 143508844355 07-JAN-19 143508844660 07-JAN-19
1 1118259 143508844660 07-JAN-19 143508845131 07-JAN-19
Backup Set Copy #1 of backup set 425779407
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:19 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779407 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779471 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139881_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779407
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:19 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779407 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779472 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139881_p1_c2_20190108.log
BS Key Size
------- ----------
425779394 1.72G
List of Archived Logs in backup set 425779394
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118260 143508845131 07-JAN-19 143508845451 07-JAN-19
1 1118261 143508845451 07-JAN-19 143508847993 07-JAN-19
1 1118262 143508847993 07-JAN-19 143508911976 07-JAN-19
1 1118263 143508911976 07-JAN-19 143508977218 07-JAN-19
1 1118264 143508977218 07-JAN-19 143508980635 07-JAN-19
1 1118265 143508980635 07-JAN-19 143508985204 07-JAN-19
1 1118266 143508985204 07-JAN-19 143509062917 07-JAN-19
1 1118267 143509062917 07-JAN-19 143509164621 07-JAN-19
Backup Set Copy #1 of backup set 425779394
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:01 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779394 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779445 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139868_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779394
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:01:01 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779394 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779446 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139868_p1_c2_20190108.log
BS Key Size
------- ----------
425779405 528.42M
List of Archived Logs in backup set 425779405
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118268 143509164621 07-JAN-19 143509212805 07-JAN-19
1 1118269 143509212805 07-JAN-19 143509217762 07-JAN-19
1 1118270 143509217762 07-JAN-19 143509218438 07-JAN-19
1 1118271 143509218438 07-JAN-19 143509219112 07-JAN-19
1 1118272 143509219112 07-JAN-19 143509219234 07-JAN-19
1 1118273 143509219234 07-JAN-19 143509219365 07-JAN-19
1 1118274 143509219365 07-JAN-19 143509219456 07-JAN-19
1 1118275 143509219456 07-JAN-19 143509219554 07-JAN-19
1 1118276 143509219554 07-JAN-19 143509219685 07-JAN-19
1 1118277 143509219685 07-JAN-19 143509219753 07-JAN-19
1 1118278 143509219753 07-JAN-19 143509220026 07-JAN-19
1 1118279 143509220026 07-JAN-19 143509220537 07-JAN-19
1 1118280 143509220537 07-JAN-19 143509221014 07-JAN-19
1 1118281 143509221014 07-JAN-19 143509221438 07-JAN-19
1 1118282 143509221438 07-JAN-19 143509222025 07-JAN-19
1 1118283 143509222025 07-JAN-19 143509222374 07-JAN-19
1 1118284 143509222374 07-JAN-19 143509222918 07-JAN-19
1 1118285 143509222918 07-JAN-19 143509223407 07-JAN-19
1 1118286 143509223407 07-JAN-19 143509224041 07-JAN-19
1 1118287 143509224041 07-JAN-19 143509224457 07-JAN-19
Backup Set Copy #1 of backup set 425779405
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:21 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779405 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779467 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139879_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779405
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:21 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779405 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779468 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139879_p1_c2_20190108.log
BS Key Size
------- ----------
425779399 1.71G
List of Archived Logs in backup set 425779399
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1118288 143509224457 07-JAN-19 143509224867 07-JAN-19
1 1118289 143509224867 07-JAN-19 143509230326 07-JAN-19
1 1118290 143509230326 07-JAN-19 143509324396 07-JAN-19
Backup Set Copy #1 of backup set 425779399
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:49 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779399 Copy #1
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779455 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139873_p1_c1_20190108.log
Backup Set Copy #2 of backup set 425779399
Device Type Elapsed Time Completion Time Compressed Tag
----------- ------------ --------------- ---------- ---
DISK 00:00:49 08-JAN-19 NO BACKUP_LEVEL2_DAILY
List of Backup Pieces for backup set 425779399 Copy #2
BP Key Pc# Status Piece Name
------- --- ----------- ----------
425779456 1 AVAILABLE /oraclebackup/rman/ddd/ORCL/archive_08_s139873_p1_c2_20190108.log
recovery will be done up to SCN 143509230326
Media recovery start SCN is 143491310070
Recovery must be done beyond SCN 143493651494 to clear datafile fuzziness
Finished restore at 29-JAN-19
Oracle - Procedure Recursively Calls Itself too Deep Leads hanging on Parsing
This week, our banner system was suffering high loading around 9pm. Too many sessions were waiting on cursor: pin S wait on X, both blocker session and blocked sessions are running the same SQL. After killing blocker, the database came back to normal.
In this situation, normally, the blocker is doing hard parsing, and hard parsing needs to hold the mutex exclusively on the related objects. For the blocked session, there are doing soft parsing, but still needs to get the related objects with shared locking.
I got the short stack of the blocker session 3 times, this session hung on the following call stack:
ksedsts()+244<-ksdxfstk()+58<-ksdxcb()+918<-sspuser()+224<-__sighandler()<-pfrgnc()+74<-qksceUnderSysPLSql()+95 <-qkscePreFillCurEnv()+1325<-kksLoadChild()+4554<-kxsGetRuntimeLock()+2155<-kksfbc()+14431<-opiexe()+2536<-opipls()+2154 <-opiodr()+1165<-rpidrus()+206<-skgmstack()+144<-rpiswu2()+739<-rpidrv()+1511<-psddr0()+478<-psdnal()+636<-pevm_EXECC()+304 <-pfrinstr_EXECC()+79<-pfrrun_no_tool()+60<-pfrrun()+1155<-plsql_run()+708<-peicnt()+285<-kkxexe()+726<-opiexe()+19651 <-kpoal8()+2848<-opiodr()+1165<-ttcpip()+2699<-opitsk()+1740<-opiino()+945<-opiodr()+1165<-opidrv()+587<-sou2o()+145 <-opimai_real()+154<-ssthrdmain()+412<-main()+236<-__libc_start_main()+253
And in the v$session(here is dba_hist_active_sess_history), the SQL_EXEC_ID and SEQ# of blocker session were unchanged, this means the session was hanging there. The event is null means the session is on CPU.
SAMPLE_ID SAMPLE_TIME SEQ# EXEC_ID PROGRAM EVENT SQL_ID TOP_LEVEL_SQL PLSQL_ID FLAG ---------- ------------------------- ------- ---------- ---------- --------------- -------------- ------------- -------- ----------------- 164832437 16-JAN-19 07.51.29.653 PM 16524 27509653 APEX Liste 06th3aykfyckb b7c37mhzaknv5 87175 NNNNYNNNNNNNNNNNN 164832447 16-JAN-19 07.51.39.673 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832457 16-JAN-19 07.51.49.713 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832467 16-JAN-19 07.51.59.753 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832477 16-JAN-19 07.52.09.773 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832487 16-JAN-19 07.52.19.883 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832497 16-JAN-19 07.52.29.913 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832507 16-JAN-19 07.52.39.943 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832517 16-JAN-19 07.52.49.983 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832527 16-JAN-19 07.53.00.023 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832537 16-JAN-19 07.53.10.043 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832547 16-JAN-19 07.53.20.133 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832557 16-JAN-19 07.53.30.173 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832567 16-JAN-19 07.53.40.193 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832577 16-JAN-19 07.53.50.233 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832587 16-JAN-19 07.54.00.263 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832597 16-JAN-19 07.54.10.293 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832607 16-JAN-19 07.54.20.394 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832617 16-JAN-19 07.54.30.434 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832627 16-JAN-19 07.54.40.454 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832637 16-JAN-19 07.54.50.484 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832647 16-JAN-19 07.55.00.514 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832657 16-JAN-19 07.55.10.544 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN 164832667 16-JAN-19 07.55.20.634 PM 16524 16777235 APEX Liste b7c37mhzaknv5 b7c37mhzaknv5 87175 NNNNYYNNNNNNNNNNN
I made processstat for the blocker session, and in the trace file, it shows that a lot of cursor invalidated because the rolling invalidate window exceeded.
NamespaceDump:
Parent Cursor: sql_id=06th3aykfyckb parent=0x203fbf2268 maxchild=22 plk=y ppn=n
CursorDiagnosticsNodes:
ChildNode: ChildNumber=11 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=11 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547689423 ksugctm=1547689428
ChildNode: ChildNumber=10 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=10 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547688568 ksugctm=1547688569
ChildNode: ChildNumber=0 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=2 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=2 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547686558 ksugctm=1547686560
ChildNode: ChildNumber=8 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=8 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547686414 ksugctm=1547686439
ChildNode: ChildNumber=9 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=9 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547684845 ksugctm=1547684850
ChildNode: ChildNumber=4 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=4 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547684253 ksugctm=1547684279
ChildNode: ChildNumber=14 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=14 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547682551 ksugctm=1547682568
ChildNode: ChildNumber=6 ID=34 reason=Rolling Invalidate Window Exceeded(2) size=0x0 details=already_processed
ChildNode: ChildNumber=6 ID=34 reason=Rolling Invalidate Window Exceeded(3) size=2x4 invalidation_window=1547681275 ksugctm=1547681278
And I checked the last_analyzed of related table, they were analyzed just a few hours before. So, I locked to statistics on them. Unfortunately, after the peace of three days, the problem occured again.
I opened a SR on metalink, the Oracle gave me some suggestions that the call stack is related with bugs:
- Bug 20264808 SPINNING ON KKSLOADCHILD / KXSGETRUNTIMELOCK CAUSING MUTEX AND TX WAITS
- Bug 24291191 SPINNING ON PFRGNC
Both are not public, we cannot see the details. The Oracle engineer copied some explain to me:
These two bugs have been closed that those bugs as not a bug with comments below “I think that the application has entered into such a recursion, so deep, that the loop in qksceUnderSysPLSql which calls pfrgnc to walk through the frames, is simply wasting time traversing through the deep level of pl/sql frames. kindly request the customer to fix the application recursion, in the first place, and then see if the issue still reproduces or not.”
I read the processstat again and found that there is a pl/sql stack section. In my case, the PEKFASG is calling itself on the same place recusively.
----- PL/SQL Stack ----- ----- PL/SQL Call Stack ----- object line object handle number name 0x204f940eb8 116 package body NLSUSER.G$_NLS 0x204f940eb8 127 package body NLSUSER.G$_NLS 0x204f940eb8 174 package body NLSUSER.G$_NLS 0x1f6fa7fec8 5836 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 package body BANINST1.PEKFASG 0x1f6fa7fec8 5839 packag
After checking the source code, I found there is a procedure in the package calling itself if it goes to exception section, like following:
5894 PROCEDURE p_write_error( …... 5926 EXCEPTION 5927 WHEN api_error THEN …... 5934 WHEN OTHERS THEN …... 5938 p_write_error( 5939 p_pidm => p_pidm, 5940 p_term => p_term, 5941 p_message => api_error_msg, 5942 p_user_id => p_user_id); 5943 END p_write_error;
I could not find any logs on Tomcat about this, I submitted this problem to the vendor and waiting for response.
