12c backup pdb to copy, "corrupt", switch to copy, recover

[oracle@waipio1 KILAUEA rman]$ rman target "'sysbackup/bkp.n1te@hilo as sysbackup'"

connected to target database: KILAUEA (DBID=2092683371)

RMAN> backup as copy database;

Starting backup at 03-SEP-13
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=69 device type=DISK
allocated channel: ORA_DISK_2
channel ORA_DISK_2: SID=186 device type=DISK
channel ORA_DISK_1: starting datafile copy
input datafile file number=00046 name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/system.280.825114671
channel ORA_DISK_2: starting datafile copy
input datafile file number=00047 name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/sysaux.260.825200449
output file name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/system.693.825201765 tag=TAG20130903T224244 RECID=7 STAMP=825201841
channel ORA_DISK_1: datafile copy complete, elapsed time: 00:01:53
channel ORA_DISK_1: starting datafile copy
input datafile file number=00050 name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/ts.263.824999673
output file name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/sysaux.688.825201827 tag=TAG20130903T224244 RECID=8 STAMP=825201888
channel ORA_DISK_2: datafile copy complete, elapsed time: 00:02:08
channel ORA_DISK_2: starting datafile copy
input datafile file number=00048 name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675
output file name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/ts.697.825201889 tag=TAG20130903T224244 RECID=9 STAMP=825201898
channel ORA_DISK_1: datafile copy complete, elapsed time: 00:00:10
output file name=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.520.825201899 tag=TAG20130903T224244 RECID=10 STAMP=825201899
channel ORA_DISK_2: datafile copy complete, elapsed time: 00:00:03
Finished backup at 03-SEP-13

Starting Control File and SPFILE Autobackup at 03-SEP-13
piece handle=+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/AUTOBACKUP/2013_09_03/s_825201901.516.825201905 comment=NONE
Finished Control File and SPFILE Autobackup at 03-SEP-13


RMAN> shutdown abort;

database closed

[grid@waipio1 ~]$ asmcmd rm +DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675



RMAN> startup

RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of startup command at 09/03/2013 22:50:10
ORA-01157: cannot identify/lock data file 48 - see DBWR trace file
ORA-01110: data file 48: '+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675'



Tue Sep 03 22:48:41 2013
ALTER SYSTEM: Flushing buffer cache inst=0 container=3 local
Pluggable database HILO closed
Completed: alter pluggable database close immediate
Tue Sep 03 22:50:10 2013
alter database open
Tue Sep 03 22:50:10 2013
Errors in file /app/oracle/diag/rdbms/kilauea/KILAUEA/trace/KILAUEA_dbw0_6762.trc:
ORA-01157: cannot identify/lock data file 48 - see DBWR trace file
ORA-01110: data file 48: '+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675'
ORA-17503: ksfdopn:2 Failed to open file +DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675
ORA-15012: ASM file '+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675' does not exist
Tue Sep 03 22:50:10 2013
Pluggable database HILO hit error 1157 during open read write
and will be closed.
Immediate Kill Session#: 12, Serial#: 763
Immediate Kill Session: sess: 0x18a5cf8e0  OS pid: 32480
ALTER SYSTEM: Flushing buffer cache inst=0 container=3 local
Tue Sep 03 22:50:12 2013
Checker run found 1 new persistent data failures
Tue Sep 03 22:50:26 2013
Errors in file /app/oracle/diag/rdbms/kilauea/KILAUEA/trace/KILAUEA_ora_32478.trc:
ORA-19625: error identifying file +DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675
ORA-17503: ksfdopn:2 Failed to open file +DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675
ORA-15012: ASM file '+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.278.825114675' does not exist
Tue Sep 03 22:50:26 2013


RMAN> switch datafile 48 to copy;

datafile 48 switched to datafile copy "+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.520.825201899"

RMAN> recover database;

Starting recover at 03-SEP-13
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=69 device type=DISK
allocated channel: ORA_DISK_2
channel ORA_DISK_2: SID=186 device type=DISK

starting media recovery
media recovery complete, elapsed time: 00:00:01

Finished recover at 03-SEP-13

RMAN> alter database open;

Statement processed

RMAN>


Tue Sep 03 22:50:26 2013
WARNING: switching recovery area datafile copy
+DATA/KILAUEA/E55656EBC9CD1972E0437901A8C02245/DATAFILE/users.520.825201899 as database area datafile.
This datafile is no more accounted into used space. Consider decrementing
db_recovery_file_dest_size parameter value by 5242880 bytes.
Switch of datafile 48 complete to datafile copy
  checkpoint is 3366571
alter database recover if needed
 datafile 46 , 47 , 48 , 50
Tue Sep 03 22:50:36 2013
Media Recovery Start
Tue Sep 03 22:50:36 2013
Serial Media Recovery started
Tue Sep 03 22:50:37 2013
Recovery of Online Redo Log: Thread 1 Group 1 Seq 157 Reading mem 0
  Mem# 0: +DATA/KILAUEA/ONLINELOG/group_1.364.824921903
  Mem# 1: +DATA/KILAUEA/ONLINELOG/group_1.681.824921909
Tue Sep 03 22:50:37 2013
Media Recovery Complete (KILAUEA)
Completed: alter database recover if needed
 datafile 46 , 47 , 48 , 50
alter database open
Tue Sep 03 22:51:02 2013
Opening pdb HILO (3) with no Resource Manager plan active
Pluggable database HILO opened read write
Completed: alter database open