ORA-03113:end-of-file on communication channel

测试上面的一个库
plsql报错：shared  memory realm does not exist
startup报错：ORA-03113：end-of-file on communication channel

SQL> startup;
ORACLE instance started.

Total System Global Area 2.8327E+10 bytes
Fixed Size            2214176 bytes
Variable Size         1.6375E+10 bytes
Database Buffers     1.1811E+10 bytes
Redo Buffers          139182080 bytes
Database mounted.
ORA-03113: end-of-file on communication channel
Process ID: 18352
Session ID: 35 Serial number: 5

error:
Errors in file /opt/app/oracle/diag/rdbms/racdb/racdb1/trace/racdb1_ora_23390.trc:
ORA-19815: WARNING: db_recovery_file_dest_size of 9413066752 bytes is 100.00% used, and has 0 remaining bytes available.
************************************************************************
You have following choices to free up space from recovery area:
1. Consider changing RMAN RETENTION POLICY. If you are using Data Guard,
   then consider changing RMAN ARCHIVELOG DELETION POLICY.
2. Back up files to tertiary device such as tape using RMAN
   BACKUP RECOVERY AREA command.
3. Add disk space and increase db_recovery_file_dest_size parameter to   -需要增加磁盘空间并且调大参数db_recovery_file_dest_size
   reflect the new space.
4. Delete unnecessary files using RMAN DELETE command. If an operating
   system command was used to delete files, then use RMAN CROSSCHECK and
   DELETE EXPIRED commands.
************************************************************************
Errors in file /opt/app/oracle/diag/rdbms/racdb/racdb1/trace/racdb1_ora_23390.trc:
ORA-19809: limit exceeded for recovery files
ORA-19804: cannot reclaim 27262976 bytes disk space from 9413066752 limit
ARCH: Error 19809 Creating archive log file to '+RECOVERY'
Errors in file /opt/app/oracle/diag/rdbms/racdb/racdb1/trace/racdb1_ora_23390.trc:
ORA-16038: log 1 sequence# 213 cannot be archived        ---不能被归档，可见是归档日志满了，数据库无法启动了
ORA-19809: limit exceeded for recovery files
ORA-00312: online log 1 thread 1: '+DATA/racdb/onlinelog/group_1.257.779192545'
ORA-00312: online log 1 thread 1: '+RECOVERY/racdb/onlinelog/group_1.257.779192545'
USER (ospid: 23390): terminating the instance due to error 16038
Fri Mar 30 09:32:18 2012
System state dump is made for local instance
System State dumped to trace file /opt/app/oracle/diag/rdbms/racdb/racdb1/trace/racdb1_diag_23157.trc


处理过程：

1：由spfile生成pfile，增大pfile中的db_recovery_file_dest_size参数的值

SQL> startup;
ORA-01081: cannot start already-running ORACLE - shut it down first
SQL> create pfile='/opt/app/oracle/admin/racdb/pfile/pfilerac1.ora' from spfile;
File created.

2：由修改过的pfile生成spfile，启动数据库

SQL> startup pfile='/opt/app/oracle/admin/racdb/pfile/pfilerac1.ora';
SQL> create spfile='/opt/app/oracle/product/11.2.0/dbs/spfileracdb1.ora' from pfile;

RAC2 节点同样要建立一个SPFILE:

在RAC2节点执行：
SQL> startup pfile='/opt/app/oracle/admin/racdb/pfile/pfilerac1.ora';
SQL> create spfile='/opt/app/oracle/product/11.2.0/dbs/spfileracdb1.ora' from pfile;

--修改PFILE 中的db_recovery_file_dest_size
vi /opt/app/oracle/admin/racdb/pfile/pfilerac1.ora
*.db_recovery_file_dest_size=100g

3：使用rman，清理过期的数据

[oracle@localhost ~]$ rman target/
Recovery Manager: Release 11.2.0.1.0 - Production on Sat Sep 25 14:18:53 2010
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: ONLINE (DBID=2094135012)
RMAN> crosscheck archivelog all;
RMAN> delete expired archivelog all;

cat /dba/oracle/diag/rdbms/wbepinterfacest/wbepinterfac/trace/alert_wbepinterfac.log
发现确实是归档日志满了，使用率100%造成的。

但是由于库现在起不来，我们可以如上，改大参数，也可以手动清理一些，然后起库，
再使用rman工具--
delete archivelog all completed before 'sysdate-2'；

这个库是用是asm，因此
su - grid
asmcmd
cd FRA_DG/WBEPINTERFACEST/ARCHIVELOG/2013_10_10
rm -fr thread*


然后startup mount
alter database noarchivelog；
alter database open；

监听可能没起来，
我们可以
crsctl start res wbepinterfac.head  -n test01