Number of Archives Generation is too high.Normally around 40 archives got generated from both nodes.But on Monday i was shocked when i checked the no of archives in a day.Around 700 archives were generated in 10 hrs.
Findings:
select trunc(first_time), count(*)
from v$archived_log
where name not like '%dr'
group by trunc(first_time)
order by 1;
(first_time) count(*)
--------- ----------
27-NOV-11 2
28-NOV-11 20
29-NOV-11 28
30-NOV-11 14
01-DEC-11 17
02-DEC-11 17
03-DEC-11 18
04-DEC-11 359
05-DEC-11 386
DB DATE TOTAL H00 H01 H02 H03 H04 H05 H06 H07 H08 H09 H10 H11 H12 H13 H14 H15 H16 H17 H18 H19 H20 H21 H22 H23
--- ---------- ------ --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- ---
1 2011-12-01 12 0 0 2 0 0 0 0 0 0 2 0 0 0 2 0 2 0 0 0 0 0 0 2 2
2 2011-12-01 22 0 0 2 0 0 0 2 0 0 2 0 4 0 0 2 2 2 0 0 2 0 0 2 2
1 2011-12-02 12 0 0 2 0 0 0 0 0 0 2 0 0 0 2 0 0 0 0 2 0 0 0 2 2
2 2011-12-02 22 0 0 2 0 0 0 2 0 0 2 0 2 0 2 0 0 2 2 2 2 0 0 0 4
1 2011-12-03 10 0 0 0 0 0 0 0 0 0 2 0 0 2 0 0 2 0 0 0 2 0 0 0 2
2 2011-12-03 26 0 0 2 0 0 0 2 0 0 2 2 0 2 2 0 4 2 2 0 2 0 0 2 2
1 2011-12-04 352 0 0 0 0 0 0 0 0 0 2 0 0 0 2 16 36 42 38 44 34 40 32 28 38
2 2011-12-04 366 0 0 2 0 0 0 2 0 0 2 0 2 0 4 16 36 42 38 44 34 40 36 32 36
1 2011-12-05 384 44 42 22 40 38 36 40 32 30 32 28 0 0 0 0 0 0 0 0 0 0 0 0 0
2 2011-12-05 388 44 42 24 40 38 36 40 32 30 32 28 0 2 0 0 0 0 0 0 0 0 0 0 0
1) The no of archives generated were 700 which inturns can cause me space issue also.Hmmm...But few GB's was used by archives.
Then i checked the size of archive files.The size of archives was in KBs and MBs.
2) It means number of log switch is tooo high.
3) Then i checked the alert log which helped me to diagnose the issue.
Error messages in alert log:
Sun Dec 04 19:51:10 2011
Errors in file /orahome/app/oracle/diag/rdbms/ebsdbprd/ebsdbprd1/trace/ebsdbprd1_arc3_2306070.trc:
ORA-12582: TNS:invalid operation
FAL[server, ARC3]: FAL archive failed, see trace file.
Errors in file /orahome/app/oracle/diag/rdbms/ebsdbprd/ebsdbprd1/trace/ebsdbprd1_arc3_2306070.trc:
ORA-16055: FAL request rejected
ARCH: FAL archive failed. Archiver continuing
ORACLE Instance ebsdbprd1 - Archival Error. Archiver continuing.
Sun Dec 04 20:07:13 2011
Errors in file /orahome/app/oracle/diag/rdbms/ebsdbprd/ebsdbprd1/trace/ebsdbprd1_nsa2_1601550.trc:
ORA-00270: error creating archive log
4) It means there is some problem at Standby database.I checked the space at archive destination on standby server.
It was full :( .RMAN backup was failed.I manually deleted old archive files.
No comments:
Post a Comment