ora-00600: internal error code, arguments: [KGHLKREM1], [0x838000020], [], [], [], [], [], [], [], [ - 数据库编程

昨天晚上凌晨12点接到监控短信（dataguard is down），于是登录系统查看原因，

在往前查看alertlog

.....
Mon Feb 20 09:35:59 2012
Archived Log entry 10127 added for thread 1 sequence 11099 ID 0x263e89b dest 1:
Mon Feb 20 10:01:06 2012
RFS[6]: Selected log 13 for thread 1 sequence 11101 dbid 40093083 branch 760555291
Mon Feb 20 10:01:06 2012
Media Recovery Waiting for thread 1 sequence 11101 (in transit)
Recovery of Online Redo Log: Thread 1 Group 13 Seq 11101 Reading mem 0
Mem# 0: /oracle/oradata/skate01/standbyredo13.log
Mon Feb 20 10:01:14 2012
Archived Log entry 10128 added for thread 1 sequence 11100 ID 0x263e89b dest 1:
Mon Feb 20 10:03:58 2012
Errors in file /oracle/app/diag/rdbms/skate01/skate01/trace/skate01_ora_17783.trc (incident=264961):
ora-00600: internal error code, arguments: [KGHLKREM1], [0x838000020], [], [], [], [], [], [], [], [], [], []
Incident details in: /oracle/app/diag/rdbms/skate01/skate01/incident/incdir_264961/skate01_ora_17783_i264961.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Mon Feb 20 10:04:27 2012
Errors in file /oracle/app/diag/rdbms/skate01/skate01/trace/skate01_mmon_1590.trc (incident=264121):
ora-00600: internal error code, arguments: [KGHLKREM1], [0x838000020], [], [], [], [], [], [], [], [], [], []
Incident details in: /oracle/app/diag/rdbms/skate01/skate01/incident/incdir_264121/skate01_mmon_1590_i264121.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Mon Feb 20 10:04:29 2012
Restarting dead background process MMON
Mon Feb 20 10:04:29 2012
MMON started with pid=15, OS id=17808
Mon Feb 20 10:04:29 2012
Dumping diagnostic data in directory=[cdmp_20120220100429], requested by (instance=1, osid=1590 (MMON)), summary=[incident=264121].
Errors in file /oracle/app/diag/rdbms/skate01/skate01/trace/skate01_mmon_17808.trc (incident=264122):
ora-00600: internal error code, arguments: [KGHLKREM1], [0x838000020], [], [], [], [], [], [], [], [], [], []
Incident details in: /oracle/app/diag/rdbms/skate01/skate01/incident/incdir_264122/skate01_mmon_17808_i264122.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Errors in file /oracle/app/diag/rdbms/skate01/skate01/trace/skate01_mmon_17808.trc (incident=264123):
ora-00600: internal error code, arguments: [KGHLKREM1], [0x838000020], [], [], [], [], [], [], [], [], [], []
Incident details in: /oracle/app/diag/rdbms/skate01/skate01/incident/incdir_264123/skate01_mmon_17808_i264123.trc
Dumping diagnostic data in directory=[cdmp_20120220100432], requested by (instance=1, osid=17808 (MMON)), summary=[incident=264122].
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Mon Feb 20 10:04:52 2012
.......

发现在“Mon Feb 20 10:03:58 2012”就已经开始报ora-600错误了。首先看看数据库现在是什么状态，是否正常。

1. $ ps -ef |grep $ORACLE_SID //检查oracle进程是否正常
2. $ netstat -an | grep 1588| wc -l //检查oracle是否有连接
3. 检查os的状态：vmstat，top，iostat

从以上检查，没发现什么异常，想起来20号有项目迁移到这个active备库上，可能和这有原因，于是想登录数据库进一步查证，发现无法登陆，提示错误如下：

[root@skate01 ~]# su - oracle
[oracle@skate01 ~]$ sqlplus "/as sysdba"

SQL*Plus: Release 11.2.0.2.0 Production on Tue Feb 21 00:26:12 2012

ERROR:
ORA-01075: you are cur

ora-00600: internal error code, arguments: [KGHLKREM1], [0x838000020], [], [], [], [], [], [], [], [(一)