故障现象
grid所在目录空间满df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sdw2 40G 22G 17G 58% /
tmpfs 16G 219M 16G 2% /dev/shm
/dev/sdw1 50G 46G 1.5G 97% /u01
# 使用find命令找出来大文件
find ./ type f -size +1024M
./crf/db/wldb01/crfclust.bdb
由于文件crfclust.bdb是Cluster Health Monitor (CHM) file,他的默认大小是1G,但是有在一些平台和版本中由于bug原因导致过大.Oracle Cluster Health Monitor (CHM) using large amount of space (more than default) (Doc ID 1343105.1)
Bug 20186278 – crfclust.bdb Becomes Huge Size Due to Sudden Retention Change (Doc ID 20186278.8)
清理crfclust.bdb
/u01/app/11.2.0/grid/bin/oclumon manage -get reppath CHM Repository Path = /u01/app/11.2.0/grid/crf/db/wldb01 Done cd /u01/app/11.2.0/grid/crf/db/wldb01 du -sh 24G . ls -lhtr total 24G -rw-r-----. 1 root root 16M Mar 25 21:38 log.0000047847 -rw-r-----. 1 root root 8.0K Mar 25 21:38 repdhosts.bdb -rw-r-----. 1 root root 24K Mar 25 21:39 __db.001 -rw-r--r--. 1 root root 115M Mar 25 21:39 wldb01.ldb -rw-r-----. 1 root root 8.0K Mar 25 21:40 crfconn.bdb -rw-r-----. 1 root root 329M Mar 25 21:52 crfts.bdb -rw-r-----. 1 root root 508M Mar 25 21:53 crfloclts.bdb -rw-r-----. 1 root root 22G Mar 25 21:53 crfclust.bdb -rw-r-----. 1 root root 392K Mar 25 21:53 __db.002 -rw-r-----. 1 root root 16M Mar 25 21:53 log.0000047848 -rw-r-----. 1 root root 504M Mar 25 21:53 crfhosts.bdb -rw-r-----. 1 root root 650M Mar 25 21:53 crfcpu.bdb -rw-r-----. 1 root root 534M Mar 25 21:53 crfalert.bdb -rw-r-----. 1 root root 56K Mar 25 21:53 __db.006 -rw-r-----. 1 root root 1.2M Mar 25 21:53 __db.005 -rw-r-----. 1 root root 2.1M Mar 25 21:53 __db.004 -rw-r-----. 1 root root 2.6M Mar 25 21:53 __db.003 # 清理bdb文件 /u01/app/11.2.0/grid/bin/crsctl stop res ora.crf -init CRS-2673: Attempting to stop 'ora.crf' on 'wldb01' CRS-2677: Stop of 'ora.crf' on 'wldb01' succeeded /u01/app/11.2.0/grid/bin/crsctl status res -t -init -------------------------------------------------------------------------------- NAME TARGET STATE SERVER STATE_DETAILS -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.asm 1 ONLINE ONLINE wldb01 Started ora.cluster_interconnect.haip 1 ONLINE ONLINE wldb01 ora.crf 1 OFFLINE OFFLINE ora.crsd 1 ONLINE ONLINE wldb01 ora.cssd 1 ONLINE ONLINE wldb01 ora.cssdmonitor 1 ONLINE ONLINE wldb01 ora.ctssd 1 ONLINE ONLINE wldb01 ACTIVE:0 ora.diskmon 1 OFFLINE OFFLINE ora.drivers.acfs 1 ONLINE ONLINE wldb01 ora.evmd 1 ONLINE ONLINE wldb01 ora.gipcd 1 ONLINE ONLINE wldb01 ora.gpnpd 1 ONLINE ONLINE wldb01 ora.mdnsd 1 ONLINE ONLINE wldb01 rm -rf *.bdb df -h Filesystem Size Used Avail Use% Mounted on /dev/sdw2 40G 22G 17G 58% / tmpfs 16G 219M 16G 2% /dev/shm /dev/sdw1 50G 22G 26G 46% /u01 du -sh 53M . u01/app/11.2.0/grid/bin/crsctl start res ora.crf -init CRS-2672: Attempting to start 'ora.crf' on 'wldb01' CRS-2676: Start of 'ora.crf' on 'wldb01' succeeded /u01/app/11.2.0/grid/bin/crsctl status res -t -init -------------------------------------------------------------------------------- NAME TARGET STATE SERVER STATE_DETAILS -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.asm 1 ONLINE ONLINE wldb01 Started ora.cluster_interconnect.haip 1 ONLINE ONLINE wldb01 ora.crf 1 ONLINE ONLINE wldb01 ora.crsd 1 ONLINE ONLINE wldb01 ora.cssd 1 ONLINE ONLINE wldb01 ora.cssdmonitor 1 ONLINE ONLINE wldb01 ora.ctssd 1 ONLINE ONLINE wldb01 ACTIVE:0 ora.diskmon 1 OFFLINE OFFLINE ora.drivers.acfs 1 ONLINE ONLINE wldb01 ora.evmd 1 ONLINE ONLINE wldb01 ora.gipcd 1 ONLINE ONLINE wldb01 ora.gpnpd 1 ONLINE ONLINE wldb01 ora.mdnsd 1 ONLINE ONLINE wldb01 |