Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- HEALTH_ERR 1 MDSs report slow metadata IOs; 1 MDSs report slow requests; 2 MDSs behind on trimming; noout flag(s) set; 1 osds down; Reduced data availability: 5 pgs inactive, 5 pgs incomplete; Degraded data redundancy: 1384859/653071893 objects degraded (0.212%), 115 pgs degraded, 115 pgs undersized; 42 slow requests are blocked > 32 sec. Implicated osds ; 759 stuck requests are blocked > 4096 sec. Implicated osds 63,80,492,494
- MDS_SLOW_METADATA_IO 1 MDSs report slow metadata IOs
- mdsdcucmds401(mds.0): 47 slow metadata IOs are blocked > 30 secs, oldest blocked for 563112 secs
- MDS_SLOW_REQUEST 1 MDSs report slow requests
- mdsdcucmds401(mds.0): 20 slow requests are blocked > 30 sec
- MDS_TRIM 2 MDSs behind on trimming
- mdsdcucmds401(mds.0): Behind on trimming (10635/128) max_segments: 128, num_segments: 10635
- mdsdcecmdsm01(mds.0): Behind on trimming (10635/128) max_segments: 128, num_segments: 10635
- OSDMAP_FLAGS noout flag(s) set
- OSD_DOWN 1 osds down
- osd.128 (root=hdd,datacenter=dce-hdd,rack=dce-sk-hdd,host=dcecsn10) is down
- PG_AVAILABILITY Reduced data availability: 5 pgs inactive, 5 pgs incomplete
- pg 17.173 is incomplete, acting [494,64]
- pg 19.5c is incomplete, acting [80,56]
- pg 22.11a is incomplete, acting [63,75]
- pg 22.1fd5 is incomplete, acting [492,66]
- pg 29.1f1 is incomplete, acting [18,135]
- PG_DEGRADED Degraded data redundancy: 1384859/653071893 objects degraded (0.212%), 115 pgs degraded, 115 pgs undersized
- pg 19.11c0 is active+undersized+degraded, acting [526]
- pg 19.127d is stuck undersized for 295690.138249, current state active+undersized+degraded, last acting [117]
- pg 19.128b is stuck undersized for 295690.135780, current state active+undersized+degraded, last acting [430]
- pg 19.1640 is stuck undersized for 295690.134516, current state active+undersized+degraded, last acting [226]
- pg 19.166c is stuck undersized for 295690.134770, current state active+undersized+degraded, last acting [145]
- pg 19.174a is stuck undersized for 295689.906275, current state active+undersized+degraded, last acting [344]
- pg 19.18dd is stuck undersized for 295690.104434, current state active+undersized+degraded, last acting [532]
- pg 19.198a is stuck undersized for 295690.126278, current state active+undersized+degraded, last acting [580]
- pg 19.1aaf is stuck undersized for 3417.034741, current state active+undersized+degraded, last acting [438]
- pg 19.1acf is stuck undersized for 295690.131979, current state active+undersized+degraded, last acting [359]
- pg 22.1245 is stuck undersized for 295690.125220, current state active+undersized+degraded, last acting [592]
- pg 22.14c1 is stuck undersized for 295690.133069, current state active+undersized+degraded, last acting [356]
- pg 22.1502 is stuck undersized for 295690.136751, current state active+undersized+degraded, last acting [231]
- pg 22.1540 is stuck undersized for 295690.136201, current state active+undersized+degraded, last acting [116]
- pg 22.15f4 is stuck undersized for 295690.139468, current state active+undersized+degraded, last acting [33]
- pg 22.162c is stuck undersized for 295690.119771, current state active+undersized+degraded, last acting [590]
- pg 22.1787 is stuck undersized for 295690.133986, current state active+undersized+degraded, last acting [226]
- pg 22.18fe is stuck undersized for 295690.135285, current state active+undersized+degraded, last acting [383]
- pg 22.190b is stuck undersized for 295689.936622, current state active+undersized+degraded, last acting [168]
- pg 22.195d is stuck undersized for 295690.138556, current state active+undersized+degraded, last acting [34]
- pg 22.1984 is stuck undersized for 295690.123381, current state active+undersized+degraded, last acting [577]
- pg 22.1a4e is stuck undersized for 295690.136314, current state active+undersized+degraded, last acting [455]
- pg 22.1aa4 is stuck undersized for 295690.134805, current state active+undersized+degraded, last acting [116]
- pg 22.20bf is stuck undersized for 295690.134410, current state active+undersized+degraded, last acting [203]
- pg 22.2316 is stuck undersized for 295690.134259, current state active+undersized+degraded, last acting [275]
- pg 22.23ed is stuck undersized for 295690.133541, current state active+undersized+degraded, last acting [147]
- pg 22.24f6 is stuck undersized for 295690.133473, current state active+undersized+degraded, last acting [408]
- pg 22.25df is stuck undersized for 295690.136292, current state active+undersized+degraded, last acting [410]
- pg 22.26b4 is stuck undersized for 295690.123370, current state active+undersized+degraded, last acting [512]
- pg 22.279a is stuck undersized for 295690.131259, current state active+undersized+degraded, last acting [143]
- pg 22.29ed is stuck undersized for 295690.134838, current state active+undersized+degraded, last acting [140]
- pg 22.2c07 is stuck undersized for 295690.134989, current state active+undersized+degraded, last acting [3]
- pg 22.2cac is stuck undersized for 295690.132551, current state active+undersized+degraded, last acting [298]
- pg 22.2d4e is stuck undersized for 295690.133480, current state active+undersized+degraded, last acting [317]
- pg 22.2f6c is stuck undersized for 295690.135492, current state active+undersized+degraded, last acting [245]
- pg 22.3039 is stuck undersized for 295690.137047, current state active+undersized+degraded, last acting [29]
- pg 22.3042 is stuck undersized for 295690.138424, current state active+undersized+degraded, last acting [59]
- pg 22.31b1 is stuck undersized for 295689.918413, current state active+undersized+degraded, last acting [397]
- pg 22.33fa is stuck undersized for 295690.134979, current state active+undersized+degraded, last acting [416]
- pg 22.346e is stuck undersized for 295690.134955, current state active+undersized+degraded, last acting [234]
- pg 22.3501 is stuck undersized for 295690.138823, current state active+undersized+degraded, last acting [196]
- pg 22.351b is stuck undersized for 295690.135487, current state active+undersized+degraded, last acting [375]
- pg 22.3527 is stuck undersized for 295690.133131, current state active+undersized+degraded, last acting [332]
- pg 22.379c is stuck undersized for 295690.137851, current state active+undersized+degraded, last acting [366]
- pg 22.3968 is stuck undersized for 295690.135097, current state active+undersized+degraded, last acting [410]
- pg 22.3982 is stuck undersized for 295690.134773, current state active+undersized+degraded, last acting [57]
- pg 22.39bf is stuck undersized for 295690.133458, current state active+undersized+degraded, last acting [287]
- pg 22.3bb2 is stuck undersized for 295690.133515, current state active+undersized+degraded, last acting [224]
- pg 22.3ee2 is stuck undersized for 295690.135597, current state active+undersized+degraded, last acting [458]
- pg 22.3f78 is stuck undersized for 295690.132724, current state active+undersized+degraded, last acting [122]
- pg 22.3f96 is stuck undersized for 295690.135326, current state active+undersized+degraded, last acting [338]
- REQUEST_SLOW 42 slow requests are blocked > 32 sec. Implicated osds
- 7 ops are blocked > 2097.15 sec
- 35 ops are blocked > 1048.58 sec
- REQUEST_STUCK 759 stuck requests are blocked > 4096 sec. Implicated osds 63,80,492,494
- 292 ops are blocked > 536871 sec
- 182 ops are blocked > 268435 sec
- 184 ops are blocked > 67108.9 sec
- 101 ops are blocked > 4194.3 sec
- osds 63,80,492,494 have stuck requests > 536871 sec
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement