API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jun 8th, 2013
205
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.06 KB | None | 0 0
raw download clone embed print report
  1.  
  2. root@ceph-osd2:~# ceph -s
  3. health HEALTH_ERR 76 pgs incomplete; 166 pgs inconsistent; 76 pgs stuck inactive; 101 pgs stuck unclean; recovery 307/2013033 degraded (0.015%); 305 scrub errors; mds cluster is degraded; mds a is laggy; 1 mons down, quorum 1,2 c,d
  4. monmap e13: 3 mons at {b=10.11.3.3:6789/0,c=10.11.3.4:6789/0,d=10.11.3.6:6789/0}, election epoch 3914, quorum 1,2 c,d
  5. osdmap e10536: 21 osds: 20 up, 20 in
  6. pgmap v910023: 1400 pgs: 1142 active+clean, 5 inconsistent+incomplete, 21 active+remapped, 71 incomplete, 157 active+clean+inconsistent, 4 active+remapped+inconsistent; 2580 GB data, 7603 GB used, 20328 GB / 27931 GB avail; 307/2013033 degraded (0.015%)
  7. mdsmap e320289: 1/1/1 up {0=a=up:replay(laggy or crashed)}
  8.  
  9.  
  10. root@ceph-osd2:~# ceph -w
  11. health HEALTH_ERR 76 pgs incomplete; 166 pgs inconsistent; 76 pgs stuck inactive; 101 pgs stuck unclean; recovery 307/2013033 degraded (0.015%); 305 scrub errors; mds cluster is degraded; mds a is laggy; 1 mons down, quorum 1,2 c,d
  12. monmap e13: 3 mons at {b=10.11.3.3:6789/0,c=10.11.3.4:6789/0,d=10.11.3.6:6789/0}, election epoch 3914, quorum 1,2 c,d
  13. osdmap e10536: 21 osds: 20 up, 20 in
  14. pgmap v910023: 1400 pgs: 1142 active+clean, 5 inconsistent+incomplete, 21 active+remapped, 71 incomplete, 157 active+clean+inconsistent, 4 active+remapped+inconsistent; 2580 GB data, 7603 GB used, 20328 GB / 27931 GB avail; 307/2013033 degraded (0.015%)
  15. mdsmap e320290: 1/1/1 up {0=a=up:replay(laggy or crashed)}
  16.  
  17. 2013-06-09 09:42:54.539766 osd.11 [WRN] slow request 36866.717970 seconds old, received at 2013-06-08 23:28:27.821710: osd_op(client.2474209.0:3 vm-101-disk-1.rbd [stat] 3.6724cd95 e10536) v4 currently reached pg
  18. 2013-06-09 09:42:48.472313 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37848.337629 secs
  19. 2013-06-09 09:42:48.472319 osd.20 [WRN] slow request 37848.337629 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  20. 2013-06-09 09:42:48.472323 osd.20 [WRN] slow request 37847.878017 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  21. 2013-06-09 09:42:49.472515 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37849.337833 secs
  22. 2013-06-09 09:42:49.472520 osd.20 [WRN] slow request 37849.337833 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  23. 2013-06-09 09:42:49.472525 osd.20 [WRN] slow request 37848.878221 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  24. 2013-06-09 09:42:50.472722 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37850.338038 secs
  25. 2013-06-09 09:42:50.472732 osd.20 [WRN] slow request 37850.338038 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  26. 2013-06-09 09:42:50.472739 osd.20 [WRN] slow request 37849.878426 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  27. 2013-06-09 09:42:51.472902 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37851.338217 secs
  28. 2013-06-09 09:42:51.472907 osd.20 [WRN] slow request 37851.338217 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  29. 2013-06-09 09:42:51.472911 osd.20 [WRN] slow request 37850.878605 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  30. 2013-06-09 09:42:52.473071 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37852.338387 secs
  31. 2013-06-09 09:42:52.473076 osd.20 [WRN] slow request 37852.338387 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  32. 2013-06-09 09:42:52.473081 osd.20 [WRN] slow request 37851.878775 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  33. 2013-06-09 09:42:53.473240 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37853.338555 secs
  34. 2013-06-09 09:42:53.473245 osd.20 [WRN] slow request 37853.338555 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  35. 2013-06-09 09:42:53.473249 osd.20 [WRN] slow request 37852.878943 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  36. 2013-06-09 09:42:54.473412 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37854.338728 secs
  37. 2013-06-09 09:42:54.473417 osd.20 [WRN] slow request 37854.338728 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  38. 2013-06-09 09:42:54.473421 osd.20 [WRN] slow request 37853.879116 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  39. 2013-06-09 09:42:55.473613 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37855.338930 secs
  40. 2013-06-09 09:42:55.473619 osd.20 [WRN] slow request 37855.338930 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  41. 2013-06-09 09:42:55.473623 osd.20 [WRN] slow request 37854.879318 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  42. 2013-06-09 09:42:56.473810 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37856.339128 secs
  43. 2013-06-09 09:42:56.473816 osd.20 [WRN] slow request 37856.339128 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  44. 2013-06-09 09:42:56.473819 osd.20 [WRN] slow request 37855.879516 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  45. 2013-06-09 09:42:57.473995 osd.20 [WRN] 2 slow requests, 2 included below; oldest blocked for > 37857.339303 secs
  46. 2013-06-09 09:42:57.474001 osd.20 [WRN] slow request 37857.339303 seconds old, received at 2013-06-08 23:12:00.134636: osd_op(client.2470731.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  47. 2013-06-09 09:42:57.474005 osd.20 [WRN] slow request 37856.879691 seconds old, received at 2013-06-08 23:12:00.594248: osd_op(client.2464662.0:18 rbd_header.15646b8b4567 [call rbd.get_size,call rbd.get_object_prefix] 3.777cb787 RETRY=7 e10532) v4 currently reached pg
  48. ^C
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!