API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Aug 4th, 2013
28
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 57.18 KB | None | 0 0
raw download clone embed print report
  1. health HEALTH_WARN 936 pgs degraded; 222 pgs peering; 2592 pgs stuck unclean; recovery 4/20 degraded (20.000%); 11/24 in osds are down
  2. monmap e3: 3 mons at {ceph-mon-0=192.168.61.19:6789/0,ceph-mon-1=192.168.61.5:6789/0,ceph-mon-2=192.168.61.6:6789/0}, election epoch 48, quorum 0,1,2 ceph-mon-0,ceph-mon-1,ceph-mon-2
  3. osdmap e11306: 24 osds: 13 up, 24 in
  4. pgmap v21975: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100431 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  5. mdsmap e1: 0/0/1 up
  6.  
  7. 2013-08-04 13:48:44.626971 mon.0 [INF] pgmap v21975: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100431 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  8. 2013-08-04 13:48:58.686971 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:49:02.686898 >= grace 20.000000)
  9. 2013-08-04 13:48:59.413362 mon.0 [INF] osdmap e11307: 24 osds: 12 up, 24 in
  10. 2013-08-04 13:48:59.493488 mon.0 [INF] pgmap v21976: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100431 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  11. 2013-08-04 13:49:00.315813 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  12. 2013-08-04 13:49:00.330080 mon.0 [INF] osdmap e11308: 24 osds: 13 up, 24 in
  13. 2013-08-04 13:49:00.415561 mon.0 [INF] pgmap v21977: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100431 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  14. 2013-08-04 13:49:01.357239 mon.0 [INF] osdmap e11309: 24 osds: 13 up, 24 in
  15. 2013-08-04 13:49:01.385183 mon.0 [INF] pgmap v21978: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100431 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  16. 2013-08-04 13:49:05.804962 mon.0 [INF] pgmap v21979: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100433 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  17. 2013-08-04 13:48:59.382794 osd.24 [WRN] map e11307 wrongly marked me down
  18. 2013-08-04 13:49:07.226149 mon.0 [INF] pgmap v21980: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100436 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  19. 2013-08-04 13:49:25.606913 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:49:26.606842 >= grace 20.000000)
  20. 2013-08-04 13:49:25.809118 mon.0 [INF] osdmap e11310: 24 osds: 12 up, 24 in
  21. 2013-08-04 13:49:25.835076 mon.0 [INF] pgmap v21981: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100436 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  22. 2013-08-04 13:49:26.880530 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  23. 2013-08-04 13:49:26.894256 mon.0 [INF] osdmap e11311: 24 osds: 13 up, 24 in
  24. 2013-08-04 13:49:25.783590 osd.24 [WRN] map e11310 wrongly marked me down
  25. 2013-08-04 13:49:26.917946 mon.0 [INF] pgmap v21982: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100436 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  26. 2013-08-04 13:49:27.925905 mon.0 [INF] osdmap e11312: 24 osds: 13 up, 24 in
  27. 2013-08-04 13:49:28.011086 mon.0 [INF] pgmap v21983: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100436 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  28. 2013-08-04 13:49:32.110337 mon.0 [INF] pgmap v21984: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100436 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  29. 2013-08-04 13:49:33.607052 mon.0 [INF] pgmap v21985: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100440 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  30. 2013-08-04 13:49:47.668315 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:49:48.668234 >= grace 20.000000)
  31. 2013-08-04 13:49:47.819039 mon.0 [INF] osdmap e11313: 24 osds: 12 up, 24 in
  32. 2013-08-04 13:49:47.846875 mon.0 [INF] pgmap v21986: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100440 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  33. 2013-08-04 13:49:48.848309 mon.0 [INF] osdmap e11314: 24 osds: 12 up, 24 in
  34. 2013-08-04 13:49:48.912616 mon.0 [INF] pgmap v21987: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100440 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  35. 2013-08-04 13:49:53.199291 mon.0 [INF] pgmap v21988: 2592 pgs: 59 peering, 1446 active+remapped, 942 active+degraded, 145 remapped+peering; 9532 KB data, 100441 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  36. 2013-08-04 13:49:54.577103 mon.0 [INF] pgmap v21989: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100446 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  37. 2013-08-04 13:49:59.666069 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  38. 2013-08-04 13:49:59.681652 mon.0 [INF] osdmap e11315: 24 osds: 13 up, 24 in
  39. 2013-08-04 13:49:59.767092 mon.0 [INF] pgmap v21990: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100446 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  40. 2013-08-04 13:50:00.654926 mon.0 [INF] osdmap e11316: 24 osds: 13 up, 24 in
  41. 2013-08-04 13:50:00.804720 mon.0 [INF] pgmap v21991: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100446 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  42. 2013-08-04 13:50:04.894420 mon.0 [INF] pgmap v21992: 2592 pgs: 10 peering, 1589 active+remapped, 991 active+degraded, 2 remapped+peering; 9532 KB data, 100446 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  43. 2013-08-04 13:50:06.387047 mon.0 [INF] pgmap v21993: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100448 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  44. 2013-08-04 13:49:59.462311 osd.24 [WRN] map e11314 wrongly marked me down
  45. 2013-08-04 13:50:21.740181 mon.0 [INF] pgmap v21994: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100449 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  46. 2013-08-04 13:50:24.756963 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:50:25.756893 >= grace 20.000000)
  47. 2013-08-04 13:50:24.935785 mon.0 [INF] osdmap e11317: 24 osds: 12 up, 24 in
  48. 2013-08-04 13:50:25.081769 mon.0 [INF] pgmap v21995: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100449 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  49. 2013-08-04 13:50:25.947974 mon.0 [INF] osdmap e11318: 24 osds: 12 up, 24 in
  50. 2013-08-04 13:50:26.017378 mon.0 [INF] pgmap v21996: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100449 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  51. 2013-08-04 13:50:30.131392 mon.0 [INF] pgmap v21997: 2592 pgs: 59 peering, 1446 active+remapped, 942 active+degraded, 145 remapped+peering; 9532 KB data, 100449 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  52. 2013-08-04 13:50:32.123542 mon.0 [INF] pgmap v21998: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100454 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  53. 2013-08-04 13:50:34.564598 osd.24 [WRN] map e11318 wrongly marked me down
  54. 2013-08-04 13:50:40.524546 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  55. 2013-08-04 13:50:40.539563 mon.0 [INF] osdmap e11319: 24 osds: 13 up, 24 in
  56. 2013-08-04 13:50:40.568846 mon.0 [INF] pgmap v21999: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100454 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  57. 2013-08-04 13:50:41.235596 mon.0 [INF] osdmap e11320: 24 osds: 13 up, 24 in
  58. 2013-08-04 13:50:41.319194 mon.0 [INF] pgmap v22000: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100454 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  59. 2013-08-04 13:50:45.855210 mon.0 [INF] pgmap v22001: 2592 pgs: 16 peering, 1554 active+remapped, 985 active+degraded, 37 remapped+peering; 9532 KB data, 100455 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  60. 2013-08-04 13:50:47.249412 mon.0 [INF] pgmap v22002: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100457 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  61. 2013-08-04 13:51:05.628979 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:51:06.628908 >= grace 20.000000)
  62. 2013-08-04 13:51:09.146117 mon.0 [INF] osdmap e11321: 24 osds: 12 up, 24 in
  63. 2013-08-04 13:51:10.532736 mon.0 [INF] pgmap v22003: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100457 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  64. 2013-08-04 13:51:12.338309 mon.0 [INF] osdmap e11322: 24 osds: 12 up, 24 in
  65. 2013-08-04 13:51:14.436866 mon.0 [INF] pgmap v22004: 2592 pgs: 65 peering, 1434 active+remapped, 936 active+degraded, 157 remapped+peering; 9532 KB data, 100457 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  66. 2013-08-04 13:51:17.271161 mon.0 [INF] pgmap v22005: 2592 pgs: 8 peering, 1567 active+remapped, 993 active+degraded, 24 remapped+peering; 9532 KB data, 100459 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  67. 2013-08-04 13:51:21.507660 mon.0 [INF] pgmap v22006: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100460 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  68. 2013-08-04 13:51:25.037776 mon.0 [INF] pgmap v22007: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 100462 MB used, 89289 GB / 89387 GB avail; 4/20 degraded (20.000%)
  69. 2013-08-04 13:51:41.326937 mon.0 [INF] osd.26 out (down for 312.065763)
  70. 2013-08-04 13:51:42.165678 mon.0 [INF] osdmap e11323: 24 osds: 12 up, 23 in
  71. 2013-08-04 13:51:43.720007 mon.0 [INF] pgmap v22008: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 96286 MB used, 85569 GB / 85663 GB avail; 4/20 degraded (20.000%)
  72. 2013-08-04 13:51:44.889914 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  73. 2013-08-04 13:51:42.872084 osd.24 [WRN] map e11323 wrongly marked me down
  74. 2013-08-04 13:51:44.890108 mon.0 [INF] osdmap e11324: 24 osds: 13 up, 23 in
  75. 2013-08-04 13:51:47.183900 mon.0 [INF] pgmap v22009: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 96286 MB used, 85569 GB / 85663 GB avail; 4/20 degraded (20.000%)
  76. 2013-08-04 13:51:49.045609 mon.0 [INF] osdmap e11325: 24 osds: 13 up, 23 in
  77. 2013-08-04 13:51:51.382854 mon.0 [INF] pgmap v22012: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 96287 MB used, 85569 GB / 85663 GB avail; 4/20 degraded (20.000%)
  78. 2013-08-04 13:51:54.565793 mon.0 [INF] pgmap v22013: 2592 pgs: 63 peering, 1445 active+remapped, 938 active+degraded, 146 remapped+peering; 9532 KB data, 96290 MB used, 85569 GB / 85663 GB avail; 4/20 degraded (20.000%)
  79. 2013-08-04 13:51:56.111871 mon.0 [INF] pgmap v22014: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 96290 MB used, 85569 GB / 85663 GB avail; 4/20 degraded (20.000%)
  80. 2013-08-04 13:52:01.437423 mon.0 [INF] osd.33 out (down for 317.475339)
  81. 2013-08-04 13:52:01.891498 mon.0 [INF] osdmap e11326: 24 osds: 13 up, 22 in
  82. 2013-08-04 13:52:02.062051 mon.0 [INF] pgmap v22015: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 92114 MB used, 81849 GB / 81938 GB avail; 4/20 degraded (20.000%)
  83. 2013-08-04 13:52:02.575966 mon.0 [INF] osdmap e11327: 24 osds: 13 up, 22 in
  84. 2013-08-04 13:52:02.604931 mon.0 [INF] pgmap v22016: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 92114 MB used, 81849 GB / 81938 GB avail; 4/20 degraded (20.000%)
  85. 2013-08-04 13:52:04.780952 mon.0 [INF] pgmap v22017: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 92115 MB used, 81849 GB / 81938 GB avail; 4/20 degraded (20.000%)
  86. 2013-08-04 13:52:06.021731 mon.0 [INF] pgmap v22018: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 92115 MB used, 81849 GB / 81938 GB avail; 4/20 degraded (20.000%)
  87. 2013-08-04 13:52:06.458225 mon.0 [INF] osd.25 out (down for 314.951835)
  88. 2013-08-04 13:52:06.458290 mon.0 [INF] osd.27 out (down for 311.181349)
  89. 2013-08-04 13:52:06.458344 mon.0 [INF] osd.28 out (down for 310.147947)
  90. 2013-08-04 13:52:06.458407 mon.0 [INF] osd.31 out (down for 322.496119)
  91. 2013-08-04 13:52:06.630674 mon.0 [INF] osdmap e11328: 24 osds: 13 up, 18 in
  92. 2013-08-04 13:52:06.706586 mon.0 [INF] pgmap v22019: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 75410 MB used, 66967 GB / 67040 GB avail; 4/20 degraded (20.000%)
  93. 2013-08-04 13:52:07.660939 mon.0 [INF] osdmap e11329: 24 osds: 13 up, 18 in
  94. 2013-08-04 13:52:07.688483 mon.0 [INF] pgmap v22020: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 75410 MB used, 66967 GB / 67040 GB avail; 4/20 degraded (20.000%)
  95. 2013-08-04 13:52:11.531257 mon.0 [INF] osd.32 out (down for 310.341348)
  96. 2013-08-04 13:52:11.655146 mon.0 [INF] osdmap e11330: 24 osds: 13 up, 17 in
  97. 2013-08-04 13:52:11.682864 mon.0 [INF] pgmap v22021: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 71233 MB used, 63246 GB / 63316 GB avail; 4/20 degraded (20.000%)
  98. 2013-08-04 13:52:12.677163 mon.0 [INF] osdmap e11331: 24 osds: 13 up, 17 in
  99. 2013-08-04 13:52:12.832018 mon.0 [INF] pgmap v22022: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 71233 MB used, 63246 GB / 63316 GB avail; 4/20 degraded (20.000%)
  100. 2013-08-04 13:52:16.547999 mon.0 [INF] osd.29 out (down for 319.215074)
  101. 2013-08-04 13:52:16.548092 mon.0 [INF] osd.30 out (down for 318.177932)
  102. 2013-08-04 13:52:16.671285 mon.0 [INF] osdmap e11332: 24 osds: 13 up, 15 in
  103. 2013-08-04 13:52:16.780133 mon.0 [INF] pgmap v22023: 2592 pgs: 67 peering, 1421 active+remapped, 934 active+degraded, 170 remapped+peering; 9532 KB data, 62879 MB used, 55806 GB / 55867 GB avail; 4/20 degraded (20.000%)
  104. 2013-08-04 13:52:17.912353 mon.0 [INF] osdmap e11333: 24 osds: 13 up, 15 in
  105. 2013-08-04 13:52:18.213189 mon.0 [INF] pgmap v22024: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 62880 MB used, 55806 GB / 55867 GB avail; 4/20 degraded (20.000%)
  106. 2013-08-04 13:52:18.936403 mon.0 [INF] osdmap e11334: 24 osds: 13 up, 15 in
  107. 2013-08-04 13:52:18.963245 mon.0 [INF] pgmap v22025: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 62880 MB used, 55806 GB / 55867 GB avail; 4/20 degraded (20.000%)
  108. 2013-08-04 13:52:20.984324 mon.0 [INF] pgmap v22026: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 62881 MB used, 55806 GB / 55867 GB avail; 4/20 degraded (20.000%)
  109. 2013-08-04 13:52:21.561717 mon.0 [INF] osd.35 out (down for 316.633519)
  110. 2013-08-04 13:52:21.708775 mon.0 [INF] osdmap e11335: 24 osds: 13 up, 14 in
  111. 2013-08-04 13:52:21.784764 mon.0 [INF] pgmap v22027: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 58704 MB used, 52085 GB / 52142 GB avail; 4/20 degraded (20.000%)
  112. 2013-08-04 13:52:22.734569 mon.0 [INF] osdmap e11336: 24 osds: 13 up, 14 in
  113. 2013-08-04 13:52:22.774578 mon.0 [INF] pgmap v22028: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 58704 MB used, 52085 GB / 52142 GB avail; 4/20 degraded (20.000%)
  114. 2013-08-04 13:52:23.764620 mon.0 [INF] osdmap e11337: 24 osds: 13 up, 14 in
  115. 2013-08-04 13:52:23.837572 mon.0 [INF] pgmap v22029: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 58704 MB used, 52085 GB / 52142 GB avail; 4/20 degraded (20.000%)
  116. 2013-08-04 13:52:26.575851 mon.0 [INF] osd.34 out (down for 322.675545)
  117. 2013-08-04 13:52:26.832643 mon.0 [INF] osdmap e11338: 24 osds: 13 up, 13 in
  118. 2013-08-04 13:52:26.861308 mon.0 [INF] pgmap v22030: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 54527 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  119. 2013-08-04 13:52:27.874817 mon.0 [INF] osdmap e11339: 24 osds: 13 up, 13 in
  120. 2013-08-04 13:52:27.907761 mon.0 [INF] pgmap v22031: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 54527 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  121. 2013-08-04 13:52:28.886042 mon.0 [INF] osdmap e11340: 24 osds: 13 up, 13 in
  122. 2013-08-04 13:52:28.912172 mon.0 [INF] pgmap v22032: 2592 pgs: 78 peering, 1408 active+remapped, 923 active+degraded, 183 remapped+peering; 9532 KB data, 54527 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  123. 2013-08-04 13:52:32.846502 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:52:33.846419 >= grace 20.000000)
  124. 2013-08-04 13:52:33.126888 mon.0 [INF] osdmap e11341: 24 osds: 12 up, 13 in
  125. 2013-08-04 13:52:33.421384 mon.0 [INF] pgmap v22034: 2592 pgs: 142 peering, 1286 active+remapped, 859 active+degraded, 305 remapped+peering; 9532 KB data, 54529 MB used, 48365 GB / 48418 GB avail; 3/20 degraded (15.000%)
  126. 2013-08-04 13:52:34.175815 mon.0 [INF] osdmap e11342: 24 osds: 12 up, 13 in
  127. 2013-08-04 13:52:34.200652 mon.0 [INF] pgmap v22035: 2592 pgs: 142 peering, 1286 active+remapped, 859 active+degraded, 305 remapped+peering; 9532 KB data, 54529 MB used, 48365 GB / 48418 GB avail; 3/20 degraded (15.000%)
  128. 2013-08-04 13:52:35.278659 mon.0 [INF] osdmap e11343: 24 osds: 12 up, 13 in
  129. 2013-08-04 13:52:35.307670 mon.0 [INF] pgmap v22036: 2592 pgs: 142 peering, 1286 active+remapped, 859 active+degraded, 305 remapped+peering; 9532 KB data, 54529 MB used, 48365 GB / 48418 GB avail; 3/20 degraded (15.000%)
  130. 2013-08-04 13:52:36.228731 mon.0 [INF] osdmap e11344: 24 osds: 12 up, 13 in
  131. 2013-08-04 13:52:36.259573 mon.0 [INF] pgmap v22037: 2592 pgs: 142 peering, 1286 active+remapped, 859 active+degraded, 305 remapped+peering; 9532 KB data, 54529 MB used, 48365 GB / 48418 GB avail; 3/20 degraded (15.000%)
  132. 2013-08-04 13:52:38.901306 mon.0 [INF] pgmap v22038: 2592 pgs: 127 peering, 1311 active+remapped, 874 active+degraded, 280 remapped+peering; 9532 KB data, 54533 MB used, 48365 GB / 48418 GB avail; 3/20 degraded (15.000%)
  133. 2013-08-04 13:52:40.005148 mon.0 [INF] pgmap v22039: 2592 pgs: 121 peering, 1328 active+remapped, 880 active+degraded, 263 remapped+peering; 9532 KB data, 54539 MB used, 48365 GB / 48418 GB avail; 3/20 degraded (15.000%)
  134. 2013-08-04 13:52:41.405951 mon.0 [INF] pgmap v22040: 2592 pgs: 8 peering, 1562 active+remapped, 993 active+degraded, 29 remapped+peering; 9532 KB data, 54534 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  135. 2013-08-04 13:52:42.411844 mon.0 [INF] pgmap v22041: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 54530 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  136. 2013-08-04 13:52:45.411199 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  137. 2013-08-04 13:52:45.426729 mon.0 [INF] osdmap e11345: 24 osds: 13 up, 14 in
  138. 2013-08-04 13:52:45.505460 mon.0 [INF] pgmap v22042: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 54530 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  139. 2013-08-04 13:52:46.509519 mon.0 [INF] osdmap e11346: 24 osds: 13 up, 14 in
  140. 2013-08-04 13:52:46.310394 osd.24 [WRN] map e11345 wrongly marked me down
  141. 2013-08-04 13:52:46.645079 mon.0 [INF] pgmap v22043: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 54530 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  142. 2013-08-04 13:52:47.575140 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  143. 2013-08-04 13:52:47.593785 mon.0 [INF] osdmap e11347: 24 osds: 14 up, 14 in
  144. 2013-08-04 13:52:47.681112 mon.0 [INF] pgmap v22044: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 54530 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  145. 2013-08-04 13:52:54.404260 mon.0 [INF] osdmap e11348: 24 osds: 14 up, 14 in
  146. 2013-08-04 13:52:57.124558 mon.0 [INF] pgmap v22045: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 54530 MB used, 48365 GB / 48418 GB avail; 4/20 degraded (20.000%)
  147. 2013-08-04 13:52:59.852619 mon.0 [INF] pgmap v22046: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58698 MB used, 52085 GB / 52142 GB avail
  148. 2013-08-04 13:53:01.459526 mon.0 [INF] pgmap v22047: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  149. 2013-08-04 13:53:08.517816 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:53:10.517730 >= grace 20.000000)
  150. 2013-08-04 13:53:10.105540 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:53:12.105443 >= grace 20.000000)
  151. 2013-08-04 13:53:10.675288 mon.0 [INF] osdmap e11349: 24 osds: 13 up, 14 in
  152. 2013-08-04 13:53:11.759568 mon.0 [INF] pgmap v22048: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  153. 2013-08-04 13:53:13.534603 mon.0 [INF] osdmap e11350: 24 osds: 12 up, 14 in
  154. 2013-08-04 13:53:13.924141 mon.0 [INF] pgmap v22049: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  155. 2013-08-04 13:53:14.305192 mon.0 [INF] osdmap e11351: 24 osds: 12 up, 14 in
  156. 2013-08-04 13:53:14.926410 mon.0 [INF] pgmap v22050: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  157. 2013-08-04 13:53:15.605163 mon.0 [INF] osdmap e11352: 24 osds: 12 up, 14 in
  158. 2013-08-04 13:53:15.856657 mon.0 [INF] pgmap v22051: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  159. 2013-08-04 13:53:16.634315 mon.0 [INF] osdmap e11353: 24 osds: 12 up, 14 in
  160. 2013-08-04 13:53:16.664759 mon.0 [INF] pgmap v22052: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  161. 2013-08-04 13:53:17.287094 osd.24 [WRN] map e11353 wrongly marked me down
  162. 2013-08-04 13:53:17.951047 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  163. 2013-08-04 13:53:17.967417 mon.0 [INF] osdmap e11354: 24 osds: 13 up, 14 in
  164. 2013-08-04 13:53:17.995290 mon.0 [INF] pgmap v22053: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  165. 2013-08-04 13:53:19.008789 mon.0 [INF] osdmap e11355: 24 osds: 13 up, 14 in
  166. 2013-08-04 13:53:19.199453 mon.0 [INF] pgmap v22054: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  167. 2013-08-04 13:53:21.274689 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  168. 2013-08-04 13:53:21.288335 mon.0 [INF] osdmap e11356: 24 osds: 14 up, 14 in
  169. 2013-08-04 13:53:21.338277 mon.0 [INF] pgmap v22055: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  170. 2013-08-04 13:53:22.617545 mon.0 [INF] osdmap e11357: 24 osds: 14 up, 14 in
  171. 2013-08-04 13:53:23.122402 mon.0 [INF] pgmap v22056: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58699 MB used, 52085 GB / 52142 GB avail
  172. 2013-08-04 13:53:26.779581 mon.0 [INF] pgmap v22057: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58693 MB used, 52085 GB / 52142 GB avail
  173. 2013-08-04 13:53:20.186376 osd.25 [WRN] map e11355 wrongly marked me down
  174. 2013-08-04 13:53:28.204041 mon.0 [INF] pgmap v22058: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58694 MB used, 52085 GB / 52142 GB avail
  175. 2013-08-04 13:53:41.713130 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:53:43.713050 >= grace 20.000000)
  176. 2013-08-04 13:53:42.675276 mon.0 [INF] osdmap e11358: 24 osds: 13 up, 14 in
  177. 2013-08-04 13:53:42.788278 mon.0 [INF] pgmap v22059: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58694 MB used, 52085 GB / 52142 GB avail
  178. 2013-08-04 13:53:43.723776 mon.0 [INF] osdmap e11359: 24 osds: 13 up, 14 in
  179. 2013-08-04 13:53:43.857443 mon.0 [INF] pgmap v22060: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58694 MB used, 52085 GB / 52142 GB avail
  180. 2013-08-04 13:53:47.586104 osd.24 [WRN] map e11359 wrongly marked me down
  181. 2013-08-04 13:53:47.782153 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  182. 2013-08-04 13:53:47.796628 mon.0 [INF] osdmap e11360: 24 osds: 14 up, 14 in
  183. 2013-08-04 13:53:47.797110 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:53:48.797029 >= grace 20.000000)
  184. 2013-08-04 13:53:47.856073 mon.0 [INF] pgmap v22061: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58694 MB used, 52085 GB / 52142 GB avail
  185. 2013-08-04 13:53:48.826155 mon.0 [INF] osdmap e11361: 24 osds: 13 up, 14 in
  186. 2013-08-04 13:53:48.942905 mon.0 [INF] pgmap v22062: 2592 pgs: 786 peering, 96 active+remapped, 211 active+degraded, 1499 remapped+peering; 9532 KB data, 58696 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  187. 2013-08-04 13:53:49.845103 mon.0 [INF] osdmap e11362: 24 osds: 13 up, 14 in
  188. 2013-08-04 13:53:49.910350 mon.0 [INF] pgmap v22063: 2592 pgs: 786 peering, 96 active+remapped, 211 active+degraded, 1499 remapped+peering; 9532 KB data, 58696 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  189. 2013-08-04 13:53:53.950897 mon.0 [INF] pgmap v22064: 2592 pgs: 761 peering, 175 active+remapped, 236 active+degraded, 1420 remapped+peering; 9532 KB data, 58684 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  190. 2013-08-04 13:53:55.795986 mon.0 [INF] pgmap v22065: 2592 pgs: 392 peering, 820 active+remapped, 605 active+degraded, 775 remapped+peering; 9532 KB data, 58707 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  191. 2013-08-04 13:53:56.490203 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  192. 2013-08-04 13:53:56.505274 mon.0 [INF] osdmap e11363: 24 osds: 14 up, 14 in
  193. 2013-08-04 13:53:56.531649 mon.0 [INF] pgmap v22066: 2592 pgs: 392 peering, 820 active+remapped, 605 active+degraded, 775 remapped+peering; 9532 KB data, 58707 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  194. 2013-08-04 13:53:57.127966 mon.0 [INF] osdmap e11364: 24 osds: 14 up, 14 in
  195. 2013-08-04 13:53:55.135992 osd.25 [WRN] map e11362 wrongly marked me down
  196. 2013-08-04 13:53:57.154670 mon.0 [INF] pgmap v22067: 2592 pgs: 392 peering, 820 active+remapped, 605 active+degraded, 775 remapped+peering; 9532 KB data, 58707 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  197. 2013-08-04 13:54:01.232521 mon.0 [INF] pgmap v22068: 2592 pgs: 421 peering, 775 active+remapped, 576 active+degraded, 820 remapped+peering; 9532 KB data, 58708 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  198. 2013-08-04 13:54:02.702533 mon.0 [INF] pgmap v22069: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58716 MB used, 52085 GB / 52142 GB avail
  199. 2013-08-04 13:54:11.235470 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:54:12.235399 >= grace 20.000000)
  200. 2013-08-04 13:54:12.391829 mon.0 [INF] osdmap e11365: 24 osds: 13 up, 14 in
  201. 2013-08-04 13:54:12.520932 mon.0 [INF] pgmap v22070: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58716 MB used, 52085 GB / 52142 GB avail
  202. 2013-08-04 13:54:13.428689 mon.0 [INF] osdmap e11366: 24 osds: 13 up, 14 in
  203. 2013-08-04 13:54:13.591966 mon.0 [INF] pgmap v22071: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58716 MB used, 52085 GB / 52142 GB avail
  204. 2013-08-04 13:54:17.561966 mon.0 [INF] pgmap v22072: 2592 pgs: 798 peering, 58 active+remapped, 203 active+degraded, 1533 remapped+peering; 9532 KB data, 58717 MB used, 52085 GB / 52142 GB avail
  205. 2013-08-04 13:54:18.093365 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:54:19.093287 >= grace 20.000000)
  206. 2013-08-04 13:54:18.944170 mon.0 [INF] pgmap v22073: 2592 pgs: 484 peering, 711 active+remapped, 517 active+degraded, 880 remapped+peering; 9532 KB data, 58735 MB used, 52085 GB / 52142 GB avail
  207. 2013-08-04 13:54:19.569165 mon.0 [INF] osdmap e11367: 24 osds: 12 up, 14 in
  208. 2013-08-04 13:54:19.687803 mon.0 [INF] pgmap v22074: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58737 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  209. 2013-08-04 13:54:20.140951 mon.0 [INF] osdmap e11368: 24 osds: 12 up, 14 in
  210. 2013-08-04 13:54:20.292410 mon.0 [INF] pgmap v22075: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58737 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  211. 2013-08-04 13:54:21.739532 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  212. 2013-08-04 13:54:21.964001 mon.0 [INF] osdmap e11369: 24 osds: 13 up, 14 in
  213. 2013-08-04 13:54:22.234334 mon.0 [INF] pgmap v22076: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58737 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  214. 2013-08-04 13:54:22.785805 mon.0 [INF] osdmap e11370: 24 osds: 13 up, 14 in
  215. 2013-08-04 13:54:22.862248 mon.0 [INF] pgmap v22077: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58737 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  216. 2013-08-04 13:54:26.833725 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  217. 2013-08-04 13:54:26.848335 mon.0 [INF] osdmap e11371: 24 osds: 14 up, 14 in
  218. 2013-08-04 13:54:20.931257 osd.24 [WRN] map e11368 wrongly marked me down
  219. 2013-08-04 13:54:26.647039 osd.25 [WRN] map e11370 wrongly marked me down
  220. 2013-08-04 13:54:26.875873 mon.0 [INF] pgmap v22078: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58737 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  221. 2013-08-04 13:54:27.993113 mon.0 [INF] osdmap e11372: 24 osds: 14 up, 14 in
  222. 2013-08-04 13:54:28.413807 mon.0 [INF] pgmap v22079: 2592 pgs: 1 inactive, 459 peering, 797 active+remapped, 541 active+degraded, 794 remapped+peering; 9532 KB data, 58741 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  223. 2013-08-04 13:54:32.028797 mon.0 [INF] pgmap v22080: 2592 pgs: 1 inactive, 487 peering, 731 active+remapped, 513 active+degraded, 860 remapped+peering; 9532 KB data, 58744 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  224. 2013-08-04 13:54:33.593649 mon.0 [INF] pgmap v22081: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58767 MB used, 52085 GB / 52142 GB avail
  225. 2013-08-04 13:54:46.894165 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:54:48.894094 >= grace 20.000000)
  226. 2013-08-04 13:54:47.099329 mon.0 [INF] osdmap e11373: 24 osds: 13 up, 14 in
  227. 2013-08-04 13:54:47.290819 mon.0 [INF] pgmap v22082: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58767 MB used, 52085 GB / 52142 GB avail
  228. 2013-08-04 13:54:48.113469 mon.0 [INF] osdmap e11374: 24 osds: 13 up, 14 in
  229. 2013-08-04 13:54:48.151078 mon.0 [INF] pgmap v22083: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58767 MB used, 52085 GB / 52142 GB avail
  230. 2013-08-04 13:54:51.140225 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  231. 2013-08-04 13:54:51.155406 mon.0 [INF] osdmap e11375: 24 osds: 14 up, 14 in
  232. 2013-08-04 13:54:51.186415 mon.0 [INF] pgmap v22084: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58767 MB used, 52085 GB / 52142 GB avail
  233. 2013-08-04 13:54:52.163115 mon.0 [INF] osdmap e11376: 24 osds: 14 up, 14 in
  234. 2013-08-04 13:54:52.247410 mon.0 [INF] pgmap v22085: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58767 MB used, 52085 GB / 52142 GB avail
  235. 2013-08-04 13:54:56.290791 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:54:58.290656 >= grace 20.000000)
  236. 2013-08-04 13:54:56.504743 mon.0 [INF] pgmap v22086: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58771 MB used, 52085 GB / 52142 GB avail
  237. 2013-08-04 13:54:56.809394 mon.0 [INF] osdmap e11377: 24 osds: 13 up, 14 in
  238. 2013-08-04 13:54:50.919859 osd.24 [WRN] map e11374 wrongly marked me down
  239. 2013-08-04 13:54:56.908605 mon.0 [INF] pgmap v22087: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58764 MB used, 52085 GB / 52142 GB avail
  240. 2013-08-04 13:54:57.699114 mon.0 [INF] osdmap e11378: 24 osds: 13 up, 14 in
  241. 2013-08-04 13:54:57.887758 mon.0 [INF] pgmap v22088: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58752 MB used, 52085 GB / 52142 GB avail
  242. 2013-08-04 13:55:00.627623 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  243. 2013-08-04 13:55:00.641382 mon.0 [INF] osdmap e11379: 24 osds: 14 up, 14 in
  244. 2013-08-04 13:55:00.680354 mon.0 [INF] pgmap v22089: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58752 MB used, 52085 GB / 52142 GB avail
  245. 2013-08-04 13:55:01.720587 mon.0 [INF] osdmap e11380: 24 osds: 14 up, 14 in
  246. 2013-08-04 13:55:01.748584 mon.0 [INF] pgmap v22090: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58752 MB used, 52085 GB / 52142 GB avail
  247. 2013-08-04 13:55:06.069147 mon.0 [INF] pgmap v22091: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58743 MB used, 52085 GB / 52142 GB avail
  248. 2013-08-04 13:55:00.442527 osd.25 [WRN] map e11378 wrongly marked me down
  249. 2013-08-04 13:55:07.350782 mon.0 [INF] pgmap v22092: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58706 MB used, 52085 GB / 52142 GB avail
  250. 2013-08-04 13:55:14.573609 mon.0 [INF] pgmap v22093: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58706 MB used, 52085 GB / 52142 GB avail
  251. 2013-08-04 13:55:15.913720 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:55:17.913646 >= grace 20.000000)
  252. 2013-08-04 13:55:16.717897 mon.0 [INF] osdmap e11381: 24 osds: 13 up, 14 in
  253. 2013-08-04 13:55:16.943169 mon.0 [INF] pgmap v22094: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58706 MB used, 52085 GB / 52142 GB avail
  254. 2013-08-04 13:55:17.761061 mon.0 [INF] osdmap e11382: 24 osds: 13 up, 14 in
  255. 2013-08-04 13:55:17.829771 mon.0 [INF] pgmap v22095: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58706 MB used, 52085 GB / 52142 GB avail
  256. 2013-08-04 13:55:21.107407 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  257. 2013-08-04 13:55:21.120706 mon.0 [INF] osdmap e11383: 24 osds: 14 up, 14 in
  258. 2013-08-04 13:55:21.214167 mon.0 [INF] pgmap v22096: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58706 MB used, 52085 GB / 52142 GB avail
  259. 2013-08-04 13:55:22.154961 mon.0 [INF] osdmap e11384: 24 osds: 14 up, 14 in
  260. 2013-08-04 13:55:22.231171 mon.0 [INF] pgmap v22097: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58706 MB used, 52085 GB / 52142 GB avail
  261. 2013-08-04 13:55:26.293292 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:55:29.293034 >= grace 20.000000)
  262. 2013-08-04 13:55:26.461678 mon.0 [INF] pgmap v22098: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58710 MB used, 52085 GB / 52142 GB avail
  263. 2013-08-04 13:55:26.702745 mon.0 [INF] osdmap e11385: 24 osds: 13 up, 14 in
  264. 2013-08-04 13:55:20.925990 osd.24 [WRN] map e11382 wrongly marked me down
  265. 2013-08-04 13:55:26.881642 mon.0 [INF] pgmap v22099: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58717 MB used, 52085 GB / 52142 GB avail
  266. 2013-08-04 13:55:27.649291 mon.0 [INF] osdmap e11386: 24 osds: 13 up, 14 in
  267. 2013-08-04 13:55:27.701112 mon.0 [INF] pgmap v22100: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58720 MB used, 52085 GB / 52142 GB avail
  268. 2013-08-04 13:55:32.067177 mon.0 [INF] pgmap v22101: 2592 pgs: 807 peering, 95 active+remapped, 190 active+degraded, 1500 remapped+peering; 9532 KB data, 58724 MB used, 52085 GB / 52142 GB avail
  269. 2013-08-04 13:55:33.085764 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  270. 2013-08-04 13:55:33.085947 mon.0 [INF] osdmap e11387: 24 osds: 14 up, 14 in
  271. 2013-08-04 13:55:34.870356 mon.0 [INF] pgmap v22103: 2592 pgs: 392 peering, 820 active+remapped, 605 active+degraded, 775 remapped+peering; 9532 KB data, 58709 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  272. 2013-08-04 13:55:35.007982 mon.0 [INF] osdmap e11388: 24 osds: 14 up, 14 in
  273. 2013-08-04 13:55:35.064987 mon.0 [INF] pgmap v22104: 2592 pgs: 392 peering, 820 active+remapped, 605 active+degraded, 775 remapped+peering; 9532 KB data, 58709 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  274. 2013-08-04 13:55:36.032655 mon.0 [INF] osdmap e11389: 24 osds: 14 up, 14 in
  275. 2013-08-04 13:55:32.538176 osd.25 [WRN] map e11386 wrongly marked me down
  276. 2013-08-04 13:55:36.056907 mon.0 [INF] pgmap v22105: 2592 pgs: 392 peering, 820 active+remapped, 605 active+degraded, 775 remapped+peering; 9532 KB data, 58709 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  277. 2013-08-04 13:55:38.619263 mon.0 [INF] pgmap v22106: 2592 pgs: 485 peering, 639 active+remapped, 512 active+degraded, 956 remapped+peering; 9532 KB data, 58710 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  278. 2013-08-04 13:55:39.944354 mon.0 [INF] pgmap v22107: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58717 MB used, 52085 GB / 52142 GB avail
  279. 2013-08-04 13:55:43.464991 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:55:45.464919 >= grace 20.000000)
  280. 2013-08-04 13:55:44.570363 mon.0 [INF] osdmap e11390: 24 osds: 13 up, 14 in
  281. 2013-08-04 13:55:44.723392 mon.0 [INF] pgmap v22108: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58717 MB used, 52085 GB / 52142 GB avail
  282. 2013-08-04 13:55:45.655220 mon.0 [INF] osdmap e11391: 24 osds: 13 up, 14 in
  283. 2013-08-04 13:55:45.745678 mon.0 [INF] pgmap v22109: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58717 MB used, 52085 GB / 52142 GB avail
  284. 2013-08-04 13:55:49.990600 mon.0 [INF] pgmap v22110: 2592 pgs: 786 peering, 96 active+remapped, 211 active+degraded, 1499 remapped+peering; 9532 KB data, 58718 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  285. 2013-08-04 13:55:50.928870 osd.24 [WRN] map e11391 wrongly marked me down
  286. 2013-08-04 13:55:51.654402 mon.0 [INF] pgmap v22111: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58738 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  287. 2013-08-04 13:55:59.723306 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  288. 2013-08-04 13:55:59.723737 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:56:00.723670 >= grace 20.000000)
  289. 2013-08-04 13:55:59.738724 mon.0 [INF] osdmap e11392: 24 osds: 14 up, 14 in
  290. 2013-08-04 13:55:59.891698 mon.0 [INF] pgmap v22112: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58738 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  291. 2013-08-04 13:56:00.817677 mon.0 [INF] osdmap e11393: 24 osds: 13 up, 14 in
  292. 2013-08-04 13:56:00.865912 mon.0 [INF] pgmap v22113: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58738 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  293. 2013-08-04 13:56:01.965583 mon.0 [INF] osdmap e11394: 24 osds: 13 up, 14 in
  294. 2013-08-04 13:56:02.025823 mon.0 [INF] pgmap v22114: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58738 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  295. 2013-08-04 13:56:04.515981 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  296. 2013-08-04 13:56:04.531474 mon.0 [INF] osdmap e11395: 24 osds: 14 up, 14 in
  297. 2013-08-04 13:56:04.574579 mon.0 [INF] pgmap v22115: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58738 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  298. 2013-08-04 13:56:05.565112 mon.0 [INF] osdmap e11396: 24 osds: 14 up, 14 in
  299. 2013-08-04 13:56:04.337496 osd.25 [WRN] map e11394 wrongly marked me down
  300. 2013-08-04 13:56:05.646794 mon.0 [INF] pgmap v22116: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58738 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  301. 2013-08-04 13:56:10.013282 mon.0 [INF] pgmap v22117: 2592 pgs: 484 peering, 711 active+remapped, 517 active+degraded, 880 remapped+peering; 9532 KB data, 58741 MB used, 52085 GB / 52142 GB avail
  302. 2013-08-04 13:56:11.460976 mon.0 [INF] pgmap v22118: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58756 MB used, 52085 GB / 52142 GB avail
  303. 2013-08-04 13:56:20.471984 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:56:21.471912 >= grace 20.000000)
  304. 2013-08-04 13:56:21.427466 mon.0 [INF] pgmap v22119: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58760 MB used, 52085 GB / 52142 GB avail
  305. 2013-08-04 13:56:21.567787 mon.0 [INF] osdmap e11397: 24 osds: 13 up, 14 in
  306. 2013-08-04 13:56:21.737839 mon.0 [INF] pgmap v22120: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58760 MB used, 52085 GB / 52142 GB avail
  307. 2013-08-04 13:56:22.672291 mon.0 [INF] osdmap e11398: 24 osds: 13 up, 14 in
  308. 2013-08-04 13:56:22.772958 mon.0 [INF] pgmap v22121: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58760 MB used, 52085 GB / 52142 GB avail
  309. 2013-08-04 13:56:27.076983 mon.0 [INF] pgmap v22122: 2592 pgs: 786 peering, 96 active+remapped, 211 active+degraded, 1499 remapped+peering; 9532 KB data, 58762 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  310. 2013-08-04 13:56:27.322812 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:56:29.322732 >= grace 20.000000)
  311. 2013-08-04 13:56:28.170700 mon.0 [INF] osdmap e11399: 24 osds: 12 up, 14 in
  312. 2013-08-04 13:56:29.243713 mon.0 [INF] pgmap v22124: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58779 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  313. 2013-08-04 13:56:29.389723 mon.0 [INF] osdmap e11400: 24 osds: 12 up, 14 in
  314. 2013-08-04 13:56:29.558895 mon.0 [INF] pgmap v22125: 2592 pgs: 439 peering, 789 active+remapped, 562 active+degraded, 802 remapped+peering; 9532 KB data, 58779 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  315. 2013-08-04 13:56:33.425065 mon.0 [INF] pgmap v22126: 2592 pgs: 410 peering, 834 active+remapped, 591 active+degraded, 757 remapped+peering; 9532 KB data, 58780 MB used, 52085 GB / 52142 GB avail; 1/20 degraded (5.000%)
  316. 2013-08-04 13:56:34.984813 mon.0 [INF] pgmap v22127: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 58758 MB used, 52085 GB / 52142 GB avail; 4/20 degraded (20.000%)
  317. 2013-08-04 13:56:35.815483 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  318. 2013-08-04 13:56:35.844653 mon.0 [INF] osdmap e11401: 24 osds: 13 up, 14 in
  319. 2013-08-04 13:56:34.708704 osd.24 [WRN] map e11400 wrongly marked me down
  320. 2013-08-04 13:56:36.458944 mon.0 [INF] pgmap v22128: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 58758 MB used, 52085 GB / 52142 GB avail; 4/20 degraded (20.000%)
  321. 2013-08-04 13:56:37.118735 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  322. 2013-08-04 13:56:37.133174 mon.0 [INF] osdmap e11402: 24 osds: 14 up, 14 in
  323. 2013-08-04 13:56:37.217281 mon.0 [INF] pgmap v22129: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 58758 MB used, 52085 GB / 52142 GB avail; 4/20 degraded (20.000%)
  324. 2013-08-04 13:56:37.894278 mon.0 [INF] osdmap e11403: 24 osds: 14 up, 14 in
  325. 2013-08-04 13:56:36.023044 osd.25 [WRN] map e11401 wrongly marked me down
  326. 2013-08-04 13:56:37.923203 mon.0 [INF] pgmap v22130: 2592 pgs: 1591 active+remapped, 1001 active+degraded; 9532 KB data, 58758 MB used, 52085 GB / 52142 GB avail; 4/20 degraded (20.000%)
  327. 2013-08-04 13:56:42.086040 mon.0 [INF] pgmap v22131: 2592 pgs: 69 peering, 1436 active+remapped, 932 active+degraded, 155 remapped+peering; 9532 KB data, 58759 MB used, 52085 GB / 52142 GB avail; 3/20 degraded (15.000%)
  328. 2013-08-04 13:56:43.597136 mon.0 [INF] pgmap v22132: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58757 MB used, 52085 GB / 52142 GB avail
  329. 2013-08-04 13:56:51.346914 mon.0 [INF] pgmap v22133: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58759 MB used, 52085 GB / 52142 GB avail
  330. 2013-08-04 13:56:57.335972 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:56:58.335901 >= grace 20.000000)
  331. 2013-08-04 13:56:58.246784 mon.0 [INF] osdmap e11404: 24 osds: 13 up, 14 in
  332. 2013-08-04 13:56:58.409168 mon.0 [INF] pgmap v22134: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58759 MB used, 52085 GB / 52142 GB avail
  333. 2013-08-04 13:56:59.384792 mon.0 [INF] osdmap e11405: 24 osds: 13 up, 14 in
  334. 2013-08-04 13:56:59.471896 mon.0 [INF] pgmap v22135: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58759 MB used, 52085 GB / 52142 GB avail
  335. 2013-08-04 13:57:03.435408 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:57:04.435323 >= grace 20.000000)
  336. 2013-08-04 13:57:03.603817 mon.0 [INF] pgmap v22136: 2592 pgs: 780 peering, 133 active+remapped, 217 active+degraded, 1462 remapped+peering; 9532 KB data, 58762 MB used, 52085 GB / 52142 GB avail
  337. 2013-08-04 13:57:03.873126 mon.0 [INF] osdmap e11406: 24 osds: 12 up, 14 in
  338. 2013-08-04 13:57:04.045769 mon.0 [INF] pgmap v22137: 2592 pgs: 633 peering, 461 active+remapped, 368 active+degraded, 1130 remapped+peering; 9532 KB data, 58757 MB used, 52085 GB / 52142 GB avail
  339. 2013-08-04 13:57:04.965640 mon.0 [INF] osdmap e11407: 24 osds: 12 up, 14 in
  340. 2013-08-04 13:57:05.128881 mon.0 [INF] pgmap v22138: 2592 pgs: 633 peering, 461 active+remapped, 368 active+degraded, 1130 remapped+peering; 9532 KB data, 58757 MB used, 52085 GB / 52142 GB avail
  341. 2013-08-04 13:57:07.196020 osd.24 [WRN] map e11407 wrongly marked me down
  342. 2013-08-04 13:57:07.460700 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  343. 2013-08-04 13:57:07.475855 mon.0 [INF] osdmap e11408: 24 osds: 13 up, 14 in
  344. 2013-08-04 13:57:07.501859 mon.0 [INF] pgmap v22139: 2592 pgs: 633 peering, 461 active+remapped, 368 active+degraded, 1130 remapped+peering; 9532 KB data, 58757 MB used, 52085 GB / 52142 GB avail
  345. 2013-08-04 13:57:08.422386 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  346. 2013-08-04 13:57:08.438467 mon.0 [INF] osdmap e11409: 24 osds: 14 up, 14 in
  347. 2013-08-04 13:57:08.518229 mon.0 [INF] pgmap v22140: 2592 pgs: 633 peering, 461 active+remapped, 368 active+degraded, 1130 remapped+peering; 9532 KB data, 58757 MB used, 52085 GB / 52142 GB avail
  348. 2013-08-04 13:57:09.463766 mon.0 [INF] osdmap e11410: 24 osds: 14 up, 14 in
  349. 2013-08-04 13:57:09.500968 mon.0 [INF] pgmap v22141: 2592 pgs: 633 peering, 461 active+remapped, 368 active+degraded, 1130 remapped+peering; 9532 KB data, 58757 MB used, 52085 GB / 52142 GB avail
  350. 2013-08-04 13:57:13.658040 mon.0 [INF] pgmap v22142: 2592 pgs: 688 peering, 341 active+remapped, 309 active+degraded, 1254 remapped+peering; 9532 KB data, 58763 MB used, 52085 GB / 52142 GB avail
  351. 2013-08-04 13:57:08.253791 osd.25 [WRN] map e11408 wrongly marked me down
  352. 2013-08-04 13:57:14.999212 mon.0 [INF] pgmap v22143: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58756 MB used, 52085 GB / 52142 GB avail
  353. 2013-08-04 13:57:29.139144 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:57:31.139083 >= grace 20.000000)
  354. 2013-08-04 13:57:30.264734 mon.0 [INF] osdmap e11411: 24 osds: 13 up, 14 in
  355. 2013-08-04 13:57:30.455087 mon.0 [INF] pgmap v22144: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58756 MB used, 52085 GB / 52142 GB avail
  356. 2013-08-04 13:57:31.278641 mon.0 [INF] osdmap e11412: 24 osds: 13 up, 14 in
  357. 2013-08-04 13:57:31.320157 mon.0 [INF] pgmap v22145: 2592 pgs: 831 peering, 18 active+remapped, 166 active+degraded, 1577 remapped+peering; 9532 KB data, 58756 MB used, 52085 GB / 52142 GB avail
  358. 2013-08-04 13:57:35.325086 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:57:36.325007 >= grace 20.000000)
  359. 2013-08-04 13:57:35.537278 mon.0 [INF] osdmap e11413: 24 osds: 12 up, 14 in
  360. 2013-08-04 13:57:35.848344 mon.0 [INF] pgmap v22147: 2592 pgs: 808 peering, 69 active+remapped, 189 active+degraded, 1526 remapped+peering; 9532 KB data, 58758 MB used, 52085 GB / 52142 GB avail
  361. 2013-08-04 13:57:36.629226 mon.0 [INF] osdmap e11414: 24 osds: 12 up, 14 in
  362. 2013-08-04 13:57:36.777664 mon.0 [INF] pgmap v22148: 2592 pgs: 655 peering, 381 active+remapped, 346 active+degraded, 1210 remapped+peering; 9532 KB data, 58752 MB used, 52085 GB / 52142 GB avail
  363. 2013-08-04 13:57:40.683004 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  364. 2013-08-04 13:57:40.683192 mon.0 [INF] osdmap e11415: 24 osds: 13 up, 14 in
  365. 2013-08-04 13:57:40.879732 mon.0 [INF] pgmap v22150: 2592 pgs: 595 peering, 524 active+remapped, 406 active+degraded, 1067 remapped+peering; 9532 KB data, 58754 MB used, 52085 GB / 52142 GB avail
  366. 2013-08-04 13:57:41.709358 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  367. 2013-08-04 13:57:41.729323 mon.0 [INF] osdmap e11416: 24 osds: 14 up, 14 in
  368. 2013-08-04 13:57:41.808217 mon.0 [INF] pgmap v22151: 2592 pgs: 595 peering, 524 active+remapped, 406 active+degraded, 1067 remapped+peering; 9532 KB data, 58754 MB used, 52085 GB / 52142 GB avail
  369. 2013-08-04 13:57:42.757349 mon.0 [INF] osdmap e11417: 24 osds: 14 up, 14 in
  370. 2013-08-04 13:57:42.787699 mon.0 [INF] pgmap v22152: 2592 pgs: 595 peering, 524 active+remapped, 406 active+degraded, 1067 remapped+peering; 9532 KB data, 58754 MB used, 52085 GB / 52142 GB avail
  371. 2013-08-04 13:57:46.205177 mon.0 [INF] osd.26 192.168.61.5:6803/28483 boot
  372. 2013-08-04 13:57:46.218769 mon.0 [INF] osdmap e11418: 24 osds: 15 up, 15 in
  373. 2013-08-04 13:57:40.504096 osd.24 [WRN] map e11414 wrongly marked me down
  374. 2013-08-04 13:57:46.288939 mon.0 [INF] pgmap v22153: 2592 pgs: 595 peering, 524 active+remapped, 406 active+degraded, 1067 remapped+peering; 9532 KB data, 58754 MB used, 52085 GB / 52142 GB avail
  375. 2013-08-04 13:57:47.600324 mon.0 [INF] osdmap e11419: 24 osds: 15 up, 15 in
  376. 2013-08-04 13:57:40.855868 osd.25 [WRN] map e11415 wrongly marked me down
  377. 2013-08-04 13:57:47.845642 mon.0 [INF] pgmap v22154: 2592 pgs: 595 peering, 524 active+remapped, 406 active+degraded, 1067 remapped+peering; 9532 KB data, 58754 MB used, 52085 GB / 52142 GB avail
  378. 2013-08-04 13:57:51.681723 mon.0 [INF] pgmap v22155: 2592 pgs: 715 peering, 252 active+remapped, 286 active+degraded, 1339 remapped+peering; 9532 KB data, 58767 MB used, 52085 GB / 52142 GB avail
  379. 2013-08-04 13:57:52.924999 mon.0 [INF] pgmap v22156: 2592 pgs: 837 peering, 2 active+remapped, 160 active+degraded, 1593 remapped+peering; 9532 KB data, 62966 MB used, 55805 GB / 55867 GB avail
  380. 2013-08-04 13:58:02.075608 mon.0 [INF] osd.24 192.168.61.5:6800/28010 failed (3 reports from 3 peers after 2013-08-04 13:58:03.075536 >= grace 20.000000)
  381. 2013-08-04 13:58:02.719236 mon.0 [INF] osdmap e11420: 24 osds: 14 up, 15 in
  382. 2013-08-04 13:58:02.846976 mon.0 [INF] pgmap v22157: 2592 pgs: 837 peering, 2 active+remapped, 160 active+degraded, 1593 remapped+peering; 9532 KB data, 62966 MB used, 55805 GB / 55867 GB avail
  383. 2013-08-04 13:58:03.770226 mon.0 [INF] osdmap e11421: 24 osds: 14 up, 15 in
  384. 2013-08-04 13:58:03.912541 mon.0 [INF] pgmap v22158: 2592 pgs: 837 peering, 2 active+remapped, 160 active+degraded, 1593 remapped+peering; 9532 KB data, 62966 MB used, 55805 GB / 55867 GB avail
  385. 2013-08-04 13:58:08.027655 mon.0 [INF] osd.25 192.168.61.5:6801/28232 failed (3 reports from 3 peers after 2013-08-04 13:58:09.027566 >= grace 20.000000)
  386. 2013-08-04 13:58:08.154389 mon.0 [INF] pgmap v22159: 2592 pgs: 811 peering, 64 active+remapped, 186 active+degraded, 1531 remapped+peering; 9532 KB data, 62967 MB used, 55805 GB / 55867 GB avail
  387. 2013-08-04 13:58:08.280062 mon.0 [INF] osd.26 192.168.61.5:6803/28483 failed (3 reports from 3 peers after 2013-08-04 13:58:09.279994 >= grace 20.000000)
  388. 2013-08-04 13:58:08.333951 mon.0 [INF] osdmap e11422: 24 osds: 13 up, 15 in
  389. 2013-08-04 13:58:08.415039 mon.0 [INF] pgmap v22160: 2592 pgs: 761 peering, 149 active+remapped, 236 active+degraded, 1446 remapped+peering; 9532 KB data, 62970 MB used, 55805 GB / 55867 GB avail
  390. 2013-08-04 13:58:09.358975 mon.0 [INF] osdmap e11423: 24 osds: 12 up, 15 in
  391. 2013-08-04 13:58:09.579615 mon.0 [INF] pgmap v22161: 2592 pgs: 693 peering, 267 active+remapped, 304 active+degraded, 1328 remapped+peering; 9532 KB data, 62974 MB used, 55805 GB / 55867 GB avail
  392. 2013-08-04 13:58:10.350492 mon.0 [INF] osdmap e11424: 24 osds: 12 up, 15 in
  393. 2013-08-04 13:58:10.430487 mon.0 [INF] pgmap v22162: 2592 pgs: 693 peering, 267 active+remapped, 304 active+degraded, 1328 remapped+peering; 9532 KB data, 62974 MB used, 55805 GB / 55867 GB avail
  394. 2013-08-04 13:58:11.361391 mon.0 [INF] osdmap e11425: 24 osds: 12 up, 15 in
  395. 2013-08-04 13:58:11.387441 mon.0 [INF] pgmap v22163: 2592 pgs: 693 peering, 267 active+remapped, 304 active+degraded, 1328 remapped+peering; 9532 KB data, 62974 MB used, 55805 GB / 55867 GB avail
  396. 2013-08-04 13:58:13.574906 mon.0 [INF] osd.25 192.168.61.5:6801/28232 boot
  397. 2013-08-04 13:58:13.575085 mon.0 [INF] osd.24 192.168.61.5:6800/28010 boot
  398. 2013-08-04 13:58:13.588550 mon.0 [INF] osdmap e11426: 24 osds: 14 up, 15 in
  399. 2013-08-04 13:58:13.652588 mon.0 [INF] pgmap v22164: 2592 pgs: 693 peering, 267 active+remapped, 304 active+degraded, 1328 remapped+peering; 9532 KB data, 62974 MB used, 55805 GB / 55867 GB avail
  400. 2013-08-04 13:58:14.690204 mon.0 [INF] osdmap e11427: 24 osds: 14 up, 15 in
  401. 2013-08-04 13:58:12.918907 osd.24 [WRN] map e11425 wrongly marked me down
  402. 2013-08-04 13:58:12.477707 osd.25 [WRN] map e11425 wrongly marked me down
  403. 2013-08-04 13:58:14.766121 mon.0 [INF] pgmap v22165: 2592 pgs: 693 peering, 267 active+remapped, 304 active+degraded, 1328 remapped+peering; 9532 KB data, 62974 MB used, 55805 GB / 55867 GB avail
  404. 2013-08-04 13:58:19.022202 mon.0 [INF] pgmap v22166: 2592 pgs: 672 peering, 305 active+remapped, 327 active+degraded, 1288 remapped+peering; 9532 KB data, 62964 MB used, 55805 GB / 55867 GB avail
  405. 2013-08-04 13:58:20.498430 mon.0 [INF] pgmap v22167: 2592 pgs: 552 peering, 503 active+remapped, 447 active+degraded, 1090 remapped+peering; 9532 KB data, 62976 MB used, 55805 GB / 55867 GB avail; 1/20 degraded (5.000%)
  406. 2013-08-04 13:58:21.325599 mon.0 [INF] osd.26 192.168.61.5:6803/28483 boot
  407. 2013-08-04 13:58:21.340199 mon.0 [INF] osdmap e11428: 24 osds: 15 up, 15 in
  408. 2013-08-04 13:58:21.463248 mon.0 [INF] pgmap v22168: 2592 pgs: 552 peering, 503 active+remapped, 447 active+degraded, 1090 remapped+peering; 9532 KB data, 62978 MB used, 55805 GB / 55867 GB avail; 1/20 degraded (5.000%)
  409. 2013-08-04 13:58:22.379898 mon.0 [INF] osdmap e11429: 24 osds: 15 up, 15 in
  410. 2013-08-04 13:58:22.454981 mon.0 [INF] pgmap v22169: 2592 pgs: 552 peering, 503 active+remapped, 447 active+degraded, 1090 remapped+peering; 9532 KB data, 62978 MB used, 55805 GB / 55867 GB avail; 1/20 degraded (5.000%)
  411. 2013-08-04 13:58:26.543354 mon.0 [INF] pgmap v22170: 2592 pgs: 576 peering, 455 active+remapped, 423 active+degraded, 1138 remapped+peering; 9532 KB data, 62978 MB used, 55805 GB / 55867 GB avail; 1/20 degraded (5.000%)
  412. 2013-08-04 13:58:20.533510 osd.26 [WRN] map e11427 wrongly marked me down
  413. 2013-08-04 13:58:28.016333 mon.0 [INF] pgmap v22171: 2592 pgs: 839 peering, 2 active+remapped, 158 active+degraded, 1593 remapped+peering; 9532 KB data, 62969 MB used, 55805 GB / 55867 GB avail
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!