API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Sep 15th, 2011
293
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 96.21 KB | None | 0 0
raw download clone embed print report
  1. [ 125.908352] rbd: fetched request
  2. [ 125.915094] rbd: write 0x80000 bytes at 0xdd200000
  3. [ 125.927541] rbd: rq->bio->bi_vcnt=128
  4. [ 125.937709] rbd: rbd_do_request obj=rb.0.3.000000000374 ofs=524288 len=2097152
  5. [ 125.955053] libceph: mapping 2097152~524288 osize 1073741824 fl_su 1073741824
  6. [ 125.972368] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  7. [ 125.988478] libceph: off 2097152 / su 1073741824 = bl 0
  8. [ 126.001806] libceph: objset 0 * sc 1 = ono 0
  9. [ 126.013216] libceph: obj extent 2097152~524288
  10. [ 126.025144] libceph: calc_layout bno=0 2097152~524288 (128 pages)
  11. [ 126.040282] libceph: __register_request ffff8804041c5400 tid 1006
  12. [ 126.055452] libceph: first request, scheduling timeout
  13. [ 126.068868] libceph: map_request ffff8804041c5400 tid 1006
  14. [ 126.082806] libceph: calc_object_layout 'rb.0.3.000000000374' pgid 2.a627d2f1
  15. [ 126.100196] libceph: map_request tid 1006 pgid 2.d2f1 osd2 (was osd-1)
  16. [ 126.116339] libceph: __remove_osd_from_lru ffff880403886000
  17. [ 126.130595] libceph: send_request ffff8804041c5400 tid 1006 to osd2 flags 36
  18. [ 126.147889] libceph: ----- ffff880803648b00 to osd2 42=osd_op len 127+0+524288 -----
  19. [ 126.166614] libceph: get_osd ffff880403886000 1 -> 2
  20. [ 126.181529] libceph: put_osd ffff880403886000 2 -> 1
  21. [ 126.208238] libceph: get_osd ffff880403886000 1 -> 2
  22. [ 126.221647] libceph: get_reply tid 1006 ffff880803648e00
  23. [ 126.235532] libceph: ===== ffff880803648e00 292 from osd2 43=osd_opreply len 105+0 (34945705 0 0) =====
  24. [ 126.257731] libceph: handle_reply ffff880803648e00 tid 1006 result 0
  25. [ 126.273795] libceph: dropping con_filling_msg ref ffff880403886030
  26. [ 126.289741] libceph: handle_reply result 0 bytes 0
  27. [ 126.302720] libceph: handle_reply tid 1006 flags 37
  28. [ 126.315906] libceph: __unregister_request ffff8804041c5400 tid 1006
  29. [ 126.331924] libceph: moving osd to ffff880403886000 lru
  30. [ 126.345881] libceph: __move_osd_to_lru ffff880403886000
  31. [ 126.359838] libceph: no requests, canceling timeout
  32. [ 126.373290] rbd: rbd_req_cb bytes=524288 readop=0 rc=0
  33. [ 126.387108] rbd: rbd_coll_end_req_index ffff880803b28980 index 0 ret 0 len 524288
  34. [ 126.405689] rbd: rbd_coll_release ffff880803b28980
  35. [ 126.418873] libceph: req=ffff8804041c5400 req->r_linger=0
  36. [ 126.433325] rbd: fetched request
  37. [ 126.443443] rbd: write 0x80000 bytes at 0xdd280000
  38. [ 126.456741] rbd: rq->bio->bi_vcnt=128
  39. [ 126.467728] libceph: put_osd ffff880403886000 2 -> 1
  40. [ 126.481281] rbd: rbd_do_request obj=rb.0.3.000000000374 ofs=524288 len=2621440
  41. [ 126.499395] libceph: mapping 2621440~524288 osize 1073741824 fl_su 1073741824
  42. [ 126.517484] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  43. [ 126.534363] libceph: off 2621440 / su 1073741824 = bl 0
  44. [ 126.548439] libceph: objset 0 * sc 1 = ono 0
  45. [ 126.560571] libceph: obj extent 2621440~524288
  46. [ 126.573197] libceph: calc_layout bno=0 2621440~524288 (128 pages)
  47. [ 126.588978] libceph: __register_request ffff8804040d3c00 tid 1007
  48. [ 126.604700] libceph: first request, scheduling timeout
  49. [ 126.618637] libceph: map_request ffff8804040d3c00 tid 1007
  50. [ 126.633111] libceph: calc_object_layout 'rb.0.3.000000000374' pgid 2.a627d2f1
  51. [ 126.650942] libceph: map_request tid 1007 pgid 2.d2f1 osd2 (was osd-1)
  52. [ 126.667531] libceph: __remove_osd_from_lru ffff880403886000
  53. [ 126.682174] libceph: send_request ffff8804040d3c00 tid 1007 to osd2 flags 36
  54. [ 126.700159] libceph: ----- ffff8804042ec700 to osd2 42=osd_op len 127+0+524288 -----
  55. [ 126.719208] libceph: get_osd ffff880403886000 1 -> 2
  56. [ 126.732828] libceph: put_osd ffff880403886000 2 -> 1
  57. [ 126.771182] libceph: get_osd ffff880403886000 1 -> 2
  58. [ 126.781177] libceph: get_reply tid 1007 ffff8804042ed100
  59. [ 126.798597] libceph: ===== ffff8804042ed100 293 from osd2 43=osd_opreply len 105+0 (3915194798 0 0) =====
  60. [ 126.821244] libceph: handle_reply ffff8804042ed100 tid 1007 result 0
  61. [ 126.837496] libceph: dropping con_filling_msg ref ffff880403886030
  62. [ 126.853560] libceph: handle_reply result 0 bytes 0
  63. [ 126.866644] libceph: handle_reply tid 1007 flags 37
  64. [ 126.879862] libceph: __unregister_request ffff8804040d3c00 tid 1007
  65. [ 126.895851] libceph: moving osd to ffff880403886000 lru
  66. [ 126.909738] libceph: __move_osd_to_lru ffff880403886000
  67. [ 126.923584] libceph: no requests, canceling timeout
  68. [ 126.936945] rbd: rbd_req_cb bytes=524288 readop=0 rc=0
  69. [ 126.950698] rbd: rbd_coll_end_req_index ffff8804055a1560 index 0 ret 0 len 524288
  70. [ 126.969221] rbd: rbd_coll_release ffff8804055a1560
  71. [ 126.982285] libceph: req=ffff8804040d3c00 req->r_linger=0
  72. [ 126.982316] rbd: fetched request
  73. [ 126.982324] rbd: write 0x80000 bytes at 0xdd300000
  74. [ 126.982330] rbd: rq->bio->bi_vcnt=128
  75. [ 126.982343] rbd: rbd_do_request obj=rb.0.3.000000000374 ofs=524288 len=3145728
  76. [ 126.982359] libceph: mapping 3145728~524288 osize 1073741824 fl_su 1073741824
  77. [ 126.982368] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  78. [ 126.982376] libceph: off 3145728 / su 1073741824 = bl 0
  79. [ 126.982384] libceph: objset 0 * sc 1 = ono 0
  80. [ 126.982391] libceph: obj extent 3145728~524288
  81. [ 126.982398] libceph: calc_layout bno=0 3145728~524288 (128 pages)
  82. [ 126.982408] libceph: __register_request ffff88040422d200 tid 1008
  83. [ 126.982414] libceph: first request, scheduling timeout
  84. [ 126.982424] libceph: map_request ffff88040422d200 tid 1008
  85. [ 126.982433] libceph: calc_object_layout 'rb.0.3.000000000374' pgid 2.a627d2f1
  86. [ 126.982447] libceph: map_request tid 1008 pgid 2.d2f1 osd2 (was osd-1)
  87. [ 126.982455] libceph: __remove_osd_from_lru ffff880403886000
  88. [ 126.982464] libceph: send_request ffff88040422d200 tid 1008 to osd2 flags 36
  89. [ 126.982475] libceph: ----- ffff880803c42900 to osd2 42=osd_op len 127+0+524288 -----
  90. [ 126.982483] libceph: get_osd ffff880403886000 2 -> 3
  91. [ 126.986498] rbd: fetched request
  92. [ 126.986503] rbd: write 0x80000 bytes at 0xdd380000
  93. [ 126.986507] rbd: rq->bio->bi_vcnt=128
  94. [ 126.986516] rbd: rbd_do_request obj=rb.0.3.000000000374 ofs=524288 len=3670016
  95. [ 126.986525] libceph: mapping 3670016~524288 osize 1073741824 fl_su 1073741824
  96. [ 126.986530] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  97. [ 126.986535] libceph: off 3670016 / su 1073741824 = bl 0
  98. [ 126.986540] libceph: objset 0 * sc 1 = ono 0
  99. [ 126.986543] libceph: obj extent 3670016~524288
  100. [ 126.986548] libceph: calc_layout bno=0 3670016~524288 (128 pages)
  101. [ 126.986553] libceph: __register_request ffff88040422c200 tid 1009
  102. [ 126.986558] libceph: map_request ffff88040422c200 tid 1009
  103. [ 126.986563] libceph: calc_object_layout 'rb.0.3.000000000374' pgid 2.a627d2f1
  104. [ 126.986573] libceph: map_request tid 1009 pgid 2.d2f1 osd2 (was osd-1)
  105. [ 126.986577] libceph: __remove_osd_from_lru ffff880403886000
  106. [ 126.986582] libceph: send_request ffff88040422c200 tid 1009 to osd2 flags 36
  107. [ 126.986589] libceph: ----- ffff880803c43600 to osd2 42=osd_op len 127+0+524288 -----
  108. [ 127.533794] libceph: put_osd ffff880403886000 3 -> 2
  109. [ 127.547156] libceph: get_osd ffff880403886000 3 -> 4
  110. [ 127.560452] libceph: put_osd ffff880403886000 4 -> 3
  111. [ 127.573780] libceph: put_osd ffff880403886000 2 -> 1
  112. [ 127.587042] libceph: get_osd ffff880403886000 2 -> 3
  113. [ 127.600271] libceph: put_osd ffff880403886000 2 -> 1
  114. [ 127.613429] libceph: get_osd ffff880403886000 2 -> 3
  115. [ 127.626575] libceph: put_osd ffff880403886000 2 -> 1
  116. [ 127.639654] libceph: get_osd ffff880403886000 2 -> 3
  117. [ 127.652697] libceph: put_osd ffff880403886000 2 -> 1
  118. [ 127.665641] libceph: get_osd ffff880403886000 2 -> 3
  119. [ 127.678571] libceph: put_osd ffff880403886000 2 -> 1
  120. [ 127.691409] libceph: get_osd ffff880403886000 2 -> 3
  121. [ 127.704271] libceph: put_osd ffff880403886000 2 -> 1
  122. [ 127.718666] libceph: get_osd ffff880403886000 1 -> 2
  123. [ 127.731470] libceph: put_osd ffff880403886000 2 -> 1
  124. [ 127.744150] libceph: get_osd ffff880403886000 2 -> 3
  125. [ 127.756774] libceph: get_reply tid 1008 ffff880803c42a00
  126. [ 127.770018] libceph: get_osd ffff880403886000 2 -> 3
  127. [ 127.782575] libceph: ===== ffff880803c42a00 294 from osd2 43=osd_opreply len 105+0 (871363252 0 0) =====
  128. [ 127.804270] libceph: handle_reply ffff880803c42a00 tid 1008 result 0
  129. [ 127.819743] libceph: dropping con_filling_msg ref ffff880403886030
  130. [ 127.835055] libceph: handle_reply result 0 bytes 0
  131. [ 127.847390] libceph: handle_reply tid 1008 flags 37
  132. [ 127.859885] libceph: __unregister_request ffff88040422d200 tid 1008
  133. [ 127.875160] rbd: rbd_req_cb bytes=524288 readop=0 rc=0
  134. [ 127.888164] rbd: rbd_coll_end_req_index ffff8808039f6240 index 0 ret 0 len 524288
  135. [ 127.905920] rbd: rbd_coll_release ffff8808039f6240
  136. [ 127.918260] libceph: req=ffff88040422d200 req->r_linger=0
  137. [ 127.931805] libceph: get_reply tid 1009 ffff880803c43300
  138. [ 127.945153] libceph: ===== ffff880803c43300 295 from osd2 43=osd_opreply len 105+0 (975266129 0 0) =====
  139. [ 127.966926] libceph: handle_reply ffff880803c43300 tid 1009 result 0
  140. [ 127.982473] libceph: dropping con_filling_msg ref ffff880403886030
  141. [ 127.997862] libceph: handle_reply result 0 bytes 0
  142. [ 128.010272] libceph: handle_reply tid 1009 flags 37
  143. [ 128.022798] libceph: __unregister_request ffff88040422c200 tid 1009
  144. [ 128.038111] libceph: moving osd to ffff880403886000 lru
  145. [ 128.051343] libceph: __move_osd_to_lru ffff880403886000
  146. [ 128.064564] libceph: no requests, canceling timeout
  147. [ 128.077273] rbd: rbd_req_cb bytes=524288 readop=0 rc=0
  148. [ 128.090334] rbd: rbd_coll_end_req_index ffff8808039f6720 index 0 ret 0 len 524288
  149. [ 128.108147] rbd: rbd_coll_release ffff8808039f6720
  150. [ 128.120573] libceph: req=ffff88040422c200 req->r_linger=0
  151. [ 128.120615] rbd: fetched request
  152. [ 128.120622] rbd: write 0x80000 bytes at 0xdd400000
  153. [ 128.120627] rbd: rq->bio->bi_vcnt=128
  154. [ 128.120643] rbd: rbd_do_request obj=rb.0.3.000000000375 ofs=524288 len=0
  155. [ 128.120656] libceph: mapping 0~524288 osize 1073741824 fl_su 1073741824
  156. [ 128.120664] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  157. [ 128.120672] libceph: off 0 / su 1073741824 = bl 0
  158. [ 128.120679] libceph: objset 0 * sc 1 = ono 0
  159. [ 128.120685] libceph: obj extent 0~524288
  160. [ 128.120692] libceph: calc_layout bno=0 0~524288 (128 pages)
  161. [ 128.120700] libceph: __register_request ffff88040422c400 tid 1010
  162. [ 128.120707] libceph: first request, scheduling timeout
  163. [ 128.120715] libceph: map_request ffff88040422c400 tid 1010
  164. [ 128.120723] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  165. [ 128.120739] libceph: map_request tid 1010 pgid 2.7661 osd0 (was osd-1)
  166. [ 128.120746] libceph: __remove_osd_from_lru ffff880804105000
  167. [ 128.120755] libceph: send_request ffff88040422c400 tid 1010 to osd0 flags 36
  168. [ 128.120765] libceph: ----- ffff880803c43900 to osd0 42=osd_op len 127+0+524288 -----
  169. [ 128.120773] libceph: get_osd ffff880804105000 1 -> 2
  170. [ 128.120941] libceph: put_osd ffff880804105000 2 -> 1
  171. [ 128.124962] rbd: fetched request
  172. [ 128.124967] rbd: write 0x80000 bytes at 0xdd480000
  173. [ 128.124971] rbd: rq->bio->bi_vcnt=128
  174. [ 128.124979] rbd: rbd_do_request obj=rb.0.3.000000000375 ofs=524288 len=524288
  175. [ 128.124989] libceph: mapping 524288~524288 osize 1073741824 fl_su 1073741824
  176. [ 128.124994] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  177. [ 128.124999] libceph: off 524288 / su 1073741824 = bl 0
  178. [ 128.125003] libceph: objset 0 * sc 1 = ono 0
  179. [ 128.125007] libceph: obj extent 524288~524288
  180. [ 128.125012] libceph: calc_layout bno=0 524288~524288 (128 pages)
  181. [ 128.125017] libceph: __register_request ffff88040422de00 tid 1011
  182. [ 128.125022] libceph: map_request ffff88040422de00 tid 1011
  183. [ 128.125027] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  184. [ 128.125039] libceph: map_request tid 1011 pgid 2.7661 osd0 (was osd-1)
  185. [ 128.125043] libceph: __remove_osd_from_lru ffff880804105000
  186. [ 128.125048] libceph: send_request ffff88040422de00 tid 1011 to osd0 flags 36
  187. [ 128.125055] libceph: ----- ffff880803c43a00 to osd0 42=osd_op len 127+0+524288 -----
  188. [ 128.125061] libceph: get_osd ffff880804105000 1 -> 2
  189. [ 128.125116] libceph: put_osd ffff880804105000 2 -> 1
  190. [ 128.696221] libceph: get_osd ffff880804105000 1 -> 2
  191. [ 128.709455] libceph: put_osd ffff880403886000 3 -> 2
  192. [ 128.722628] libceph: put_osd ffff880403886000 2 -> 1
  193. [ 128.737818] libceph: put_osd ffff880804105000 2 -> 1
  194. [ 128.750901] libceph: get_osd ffff880804105000 2 -> 3
  195. [ 128.763956] libceph: put_osd ffff880804105000 2 -> 1
  196. [ 128.776913] libceph: get_osd ffff880804105000 2 -> 3
  197. [ 128.789835] libceph: put_osd ffff880804105000 2 -> 1
  198. [ 128.803317] libceph: get_osd ffff880804105000 1 -> 2
  199. [ 128.813306] libceph: put_osd ffff880804105000 2 -> 1
  200. [ 128.829399] libceph: get_osd ffff880804105000 1 -> 2
  201. [ 128.839394] libceph: get_reply tid 1010 ffff880803c43800
  202. [ 128.855583] libceph: ===== ffff880803c43800 448 from osd0 43=osd_opreply len 105+0 (357583372 0 0) =====
  203. [ 128.877413] libceph: handle_reply ffff880803c43800 tid 1010 result 0
  204. [ 128.892992] libceph: dropping con_filling_msg ref ffff880804105030
  205. [ 128.908391] libceph: get_osd ffff880804105000 2 -> 3
  206. [ 128.921198] libceph: handle_reply result 0 bytes 0
  207. [ 128.933661] libceph: handle_reply tid 1010 flags 37
  208. [ 128.946282] libceph: __unregister_request ffff88040422c400 tid 1010
  209. [ 128.961735] rbd: rbd_req_cb bytes=524288 readop=0 rc=0
  210. [ 128.974912] rbd: rbd_coll_end_req_index ffff8808039f6f60 index 0 ret 0 len 524288
  211. [ 128.992853] rbd: rbd_coll_release ffff8808039f6f60
  212. [ 129.005378] libceph: req=ffff88040422c400 req->r_linger=0
  213. [ 129.019110] libceph: get_reply tid 1011 ffff880803c43700
  214. [ 129.032662] libceph: ===== ffff880803c43700 449 from osd0 43=osd_opreply len 105+0 (2405111162 0 0) =====
  215. [ 129.054805] libceph: handle_reply ffff880803c43700 tid 1011 result 0
  216. [ 129.070500] libceph: dropping con_filling_msg ref ffff880804105030
  217. [ 129.086021] libceph: handle_reply result 0 bytes 0
  218. [ 129.098628] libceph: handle_reply tid 1011 flags 37
  219. [ 129.111372] libceph: __unregister_request ffff88040422de00 tid 1011
  220. [ 129.126921] libceph: moving osd to ffff880804105000 lru
  221. [ 129.140391] libceph: __move_osd_to_lru ffff880804105000
  222. [ 129.153837] libceph: no requests, canceling timeout
  223. [ 129.166726] rbd: rbd_req_cb bytes=524288 readop=0 rc=0
  224. [ 129.179939] rbd: rbd_coll_end_req_index ffff8808039f6f40 index 0 ret 0 len 524288
  225. [ 129.197907] rbd: rbd_coll_release ffff8808039f6f40
  226. [ 129.210484] libceph: req=ffff88040422de00 req->r_linger=0
  227. [ 129.210516] rbd: fetched request
  228. [ 129.210524] rbd: write 0x80000 bytes at 0xdd500000
  229. [ 129.210528] rbd: rq->bio->bi_vcnt=128
  230. [ 129.210537] rbd: rbd_do_request obj=rb.0.3.000000000375 ofs=524288 len=1048576
  231. [ 129.210552] libceph: mapping 1048576~524288 osize 1073741824 fl_su 1073741824
  232. [ 129.210561] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  233. [ 129.210570] libceph: off 1048576 / su 1073741824 = bl 0
  234. [ 129.210578] libceph: objset 0 * sc 1 = ono 0
  235. [ 129.210585] libceph: obj extent 1048576~524288
  236. [ 129.210593] libceph: calc_layout bno=0 1048576~524288 (128 pages)
  237. [ 129.210602] libceph: __register_request ffff88040422ca00 tid 1012
  238. [ 129.210609] libceph: first request, scheduling timeout
  239. [ 129.210618] libceph: map_request ffff88040422ca00 tid 1012
  240. [ 129.210626] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  241. [ 129.210643] libceph: map_request tid 1012 pgid 2.7661 osd0 (was osd-1)
  242. [ 129.210651] libceph: __remove_osd_from_lru ffff880804105000
  243. [ 129.210659] libceph: send_request ffff88040422ca00 tid 1012 to osd0 flags 36
  244. [ 129.210670] libceph: ----- ffff880803c43900 to osd0 42=osd_op len 127+0+524288 -----
  245. [ 129.210679] libceph: get_osd ffff880804105000 3 -> 4
  246. [ 129.210686] libceph: put_osd ffff880804105000 4 -> 3
  247. [ 129.214701] rbd: fetched request
  248. [ 129.214706] rbd: write 0x80000 bytes at 0xdd580000
  249. [ 129.214710] rbd: rq->bio->bi_vcnt=128
  250. [ 129.214719] rbd: rbd_do_request obj=rb.0.3.000000000375 ofs=524288 len=1572864
  251. [ 129.214728] libceph: mapping 1572864~524288 osize 1073741824 fl_su 1073741824
  252. [ 129.214733] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  253. [ 129.214738] libceph: off 1572864 / su 1073741824 = bl 0
  254. [ 129.214742] libceph: objset 0 * sc 1 = ono 0
  255. [ 129.214746] libceph: obj extent 1572864~524288
  256. [ 129.214751] libceph: calc_layout bno=0 1572864~524288 (128 pages)
  257. [ 129.214755] libceph: __register_request ffff88040422dc00 tid 1013
  258. [ 129.214760] libceph: map_request ffff88040422dc00 tid 1013
  259. [ 129.214765] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  260. [ 129.214776] libceph: map_request tid 1013 pgid 2.7661 osd0 (was osd-1)
  261. [ 129.214780] libceph: __remove_osd_from_lru ffff880804105000
  262. [ 129.214785] libceph: send_request ffff88040422dc00 tid 1013 to osd0 flags 36
  263. [ 129.214792] libceph: ----- ffff880803c43600 to osd0 42=osd_op len 127+0+524288 -----
  264. [ 129.768980] libceph: get_osd ffff880804105000 3 -> 4
  265. [ 129.782307] libceph: put_osd ffff880804105000 4 -> 3
  266. [ 129.796030] libceph: put_osd ffff880804105000 3 -> 2
  267. [ 129.809290] libceph: osd0 192.168.42.113:6800 socket closed
  268. [ 129.823579] libceph: osd_reset osd0
  269. [ 129.833842] libceph: __kick_osd_requests osd0
  270. [ 129.845845] libceph: __reset_osd ffff880804105000 osd0
  271. [ 129.859409] libceph: get_osd ffff880804105000 2 -> 3
  272. [ 129.872562] libceph: get_osd ffff880804105000 3 -> 4
  273. [ 129.885649] libceph: put_osd ffff880804105000 4 -> 3
  274. [ 129.898681] libceph: requeued ffff88040422dc00 tid 1013 osd0
  275. [ 129.913103] libceph: requeued ffff88040422ca00 tid 1012 osd0
  276. [ 129.927495] libceph: send_queued
  277. [ 129.937020] libceph: send_request ffff88040422ca00 tid 1012 to osd0 flags 44
  278. [ 129.954226] libceph: ----- ffff880803c43900 to osd0 42=osd_op len 127+0+524288 -----
  279. [ 129.972812] libceph: get_osd ffff880804105000 3 -> 4
  280. [ 129.985830] libceph: put_osd ffff880804105000 4 -> 3
  281. [ 129.998799] libceph: send_request ffff88040422dc00 tid 1013 to osd0 flags 44
  282. [ 130.015979] libceph: ----- ffff880803c43600 to osd0 42=osd_op len 127+0+524288 -----
  283. [ 130.034609] libceph: put_osd ffff880804105000 3 -> 2
  284. [ 130.047722] libceph: put_osd ffff880804105000 2 -> 1
  285. [ 130.060756] libceph: get_osd ffff880804105000 2 -> 3
  286. [ 130.073744] libceph: osd0 192.168.42.113:6800 connection failed
  287. [ 130.088492] libceph: get_osd ffff880804105000 2 -> 3
  288. [ 130.101452] libceph: osd_reset osd0
  289. [ 130.111432] libceph: __kick_osd_requests osd0
  290. [ 130.123124] libceph: __reset_osd ffff880804105000 osd0
  291. [ 130.136367] libceph: osd addr hasn't changed and connection never opened, letting msgr retry
  292. [ 130.156469] libceph: send_queued
  293. [ 130.165907] libceph: put_osd ffff880804105000 3 -> 2
  294. [ 131.040158] libceph: put_osd ffff880804105000 2 -> 1
  295. [ 131.053141] libceph: get_osd ffff880804105000 2 -> 3
  296. [ 131.066083] libceph: osd0 192.168.42.113:6800 connection failed
  297. [ 131.080751] libceph: get_osd ffff880804105000 2 -> 3
  298. [ 131.093641] libceph: osd_reset osd0
  299. [ 131.103528] libceph: __kick_osd_requests osd0
  300. [ 131.115113] libceph: __reset_osd ffff880804105000 osd0
  301. [ 131.128252] libceph: osd addr hasn't changed and connection never opened, letting msgr retry
  302. [ 131.148293] libceph: send_queued
  303. [ 131.157719] libceph: put_osd ffff880804105000 3 -> 2
  304. [ 132.040133] libceph: put_osd ffff880804105000 2 -> 1
  305. [ 132.053014] libceph: get_osd ffff880804105000 2 -> 3
  306. [ 132.065852] libceph: osd0 192.168.42.113:6800 connection failed
  307. [ 132.080389] libceph: get_osd ffff880804105000 2 -> 3
  308. [ 132.093158] libceph: osd_reset osd0
  309. [ 132.102932] libceph: __kick_osd_requests osd0
  310. [ 132.114417] libceph: __reset_osd ffff880804105000 osd0
  311. [ 132.127442] libceph: osd addr hasn't changed and connection never opened, letting msgr retry
  312. [ 132.147329] libceph: send_queued
  313. [ 132.156612] libceph: put_osd ffff880804105000 3 -> 2
  314. [ 134.040483] libceph: get_osd ffff880804105000 2 -> 3
  315. [ 134.053294] libceph: osd0 192.168.42.113:6800 connection failed
  316. [ 134.067853] libceph: get_osd ffff880804105000 3 -> 4
  317. [ 134.080678] libceph: put_osd ffff880804105000 4 -> 3
  318. [ 134.093473] libceph: osd_reset osd0
  319. [ 134.103312] libceph: __kick_osd_requests osd0
  320. [ 134.114917] libceph: __reset_osd ffff880804105000 osd0
  321. [ 134.128131] libceph: osd addr hasn't changed and connection never opened, letting msgr retry
  322. [ 134.148238] libceph: send_queued
  323. [ 134.157726] libceph: put_osd ffff880804105000 3 -> 2
  324. [ 134.220127] libceph: timeout
  325. [ 134.228870] libceph: request_next_osdmap have 26
  326. [ 134.241085] libceph: __send_subscribe sub_sent=0 exp=0 want_osd=1
  327. [ 134.256239] libceph: __send_subscribe to 'osdmap' 26
  328. [ 134.269142] libceph: ----- ffff880803091300 to mon0 15=mon_subscribe len 58+0+0 -----
  329. [ 134.287826] libceph: send_queued
  330. [ 134.297705] libceph: ===== ffff8804044d5200 5 from mon0 4=mon_map len 191+0 (290625020 0 0) =====
  331. [ 134.318526] libceph: handle_monmap
  332. [ 134.328411] libceph: monmap_decode ffff88040512ac04 ffff88040512acbf len 187
  333. [ 134.345688] libceph: monmap_decode epoch 1, num_mon 1
  334. [ 134.358947] libceph: monmap_decode mon0 is 192.168.42.112:6789
  335. [ 134.373950] libceph: ===== ffff880803090900 6 from mon0 16=mon_subscribe_ack len 20+0 (3638840929 0 0) =====
  336. [ 134.396868] libceph: handle_subscribe_ack after 300 seconds
  337. [ 134.800089] libceph: monc delayed_work
  338. [ 134.810868] libceph: __send_subscribe sub_sent=0 exp=0 want_osd=2
  339. [ 134.826311] libceph: __schedule_delayed after 2000
  340. [ 138.050438] libceph: get_osd ffff880804105000 2 -> 3
  341. [ 138.063584] libceph: osd0 192.168.42.113:6800 connection failed
  342. [ 138.078526] libceph: get_osd ffff880804105000 3 -> 4
  343. [ 138.091764] libceph: put_osd ffff880804105000 4 -> 3
  344. [ 138.104957] libceph: osd_reset osd0
  345. [ 138.115173] libceph: __kick_osd_requests osd0
  346. [ 138.127116] libceph: __reset_osd ffff880804105000 osd0
  347. [ 138.140660] libceph: osd addr hasn't changed and connection never opened, letting msgr retry
  348. [ 138.161112] libceph: send_queued
  349. [ 138.170851] libceph: put_osd ffff880804105000 3 -> 2
  350. [ 138.490897] rbd: fetched request
  351. [ 138.500614] rbd: read 0x1000 bytes at 0x24a1000
  352. [ 138.512953] rbd: rq->bio->bi_vcnt=1
  353. [ 138.523250] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=4096 len=659456
  354. [ 138.540572] libceph: mapping 659456~4096 osize 1073741824 fl_su 1073741824
  355. [ 138.557875] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  356. [ 138.574507] libceph: off 659456 / su 1073741824 = bl 0
  357. [ 138.574509] libceph: objset 0 * sc 1 = ono 0
  358. [ 138.574510] libceph: obj extent 659456~4096
  359. [ 138.574512] libceph: calc_layout bno=0 659456~4096 (1 pages)
  360. [ 138.574518] libceph: __register_request ffff880803c38400 tid 1014
  361. [ 138.574520] libceph: map_request ffff880803c38400 tid 1014
  362. [ 138.574523] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  363. [ 138.574528] libceph: map_request tid 1014 pgid 2.8318 osd2 (was osd-1)
  364. [ 138.574533] libceph: __remove_osd_from_lru ffff880403886000
  365. [ 138.574538] libceph: send_request ffff880803c38400 tid 1014 to osd2 flags 16
  366. [ 138.574544] libceph: ----- ffff880804fb0400 to osd2 42=osd_op len 127+0+0 -----
  367. [ 138.574549] libceph: get_osd ffff880403886000 1 -> 2
  368. [ 138.574577] libceph: put_osd ffff880403886000 2 -> 1
  369. [ 138.705163] libceph: get_osd ffff880403886000 1 -> 2
  370. [ 138.780965] libceph: get_reply tid 1014 ffff880804fb1e00
  371. [ 138.794992] libceph: ===== ffff880804fb1e00 296 from osd2 43=osd_opreply len 105+4096 (4189902018 0 0) =====
  372. [ 138.818133] libceph: handle_reply ffff880804fb1e00 tid 1014 result 0
  373. [ 138.834389] libceph: dropping con_filling_msg ref ffff880403886030
  374. [ 138.850446] libceph: handle_reply result 0 bytes 4096
  375. [ 138.864088] libceph: handle_reply tid 1014 flags 21
  376. [ 138.877324] libceph: __unregister_request ffff880803c38400 tid 1014
  377. [ 138.893343] libceph: moving osd to ffff880403886000 lru
  378. [ 138.907223] libceph: __move_osd_to_lru ffff880403886000
  379. [ 138.921047] rbd: rbd_req_cb bytes=4096 readop=1 rc=0
  380. [ 138.934334] rbd: rbd_coll_end_req_index ffff8808034a0380 index 0 ret 0 len 4096
  381. [ 138.952390] rbd: rbd_coll_release ffff8808034a0380
  382. [ 138.965409] libceph: req=ffff880803c38400 req->r_linger=0
  383. [ 138.965619] rbd: fetched request
  384. [ 138.965622] rbd: write 0x1000 bytes at 0x2466000
  385. [ 138.965624] rbd: rq->bio->bi_vcnt=1
  386. [ 138.965630] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=4096 len=417792
  387. [ 138.965636] libceph: mapping 417792~4096 osize 1073741824 fl_su 1073741824
  388. [ 138.965638] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  389. [ 138.965640] libceph: off 417792 / su 1073741824 = bl 0
  390. [ 138.965641] libceph: objset 0 * sc 1 = ono 0
  391. [ 138.965643] libceph: obj extent 417792~4096
  392. [ 138.965645] libceph: calc_layout bno=0 417792~4096 (1 pages)
  393. [ 138.965648] libceph: __register_request ffff880804ffae00 tid 1015
  394. [ 138.965650] libceph: map_request ffff880804ffae00 tid 1015
  395. [ 138.965652] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  396. [ 138.965657] libceph: map_request tid 1015 pgid 2.8318 osd2 (was osd-1)
  397. [ 138.965659] libceph: __remove_osd_from_lru ffff880403886000
  398. [ 138.965661] libceph: send_request ffff880804ffae00 tid 1015 to osd2 flags 36
  399. [ 138.965665] libceph: ----- ffff880804762e00 to osd2 42=osd_op len 127+0+4096 -----
  400. [ 138.965667] libceph: get_osd ffff880403886000 2 -> 3
  401. [ 138.965671] rbd: fetched request
  402. [ 138.965672] rbd: write 0x9000 bytes at 0x245b000
  403. [ 138.965674] rbd: rq->bio->bi_vcnt=1
  404. [ 138.965688] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=36864 len=372736
  405. [ 138.965693] libceph: mapping 372736~36864 osize 1073741824 fl_su 1073741824
  406. [ 138.965694] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  407. [ 138.965696] libceph: off 372736 / su 1073741824 = bl 0
  408. [ 138.965698] libceph: objset 0 * sc 1 = ono 0
  409. [ 138.965699] libceph: obj extent 372736~36864
  410. [ 138.965701] libceph: calc_layout bno=0 372736~36864 (9 pages)
  411. [ 138.965703] libceph: __register_request ffff880804ff9e00 tid 1016
  412. [ 138.965705] libceph: map_request ffff880804ff9e00 tid 1016
  413. [ 138.965707] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  414. [ 138.965710] libceph: map_request tid 1016 pgid 2.8318 osd2 (was osd-1)
  415. [ 138.965711] libceph: __remove_osd_from_lru ffff880403886000
  416. [ 138.965713] libceph: send_request ffff880804ff9e00 tid 1016 to osd2 flags 36
  417. [ 138.965716] libceph: ----- ffff880804762a00 to osd2 42=osd_op len 127+0+36864 -----
  418. [ 138.965718] rbd: fetched request
  419. [ 138.965719] rbd: write 0x2000 bytes at 0x2458000
  420. [ 138.965721] rbd: rq->bio->bi_vcnt=1
  421. [ 138.965727] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=8192 len=360448
  422. [ 138.965731] libceph: mapping 360448~8192 osize 1073741824 fl_su 1073741824
  423. [ 138.965732] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  424. [ 138.965734] libceph: off 360448 / su 1073741824 = bl 0
  425. [ 138.965736] libceph: objset 0 * sc 1 = ono 0
  426. [ 138.965737] libceph: obj extent 360448~8192
  427. [ 138.965739] libceph: calc_layout bno=0 360448~8192 (2 pages)
  428. [ 138.965740] libceph: __register_request ffff880804ffa200 tid 1017
  429. [ 138.965742] libceph: map_request ffff880804ffa200 tid 1017
  430. [ 138.965744] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  431. [ 138.965747] libceph: map_request tid 1017 pgid 2.8318 osd2 (was osd-1)
  432. [ 138.965749] libceph: __remove_osd_from_lru ffff880403886000
  433. [ 138.965750] libceph: send_request ffff880804ffa200 tid 1017 to osd2 flags 36
  434. [ 138.965753] libceph: ----- ffff880804762f00 to osd2 42=osd_op len 127+0+8192 -----
  435. [ 138.965755] rbd: fetched request
  436. [ 138.965756] rbd: write 0x8000 bytes at 0x244f000
  437. [ 138.965758] rbd: rq->bio->bi_vcnt=1
  438. [ 138.965772] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=32768 len=323584
  439. [ 138.965776] libceph: mapping 323584~32768 osize 1073741824 fl_su 1073741824
  440. [ 138.965778] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  441. [ 138.965780] libceph: off 323584 / su 1073741824 = bl 0
  442. [ 138.965781] libceph: objset 0 * sc 1 = ono 0
  443. [ 138.965783] libceph: obj extent 323584~32768
  444. [ 138.965784] libceph: calc_layout bno=0 323584~32768 (8 pages)
  445. [ 138.965786] libceph: __register_request ffff880804ff8a00 tid 1018
  446. [ 138.965788] libceph: map_request ffff880804ff8a00 tid 1018
  447. [ 138.965790] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  448. [ 138.965793] libceph: map_request tid 1018 pgid 2.8318 osd2 (was osd-1)
  449. [ 138.965794] libceph: __remove_osd_from_lru ffff880403886000
  450. [ 138.965796] libceph: send_request ffff880804ff8a00 tid 1018 to osd2 flags 36
  451. [ 138.965799] libceph: ----- ffff880804763100 to osd2 42=osd_op len 127+0+32768 -----
  452. [ 138.965801] rbd: fetched request
  453. [ 138.965802] rbd: write 0x46000 bytes at 0x2408000
  454. [ 138.965804] rbd: rq->bio->bi_vcnt=1
  455. [ 138.965921] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=286720 len=32768
  456. [ 138.965925] libceph: mapping 32768~286720 osize 1073741824 fl_su 1073741824
  457. [ 138.965927] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  458. [ 138.965929] libceph: off 32768 / su 1073741824 = bl 0
  459. [ 138.965930] libceph: objset 0 * sc 1 = ono 0
  460. [ 138.965932] libceph: obj extent 32768~286720
  461. [ 138.965933] libceph: calc_layout bno=0 32768~286720 (70 pages)
  462. [ 138.965935] libceph: __register_request ffff880804ffba00 tid 1019
  463. [ 138.965937] libceph: map_request ffff880804ffba00 tid 1019
  464. [ 138.965939] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  465. [ 138.965942] libceph: map_request tid 1019 pgid 2.8318 osd2 (was osd-1)
  466. [ 138.965944] libceph: __remove_osd_from_lru ffff880403886000
  467. [ 138.965945] libceph: send_request ffff880804ffba00 tid 1019 to osd2 flags 36
  468. [ 138.965948] libceph: ----- ffff880804763400 to osd2 42=osd_op len 127+0+286720 -----
  469. [ 138.965950] rbd: fetched request
  470. [ 138.965952] rbd: write 0x1000 bytes at 0x2406000
  471. [ 138.965953] rbd: rq->bio->bi_vcnt=1
  472. [ 138.965957] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=4096 len=24576
  473. [ 138.965960] libceph: mapping 24576~4096 osize 1073741824 fl_su 1073741824
  474. [ 138.965962] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  475. [ 138.965964] libceph: off 24576 / su 1073741824 = bl 0
  476. [ 138.965966] libceph: objset 0 * sc 1 = ono 0
  477. [ 138.965967] libceph: obj extent 24576~4096
  478. [ 138.965969] libceph: calc_layout bno=0 24576~4096 (1 pages)
  479. [ 138.965970] libceph: __register_request ffff880804ffbc00 tid 1020
  480. [ 138.965972] libceph: map_request ffff880804ffbc00 tid 1020
  481. [ 138.965974] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  482. [ 138.965977] libceph: map_request tid 1020 pgid 2.8318 osd2 (was osd-1)
  483. [ 138.965978] libceph: __remove_osd_from_lru ffff880403886000
  484. [ 138.965980] libceph: send_request ffff880804ffbc00 tid 1020 to osd2 flags 36
  485. [ 138.965982] libceph: ----- ffff880804763600 to osd2 42=osd_op len 127+0+4096 -----
  486. [ 138.965985] rbd: fetched request
  487. [ 138.965986] rbd: write 0x1000 bytes at 0x2403000
  488. [ 138.965988] rbd: rq->bio->bi_vcnt=1
  489. [ 138.965991] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=4096 len=12288
  490. [ 138.965997] libceph: mapping 12288~4096 osize 1073741824 fl_su 1073741824
  491. [ 138.965999] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  492. [ 138.966001] libceph: off 12288 / su 1073741824 = bl 0
  493. [ 138.966002] libceph: objset 0 * sc 1 = ono 0
  494. [ 138.966004] libceph: obj extent 12288~4096
  495. [ 138.966005] libceph: calc_layout bno=0 12288~4096 (1 pages)
  496. [ 138.966007] libceph: __register_request ffff880804ff8800 tid 1021
  497. [ 138.966009] libceph: map_request ffff880804ff8800 tid 1021
  498. [ 138.966010] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  499. [ 138.966013] libceph: map_request tid 1021 pgid 2.8318 osd2 (was osd-1)
  500. [ 138.966015] libceph: __remove_osd_from_lru ffff880403886000
  501. [ 138.966017] libceph: send_request ffff880804ff8800 tid 1021 to osd2 flags 36
  502. [ 138.966019] libceph: ----- ffff880804763a00 to osd2 42=osd_op len 127+0+4096 -----
  503. [ 138.966021] rbd: fetched request
  504. [ 138.966023] rbd: write 0x1000 bytes at 0x2401000
  505. [ 138.966024] rbd: rq->bio->bi_vcnt=1
  506. [ 138.966027] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=4096 len=4096
  507. [ 138.966032] libceph: mapping 4096~4096 osize 1073741824 fl_su 1073741824
  508. [ 138.966033] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  509. [ 138.966035] libceph: off 4096 / su 1073741824 = bl 0
  510. [ 138.966037] libceph: objset 0 * sc 1 = ono 0
  511. [ 138.966038] libceph: obj extent 4096~4096
  512. [ 138.966040] libceph: calc_layout bno=0 4096~4096 (1 pages)
  513. [ 138.966041] libceph: __register_request ffff880804ff9400 tid 1022
  514. [ 138.966043] libceph: map_request ffff880804ff9400 tid 1022
  515. [ 138.966045] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  516. [ 138.966048] libceph: map_request tid 1022 pgid 2.8318 osd2 (was osd-1)
  517. [ 138.966049] libceph: __remove_osd_from_lru ffff880403886000
  518. [ 138.966051] libceph: send_request ffff880804ff9400 tid 1022 to osd2 flags 36
  519. [ 138.966053] libceph: ----- ffff880804762500 to osd2 42=osd_op len 127+0+4096 -----
  520. [ 138.966056] rbd: fetched request
  521. [ 138.966057] rbd: write 0x1000 bytes at 0x42401000
  522. [ 138.966059] rbd: rq->bio->bi_vcnt=1
  523. [ 138.966062] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=4096 len=4096
  524. [ 138.966066] libceph: mapping 4096~4096 osize 1073741824 fl_su 1073741824
  525. [ 138.966068] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  526. [ 138.966069] libceph: off 4096 / su 1073741824 = bl 0
  527. [ 138.966071] libceph: objset 0 * sc 1 = ono 0
  528. [ 138.966072] libceph: obj extent 4096~4096
  529. [ 138.966074] libceph: calc_layout bno=0 4096~4096 (1 pages)
  530. [ 138.966076] libceph: __register_request ffff880804ff8c00 tid 1023
  531. [ 138.966077] libceph: map_request ffff880804ff8c00 tid 1023
  532. [ 138.966079] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  533. [ 138.966082] libceph: map_request tid 1023 pgid 2.77dc osd0 (was osd-1)
  534. [ 138.966083] libceph: __remove_osd_from_lru ffff880804105000
  535. [ 138.966085] libceph: send_request ffff880804ff8c00 tid 1023 to osd0 flags 36
  536. [ 138.966088] libceph: ----- ffff880804762300 to osd0 42=osd_op len 127+0+4096 -----
  537. [ 138.966090] rbd: fetched request
  538. [ 138.966092] rbd: write 0x1000 bytes at 0x42403000
  539. [ 138.966093] rbd: rq->bio->bi_vcnt=1
  540. [ 138.966097] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=4096 len=12288
  541. [ 138.966101] libceph: mapping 12288~4096 osize 1073741824 fl_su 1073741824
  542. [ 138.966102] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  543. [ 138.966104] libceph: off 12288 / su 1073741824 = bl 0
  544. [ 138.966106] libceph: objset 0 * sc 1 = ono 0
  545. [ 138.966107] libceph: obj extent 12288~4096
  546. [ 138.966109] libceph: calc_layout bno=0 12288~4096 (1 pages)
  547. [ 138.966110] libceph: __register_request ffff880804ffb200 tid 1024
  548. [ 138.966112] libceph: map_request ffff880804ffb200 tid 1024
  549. [ 138.966114] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  550. [ 138.966117] libceph: map_request tid 1024 pgid 2.77dc osd0 (was osd-1)
  551. [ 138.966118] libceph: __remove_osd_from_lru ffff880804105000
  552. [ 138.966120] libceph: send_request ffff880804ffb200 tid 1024 to osd0 flags 36
  553. [ 138.966123] libceph: ----- ffff880804762100 to osd0 42=osd_op len 127+0+4096 -----
  554. [ 138.966125] rbd: fetched request
  555. [ 138.966126] rbd: write 0x1000 bytes at 0x42406000
  556. [ 138.966128] rbd: rq->bio->bi_vcnt=1
  557. [ 138.966131] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=4096 len=24576
  558. [ 138.966134] libceph: mapping 24576~4096 osize 1073741824 fl_su 1073741824
  559. [ 138.966136] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  560. [ 138.966138] libceph: off 24576 / su 1073741824 = bl 0
  561. [ 138.966140] libceph: objset 0 * sc 1 = ono 0
  562. [ 138.966141] libceph: obj extent 24576~4096
  563. [ 138.966143] libceph: calc_layout bno=0 24576~4096 (1 pages)
  564. [ 138.966144] libceph: __register_request ffff880804ffa000 tid 1025
  565. [ 138.966146] libceph: map_request ffff880804ffa000 tid 1025
  566. [ 138.966148] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  567. [ 138.966151] libceph: map_request tid 1025 pgid 2.77dc osd0 (was osd-1)
  568. [ 138.966152] libceph: __remove_osd_from_lru ffff880804105000
  569. [ 138.966154] libceph: send_request ffff880804ffa000 tid 1025 to osd0 flags 36
  570. [ 138.966156] libceph: ----- ffff880804762600 to osd0 42=osd_op len 127+0+4096 -----
  571. [ 138.966159] rbd: fetched request
  572. [ 138.966160] rbd: write 0x46000 bytes at 0x42408000
  573. [ 138.966161] rbd: rq->bio->bi_vcnt=1
  574. [ 138.966252] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=286720 len=32768
  575. [ 138.966256] libceph: mapping 32768~286720 osize 1073741824 fl_su 1073741824
  576. [ 138.966258] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  577. [ 138.966260] libceph: off 32768 / su 1073741824 = bl 0
  578. [ 138.966262] libceph: objset 0 * sc 1 = ono 0
  579. [ 138.966263] libceph: obj extent 32768~286720
  580. [ 138.966265] libceph: calc_layout bno=0 32768~286720 (70 pages)
  581. [ 138.966266] libceph: __register_request ffff880804ffa800 tid 1026
  582. [ 138.966268] libceph: map_request ffff880804ffa800 tid 1026
  583. [ 138.966270] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  584. [ 138.966273] libceph: map_request tid 1026 pgid 2.77dc osd0 (was osd-1)
  585. [ 138.966274] libceph: __remove_osd_from_lru ffff880804105000
  586. [ 138.966276] libceph: send_request ffff880804ffa800 tid 1026 to osd0 flags 36
  587. [ 138.966279] libceph: ----- ffff880804762700 to osd0 42=osd_op len 127+0+286720 -----
  588. [ 138.966281] rbd: fetched request
  589. [ 138.966283] rbd: write 0x8000 bytes at 0x4244f000
  590. [ 138.966284] rbd: rq->bio->bi_vcnt=1
  591. [ 138.966296] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=32768 len=323584
  592. [ 138.966300] libceph: mapping 323584~32768 osize 1073741824 fl_su 1073741824
  593. [ 138.966302] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  594. [ 138.966304] libceph: off 323584 / su 1073741824 = bl 0
  595. [ 138.966306] libceph: objset 0 * sc 1 = ono 0
  596. [ 138.966307] libceph: obj extent 323584~32768
  597. [ 138.966309] libceph: calc_layout bno=0 323584~32768 (8 pages)
  598. [ 138.966311] libceph: __register_request ffff880804ffb400 tid 1027
  599. [ 138.966312] libceph: map_request ffff880804ffb400 tid 1027
  600. [ 138.966314] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  601. [ 138.966317] libceph: map_request tid 1027 pgid 2.77dc osd0 (was osd-1)
  602. [ 138.966318] libceph: __remove_osd_from_lru ffff880804105000
  603. [ 138.966320] libceph: send_request ffff880804ffb400 tid 1027 to osd0 flags 36
  604. [ 138.966323] libceph: ----- ffff880404755000 to osd0 42=osd_op len 127+0+32768 -----
  605. [ 138.966325] rbd: fetched request
  606. [ 138.966326] rbd: write 0x2000 bytes at 0x42458000
  607. [ 138.966328] rbd: rq->bio->bi_vcnt=1
  608. [ 138.966332] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=8192 len=360448
  609. [ 138.966337] libceph: mapping 360448~8192 osize 1073741824 fl_su 1073741824
  610. [ 138.966339] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  611. [ 138.966340] libceph: off 360448 / su 1073741824 = bl 0
  612. [ 138.966342] libceph: objset 0 * sc 1 = ono 0
  613. [ 138.966343] libceph: obj extent 360448~8192
  614. [ 138.966345] libceph: calc_layout bno=0 360448~8192 (2 pages)
  615. [ 138.966347] libceph: __register_request ffff88040408f600 tid 1028
  616. [ 138.966348] libceph: map_request ffff88040408f600 tid 1028
  617. [ 138.966350] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  618. [ 138.966353] libceph: map_request tid 1028 pgid 2.77dc osd0 (was osd-1)
  619. [ 138.966355] libceph: __remove_osd_from_lru ffff880804105000
  620. [ 138.966356] libceph: send_request ffff88040408f600 tid 1028 to osd0 flags 36
  621. [ 138.966359] libceph: ----- ffff880803ad0c00 to osd0 42=osd_op len 127+0+8192 -----
  622. [ 138.966361] rbd: fetched request
  623. [ 138.966362] rbd: write 0x9000 bytes at 0x4245b000
  624. [ 138.966364] rbd: rq->bio->bi_vcnt=1
  625. [ 138.966377] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=36864 len=372736
  626. [ 138.966380] libceph: mapping 372736~36864 osize 1073741824 fl_su 1073741824
  627. [ 138.966382] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  628. [ 138.966384] libceph: off 372736 / su 1073741824 = bl 0
  629. [ 138.966386] libceph: objset 0 * sc 1 = ono 0
  630. [ 138.966387] libceph: obj extent 372736~36864
  631. [ 138.966389] libceph: calc_layout bno=0 372736~36864 (9 pages)
  632. [ 138.966390] libceph: __register_request ffff88040408f800 tid 1029
  633. [ 138.966392] libceph: map_request ffff88040408f800 tid 1029
  634. [ 138.966394] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  635. [ 138.966397] libceph: map_request tid 1029 pgid 2.77dc osd0 (was osd-1)
  636. [ 138.966398] libceph: __remove_osd_from_lru ffff880804105000
  637. [ 138.966400] libceph: send_request ffff88040408f800 tid 1029 to osd0 flags 36
  638. [ 138.966403] libceph: ----- ffff880803ad0e00 to osd0 42=osd_op len 127+0+36864 -----
  639. [ 138.966405] rbd: fetched request
  640. [ 138.966406] rbd: write 0x1000 bytes at 0x42466000
  641. [ 138.966408] rbd: rq->bio->bi_vcnt=1
  642. [ 138.966412] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=4096 len=417792
  643. [ 138.966416] libceph: mapping 417792~4096 osize 1073741824 fl_su 1073741824
  644. [ 138.966418] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  645. [ 138.966420] libceph: off 417792 / su 1073741824 = bl 0
  646. [ 138.966421] libceph: objset 0 * sc 1 = ono 0
  647. [ 138.966423] libceph: obj extent 417792~4096
  648. [ 138.966424] libceph: calc_layout bno=0 417792~4096 (1 pages)
  649. [ 138.966426] libceph: __register_request ffff88040408f400 tid 1030
  650. [ 138.966428] libceph: map_request ffff88040408f400 tid 1030
  651. [ 138.966430] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  652. [ 138.966432] libceph: map_request tid 1030 pgid 2.77dc osd0 (was osd-1)
  653. [ 138.966434] libceph: __remove_osd_from_lru ffff880804105000
  654. [ 138.966436] libceph: send_request ffff88040408f400 tid 1030 to osd0 flags 36
  655. [ 138.966438] libceph: ----- ffff880803ad1100 to osd0 42=osd_op len 127+0+4096 -----
  656. [ 138.966500] rbd: fetched request
  657. [ 138.966502] rbd: write 0x2d000 bytes at 0x42467000
  658. [ 138.966503] rbd: rq->bio->bi_vcnt=1
  659. [ 138.966558] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=184320 len=421888
  660. [ 138.966562] libceph: mapping 421888~184320 osize 1073741824 fl_su 1073741824
  661. [ 138.966564] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  662. [ 138.966566] libceph: off 421888 / su 1073741824 = bl 0
  663. [ 138.966567] libceph: objset 0 * sc 1 = ono 0
  664. [ 138.966569] libceph: obj extent 421888~184320
  665. [ 138.966570] libceph: calc_layout bno=0 421888~184320 (45 pages)
  666. [ 138.966572] libceph: __register_request ffff8804042e0a00 tid 1031
  667. [ 138.966574] libceph: map_request ffff8804042e0a00 tid 1031
  668. [ 138.966576] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  669. [ 138.966579] libceph: map_request tid 1031 pgid 2.77dc osd0 (was osd-1)
  670. [ 138.966580] libceph: __remove_osd_from_lru ffff880804105000
  671. [ 138.966582] libceph: send_request ffff8804042e0a00 tid 1031 to osd0 flags 36
  672. [ 138.966585] libceph: ----- ffff880803ad0400 to osd0 42=osd_op len 127+0+184320 -----
  673. [ 138.966587] rbd: fetched request
  674. [ 138.966589] rbd: write 0x1000 bytes at 0x42495000
  675. [ 138.966590] rbd: rq->bio->bi_vcnt=1
  676. [ 138.966593] rbd: rbd_do_request obj=rb.0.3.000000000109 ofs=4096 len=610304
  677. [ 138.966597] libceph: mapping 610304~4096 osize 1073741824 fl_su 1073741824
  678. [ 138.966599] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  679. [ 138.966601] libceph: off 610304 / su 1073741824 = bl 0
  680. [ 138.966602] libceph: objset 0 * sc 1 = ono 0
  681. [ 138.966604] libceph: obj extent 610304~4096
  682. [ 138.966605] libceph: calc_layout bno=0 610304~4096 (1 pages)
  683. [ 138.966607] libceph: __register_request ffff8804042e1000 tid 1032
  684. [ 138.966609] libceph: map_request ffff8804042e1000 tid 1032
  685. [ 138.966610] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  686. [ 138.966613] libceph: map_request tid 1032 pgid 2.77dc osd0 (was osd-1)
  687. [ 138.966615] libceph: __remove_osd_from_lru ffff880804105000
  688. [ 138.966617] libceph: send_request ffff8804042e1000 tid 1032 to osd0 flags 36
  689. [ 138.966619] libceph: ----- ffff880803ad0200 to osd0 42=osd_op len 127+0+4096 -----
  690. [ 138.966621] rbd: fetched request
  691. [ 138.966623] rbd: write 0x2d000 bytes at 0x2467000
  692. [ 138.966624] rbd: rq->bio->bi_vcnt=1
  693. [ 138.966681] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=184320 len=421888
  694. [ 138.966685] libceph: mapping 421888~184320 osize 1073741824 fl_su 1073741824
  695. [ 138.966687] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  696. [ 138.966689] libceph: off 421888 / su 1073741824 = bl 0
  697. [ 138.966690] libceph: objset 0 * sc 1 = ono 0
  698. [ 138.966692] libceph: obj extent 421888~184320
  699. [ 138.966694] libceph: calc_layout bno=0 421888~184320 (45 pages)
  700. [ 138.966695] libceph: __register_request ffff880403840e00 tid 1033
  701. [ 138.966697] libceph: map_request ffff880403840e00 tid 1033
  702. [ 138.966699] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  703. [ 138.966702] libceph: map_request tid 1033 pgid 2.8318 osd2 (was osd-1)
  704. [ 138.966704] libceph: __remove_osd_from_lru ffff880403886000
  705. [ 138.966705] libceph: send_request ffff880403840e00 tid 1033 to osd2 flags 36
  706. [ 138.966708] libceph: ----- ffff880803ad0000 to osd2 42=osd_op len 127+0+184320 -----
  707. [ 138.966710] rbd: fetched request
  708. [ 138.966712] rbd: write 0x1000 bytes at 0x2495000
  709. [ 138.966713] rbd: rq->bio->bi_vcnt=1
  710. [ 138.966716] rbd: rbd_do_request obj=rb.0.3.000000000009 ofs=4096 len=610304
  711. [ 138.966720] libceph: mapping 610304~4096 osize 1073741824 fl_su 1073741824
  712. [ 138.966721] libceph: osize 1073741824 / su 1073741824 = su_per_object 1
  713. [ 138.966723] libceph: off 610304 / su 1073741824 = bl 0
  714. [ 138.966725] libceph: objset 0 * sc 1 = ono 0
  715. [ 138.966726] libceph: obj extent 610304~4096
  716. [ 138.966728] libceph: calc_layout bno=0 610304~4096 (1 pages)
  717. [ 138.966729] libceph: __register_request ffff880403841400 tid 1034
  718. [ 138.966731] libceph: map_request ffff880403841400 tid 1034
  719. [ 138.966733] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  720. [ 138.966736] libceph: map_request tid 1034 pgid 2.8318 osd2 (was osd-1)
  721. [ 138.966737] libceph: __remove_osd_from_lru ffff880403886000
  722. [ 138.966739] libceph: send_request ffff880403841400 tid 1034 to osd2 flags 36
  723. [ 138.966742] libceph: ----- ffff880803ad1800 to osd2 42=osd_op len 127+0+4096 -----
  724. [ 144.009650] Clocksource tsc unstable (delta = 4686968746 ns)
  725. [ 144.009722] libceph: timeout
  726. [ 144.009729] libceph: request_next_osdmap have 26
  727. [ 144.009734] libceph: tid 1012 is slow, will send keepalive on osd0
  728. [ 144.009739] libceph: tid 1013 is slow, will send keepalive on osd0
  729. [ 144.009744] libceph: tid 1015 is slow, will send keepalive on osd2
  730. [ 144.009749] libceph: tid 1016 is slow, will send keepalive on osd2
  731. [ 144.009753] libceph: tid 1017 is slow, will send keepalive on osd2
  732. [ 144.009758] libceph: tid 1018 is slow, will send keepalive on osd2
  733. [ 144.009762] libceph: tid 1019 is slow, will send keepalive on osd2
  734. [ 144.009766] libceph: tid 1020 is slow, will send keepalive on osd2
  735. [ 144.009771] libceph: tid 1021 is slow, will send keepalive on osd2
  736. [ 144.009775] libceph: tid 1022 is slow, will send keepalive on osd2
  737. [ 144.009779] libceph: tid 1023 is slow, will send keepalive on osd0
  738. [ 144.009783] libceph: tid 1024 is slow, will send keepalive on osd0
  739. [ 144.009787] libceph: tid 1025 is slow, will send keepalive on osd0
  740. [ 144.009792] libceph: tid 1026 is slow, will send keepalive on osd0
  741. [ 144.009796] libceph: tid 1027 is slow, will send keepalive on osd0
  742. [ 144.009800] libceph: tid 1028 is slow, will send keepalive on osd0
  743. [ 144.009804] libceph: tid 1029 is slow, will send keepalive on osd0
  744. [ 144.009809] libceph: tid 1030 is slow, will send keepalive on osd0
  745. [ 144.009813] libceph: tid 1031 is slow, will send keepalive on osd0
  746. [ 144.009817] libceph: tid 1032 is slow, will send keepalive on osd0
  747. [ 144.009822] libceph: tid 1033 is slow, will send keepalive on osd2
  748. [ 144.009826] libceph: tid 1034 is slow, will send keepalive on osd2
  749. [ 144.009831] libceph: send_queued
  750. [ 144.010387] libceph: put_osd ffff880403886000 3 -> 2
  751. [ 144.010714] libceph: get_osd ffff880403886000 2 -> 3
  752. [ 144.010719] libceph: put_osd ffff880403886000 3 -> 2
  753. [ 144.010850] libceph: get_osd ffff880403886000 2 -> 3
  754. [ 144.010852] libceph: put_osd ffff880403886000 3 -> 2
  755. [ 144.012580] libceph: ===== ffff8804044d5700 297 from osd2 41=osd_map len 869+0 (4006665912 0 0) =====
  756. [ 144.012583] libceph: handle_map have 26
  757. [ 144.012584] libceph: 3 inc maps
  758. [ 144.012586] libceph: applying incremental map 27 len 117
  759. [ 144.012592] libceph: 0 pool names
  760. [ 144.012595] libceph: osd0 down
  761. [ 144.012599] libceph: kick_requests
  762. [ 144.012603] libceph: map_request ffff88040422ca00 tid 1012
  763. [ 144.012608] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  764. [ 144.012617] libceph: map_request tid 1012 pgid 2.7661 osd2 (was osd0)
  765. [ 144.012622] libceph: __remove_osd_from_lru ffff880403886000
  766. [ 144.012627] libceph: ffff88040422ca00 tid 1012 requeued on osd2
  767. [ 144.012633] libceph: map_request ffff88040422dc00 tid 1013
  768. [ 144.012638] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  769. [ 144.012645] libceph: map_request tid 1013 pgid 2.7661 osd2 (was osd0)
  770. [ 144.012650] libceph: __remove_osd_from_lru ffff880403886000
  771. [ 144.012655] libceph: ffff88040422dc00 tid 1013 requeued on osd2
  772. [ 144.012660] libceph: map_request ffff880804ffae00 tid 1015
  773. [ 144.012666] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  774. [ 144.012673] libceph: map_request tid 1015 pgid 2.8318 osd2 (was osd2)
  775. [ 144.012678] libceph: __remove_osd_from_lru ffff880403886000
  776. [ 144.012683] libceph: ffff880804ffae00 tid 1015 requeued on osd2
  777. [ 144.012688] libceph: map_request ffff880804ff9e00 tid 1016
  778. [ 144.012693] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  779. [ 144.012700] libceph: map_request tid 1016 pgid 2.8318 osd2 (was osd2)
  780. [ 144.012706] libceph: __remove_osd_from_lru ffff880403886000
  781. [ 144.012720] libceph: ffff880804ff9e00 tid 1016 requeued on osd2
  782. [ 144.012725] libceph: map_request ffff880804ffa200 tid 1017
  783. [ 144.012730] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  784. [ 144.012737] libceph: map_request tid 1017 pgid 2.8318 osd2 (was osd2)
  785. [ 144.012741] libceph: __remove_osd_from_lru ffff880403886000
  786. [ 144.012747] libceph: ffff880804ffa200 tid 1017 requeued on osd2
  787. [ 144.012752] libceph: map_request ffff880804ff8a00 tid 1018
  788. [ 144.012757] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  789. [ 144.012763] libceph: map_request tid 1018 pgid 2.8318 osd2 (was osd2)
  790. [ 144.012768] libceph: __remove_osd_from_lru ffff880403886000
  791. [ 144.012773] libceph: ffff880804ff8a00 tid 1018 requeued on osd2
  792. [ 144.012778] libceph: map_request ffff880804ffba00 tid 1019
  793. [ 144.012783] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  794. [ 144.012790] libceph: map_request tid 1019 pgid 2.8318 osd2 (was osd2)
  795. [ 144.012795] libceph: __remove_osd_from_lru ffff880403886000
  796. [ 144.012800] libceph: ffff880804ffba00 tid 1019 requeued on osd2
  797. [ 144.012805] libceph: map_request ffff880804ffbc00 tid 1020
  798. [ 144.012810] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  799. [ 144.012817] libceph: map_request tid 1020 pgid 2.8318 osd2 (was osd2)
  800. [ 144.012822] libceph: __remove_osd_from_lru ffff880403886000
  801. [ 144.012827] libceph: ffff880804ffbc00 tid 1020 requeued on osd2
  802. [ 144.012832] libceph: map_request ffff880804ff8800 tid 1021
  803. [ 144.012837] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  804. [ 144.012845] libceph: map_request tid 1021 pgid 2.8318 osd2 (was osd2)
  805. [ 144.012850] libceph: __remove_osd_from_lru ffff880403886000
  806. [ 144.012860] libceph: ffff880804ff8800 tid 1021 requeued on osd2
  807. [ 144.012865] libceph: map_request ffff880804ff9400 tid 1022
  808. [ 144.012870] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  809. [ 144.012877] libceph: map_request tid 1022 pgid 2.8318 osd2 (was osd2)
  810. [ 144.012882] libceph: __remove_osd_from_lru ffff880403886000
  811. [ 144.012887] libceph: ffff880804ff9400 tid 1022 requeued on osd2
  812. [ 144.012892] libceph: map_request ffff880804ff8c00 tid 1023
  813. [ 144.012897] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  814. [ 144.012903] libceph: map_request tid 1023 pgid 2.77dc osd1 (was osd0)
  815. [ 144.012908] libceph: __remove_osd_from_lru ffff880804deb000
  816. [ 144.012913] libceph: ffff880804ff8c00 tid 1023 requeued on osd1
  817. [ 144.012918] libceph: map_request ffff880804ffb200 tid 1024
  818. [ 144.012923] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  819. [ 144.012930] libceph: map_request tid 1024 pgid 2.77dc osd1 (was osd0)
  820. [ 144.012935] libceph: __remove_osd_from_lru ffff880804deb000
  821. [ 144.012940] libceph: ffff880804ffb200 tid 1024 requeued on osd1
  822. [ 144.012945] libceph: map_request ffff880804ffa000 tid 1025
  823. [ 144.012950] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  824. [ 144.012956] libceph: map_request tid 1025 pgid 2.77dc osd1 (was osd0)
  825. [ 144.012961] libceph: __remove_osd_from_lru ffff880804deb000
  826. [ 144.012966] libceph: ffff880804ffa000 tid 1025 requeued on osd1
  827. [ 144.012971] libceph: map_request ffff880804ffa800 tid 1026
  828. [ 144.012976] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  829. [ 144.012982] libceph: map_request tid 1026 pgid 2.77dc osd1 (was osd0)
  830. [ 144.012988] libceph: __remove_osd_from_lru ffff880804deb000
  831. [ 144.012993] libceph: ffff880804ffa800 tid 1026 requeued on osd1
  832. [ 144.013000] libceph: map_request ffff880804ffb400 tid 1027
  833. [ 144.013005] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  834. [ 144.013011] libceph: map_request tid 1027 pgid 2.77dc osd1 (was osd0)
  835. [ 144.013016] libceph: __remove_osd_from_lru ffff880804deb000
  836. [ 144.013022] libceph: ffff880804ffb400 tid 1027 requeued on osd1
  837. [ 144.013027] libceph: map_request ffff88040408f600 tid 1028
  838. [ 144.013032] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  839. [ 144.013038] libceph: map_request tid 1028 pgid 2.77dc osd1 (was osd0)
  840. [ 144.013043] libceph: __remove_osd_from_lru ffff880804deb000
  841. [ 144.013048] libceph: ffff88040408f600 tid 1028 requeued on osd1
  842. [ 144.013053] libceph: map_request ffff88040408f800 tid 1029
  843. [ 144.013058] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  844. [ 144.013064] libceph: map_request tid 1029 pgid 2.77dc osd1 (was osd0)
  845. [ 144.013069] libceph: __remove_osd_from_lru ffff880804deb000
  846. [ 144.013074] libceph: ffff88040408f800 tid 1029 requeued on osd1
  847. [ 144.013078] libceph: map_request ffff88040408f400 tid 1030
  848. [ 144.013083] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  849. [ 144.013090] libceph: map_request tid 1030 pgid 2.77dc osd1 (was osd0)
  850. [ 144.013095] libceph: __remove_osd_from_lru ffff880804deb000
  851. [ 144.013100] libceph: ffff88040408f400 tid 1030 requeued on osd1
  852. [ 144.013105] libceph: map_request ffff8804042e0a00 tid 1031
  853. [ 144.013110] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  854. [ 144.013116] libceph: map_request tid 1031 pgid 2.77dc osd1 (was osd0)
  855. [ 144.013121] libceph: __remove_osd_from_lru ffff880804deb000
  856. [ 144.013126] libceph: ffff8804042e0a00 tid 1031 requeued on osd1
  857. [ 144.013131] libceph: map_request ffff8804042e1000 tid 1032
  858. [ 144.013136] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  859. [ 144.013151] libceph: map_request tid 1032 pgid 2.77dc osd1 (was osd0)
  860. [ 144.013157] libceph: __remove_osd_from_lru ffff880804deb000
  861. [ 144.013162] libceph: ffff8804042e1000 tid 1032 requeued on osd1
  862. [ 144.013167] libceph: map_request ffff880403840e00 tid 1033
  863. [ 144.013172] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  864. [ 144.013178] libceph: map_request tid 1033 pgid 2.8318 osd2 (was osd2)
  865. [ 144.013183] libceph: __remove_osd_from_lru ffff880403886000
  866. [ 144.013189] libceph: ffff880403840e00 tid 1033 requeued on osd2
  867. [ 144.013194] libceph: map_request ffff880403841400 tid 1034
  868. [ 144.013199] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  869. [ 144.013205] libceph: map_request tid 1034 pgid 2.8318 osd2 (was osd2)
  870. [ 144.013211] libceph: __remove_osd_from_lru ffff880403886000
  871. [ 144.013216] libceph: ffff880403841400 tid 1034 requeued on osd2
  872. [ 144.013220] libceph: linger req=ffff8804041c4400 req->r_osd=ffff880804deb000
  873. [ 144.013226] libceph: map_request ffff8804041c4400 tid 8
  874. [ 144.013230] libceph: calc_object_layout 'test.rbd' pgid 2.a2fa4514
  875. [ 144.013236] libceph: map_request tid 8 pgid 2.4514 osd1 (was osd1)
  876. [ 144.013241] libceph: __remove_osd_from_lru ffff880804deb000
  877. [ 144.013246] libceph: kicking lingering ffff8804041c4400 tid 8 osd1
  878. [ 144.013251] libceph: __unregister_linger_request ffff8804041c4400
  879. [ 144.013256] libceph: __register_request ffff8804041c4400 tid 1035
  880. [ 144.013262] libceph: __reset_osd ffff880804105000 osd0
  881. [ 144.013266] libceph: __remove_osd ffff880804105000
  882. [ 144.013271] libceph: get_osd ffff880804105000 2 -> 3
  883. [ 144.013276] libceph: put_osd ffff880804105000 3 -> 2
  884. [ 144.013281] libceph: applying incremental map 28 len 568
  885. [ 144.013287] libceph: 0 pool names
  886. [ 144.013290] libceph: osd0 up
  887. [ 144.013293] libceph: osd0 weight 0x10000 (in)
  888. [ 144.013298] libceph: kick_requests
  889. [ 144.013302] libceph: map_request ffff88040422ca00 tid 1012
  890. [ 144.013307] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  891. [ 144.013314] libceph: map_request tid 1012 pgid 2.7661 osd0 (was osd2)
  892. [ 144.013320] libceph: map_request osd ffff88040436c800 is osd0
  893. [ 144.013325] libceph: __insert_osd ffff88040436c800 osd0
  894. [ 144.013330] libceph: get_osd ffff88040436c800 1 -> 2
  895. [ 144.013335] libceph: __remove_osd_from_lru ffff88040436c800
  896. [ 144.013340] libceph: ffff88040422ca00 tid 1012 requeued on osd0
  897. [ 144.013345] libceph: map_request ffff88040422dc00 tid 1013
  898. [ 144.013350] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  899. [ 144.013357] libceph: map_request tid 1013 pgid 2.7661 osd0 (was osd2)
  900. [ 144.013362] libceph: __remove_osd_from_lru ffff88040436c800
  901. [ 144.013367] libceph: ffff88040422dc00 tid 1013 requeued on osd0
  902. [ 144.013372] libceph: map_request ffff880804ffae00 tid 1015
  903. [ 144.013377] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  904. [ 144.013383] libceph: map_request tid 1015 pgid 2.8318 osd2 (was osd2)
  905. [ 144.013389] libceph: __remove_osd_from_lru ffff880403886000
  906. [ 144.013394] libceph: ffff880804ffae00 tid 1015 requeued on osd2
  907. [ 144.013399] libceph: map_request ffff880804ff9e00 tid 1016
  908. [ 144.013404] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  909. [ 144.013410] libceph: map_request tid 1016 pgid 2.8318 osd2 (was osd2)
  910. [ 144.013415] libceph: __remove_osd_from_lru ffff880403886000
  911. [ 144.013420] libceph: ffff880804ff9e00 tid 1016 requeued on osd2
  912. [ 144.013425] libceph: map_request ffff880804ffa200 tid 1017
  913. [ 144.013431] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  914. [ 144.013437] libceph: map_request tid 1017 pgid 2.8318 osd2 (was osd2)
  915. [ 144.013443] libceph: __remove_osd_from_lru ffff880403886000
  916. [ 144.013448] libceph: ffff880804ffa200 tid 1017 requeued on osd2
  917. [ 144.013453] libceph: map_request ffff880804ff8a00 tid 1018
  918. [ 144.013458] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  919. [ 144.013465] libceph: map_request tid 1018 pgid 2.8318 osd2 (was osd2)
  920. [ 144.013470] libceph: __remove_osd_from_lru ffff880403886000
  921. [ 144.013475] libceph: ffff880804ff8a00 tid 1018 requeued on osd2
  922. [ 144.013480] libceph: map_request ffff880804ffba00 tid 1019
  923. [ 144.013485] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  924. [ 144.013491] libceph: map_request tid 1019 pgid 2.8318 osd2 (was osd2)
  925. [ 144.013496] libceph: __remove_osd_from_lru ffff880403886000
  926. [ 144.013501] libceph: ffff880804ffba00 tid 1019 requeued on osd2
  927. [ 144.013506] libceph: map_request ffff880804ffbc00 tid 1020
  928. [ 144.013512] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  929. [ 144.013518] libceph: map_request tid 1020 pgid 2.8318 osd2 (was osd2)
  930. [ 144.013523] libceph: __remove_osd_from_lru ffff880403886000
  931. [ 144.013528] libceph: ffff880804ffbc00 tid 1020 requeued on osd2
  932. [ 144.013533] libceph: map_request ffff880804ff8800 tid 1021
  933. [ 144.013538] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  934. [ 144.013544] libceph: map_request tid 1021 pgid 2.8318 osd2 (was osd2)
  935. [ 144.013550] libceph: __remove_osd_from_lru ffff880403886000
  936. [ 144.013555] libceph: ffff880804ff8800 tid 1021 requeued on osd2
  937. [ 144.013560] libceph: map_request ffff880804ff9400 tid 1022
  938. [ 144.013565] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  939. [ 144.013581] libceph: map_request tid 1022 pgid 2.8318 osd2 (was osd2)
  940. [ 144.013586] libceph: __remove_osd_from_lru ffff880403886000
  941. [ 144.013591] libceph: ffff880804ff9400 tid 1022 requeued on osd2
  942. [ 144.013596] libceph: map_request ffff880804ff8c00 tid 1023
  943. [ 144.013602] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  944. [ 144.013608] libceph: map_request tid 1023 pgid 2.77dc osd0 (was osd1)
  945. [ 144.013613] libceph: __remove_osd_from_lru ffff88040436c800
  946. [ 144.013618] libceph: ffff880804ff8c00 tid 1023 requeued on osd0
  947. [ 144.013623] libceph: map_request ffff880804ffb200 tid 1024
  948. [ 144.013628] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  949. [ 144.013635] libceph: map_request tid 1024 pgid 2.77dc osd0 (was osd1)
  950. [ 144.013640] libceph: __remove_osd_from_lru ffff88040436c800
  951. [ 144.013646] libceph: ffff880804ffb200 tid 1024 requeued on osd0
  952. [ 144.013651] libceph: map_request ffff880804ffa000 tid 1025
  953. [ 144.013656] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  954. [ 144.013662] libceph: map_request tid 1025 pgid 2.77dc osd0 (was osd1)
  955. [ 144.013667] libceph: __remove_osd_from_lru ffff88040436c800
  956. [ 144.013673] libceph: ffff880804ffa000 tid 1025 requeued on osd0
  957. [ 144.013678] libceph: map_request ffff880804ffa800 tid 1026
  958. [ 144.013683] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  959. [ 144.013690] libceph: map_request tid 1026 pgid 2.77dc osd0 (was osd1)
  960. [ 144.013695] libceph: __remove_osd_from_lru ffff88040436c800
  961. [ 144.013700] libceph: ffff880804ffa800 tid 1026 requeued on osd0
  962. [ 144.013705] libceph: map_request ffff880804ffb400 tid 1027
  963. [ 144.013710] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  964. [ 144.013718] libceph: map_request tid 1027 pgid 2.77dc osd0 (was osd1)
  965. [ 144.013723] libceph: __remove_osd_from_lru ffff88040436c800
  966. [ 144.013728] libceph: ffff880804ffb400 tid 1027 requeued on osd0
  967. [ 144.013733] libceph: map_request ffff88040408f600 tid 1028
  968. [ 144.013738] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  969. [ 144.013744] libceph: map_request tid 1028 pgid 2.77dc osd0 (was osd1)
  970. [ 144.013749] libceph: __remove_osd_from_lru ffff88040436c800
  971. [ 144.013754] libceph: ffff88040408f600 tid 1028 requeued on osd0
  972. [ 144.013760] libceph: map_request ffff88040408f800 tid 1029
  973. [ 144.013765] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  974. [ 144.013772] libceph: map_request tid 1029 pgid 2.77dc osd0 (was osd1)
  975. [ 144.013777] libceph: __remove_osd_from_lru ffff88040436c800
  976. [ 144.013782] libceph: ffff88040408f800 tid 1029 requeued on osd0
  977. [ 144.013787] libceph: map_request ffff88040408f400 tid 1030
  978. [ 144.013792] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  979. [ 144.013798] libceph: map_request tid 1030 pgid 2.77dc osd0 (was osd1)
  980. [ 144.013803] libceph: __remove_osd_from_lru ffff88040436c800
  981. [ 144.013808] libceph: ffff88040408f400 tid 1030 requeued on osd0
  982. [ 144.013813] libceph: map_request ffff8804042e0a00 tid 1031
  983. [ 144.013818] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  984. [ 144.013825] libceph: map_request tid 1031 pgid 2.77dc osd0 (was osd1)
  985. [ 144.013830] libceph: __remove_osd_from_lru ffff88040436c800
  986. [ 144.013835] libceph: ffff8804042e0a00 tid 1031 requeued on osd0
  987. [ 144.013840] libceph: map_request ffff8804042e1000 tid 1032
  988. [ 144.013845] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  989. [ 144.013851] libceph: map_request tid 1032 pgid 2.77dc osd0 (was osd1)
  990. [ 144.013857] libceph: __remove_osd_from_lru ffff88040436c800
  991. [ 144.013862] libceph: ffff8804042e1000 tid 1032 requeued on osd0
  992. [ 144.013867] libceph: map_request ffff880403840e00 tid 1033
  993. [ 144.013872] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  994. [ 144.013879] libceph: map_request tid 1033 pgid 2.8318 osd2 (was osd2)
  995. [ 144.013884] libceph: __remove_osd_from_lru ffff880403886000
  996. [ 144.013889] libceph: ffff880403840e00 tid 1033 requeued on osd2
  997. [ 144.013894] libceph: map_request ffff880403841400 tid 1034
  998. [ 144.013899] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  999. [ 144.013905] libceph: map_request tid 1034 pgid 2.8318 osd2 (was osd2)
  1000. [ 144.013910] libceph: __remove_osd_from_lru ffff880403886000
  1001. [ 144.013915] libceph: ffff880403841400 tid 1034 requeued on osd2
  1002. [ 144.013921] libceph: map_request ffff8804041c4400 tid 1035
  1003. [ 144.013926] libceph: calc_object_layout 'test.rbd' pgid 2.a2fa4514
  1004. [ 144.013931] libceph: map_request tid 1035 pgid 2.4514 osd1 (was osd1)
  1005. [ 144.013937] libceph: __remove_osd_from_lru ffff880804deb000
  1006. [ 144.013942] libceph: ffff8804041c4400 tid 1035 requeued on osd1
  1007. [ 144.013947] libceph: applying incremental map 29 len 136
  1008. [ 144.013952] libceph: 0 pool names
  1009. [ 144.013955] libceph: kick_requests
  1010. [ 144.013959] libceph: map_request ffff88040422ca00 tid 1012
  1011. [ 144.013964] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  1012. [ 144.013971] libceph: map_request tid 1012 pgid 2.7661 osd0 (was osd0)
  1013. [ 144.013977] libceph: __remove_osd_from_lru ffff88040436c800
  1014. [ 144.013982] libceph: ffff88040422ca00 tid 1012 requeued on osd0
  1015. [ 144.013987] libceph: map_request ffff88040422dc00 tid 1013
  1016. [ 144.013992] libceph: calc_object_layout 'rb.0.3.000000000375' pgid 2.303d7661
  1017. [ 144.013998] libceph: map_request tid 1013 pgid 2.7661 osd0 (was osd0)
  1018. [ 144.014012] libceph: __remove_osd_from_lru ffff88040436c800
  1019. [ 144.014017] libceph: ffff88040422dc00 tid 1013 requeued on osd0
  1020. [ 144.014022] libceph: map_request ffff880804ffae00 tid 1015
  1021. [ 144.014027] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1022. [ 144.014034] libceph: map_request tid 1015 pgid 2.8318 osd2 (was osd2)
  1023. [ 144.014039] libceph: __remove_osd_from_lru ffff880403886000
  1024. [ 144.014044] libceph: ffff880804ffae00 tid 1015 requeued on osd2
  1025. [ 144.014049] libceph: map_request ffff880804ff9e00 tid 1016
  1026. [ 144.014054] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1027. [ 144.014060] libceph: map_request tid 1016 pgid 2.8318 osd2 (was osd2)
  1028. [ 144.014065] libceph: __remove_osd_from_lru ffff880403886000
  1029. [ 144.014071] libceph: ffff880804ff9e00 tid 1016 requeued on osd2
  1030. [ 144.014076] libceph: map_request ffff880804ffa200 tid 1017
  1031. [ 144.014081] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1032. [ 144.014088] libceph: map_request tid 1017 pgid 2.8318 osd2 (was osd2)
  1033. [ 144.014093] libceph: __remove_osd_from_lru ffff880403886000
  1034. [ 144.014098] libceph: ffff880804ffa200 tid 1017 requeued on osd2
  1035. [ 144.014103] libceph: map_request ffff880804ff8a00 tid 1018
  1036. [ 144.014108] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1037. [ 144.014114] libceph: map_request tid 1018 pgid 2.8318 osd2 (was osd2)
  1038. [ 144.014119] libceph: __remove_osd_from_lru ffff880403886000
  1039. [ 144.014124] libceph: ffff880804ff8a00 tid 1018 requeued on osd2
  1040. [ 144.014129] libceph: map_request ffff880804ffba00 tid 1019
  1041. [ 144.014134] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1042. [ 144.014140] libceph: map_request tid 1019 pgid 2.8318 osd2 (was osd2)
  1043. [ 144.014152] libceph: __remove_osd_from_lru ffff880403886000
  1044. [ 144.014157] libceph: ffff880804ffba00 tid 1019 requeued on osd2
  1045. [ 144.014162] libceph: map_request ffff880804ffbc00 tid 1020
  1046. [ 144.014167] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1047. [ 144.014173] libceph: map_request tid 1020 pgid 2.8318 osd2 (was osd2)
  1048. [ 144.014178] libceph: __remove_osd_from_lru ffff880403886000
  1049. [ 144.014183] libceph: ffff880804ffbc00 tid 1020 requeued on osd2
  1050. [ 144.014188] libceph: map_request ffff880804ff8800 tid 1021
  1051. [ 144.014193] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1052. [ 144.014199] libceph: map_request tid 1021 pgid 2.8318 osd2 (was osd2)
  1053. [ 144.014205] libceph: __remove_osd_from_lru ffff880403886000
  1054. [ 144.014210] libceph: ffff880804ff8800 tid 1021 requeued on osd2
  1055. [ 144.014215] libceph: map_request ffff880804ff9400 tid 1022
  1056. [ 144.014220] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1057. [ 144.014226] libceph: map_request tid 1022 pgid 2.8318 osd2 (was osd2)
  1058. [ 144.014231] libceph: __remove_osd_from_lru ffff880403886000
  1059. [ 144.014236] libceph: ffff880804ff9400 tid 1022 requeued on osd2
  1060. [ 144.014241] libceph: map_request ffff880804ff8c00 tid 1023
  1061. [ 144.014246] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1062. [ 144.014252] libceph: map_request tid 1023 pgid 2.77dc osd0 (was osd0)
  1063. [ 144.014258] libceph: __remove_osd_from_lru ffff88040436c800
  1064. [ 144.014264] libceph: ffff880804ff8c00 tid 1023 requeued on osd0
  1065. [ 144.014269] libceph: map_request ffff880804ffb200 tid 1024
  1066. [ 144.014274] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1067. [ 144.014280] libceph: map_request tid 1024 pgid 2.77dc osd0 (was osd0)
  1068. [ 144.014285] libceph: __remove_osd_from_lru ffff88040436c800
  1069. [ 144.014291] libceph: ffff880804ffb200 tid 1024 requeued on osd0
  1070. [ 144.014297] libceph: map_request ffff880804ffa000 tid 1025
  1071. [ 144.014302] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1072. [ 144.014308] libceph: map_request tid 1025 pgid 2.77dc osd0 (was osd0)
  1073. [ 144.014313] libceph: __remove_osd_from_lru ffff88040436c800
  1074. [ 144.014318] libceph: ffff880804ffa000 tid 1025 requeued on osd0
  1075. [ 144.014323] libceph: map_request ffff880804ffa800 tid 1026
  1076. [ 144.014328] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1077. [ 144.014334] libceph: map_request tid 1026 pgid 2.77dc osd0 (was osd0)
  1078. [ 144.014339] libceph: __remove_osd_from_lru ffff88040436c800
  1079. [ 144.014344] libceph: ffff880804ffa800 tid 1026 requeued on osd0
  1080. [ 144.014349] libceph: map_request ffff880804ffb400 tid 1027
  1081. [ 144.014354] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1082. [ 144.014360] libceph: map_request tid 1027 pgid 2.77dc osd0 (was osd0)
  1083. [ 144.014365] libceph: __remove_osd_from_lru ffff88040436c800
  1084. [ 144.014370] libceph: ffff880804ffb400 tid 1027 requeued on osd0
  1085. [ 144.014375] libceph: map_request ffff88040408f600 tid 1028
  1086. [ 144.014381] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1087. [ 144.014387] libceph: map_request tid 1028 pgid 2.77dc osd0 (was osd0)
  1088. [ 144.014393] libceph: __remove_osd_from_lru ffff88040436c800
  1089. [ 144.014398] libceph: ffff88040408f600 tid 1028 requeued on osd0
  1090. [ 144.014403] libceph: map_request ffff88040408f800 tid 1029
  1091. [ 144.014408] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1092. [ 144.014414] libceph: map_request tid 1029 pgid 2.77dc osd0 (was osd0)
  1093. [ 144.014419] libceph: __remove_osd_from_lru ffff88040436c800
  1094. [ 144.014424] libceph: ffff88040408f800 tid 1029 requeued on osd0
  1095. [ 144.014429] libceph: map_request ffff88040408f400 tid 1030
  1096. [ 144.014435] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1097. [ 144.014441] libceph: map_request tid 1030 pgid 2.77dc osd0 (was osd0)
  1098. [ 144.014446] libceph: __remove_osd_from_lru ffff88040436c800
  1099. [ 144.014451] libceph: ffff88040408f400 tid 1030 requeued on osd0
  1100. [ 144.014456] libceph: map_request ffff8804042e0a00 tid 1031
  1101. [ 144.014461] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1102. [ 144.014467] libceph: map_request tid 1031 pgid 2.77dc osd0 (was osd0)
  1103. [ 144.014472] libceph: __remove_osd_from_lru ffff88040436c800
  1104. [ 144.014477] libceph: ffff8804042e0a00 tid 1031 requeued on osd0
  1105. [ 144.014482] libceph: map_request ffff8804042e1000 tid 1032
  1106. [ 144.014487] libceph: calc_object_layout 'rb.0.3.000000000109' pgid 2.ccac77dc
  1107. [ 144.014494] libceph: map_request tid 1032 pgid 2.77dc osd0 (was osd0)
  1108. [ 144.014499] libceph: __remove_osd_from_lru ffff88040436c800
  1109. [ 144.014504] libceph: ffff8804042e1000 tid 1032 requeued on osd0
  1110. [ 144.014509] libceph: map_request ffff880403840e00 tid 1033
  1111. [ 144.014514] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1112. [ 144.014520] libceph: map_request tid 1033 pgid 2.8318 osd2 (was osd2)
  1113. [ 144.014525] libceph: __remove_osd_from_lru ffff880403886000
  1114. [ 144.014530] libceph: ffff880403840e00 tid 1033 requeued on osd2
  1115. [ 144.014535] libceph: map_request ffff880403841400 tid 1034
  1116. [ 144.014540] libceph: calc_object_layout 'rb.0.3.000000000009' pgid 2.7bd88318
  1117. [ 144.014546] libceph: map_request tid 1034 pgid 2.8318 osd2 (was osd2)
  1118. [ 144.014552] libceph: __remove_osd_from_lru ffff880403886000
  1119. [ 144.014557] libceph: ffff880403841400 tid 1034 requeued on osd2
  1120. [ 144.014562] libceph: map_request ffff8804041c4400 tid 1035
  1121. [ 144.014567] libceph: calc_object_layout 'test.rbd' pgid 2.a2fa4514
  1122. [ 144.014573] libceph: map_request tid 1035 pgid 2.4514 osd1 (was osd1)
  1123. [ 144.014586] libceph: __remove_osd_from_lru ffff880804deb000
  1124. [ 144.014591] libceph: ffff8804041c4400 tid 1035 requeued on osd1
  1125. [ 144.014597] libceph: send_queued
  1126. [ 144.014601] libceph: send_request ffff8804041c4400 tid 1035 to osd1 flags 36
  1127. [ 144.014607] libceph: ----- ffff880803648100 to osd1 42=osd_op len 116+0+0 -----
  1128. [ 144.014613] libceph: get_osd ffff880804deb000 1 -> 2
  1129. [ 144.014619] libceph: send_request ffff880403841400 tid 1034 to osd2 flags 44
  1130. [ 144.014625] libceph: ----- ffff880803ad1800 to osd2 42=osd_op len 127+0+4096 -----
  1131. [ 144.014631] libceph: get_osd ffff880403886000 2 -> 3
  1132. [ 144.014636] libceph: send_request ffff880403840e00 tid 1033 to osd2 flags 44
  1133. [ 144.014642] libceph: ----- ffff880803ad0000 to osd2 42=osd_op len 127+0+184320 -----
  1134. [ 144.014648] libceph: send_request ffff8804042e1000 tid 1032 to osd0 flags 44
  1135. [ 144.014654] libceph: ----- ffff880803ad0200 to osd0 42=osd_op len 127+0+4096 -----
  1136. [ 144.014660] libceph: get_osd ffff88040436c800 2 -> 3
  1137. [ 144.014665] libceph: put_osd ffff88040436c800 3 -> 2
  1138. [ 144.014670] libceph: send_request ffff8804042e0a00 tid 1031 to osd0 flags 44
  1139. [ 144.014676] libceph: ----- ffff880803ad0400 to osd0 42=osd_op len 127+0+184320 -----
  1140. [ 144.014682] libceph: send_request ffff88040408f400 tid 1030 to osd0 flags 44
  1141. [ 144.014689] libceph: ----- ffff880803ad1100 to osd0 42=osd_op len 127+0+4096 -----
  1142. [ 144.014695] libceph: send_request ffff88040408f800 tid 1029 to osd0 flags 44
  1143. [ 144.014702] libceph: ----- ffff880803ad0e00 to osd0 42=osd_op len 127+0+36864 -----
  1144. [ 144.014708] libceph: send_request ffff88040408f600 tid 1028 to osd0 flags 44
  1145. [ 144.014714] libceph: ----- ffff880803ad0c00 to osd0 42=osd_op len 127+0+8192 -----
  1146. [ 144.014722] libceph: send_request ffff880804ffb400 tid 1027 to osd0 flags 44
  1147. [ 144.014728] libceph: ----- ffff880404755000 to osd0 42=osd_op len 127+0+32768 -----
  1148. [ 144.014734] libceph: send_request ffff880804ffa800 tid 1026 to osd0 flags 44
  1149. [ 144.014740] libceph: ----- ffff880804762700 to osd0 42=osd_op len 127+0+286720 -----
  1150. [ 144.014746] libceph: send_request ffff880804ffa000 tid 1025 to osd0 flags 44
  1151. [ 144.014752] libceph: ----- ffff880804762600 to osd0 42=osd_op len 127+0+4096 -----
  1152. [ 144.014758] libceph: send_request ffff880804ffb200 tid 1024 to osd0 flags 44
  1153. [ 144.014764] libceph: ----- ffff880804762100 to osd0 42=osd_op len 127+0+4096 -----
  1154. [ 144.014771] libceph: send_request ffff880804ff8c00 tid 1023 to osd0 flags 44
  1155. [ 144.014777] libceph: ----- ffff880804762300 to osd0 42=osd_op len 127+0+4096 -----
  1156. [ 144.014783] libceph: send_request ffff880804ff9400 tid 1022 to osd2 flags 44
  1157. [ 144.014789] libceph: ----- ffff880804762500 to osd2 42=osd_op len 127+0+4096 -----
  1158. [ 144.014795] libceph: send_request ffff880804ff8800 tid 1021 to osd2 flags 44
  1159. [ 144.014801] libceph: ----- ffff880804763a00 to osd2 42=osd_op len 127+0+4096 -----
  1160. [ 144.014807] libceph: send_request ffff880804ffbc00 tid 1020 to osd2 flags 44
  1161. [ 144.014813] libceph: ----- ffff880804763600 to osd2 42=osd_op len 127+0+4096 -----
  1162. [ 144.014819] libceph: send_request ffff880804ffba00 tid 1019 to osd2 flags 44
  1163. [ 144.014825] libceph: ----- ffff880804763400 to osd2 42=osd_op len 127+0+286720 -----
  1164. [ 144.014831] libceph: send_request ffff880804ff8a00 tid 1018 to osd2 flags 44
  1165. [ 144.014837] libceph: ----- ffff880804763100 to osd2 42=osd_op len 127+0+32768 -----
  1166. [ 144.014843] libceph: send_request ffff880804ffa200 tid 1017 to osd2 flags 44
  1167. [ 144.014850] libceph: ----- ffff880804762f00 to osd2 42=osd_op len 127+0+8192 -----
  1168. [ 144.014856] libceph: send_request ffff880804ff9e00 tid 1016 to osd2 flags 44
  1169. [ 144.014863] libceph: ----- ffff880804762a00 to osd2 42=osd_op len 127+0+36864 -----
  1170. [ 144.014869] libceph: send_request ffff880804ffae00 tid 1015 to osd2 flags 44
  1171. [ 144.014875] libceph: ----- ffff880804762e00 to osd2 42=osd_op len 127+0+4096 -----
  1172. [ 144.014881] libceph: send_request ffff88040422dc00 tid 1013 to osd0 flags 44
  1173. [ 144.014887] libceph: ----- ffff880803c43600 to osd0 42=osd_op len 127+0+524288 -----
  1174. [ 144.014894] libceph: send_request ffff88040422ca00 tid 1012 to osd0 flags 44
  1175. [ 144.014900] libceph: ----- ffff880803c43900 to osd0 42=osd_op len 127+0+524288 -----
  1176. [ 144.014950] libceph: put_osd ffff880403886000 3 -> 2
  1177. [ 144.014961] libceph: ===== ffff8804044e3d00 7 from mon0 41=osd_map len 149+0 (4276739081 0 0) =====
  1178. [ 144.014967] libceph: handle_map have 29
  1179. [ 144.014971] libceph: 1 inc maps
  1180. [ 144.014976] libceph: ignoring incremental map 27 len 117
  1181. [ 144.014980] libceph: 0 full maps
  1182. [ 144.014984] libceph: send_queued
  1183. [ 144.014990] libceph: put_osd ffff880804105000 2 -> 1
  1184. [ 144.015012] libceph: get_osd ffff880403886000 2 -> 3
  1185. [ 144.015018] libceph: put_osd ffff880403886000 3 -> 2
  1186. [ 144.015027] libceph: put_osd ffff88040436c800 2 -> 1
  1187. [ 144.015042] libceph: put_osd ffff880804deb000 2 -> 1
  1188. [ 144.015054] libceph: put_osd ffff880403886000 2 -> 1
  1189. [ 144.015155] libceph: get_osd ffff880403886000 1 -> 2
  1190. [ 144.015163] libceph: put_osd ffff880403886000 2 -> 1
  1191. [ 144.015445] libceph: get_osd ffff88040436c800 1 -> 2
  1192. [ 144.015457] libceph: get_osd ffff880403886000 1 -> 2
  1193. [ 144.015469] libceph: put_osd ffff88040436c800 2 -> 1
  1194. [ 144.015484] libceph: put_osd ffff880403886000 2 -> 1
  1195. [ 144.015729] libceph: get_osd ffff880403886000 1 -> 2
  1196. [ 144.015738] libceph: get_osd ffff880403886000 2 -> 3
  1197. [ 144.015743] libceph: put_osd ffff880403886000 3 -> 2
  1198. [ 144.015754] libceph: get_reply tid 1015 ffff880804763000
  1199. [ 144.015761] libceph: ===== ffff880804763000 298 from osd2 43=osd_opreply len 105+0 (3599868573 0 0) =====
  1200. [ 144.015768] libceph: handle_reply ffff880804763000 tid 1015 result 0
  1201. [ 144.015773] libceph: dropping con_filling_msg ref ffff880403886030
  1202. [ 144.015778] libceph: handle_reply result 0 bytes 0
  1203. [ 144.015783] libceph: handle_reply tid 1015 flags 37
  1204. [ 144.015788] libceph: __unregister_request ffff880804ffae00 tid 1015
  1205. [ 144.015793] rbd: rbd_req_cb bytes=4096 readop=0 rc=0
  1206. [ 144.015798] rbd: rbd_coll_end_req_index ffff88040431c940 index 0 ret 0 len 4096
  1207. [ 144.015808] rbd: rbd_coll_release ffff88040431c940
  1208. [ 144.015814] libceph: req=ffff880804ffae00 req->r_linger=0
  1209. [ 144.015821] libceph: put_osd ffff880403886000 2 -> 1
  1210. [ 144.015869] libceph: get_osd ffff88040436c800 1 -> 2
  1211. [ 144.015883] libceph: get_osd ffff880403886000 1 -> 2
  1212. [ 144.015891] libceph: put_osd ffff88040436c800 2 -> 1
  1213. [ 144.015894] libceph: put_osd ffff880403886000 2 -> 1
  1214. [ 144.016013] libceph: get_osd ffff88040436c800 1 -> 2
  1215. [ 144.016019] libceph: get_osd ffff880804deb000 1 -> 2
  1216. [ 144.016027] libceph: put_osd ffff88040436c800 2 -> 1
  1217. [ 144.016031] libceph: get_reply tid 1035 ffff880803648000
  1218. [ 144.016036] libceph: ===== ffff880803648000 268 from osd1 43=osd_opreply len 94+0 (1534719791 0 0) =====
  1219. [ 144.016039] libceph: handle_reply ffff880803648000 tid 1035 result 0
  1220. [ 144.016040] libceph: dropping con_filling_msg ref ffff880804deb030
  1221. [ 144.016042] libceph: handle_reply tid 1035 flags 37
  1222. [ 144.016043] libceph: __register_linger_request ffff8804041c4400
  1223. [ 144.016045] libceph: __unregister_request ffff8804041c4400 tid 1035
  1224. [ 144.016047] libceph: req=ffff8804041c4400 req->r_linger=1
  1225. [ 144.016051] libceph: put_osd ffff880804deb000 2 -> 1
  1226. [ 144.016157] libceph: get_osd ffff88040436c800 1 -> 2
  1227. [ 144.016163] libceph: get_osd ffff880403886000 1 -> 2
  1228. [ 144.016172] libceph: get_osd ffff880403886000 2 -> 3
  1229. [ 144.016174] libceph: put_osd ffff880403886000 3 -> 2
  1230. [ 144.016199] libceph: put_osd ffff88040436c800 2 -> 1
  1231. [ 144.016211] libceph: put_osd ffff880403886000 2 -> 1
  1232. [ 144.016452] libceph: get_osd ffff880403886000 1 -> 2
  1233. [ 144.016460] libceph: put_osd ffff880403886000 2 -> 1
  1234. [ 144.016589] libceph: get_osd ffff88040436c800 1 -> 2
  1235. [ 144.016602] libceph: put_osd ffff88040436c800 2 -> 1
  1236. [ 144.016729] libceph: get_osd ffff88040436c800 1 -> 2
  1237. [ 144.016754] libceph: put_osd ffff88040436c800 2 -> 1
  1238. [ 144.017024] libceph: get_osd ffff88040436c800 1 -> 2
  1239. [ 144.017040] libceph: put_osd ffff88040436c800 2 -> 1
  1240. [ 144.017305] libceph: get_osd ffff88040436c800 1 -> 2
  1241. [ 144.017319] libceph: put_osd ffff88040436c800 2 -> 1
  1242. [ 144.017593] libceph: get_osd ffff88040436c800 1 -> 2
  1243. [ 144.017605] libceph: put_osd ffff88040436c800 2 -> 1
  1244. [ 144.017737] libceph: get_osd ffff88040436c800 1 -> 2
  1245. [ 144.017752] libceph: put_osd ffff88040436c800 2 -> 1
  1246. [ 144.017884] libceph: get_osd ffff88040436c800 1 -> 2
  1247. [ 144.017892] libceph: put_osd ffff88040436c800 2 -> 1
  1248. [ 144.018022] libceph: get_osd ffff88040436c800 1 -> 2
  1249. [ 144.018041] libceph: put_osd ffff88040436c800 2 -> 1
  1250. [ 144.018167] libceph: get_osd ffff88040436c800 1 -> 2
  1251. [ 144.018173] libceph: put_osd ffff88040436c800 2 -> 1
  1252. [ 144.018306] libceph: get_osd ffff88040436c800 1 -> 2
  1253. [ 144.018326] libceph: put_osd ffff88040436c800 2 -> 1
  1254. [ 144.018455] libceph: get_osd ffff88040436c800 1 -> 2
  1255. [ 144.018464] libceph: put_osd ffff88040436c800 2 -> 1
  1256. [ 144.018737] libceph: get_osd ffff88040436c800 1 -> 2
  1257. [ 144.018742] libceph: get_osd ffff88040436c800 2 -> 3
  1258. [ 144.018744] libceph: put_osd ffff88040436c800 3 -> 2
  1259. [ 144.018753] libceph: put_osd ffff88040436c800 2 -> 1
  1260. [ 144.019029] libceph: get_osd ffff88040436c800 1 -> 2
  1261. [ 144.019036] libceph: put_osd ffff88040436c800 2 -> 1
  1262. [ 144.019741] libceph: get_osd ffff88040436c800 1 -> 2
  1263. [ 144.019755] libceph: put_osd ffff88040436c800 2 -> 1
  1264. [ 144.019886] libceph: get_osd ffff88040436c800 1 -> 2
  1265. [ 144.019895] libceph: get_osd ffff880403886000 1 -> 2
  1266. [ 144.019905] libceph: put_osd ffff88040436c800 2 -> 1
  1267. [ 144.019911] libceph: put_osd ffff880403886000 2 -> 1
  1268. [ 144.020466] libceph: get_osd ffff88040436c800 1 -> 2
  1269. [ 144.020500] libceph: put_osd ffff88040436c800 2 -> 1
  1270. [ 144.020606] libceph: get_osd ffff88040436c800 1 -> 2
  1271. [ 144.020620] libceph: put_osd ffff88040436c800 2 -> 1
  1272. [ 144.020893] libceph: get_osd ffff88040436c800 1 -> 2
  1273. [ 144.020911] libceph: put_osd ffff88040436c800 2 -> 1
  1274. [ 144.021185] libceph: get_osd ffff88040436c800 1 -> 2
  1275. [ 144.021202] libceph: put_osd ffff88040436c800 2 -> 1
  1276. [ 144.021327] libceph: get_osd ffff88040436c800 1 -> 2
  1277. [ 144.021337] libceph: put_osd ffff88040436c800 2 -> 1
  1278. [ 144.021616] libceph: get_osd ffff88040436c800 1 -> 2
  1279. [ 144.021631] libceph: put_osd ffff88040436c800 2 -> 1
  1280. [ 144.021758] libceph: get_osd ffff88040436c800 1 -> 2
  1281. [ 144.021799] libceph: put_osd ffff88040436c800 2 -> 1
  1282. [ 144.021899] libceph: get_osd ffff88040436c800 1 -> 2
  1283. [ 144.021909] libceph: put_osd ffff88040436c800 2 -> 1
  1284. [ 144.022329] libceph: get_osd ffff88040436c800 1 -> 2
  1285. [ 144.022336] libceph: get_osd ffff88040436c800 2 -> 3
  1286. [ 144.022339] libceph: put_osd ffff88040436c800 3 -> 2
  1287. [ 144.022356] libceph: put_osd ffff88040436c800 2 -> 1
  1288. [ 144.023634] libceph: get_osd ffff88040436c800 1 -> 2
  1289. [ 144.023649] libceph: put_osd ffff88040436c800 2 -> 1
  1290. [ 144.024478] libceph: get_osd ffff88040436c800 1 -> 2
  1291. [ 144.024494] libceph: put_osd ffff88040436c800 2 -> 1
  1292. [ 144.024764] libceph: get_osd ffff88040436c800 1 -> 2
  1293. [ 144.024787] libceph: put_osd ffff88040436c800 2 -> 1
  1294. [ 144.025048] libceph: get_osd ffff88040436c800 1 -> 2
  1295. [ 144.025066] libceph: put_osd ffff88040436c800 2 -> 1
  1296. [ 144.025479] libceph: get_osd ffff88040436c800 1 -> 2
  1297. [ 144.025489] libceph: get_osd ffff88040436c800 2 -> 3
  1298. [ 144.025492] libceph: put_osd ffff88040436c800 3 -> 2
  1299. [ 144.025521] libceph: put_osd ffff88040436c800 2 -> 1
  1300. [ 144.025767] libceph: get_osd ffff88040436c800 1 -> 2
  1301. [ 144.025777] libceph: put_osd ffff88040436c800 2 -> 1
  1302. [ 144.026052] libceph: get_osd ffff88040436c800 1 -> 2
  1303. [ 144.026073] libceph: put_osd ffff88040436c800 2 -> 1
  1304. [ 144.026340] libceph: get_osd ffff88040436c800 1 -> 2
  1305. [ 144.026356] libceph: get_osd ffff880403886000 1 -> 2
  1306. [ 144.026367] libceph: put_osd ffff88040436c800 2 -> 1
  1307. [ 144.026376] libceph: get_reply tid 1016 ffff880804763200
  1308. [ 144.026384] libceph: ===== ffff880804763200 299 from osd2 43=osd_opreply len 105+0 (2532481544 0 0) =====
  1309. [ 144.026388] libceph: handle_reply ffff880804763200 tid 1016 result 0
  1310. [ 144.026391] libceph: dropping con_filling_msg ref ffff880403886030
  1311. [ 144.026394] libceph: handle_reply result 0 bytes 0
  1312. [ 144.026396] libceph: handle_reply tid 1016 flags 37
  1313. [ 144.026399] libceph: __unregister_request ffff880804ff9e00 tid 1016
  1314. [ 144.026403] rbd: rbd_req_cb bytes=36864 readop=0 rc=0
  1315. [ 144.026406] rbd: rbd_coll_end_req_index ffff88040431cca0 index 0 ret 0 len 36864
  1316. [ 144.026419] rbd: rbd_coll_release ffff88040431cca0
  1317. [ 144.026426] libceph: req=ffff880804ff9e00 req->r_linger=0
  1318. [ 144.026432] libceph: put_osd ffff880403886000 2 -> 1
  1319. [ 144.026484] libceph: get_osd ffff88040436c800 1 -> 2
  1320. [ 144.026509] libceph: put_osd ffff88040436c800 2 -> 1
  1321. [ 144.026771] libceph: get_osd ffff88040436c800 1 -> 2
  1322. [ 144.026789] libceph: put_osd ffff88040436c800 2 -> 1
  1323. [ 144.027057] libceph: get_osd ffff88040436c800 1 -> 2
  1324. [ 144.027069] libceph: put_osd ffff88040436c800 2 -> 1
  1325. [ 144.027195] libceph: get_osd ffff880403886000 1 -> 2
  1326. [ 144.027208] libceph: get_osd ffff88040436c800 1 -> 2
  1327. [ 144.027221] libceph: get_reply unknown tid 1016 from osd2
  1328. [ 144.027226] libceph: put_osd ffff880403886000 2 -> 1
  1329. [ 144.027236] libceph: put_osd ffff88040436c800 2 -> 1
  1330. [ 144.027487] libceph: get_osd ffff88040436c800 1 -> 2
  1331. [ 144.027498] libceph: put_osd ffff88040436c800 2 -> 1
  1332. [ 144.027774] libceph: get_osd ffff88040436c800 1 -> 2
  1333. [ 144.027790] libceph: put_osd ffff88040436c800 2 -> 1
  1334. [ 144.028206] libceph: get_osd ffff88040436c800 1 -> 2
  1335. [ 144.028231] libceph: put_osd ffff88040436c800 2 -> 1
  1336. [ 144.034648] libceph: get_osd ffff880403886000 1 -> 2
  1337. [ 144.034655] libceph: get_osd ffff880403886000 2 -> 3
  1338. [ 144.034658] libceph: put_osd ffff880403886000 3 -> 2
  1339. [ 144.034669] libceph: get_reply tid 1017 ffff880804763300
  1340. [ 144.034676] libceph: ===== ffff880804763300 301 from osd2 43=osd_opreply len 105+0 (3978741235 0 0) =====
  1341. [ 144.034680] libceph: handle_reply ffff880804763300 tid 1017 result 0
  1342. [ 144.034683] libceph: dropping con_filling_msg ref ffff880403886030
  1343. [ 144.034686] libceph: handle_reply result 0 bytes 0
  1344. [ 144.034688] libceph: handle_reply tid 1017 flags 37
  1345. [ 144.034691] libceph: __unregister_request ffff880804ffa200 tid 1017
  1346. [ 144.034694] rbd: rbd_req_cb bytes=8192 readop=0 rc=0
  1347. [ 144.034697] rbd: rbd_coll_end_req_index ffff88040431cc00 index 0 ret 0 len 8192
  1348. [ 144.034705] rbd: rbd_coll_release ffff88040431cc00
  1349. [ 144.034709] libceph: req=ffff880804ffa200 req->r_linger=0
  1350. [ 144.034714] libceph: get_reply tid 1018 ffff880804763500
  1351. [ 144.034724] libceph: ===== ffff880804763500 302 from osd2 43=osd_opreply len 105+0 (1270688937 0 0) =====
  1352. [ 144.034728] libceph: handle_reply ffff880804763500 tid 1018 result 0
  1353. [ 144.034730] libceph: dropping con_filling_msg ref ffff880403886030
  1354. [ 144.034733] libceph: handle_reply result 0 bytes 0
  1355. [ 144.034736] libceph: handle_reply tid 1018 flags 37
  1356. [ 144.034738] libceph: __unregister_request ffff880804ff8a00 tid 1018
  1357. [ 144.034742] rbd: rbd_req_cb bytes=32768 readop=0 rc=0
  1358. [ 144.034745] rbd: rbd_coll_end_req_index ffff88040431cc60 index 0 ret 0 len 32768
  1359. [ 144.034756] rbd: rbd_coll_release ffff88040431cc60
  1360. [ 144.034762] libceph: req=ffff880804ff8a00 req->r_linger=0
  1361. [ 144.034768] libceph: put_osd ffff880403886000 2 -> 1
  1362. [ 144.035229] libceph: get_osd ffff88040436c800 1 -> 2
  1363. [ 144.035274] BUG: unable to handle kernel NULL pointer dereference at 0000000000000048
  1364. [ 144.035278] IP: [<ffffffffa036c053>] con_work+0x1463/0x2ce0 [libceph]
  1365. [ 144.035300] PGD 0
  1366. [ 144.035303] Oops: 0000 [#1] SMP
  1367. [ 144.035307] CPU 0
  1368. [ 144.035309] Modules linked in: rbd libceph ip6table_filter ip6_tables iptable_filter ip_tables x_tables nv_tco bridge stp kvm_amd kvm radeon psmouse ttm amd64_edac_mod edac_core k10temp i2c_nforce2 edac_mce_amd shpchp drm_kms_helper drm lp i2c_algo_bit serio_raw parport ses enclosure aacraid forcedeth btrfs zlib_deflate libcrc32c
  1369. [ 144.035335]
  1370. [ 144.035339] Pid: 10, comm: kworker/0:1 Not tainted 3.1.0-rc6 #1 Supermicro H8DM8-2/H8DM8-2
  1371. [ 144.035345] RIP: 0010:[<ffffffffa036c053>] [<ffffffffa036c053>] con_work+0x1463/0x2ce0 [libceph]
  1372. [ 144.035358] RSP: 0018:ffff880405cc5cf0 EFLAGS: 00010256
  1373. [ 144.035360] RAX: 0000000000000000 RBX: ffff88040436c830 RCX: 0000000000000000
  1374. [ 144.035364] RDX: 000000000005e000 RSI: ffff880803c436a0 RDI: 0000000000000000
  1375. [ 144.035367] RBP: ffff880405cc5e10 R08: 0000000000000000 R09: ffffea0020019f00
  1376. [ 144.035370] R10: 0000000000001000 R11: 0000000000000000 R12: 0000000000001000
  1377. [ 144.035373] R13: ffffea0020019f00 R14: 0000000000022000 R15: ffff880803c43600
  1378. [ 144.035377] FS: 00007f3d1d167720(0000) GS:ffff88040fc00000(0000) knlGS:0000000000000000
  1379. [ 144.035380] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1380. [ 144.035383] CR2: 0000000000000048 CR3: 00000004041b4000 CR4: 00000000000006f0
  1381. [ 144.035387] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
  1382. [ 144.035390] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
  1383. [ 144.035394] Process kworker/0:1 (pid: 10, threadinfo ffff880405cc4000, task ffff880405c9dbc0)
  1384. [ 144.035396] Stack:
  1385. [ 144.035398] 000000000000025c ffff88040fc0dd20 000000000000025c 0000000000000000
  1386. [ 144.035402] ffff88040fc13080 ffff88040fc930f0 ffff88040fc93080 ffff88040fc938a0
  1387. [ 144.035407] 0000000000000002 ffff88040fc938f8 0000000200000000 000000000000025c
  1388. [ 144.035411] Call Trace:
  1389. [ 144.035420] [<ffffffff815e5787>] ? __schedule+0x3d7/0x8b0
  1390. [ 144.035431] [<ffffffffa036abf0>] ? ceph_msg_new+0x260/0x260 [libceph]
  1391. [ 144.035438] [<ffffffff8108110d>] process_one_work+0x11d/0x430
  1392. [ 144.035442] [<ffffffff81081dd9>] worker_thread+0x169/0x360
  1393. [ 144.035446] [<ffffffff81081c70>] ? manage_workers.clone.21+0x240/0x240
  1394. [ 144.035451] [<ffffffff81086616>] kthread+0x96/0xa0
  1395. [ 144.035457] [<ffffffff815f2474>] kernel_thread_helper+0x4/0x10
  1396. [ 144.035462] [<ffffffff81086580>] ? flush_kthread_worker+0xb0/0xb0
  1397. [ 144.035466] [<ffffffff815f2470>] ? gs_change+0x13/0x13
  1398. [ 144.035468] Code: f7 ff ff 0f 1f 44 00 00 49 83 bf 90 00 00 00 00 0f 84 12 02 00 00 49 63 8f a0 00 00 00 49 8b 87 98 00 00 00 8b 7d 98 48 c1 e1 04
  1399. [ 144.035486] 03 48 48 85 ff 4c 8b 29 44 8b 61 0c 0f 85 37 01 00 00 8b 93
  1400. [ 144.035495] RIP [<ffffffffa036c053>] con_work+0x1463/0x2ce0 [libceph]
  1401. [ 144.035505] RSP <ffff880405cc5cf0>
  1402. [ 144.035507] CR2: 0000000000000048
  1403. [ 144.035534] ---[ end trace 1e72a8989a078b7f ]---
  1404. [ 144.035588] BUG: unable to handle kernel paging request at fffffffffffffff8
  1405. [ 144.035591] IP: [<ffffffff81086a70>] kthread_data+0x10/0x20
  1406. [ 144.035597] PGD 1a07067 PUD 1a08067 PMD 0
  1407. [ 144.035601] Oops: 0000 [#2] SMP
  1408. [ 144.035603] CPU 0
  1409. [ 144.035604] Modules linked in: rbd libceph ip6table_filter ip6_tables iptable_filter ip_tables x_tables nv_tco bridge stp kvm_amd kvm radeon psmouse ttm amd64_edac_mod edac_core k10temp i2c_nforce2 edac_mce_amd shpchp drm_kms_helper drm lp i2c_algo_bit serio_raw parport ses enclosure aacraid forcedeth btrfs zlib_deflate libcrc32c
  1410. [ 144.035625]
  1411. [ 144.035628] Pid: 10, comm: kworker/0:1 Tainted: G D 3.1.0-rc6 #1 Supermicro H8DM8-2/H8DM8-2
  1412. [ 144.035632] RIP: 0010:[<ffffffff81086a70>] [<ffffffff81086a70>] kthread_data+0x10/0x20
  1413. [ 144.035638] RSP: 0018:ffff880405cc5908 EFLAGS: 00010096
  1414. [ 144.035641] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
  1415. [ 144.035644] RDX: ffff880405c9dbc0 RSI: 0000000000000000 RDI: ffff880405c9dbc0
  1416. [ 144.035647] RBP: ffff880405cc5908 R08: 0000000000989680 R09: 0000000000000000
  1417. [ 144.035650] R10: 0000000000000400 R11: 0000000000000006 R12: ffff880405c9df88
  1418. [ 144.035653] R13: 0000000000000000 R14: 0000000000000000 R15: ffff880405c9de90
  1419. [ 144.035657] FS: 00007f3d1d167720(0000) GS:ffff88040fc00000(0000) knlGS:0000000000000000
  1420. [ 144.035660] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1421. [ 144.035663] CR2: fffffffffffffff8 CR3: 00000004041b4000 CR4: 00000000000006f0
  1422. [ 144.035666] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
  1423. [ 144.035669] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
  1424. [ 144.035672] Process kworker/0:1 (pid: 10, threadinfo ffff880405cc4000, task ffff880405c9dbc0)
  1425. [ 144.035675] Stack:
  1426. [ 144.035677] ffff880405cc5928 ffffffff810824b5 ffff880405cc5928 ffff88040fc13080
  1427. [ 144.035681] ffff880405cc59b8 ffffffff815e5972 ffff880405c78000 ffff880405c9de90
  1428. [ 144.035685] ffff880405cc5978 ffff880405cc5fd8 ffff880405cc4000 ffff880405cc5fd8
  1429. [ 144.035689] Call Trace:
  1430. [ 144.035693] [<ffffffff810824b5>] wq_worker_sleeping+0x15/0xa0
  1431. [ 144.035698] [<ffffffff815e5972>] __schedule+0x5c2/0x8b0
  1432. [ 144.035705] [<ffffffff812cbaf6>] ? put_io_context+0x46/0x70
  1433. [ 144.035709] [<ffffffff8105b81f>] schedule+0x3f/0x60
  1434. [ 144.035714] [<ffffffff81068313>] do_exit+0x5e3/0x8a0
  1435. [ 144.035718] [<ffffffff815e950f>] oops_end+0xaf/0xf0
  1436. [ 144.035724] [<ffffffff8103f8a8>] no_context+0xf8/0x260
  1437. [ 144.035729] [<ffffffff815546fb>] ? inet_recvmsg+0x6b/0x80
  1438. [ 144.035733] [<ffffffff8103fb45>] __bad_area_nosemaphore+0x135/0x220
  1439. [ 144.035738] [<ffffffff811596b5>] ? __kmalloc_node_track_caller+0x55/0x1a0
  1440. [ 144.035743] [<ffffffff812dfa96>] ? cpumask_next_and+0x36/0x50
  1441. [ 144.035747] [<ffffffff8103fc43>] bad_area_nosemaphore+0x13/0x20
  1442. [ 144.035752] [<ffffffff815ebec5>] do_page_fault+0x445/0x540
  1443. [ 144.035756] [<ffffffff815e8169>] ? _raw_spin_unlock_bh+0x19/0x20
  1444. [ 144.035762] [<ffffffff814db4da>] ? release_sock+0xfa/0x120
  1445. [ 144.035767] [<ffffffff8152fa60>] ? tcp_sendpage+0xd0/0x6c0
  1446. [ 144.035771] [<ffffffff815e8875>] page_fault+0x25/0x30
  1447. [ 144.035781] [<ffffffffa036c053>] ? con_work+0x1463/0x2ce0 [libceph]
  1448. [ 144.035787] [<ffffffff815e5787>] ? __schedule+0x3d7/0x8b0
  1449. [ 144.035797] [<ffffffffa036abf0>] ? ceph_msg_new+0x260/0x260 [libceph]
  1450. [ 144.035801] [<ffffffff8108110d>] process_one_work+0x11d/0x430
  1451. [ 144.035805] [<ffffffff81081dd9>] worker_thread+0x169/0x360
  1452. [ 144.035809] [<ffffffff81081c70>] ? manage_workers.clone.21+0x240/0x240
  1453. [ 144.035813] [<ffffffff81086616>] kthread+0x96/0xa0
  1454. [ 144.035817] [<ffffffff815f2474>] kernel_thread_helper+0x4/0x10
  1455. [ 144.035822] [<ffffffff81086580>] ? flush_kthread_worker+0xb0/0xb0
  1456. [ 144.035826] [<ffffffff815f2470>] ? gs_change+0x13/0x13
  1457. [ 144.035828] Code: 5e 41 5f c9 c3 be 3e 01 00 00 48 c7 c7 24 e4 7d 81 e8 f5 d2 fd ff e9 84 fe ff ff 55 48 89 e5 66 66 66 66 90 48 8b 87 70 03 00 00
  1458. [ 144.035845] 8b 40 f8 c9 c3 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 66
  1459. [ 144.035854] RIP [<ffffffff81086a70>] kthread_data+0x10/0x20
  1460. [ 144.035859] RSP <ffff880405cc5908>
  1461. [ 144.035861] CR2: fffffffffffffff8
  1462. [ 144.035863] ---[ end trace 1e72a8989a078b80 ]---
  1463. [ 144.035865] Fixing recursive fault but reboot is needed!
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!