Guest User

Untitled

a guest
Aug 17th, 2015
65
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 107.69 KB | None | 0 0
  1.  
  2. 2015-08-17 09:27:04.069203 7f0ea709d700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader got ACK
  3. 2015-08-17 09:27:04.069230 7f0ea709d700 15 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader got ack seq 132981
  4. 2015-08-17 09:27:04.069239 7f0ea709d700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader reading tag...
  5. 2015-08-17 09:27:04.072203 7f0ea729f700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader got ACK
  6. 2015-08-17 09:27:04.072239 7f0ea729f700 15 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader got ack seq 132981
  7. 2015-08-17 09:27:04.072254 7f0ea729f700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader reading tag...
  8. 2015-08-17 09:27:04.097412 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got MSG
  9. 2015-08-17 09:27:04.097414 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got MSG
  10. 2015-08-17 09:27:04.097456 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got envelope type=70 src osd.77 front=47 data=0 off 0
  11. 2015-08-17 09:27:04.097475 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got envelope type=70 src osd.77 front=47 data=0 off 0
  12. 2015-08-17 09:27:04.097500 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader wants 47 from dispatch throttler 0/104857600
  13. 2015-08-17 09:27:04.097709 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got front 47
  14. 2015-08-17 09:27:04.097719 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).aborted = 0
  15. 2015-08-17 09:27:04.097724 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got 47 + 0 + 0 byte message
  16. 2015-08-17 09:27:04.097750 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got message 133030 0x1964ba00 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.091014) v2
  17. 2015-08-17 09:27:04.097764 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 queue 0x1964ba00 prio 127
  18. 2015-08-17 09:27:04.097482 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader wants 47 from dispatch throttler 0/104857600
  19. 2015-08-17 09:27:04.097777 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader reading tag...
  20. 2015-08-17 09:27:04.097781 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got front 47
  21. 2015-08-17 09:27:04.097794 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).aborted = 0
  22. 2015-08-17 09:27:04.097782 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).writer: state = open policy.server=1
  23. 2015-08-17 09:27:04.097802 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got 47 + 0 + 0 byte message
  24. 2015-08-17 09:27:04.097806 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).write_ack 133030
  25. 2015-08-17 09:27:04.097816 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).writer: state = open policy.server=1
  26. 2015-08-17 09:27:04.097820 7f0e9dc8a700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).writer sleeping
  27. 2015-08-17 09:27:04.097853 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.77 10.0.230.51:0/30644 133030 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.091014) v2 ==== 47+0+0 (1635801934 0 0) 0x1964ba00 con 0x145c6ca0
  28. 2015-08-17 09:27:04.097876 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x1964ba00
  29. 2015-08-17 09:27:04.097882 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  30. 2015-08-17 09:27:04.097889 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x1964ba00
  31. 2015-08-17 09:27:04.097821 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got message 133030 0x1898f800 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.091014) v2
  32. 2015-08-17 09:27:04.097969 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 queue 0x1898f800 prio 127
  33. 2015-08-17 09:27:04.097991 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.77 10.0.230.51:0/30644 133030 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.091014) v2 ==== 47+0+0 (1635801934 0 0) 0x1898f800 con 0x14686040
  34. 2015-08-17 09:27:04.098006 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x1898f800
  35. 2015-08-17 09:27:04.098008 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  36. 2015-08-17 09:27:04.097987 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader reading tag...
  37. 2015-08-17 09:27:04.098012 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x1898f800
  38. 2015-08-17 09:27:04.097994 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).writer: state = open policy.server=1
  39. 2015-08-17 09:27:04.098029 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).write_ack 133030
  40. 2015-08-17 09:27:04.098044 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).writer: state = open policy.server=1
  41. 2015-08-17 09:27:04.098051 7f0e9dd8b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).writer sleeping
  42. 2015-08-17 09:27:04.307873 7f0e9f6a4700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader got MSG
  43. 2015-08-17 09:27:04.307895 7f0e9f7a5700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader got MSG
  44. 2015-08-17 09:27:04.307909 7f0e9f6a4700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader got envelope type=70 src osd.67 front=47 data=0 off 0
  45. 2015-08-17 09:27:04.307915 7f0e9f7a5700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader got envelope type=70 src osd.67 front=47 data=0 off 0
  46. 2015-08-17 09:27:04.307938 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader wants 47 from dispatch throttler 0/104857600
  47. 2015-08-17 09:27:04.307934 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader wants 47 from dispatch throttler 0/104857600
  48. 2015-08-17 09:27:04.308194 7f0e9f7a5700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader got front 47
  49. 2015-08-17 09:27:04.308206 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).aborted = 0
  50. 2015-08-17 09:27:04.308204 7f0e9f6a4700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader got front 47
  51. 2015-08-17 09:27:04.308213 7f0e9f7a5700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader got 47 + 0 + 0 byte message
  52. 2015-08-17 09:27:04.308216 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).aborted = 0
  53. 2015-08-17 09:27:04.308222 7f0e9f6a4700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader got 47 + 0 + 0 byte message
  54. 2015-08-17 09:27:04.308238 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader got message 133274 0x1b273800 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.302285) v2
  55. 2015-08-17 09:27:04.308250 7f0e9f6a4700 20 -- 10.0.231.50:6877/22176 queue 0x1b273800 prio 127
  56. 2015-08-17 09:27:04.308269 7f0e9f6a4700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader reading tag...
  57. 2015-08-17 09:27:04.308288 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.67 10.0.230.51:0/24917 133274 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.302285) v2 ==== 47+0+0 (446864893 0 0) 0x1b273800 con 0x145c7220
  58. 2015-08-17 09:27:04.308276 7f0e9f5a3700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).writer: state = open policy.server=1
  59. 2015-08-17 09:27:04.308310 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x1b273800
  60. 2015-08-17 09:27:04.308315 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  61. 2015-08-17 09:27:04.308313 7f0e9f5a3700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).write_ack 133274
  62. 2015-08-17 09:27:04.308319 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x1b273800
  63. 2015-08-17 09:27:04.308327 7f0e9f5a3700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).writer: state = open policy.server=1
  64. 2015-08-17 09:27:04.308334 7f0e9f5a3700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).writer sleeping
  65. 2015-08-17 09:27:04.308229 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader got message 133274 0x14a44000 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.302285) v2
  66. 2015-08-17 09:27:04.308345 7f0e9f7a5700 20 -- 10.0.230.50:6877/22176 queue 0x14a44000 prio 127
  67. 2015-08-17 09:27:04.308376 7f0e9f7a5700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader reading tag...
  68. 2015-08-17 09:27:04.308384 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.67 10.0.230.51:0/24917 133274 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.302285) v2 ==== 47+0+0 (446864893 0 0) 0x14a44000 con 0x146865c0
  69. 2015-08-17 09:27:04.308384 7f0e9f4a2700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).writer: state = open policy.server=1
  70. 2015-08-17 09:27:04.308410 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x14a44000
  71. 2015-08-17 09:27:04.308415 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  72. 2015-08-17 09:27:04.308413 7f0e9f4a2700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).write_ack 133274
  73. 2015-08-17 09:27:04.308422 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x14a44000
  74. 2015-08-17 09:27:04.308428 7f0e9f4a2700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).writer: state = open policy.server=1
  75. 2015-08-17 09:27:04.308435 7f0e9f4a2700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).writer sleeping
  76. 2015-08-17 09:27:04.316369 7f0e9f7a5700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).reader couldn't read tag, (0) Success
  77. 2015-08-17 09:27:04.316401 7f0e9f7a5700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).fault (0) Success
  78. 2015-08-17 09:27:04.316413 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).fault on lossy channel, failing
  79. 2015-08-17 09:27:04.316417 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=2 pgs=21 cs=1 l=1 c=0x146865c0).stop
  80. 2015-08-17 09:27:04.316415 7f0e9f6a4700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).reader couldn't read tag, (0) Success
  81. 2015-08-17 09:27:04.316425 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).unregister_pipe
  82. 2015-08-17 09:27:04.316440 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).discard_queue
  83. 2015-08-17 09:27:04.316440 7f0e9f6a4700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).fault (0) Success
  84. 2015-08-17 09:27:04.316451 7f0e9f7a5700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).reader done
  85. 2015-08-17 09:27:04.316458 7f0e9f4a2700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).writer finishing
  86. 2015-08-17 09:27:04.316463 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).fault on lossy channel, failing
  87. 2015-08-17 09:27:04.316471 7f0e9f4a2700 10 -- 10.0.230.50:6877/22176 queue_reap 0x146fc800
  88. 2015-08-17 09:27:04.316471 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=2 pgs=22 cs=1 l=1 c=0x145c7220).stop
  89. 2015-08-17 09:27:04.316479 7f0e9f4a2700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).writer done
  90. 2015-08-17 09:27:04.316506 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  91. 2015-08-17 09:27:04.316517 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x146fc800 10.0.230.51:0/24917
  92. 2015-08-17 09:27:04.316507 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).unregister_pipe
  93. 2015-08-17 09:27:04.316523 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).discard_queue
  94. 2015-08-17 09:27:04.316522 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).discard_queue
  95. 2015-08-17 09:27:04.316533 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).unregister_pipe - not registered
  96. 2015-08-17 09:27:04.316540 7f0e9f6a4700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).reader done
  97. 2015-08-17 09:27:04.316545 7f0e9f5a3700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).writer finishing
  98. 2015-08-17 09:27:04.316547 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x146fc800 sd=263 :6877 s=4 pgs=21 cs=1 l=1 c=0x146865c0).join
  99. 2015-08-17 09:27:04.316564 7f0e9f5a3700 10 -- 10.0.231.50:6877/22176 queue_reap 0x1470a000
  100. 2015-08-17 09:27:04.316573 7f0e9f5a3700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).writer done
  101. 2015-08-17 09:27:04.316579 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  102. 2015-08-17 09:27:04.316590 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x1470a000 10.0.230.51:0/24917
  103. 2015-08-17 09:27:04.316597 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).discard_queue
  104. 2015-08-17 09:27:04.316608 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).unregister_pipe - not registered
  105. 2015-08-17 09:27:04.316623 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/24917 pipe(0x1470a000 sd=264 :6877 s=4 pgs=22 cs=1 l=1 c=0x145c7220).join
  106. 2015-08-17 09:27:04.316647 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x146fc800 10.0.230.51:0/24917
  107. 2015-08-17 09:27:04.316665 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x146fc800
  108. 2015-08-17 09:27:04.316668 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  109. 2015-08-17 09:27:04.316898 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x1470a000 10.0.230.51:0/24917
  110. 2015-08-17 09:27:04.316921 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x1470a000
  111. 2015-08-17 09:27:04.316926 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  112. 2015-08-17 09:27:04.317623 7f0e92185700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader got MSG
  113. 2015-08-17 09:27:04.317638 7f0e92185700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader got envelope type=70 src osd.55 front=47 data=0 off 0
  114. 2015-08-17 09:27:04.317650 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader wants 47 from dispatch throttler 0/104857600
  115. 2015-08-17 09:27:04.317657 7f0e92185700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader got front 47
  116. 2015-08-17 09:27:04.317661 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).aborted = 0
  117. 2015-08-17 09:27:04.317664 7f0e92185700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader got 47 + 0 + 0 byte message
  118. 2015-08-17 09:27:04.317627 7f0e92084700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader got MSG
  119. 2015-08-17 09:27:04.317676 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader got message 105622 0x198fe600 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.312290) v2
  120. 2015-08-17 09:27:04.317683 7f0e92185700 20 -- 10.0.230.50:6877/22176 queue 0x198fe600 prio 127
  121. 2015-08-17 09:27:04.317671 7f0e92084700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader got envelope type=70 src osd.55 front=47 data=0 off 0
  122. 2015-08-17 09:27:04.317687 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader wants 47 from dispatch throttler 0/104857600
  123. 2015-08-17 09:27:04.317693 7f0e92185700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader reading tag...
  124. 2015-08-17 09:27:04.317696 7f0e92084700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader got front 47
  125. 2015-08-17 09:27:04.317701 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).aborted = 0
  126. 2015-08-17 09:27:04.317706 7f0e92084700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader got 47 + 0 + 0 byte message
  127. 2015-08-17 09:27:04.317700 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.55 10.0.230.51:0/12818 105622 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.312290) v2 ==== 47+0+0 (2064768797 0 0) 0x198fe600 con 0x14542c00
  128. 2015-08-17 09:27:04.317721 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x198fe600
  129. 2015-08-17 09:27:04.317724 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  130. 2015-08-17 09:27:04.317701 7f0e91f83700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).writer: state = open policy.server=1
  131. 2015-08-17 09:27:04.317729 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x198fe600
  132. 2015-08-17 09:27:04.317722 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader got message 105622 0x1fc13400 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.312290) v2
  133. 2015-08-17 09:27:04.317749 7f0e92084700 20 -- 10.0.231.50:6877/22176 queue 0x1fc13400 prio 127
  134. 2015-08-17 09:27:04.317732 7f0e91f83700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).write_ack 105622
  135. 2015-08-17 09:27:04.317761 7f0e92084700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader reading tag...
  136. 2015-08-17 09:27:04.317763 7f0e91f83700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).writer: state = open policy.server=1
  137. 2015-08-17 09:27:04.317764 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.55 10.0.230.51:0/12818 105622 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.312290) v2 ==== 47+0+0 (2064768797 0 0) 0x1fc13400 con 0x13347a60
  138. 2015-08-17 09:27:04.317782 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x1fc13400
  139. 2015-08-17 09:27:04.317775 7f0e91f83700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).writer sleeping
  140. 2015-08-17 09:27:04.317785 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  141. 2015-08-17 09:27:04.317789 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x1fc13400
  142. 2015-08-17 09:27:04.317770 7f0e91e82700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).writer: state = open policy.server=1
  143. 2015-08-17 09:27:04.317807 7f0e91e82700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).write_ack 105622
  144. 2015-08-17 09:27:04.317827 7f0e91e82700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).writer: state = open policy.server=1
  145. 2015-08-17 09:27:04.317837 7f0e91e82700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).writer sleeping
  146. 2015-08-17 09:27:04.325555 7f0e92185700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).reader couldn't read tag, (0) Success
  147. 2015-08-17 09:27:04.325581 7f0e92185700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).fault (0) Success
  148. 2015-08-17 09:27:04.325574 7f0e92084700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).reader couldn't read tag, (0) Success
  149. 2015-08-17 09:27:04.325594 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).fault on lossy channel, failing
  150. 2015-08-17 09:27:04.325598 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=2 pgs=85 cs=1 l=1 c=0x14542c00).stop
  151. 2015-08-17 09:27:04.325595 7f0e92084700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).fault (0) Success
  152. 2015-08-17 09:27:04.325620 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).unregister_pipe
  153. 2015-08-17 09:27:04.325625 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).fault on lossy channel, failing
  154. 2015-08-17 09:27:04.325631 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=2 pgs=86 cs=1 l=1 c=0x13347a60).stop
  155. 2015-08-17 09:27:04.325626 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).discard_queue
  156. 2015-08-17 09:27:04.325639 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).unregister_pipe
  157. 2015-08-17 09:27:04.325645 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).discard_queue
  158. 2015-08-17 09:27:04.325647 7f0e92185700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).reader done
  159. 2015-08-17 09:27:04.325657 7f0e92084700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).reader done
  160. 2015-08-17 09:27:04.325654 7f0e91f83700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).writer finishing
  161. 2015-08-17 09:27:04.325673 7f0e91f83700 10 -- 10.0.230.50:6877/22176 queue_reap 0x246c2000
  162. 2015-08-17 09:27:04.325665 7f0e91e82700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).writer finishing
  163. 2015-08-17 09:27:04.325681 7f0e91f83700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).writer done
  164. 2015-08-17 09:27:04.325684 7f0e91e82700 10 -- 10.0.231.50:6877/22176 queue_reap 0x24769000
  165. 2015-08-17 09:27:04.325692 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  166. 2015-08-17 09:27:04.325695 7f0e91e82700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).writer done
  167. 2015-08-17 09:27:04.325702 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x246c2000 10.0.230.51:0/12818
  168. 2015-08-17 09:27:04.325701 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  169. 2015-08-17 09:27:04.325709 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).discard_queue
  170. 2015-08-17 09:27:04.325720 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).unregister_pipe - not registered
  171. 2015-08-17 09:27:04.325715 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x24769000 10.0.230.51:0/12818
  172. 2015-08-17 09:27:04.325727 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).discard_queue
  173. 2015-08-17 09:27:04.325730 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x246c2000 sd=407 :6877 s=4 pgs=85 cs=1 l=1 c=0x14542c00).join
  174. 2015-08-17 09:27:04.325755 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).unregister_pipe - not registered
  175. 2015-08-17 09:27:04.325771 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12818 pipe(0x24769000 sd=408 :6877 s=4 pgs=86 cs=1 l=1 c=0x13347a60).join
  176. 2015-08-17 09:27:04.326387 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x246c2000 10.0.230.51:0/12818
  177. 2015-08-17 09:27:04.326409 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x246c2000
  178. 2015-08-17 09:27:04.326412 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  179. 2015-08-17 09:27:04.326527 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x24769000 10.0.230.51:0/12818
  180. 2015-08-17 09:27:04.326545 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x24769000
  181. 2015-08-17 09:27:04.326550 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  182. 2015-08-17 09:27:04.332316 7f0eae511700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader got MSG
  183. 2015-08-17 09:27:04.332342 7f0eae511700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader got envelope type=70 src osd.45 front=47 data=0 off 0
  184. 2015-08-17 09:27:04.332384 7f0eae410700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader got MSG
  185. 2015-08-17 09:27:04.332413 7f0eae410700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader got envelope type=70 src osd.45 front=47 data=0 off 0
  186. 2015-08-17 09:27:04.332361 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader wants 47 from dispatch throttler 0/104857600
  187. 2015-08-17 09:27:04.332538 7f0eae511700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader got front 47
  188. 2015-08-17 09:27:04.332572 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).aborted = 0
  189. 2015-08-17 09:27:04.332589 7f0eae511700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader got 47 + 0 + 0 byte message
  190. 2015-08-17 09:27:04.332444 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader wants 47 from dispatch throttler 0/104857600
  191. 2015-08-17 09:27:04.332615 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader got message 133057 0x23805600 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.327075) v2
  192. 2015-08-17 09:27:04.332697 7f0eae410700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader got front 47
  193. 2015-08-17 09:27:04.332727 7f0eae511700 20 -- 10.0.231.50:6877/22176 queue 0x23805600 prio 127
  194. 2015-08-17 09:27:04.332734 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).aborted = 0
  195. 2015-08-17 09:27:04.332754 7f0eae511700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader reading tag...
  196. 2015-08-17 09:27:04.332756 7f0eae410700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader got 47 + 0 + 0 byte message
  197. 2015-08-17 09:27:04.332757 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.45 10.0.231.51:0/7523 133057 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.327075) v2 ==== 47+0+0 (3193107341 0 0) 0x23805600 con 0x1370d120
  198. 2015-08-17 09:27:04.332774 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x23805600
  199. 2015-08-17 09:27:04.332758 7f0eabfec700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).writer: state = open policy.server=1
  200. 2015-08-17 09:27:04.332777 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  201. 2015-08-17 09:27:04.332782 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x23805600
  202. 2015-08-17 09:27:04.332780 7f0eabfec700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).write_ack 133057
  203. 2015-08-17 09:27:04.332790 7f0eabfec700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).writer: state = open policy.server=1
  204. 2015-08-17 09:27:04.332795 7f0eabfec700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).writer sleeping
  205. 2015-08-17 09:27:04.332777 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader got message 133057 0x203f9a00 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.327075) v2
  206. 2015-08-17 09:27:04.332895 7f0eae410700 20 -- 10.0.230.50:6877/22176 queue 0x203f9a00 prio 127
  207. 2015-08-17 09:27:04.332906 7f0eae410700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader reading tag...
  208. 2015-08-17 09:27:04.332910 7f0eabeeb700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).writer: state = open policy.server=1
  209. 2015-08-17 09:27:04.332929 7f0eabeeb700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).write_ack 133057
  210. 2015-08-17 09:27:04.332915 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.45 10.0.231.51:0/7523 133057 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.327075) v2 ==== 47+0+0 (3193107341 0 0) 0x203f9a00 con 0x137f98c0
  211. 2015-08-17 09:27:04.332938 7f0eabeeb700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).writer: state = open policy.server=1
  212. 2015-08-17 09:27:04.332940 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x203f9a00
  213. 2015-08-17 09:27:04.332942 7f0eabeeb700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).writer sleeping
  214. 2015-08-17 09:27:04.332945 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  215. 2015-08-17 09:27:04.332953 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x203f9a00
  216. 2015-08-17 09:27:04.339488 7f0eae410700 2 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).reader couldn't read tag, (0) Success
  217. 2015-08-17 09:27:04.339505 7f0eae511700 2 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).reader couldn't read tag, (0) Success
  218. 2015-08-17 09:27:04.339519 7f0eae410700 2 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).fault (0) Success
  219. 2015-08-17 09:27:04.339523 7f0eae511700 2 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).fault (0) Success
  220. 2015-08-17 09:27:04.339542 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).fault on lossy channel, failing
  221. 2015-08-17 09:27:04.339547 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=2 pgs=28 cs=1 l=1 c=0x1370d120).stop
  222. 2015-08-17 09:27:04.339548 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).fault on lossy channel, failing
  223. 2015-08-17 09:27:04.339555 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=2 pgs=27 cs=1 l=1 c=0x137f98c0).stop
  224. 2015-08-17 09:27:04.339558 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).unregister_pipe
  225. 2015-08-17 09:27:04.339564 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).discard_queue
  226. 2015-08-17 09:27:04.339576 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).unregister_pipe
  227. 2015-08-17 09:27:04.339578 7f0eae511700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).reader done
  228. 2015-08-17 09:27:04.339582 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).discard_queue
  229. 2015-08-17 09:27:04.339581 7f0eabfec700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).writer finishing
  230. 2015-08-17 09:27:04.339595 7f0eabfec700 10 -- 10.0.231.50:6877/22176 queue_reap 0x12aa4800
  231. 2015-08-17 09:27:04.339595 7f0eae410700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).reader done
  232. 2015-08-17 09:27:04.339601 7f0eabfec700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).writer done
  233. 2015-08-17 09:27:04.339601 7f0eabeeb700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).writer finishing
  234. 2015-08-17 09:27:04.339609 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  235. 2015-08-17 09:27:04.339619 7f0eabeeb700 10 -- 10.0.230.50:6877/22176 queue_reap 0x1299c800
  236. 2015-08-17 09:27:04.339621 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x12aa4800 10.0.231.51:0/7523
  237. 2015-08-17 09:27:04.339627 7f0eabeeb700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).writer done
  238. 2015-08-17 09:27:04.339627 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).discard_queue
  239. 2015-08-17 09:27:04.339638 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).unregister_pipe - not registered
  240. 2015-08-17 09:27:04.339636 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  241. 2015-08-17 09:27:04.339648 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x12aa4800 sd=40 :6877 s=4 pgs=28 cs=1 l=1 c=0x1370d120).join
  242. 2015-08-17 09:27:04.339648 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x1299c800 10.0.231.51:0/7523
  243. 2015-08-17 09:27:04.339656 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).discard_queue
  244. 2015-08-17 09:27:04.339673 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).unregister_pipe - not registered
  245. 2015-08-17 09:27:04.339687 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/7523 pipe(0x1299c800 sd=101 :6877 s=4 pgs=27 cs=1 l=1 c=0x137f98c0).join
  246. 2015-08-17 09:27:04.339711 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x12aa4800 10.0.231.51:0/7523
  247. 2015-08-17 09:27:04.339723 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x12aa4800
  248. 2015-08-17 09:27:04.339725 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  249. 2015-08-17 09:27:04.339798 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x1299c800 10.0.231.51:0/7523
  250. 2015-08-17 09:27:04.339812 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x1299c800
  251. 2015-08-17 09:27:04.339817 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  252. 2015-08-17 09:27:04.352866 7f0ea729f700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader got MSG
  253. 2015-08-17 09:27:04.352890 7f0ea729f700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader got envelope type=70 src osd.84 front=47 data=0 off 0
  254. 2015-08-17 09:27:04.352909 7f0ea709d700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader got MSG
  255. 2015-08-17 09:27:04.352933 7f0ea709d700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader got envelope type=70 src osd.84 front=47 data=0 off 0
  256. 2015-08-17 09:27:04.352910 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader wants 47 from dispatch throttler 0/104857600
  257. 2015-08-17 09:27:04.353134 7f0ea729f700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader got front 47
  258. 2015-08-17 09:27:04.353146 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).aborted = 0
  259. 2015-08-17 09:27:04.353152 7f0ea729f700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader got 47 + 0 + 0 byte message
  260. 2015-08-17 09:27:04.352954 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader wants 47 from dispatch throttler 0/104857600
  261. 2015-08-17 09:27:04.353199 7f0ea709d700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader got front 47
  262. 2015-08-17 09:27:04.353207 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).aborted = 0
  263. 2015-08-17 09:27:04.353211 7f0ea709d700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader got 47 + 0 + 0 byte message
  264. 2015-08-17 09:27:04.353166 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader got message 132982 0x1f077600 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.347462) v2
  265. 2015-08-17 09:27:04.353253 7f0ea729f700 20 -- 10.0.230.50:6877/22176 queue 0x1f077600 prio 127
  266. 2015-08-17 09:27:04.353264 7f0ea729f700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader reading tag...
  267. 2015-08-17 09:27:04.353271 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.84 10.0.230.51:0/12191 132982 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.347462) v2 ==== 47+0+0 (1359677521 0 0) 0x1f077600 con 0x1396ee00
  268. 2015-08-17 09:27:04.353301 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x1f077600
  269. 2015-08-17 09:27:04.353270 7f0ea6f9c700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).writer: state = open policy.server=1
  270. 2015-08-17 09:27:04.353306 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  271. 2015-08-17 09:27:04.353307 7f0ea6f9c700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).write_ack 132982
  272. 2015-08-17 09:27:04.353312 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x1f077600
  273. 2015-08-17 09:27:04.353319 7f0ea6f9c700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).writer: state = open policy.server=1
  274. 2015-08-17 09:27:04.353329 7f0ea6f9c700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).writer sleeping
  275. 2015-08-17 09:27:04.353226 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader got message 132982 0x18675e00 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.347462) v2
  276. 2015-08-17 09:27:04.353354 7f0ea709d700 20 -- 10.0.231.50:6877/22176 queue 0x18675e00 prio 127
  277. 2015-08-17 09:27:04.353367 7f0ea709d700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader reading tag...
  278. 2015-08-17 09:27:04.353371 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.84 10.0.230.51:0/12191 132982 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.347462) v2 ==== 47+0+0 (1359677521 0 0) 0x18675e00 con 0x13d6b700
  279. 2015-08-17 09:27:04.353387 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x18675e00
  280. 2015-08-17 09:27:04.353372 7f0ea6d9a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).writer: state = open policy.server=1
  281. 2015-08-17 09:27:04.353391 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  282. 2015-08-17 09:27:04.353395 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x18675e00
  283. 2015-08-17 09:27:04.353393 7f0ea6d9a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).write_ack 132982
  284. 2015-08-17 09:27:04.353404 7f0ea6d9a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).writer: state = open policy.server=1
  285. 2015-08-17 09:27:04.353409 7f0ea6d9a700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).writer sleeping
  286. 2015-08-17 09:27:04.359828 7f0ea729f700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).reader couldn't read tag, (0) Success
  287. 2015-08-17 09:27:04.359862 7f0ea729f700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).fault (0) Success
  288. 2015-08-17 09:27:04.359870 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).fault on lossy channel, failing
  289. 2015-08-17 09:27:04.359875 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=2 pgs=1 cs=1 l=1 c=0x1396ee00).stop
  290. 2015-08-17 09:27:04.359883 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).unregister_pipe
  291. 2015-08-17 09:27:04.359902 7f0ea709d700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).reader couldn't read tag, (0) Success
  292. 2015-08-17 09:27:04.359934 7f0ea709d700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).fault (0) Success
  293. 2015-08-17 09:27:04.359945 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).fault on lossy channel, failing
  294. 2015-08-17 09:27:04.359950 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=2 pgs=2 cs=1 l=1 c=0x13d6b700).stop
  295. 2015-08-17 09:27:04.359957 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).unregister_pipe
  296. 2015-08-17 09:27:04.359888 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).discard_queue
  297. 2015-08-17 09:27:04.359963 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).discard_queue
  298. 2015-08-17 09:27:04.359969 7f0ea729f700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).reader done
  299. 2015-08-17 09:27:04.359976 7f0ea709d700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).reader done
  300. 2015-08-17 09:27:04.359980 7f0ea6d9a700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).writer finishing
  301. 2015-08-17 09:27:04.359972 7f0ea6f9c700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).writer finishing
  302. 2015-08-17 09:27:04.359989 7f0ea6d9a700 10 -- 10.0.231.50:6877/22176 queue_reap 0x142c5800
  303. 2015-08-17 09:27:04.359990 7f0ea6f9c700 10 -- 10.0.230.50:6877/22176 queue_reap 0x142c1000
  304. 2015-08-17 09:27:04.359995 7f0ea6d9a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).writer done
  305. 2015-08-17 09:27:04.359997 7f0ea6f9c700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).writer done
  306. 2015-08-17 09:27:04.360007 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  307. 2015-08-17 09:27:04.360011 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  308. 2015-08-17 09:27:04.360019 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x142c1000 10.0.230.51:0/12191
  309. 2015-08-17 09:27:04.360024 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x142c5800 10.0.230.51:0/12191
  310. 2015-08-17 09:27:04.360030 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).discard_queue
  311. 2015-08-17 09:27:04.360027 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).discard_queue
  312. 2015-08-17 09:27:04.360043 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).unregister_pipe - not registered
  313. 2015-08-17 09:27:04.360045 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).unregister_pipe - not registered
  314. 2015-08-17 09:27:04.360055 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c5800 sd=204 :6877 s=4 pgs=2 cs=1 l=1 c=0x13d6b700).join
  315. 2015-08-17 09:27:04.360059 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/12191 pipe(0x142c1000 sd=202 :6877 s=4 pgs=1 cs=1 l=1 c=0x1396ee00).join
  316. 2015-08-17 09:27:04.360137 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x142c1000 10.0.230.51:0/12191
  317. 2015-08-17 09:27:04.360154 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x142c1000
  318. 2015-08-17 09:27:04.360159 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  319. 2015-08-17 09:27:04.360234 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x142c5800 10.0.230.51:0/12191
  320. 2015-08-17 09:27:04.360252 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x142c5800
  321. 2015-08-17 09:27:04.360255 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  322. 2015-08-17 09:27:04.389379 7f0ea25d3700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader got MSG
  323. 2015-08-17 09:27:04.389402 7f0ea25d3700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader got envelope type=70 src osd.71 front=47 data=0 off 0
  324. 2015-08-17 09:27:04.389415 7f0ea27d5700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader got MSG
  325. 2015-08-17 09:27:04.389434 7f0ea27d5700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader got envelope type=70 src osd.71 front=47 data=0 off 0
  326. 2015-08-17 09:27:04.389424 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader wants 47 from dispatch throttler 0/104857600
  327. 2015-08-17 09:27:04.389708 7f0ea25d3700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader got front 47
  328. 2015-08-17 09:27:04.389720 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).aborted = 0
  329. 2015-08-17 09:27:04.389725 7f0ea25d3700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader got 47 + 0 + 0 byte message
  330. 2015-08-17 09:27:04.389460 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader wants 47 from dispatch throttler 0/104857600
  331. 2015-08-17 09:27:04.389783 7f0ea27d5700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader got front 47
  332. 2015-08-17 09:27:04.389799 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).aborted = 0
  333. 2015-08-17 09:27:04.389808 7f0ea27d5700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader got 47 + 0 + 0 byte message
  334. 2015-08-17 09:27:04.389748 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader got message 132921 0x1fbff800 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.384279) v2
  335. 2015-08-17 09:27:04.389850 7f0ea25d3700 20 -- 10.0.231.50:6877/22176 queue 0x1fbff800 prio 127
  336. 2015-08-17 09:27:04.389862 7f0ea25d3700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader reading tag...
  337. 2015-08-17 09:27:04.389868 7f0ea24d2700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).writer: state = open policy.server=1
  338. 2015-08-17 09:27:04.389868 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.71 10.0.231.51:0/21016 132921 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.384279) v2 ==== 47+0+0 (3119970783 0 0) 0x1fbff800 con 0x144ce880
  339. 2015-08-17 09:27:04.389906 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x1fbff800
  340. 2015-08-17 09:27:04.389903 7f0ea24d2700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).write_ack 132921
  341. 2015-08-17 09:27:04.389913 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  342. 2015-08-17 09:27:04.389918 7f0ea24d2700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).writer: state = open policy.server=1
  343. 2015-08-17 09:27:04.389923 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x1fbff800
  344. 2015-08-17 09:27:04.389926 7f0ea24d2700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).writer sleeping
  345. 2015-08-17 09:27:04.389829 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader got message 132921 0x1356cc00 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.384279) v2
  346. 2015-08-17 09:27:04.389963 7f0ea27d5700 20 -- 10.0.230.50:6877/22176 queue 0x1356cc00 prio 127
  347. 2015-08-17 09:27:04.389976 7f0ea27d5700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader reading tag...
  348. 2015-08-17 09:27:04.389983 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.71 10.0.231.51:0/21016 132921 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.384279) v2 ==== 47+0+0 (3119970783 0 0) 0x1356cc00 con 0x144c9a20
  349. 2015-08-17 09:27:04.389981 7f0ea26d4700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).writer: state = open policy.server=1
  350. 2015-08-17 09:27:04.390007 7f0ea26d4700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).write_ack 132921
  351. 2015-08-17 09:27:04.390020 7f0ea26d4700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).writer: state = open policy.server=1
  352. 2015-08-17 09:27:04.390004 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x1356cc00
  353. 2015-08-17 09:27:04.390026 7f0ea26d4700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).writer sleeping
  354. 2015-08-17 09:27:04.390030 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  355. 2015-08-17 09:27:04.390037 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x1356cc00
  356. 2015-08-17 09:27:04.397626 7f0ea27d5700 2 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).reader couldn't read tag, (0) Success
  357. 2015-08-17 09:27:04.397663 7f0ea27d5700 2 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).fault (0) Success
  358. 2015-08-17 09:27:04.397689 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).fault on lossy channel, failing
  359. 2015-08-17 09:27:04.397697 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=2 pgs=41 cs=1 l=1 c=0x144c9a20).stop
  360. 2015-08-17 09:27:04.397665 7f0ea25d3700 2 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).reader couldn't read tag, (0) Success
  361. 2015-08-17 09:27:04.397711 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).unregister_pipe
  362. 2015-08-17 09:27:04.397719 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).discard_queue
  363. 2015-08-17 09:27:04.397719 7f0ea25d3700 2 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).fault (0) Success
  364. 2015-08-17 09:27:04.397733 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).fault on lossy channel, failing
  365. 2015-08-17 09:27:04.397736 7f0ea27d5700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).reader done
  366. 2015-08-17 09:27:04.397748 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=2 pgs=42 cs=1 l=1 c=0x144ce880).stop
  367. 2015-08-17 09:27:04.397760 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).unregister_pipe
  368. 2015-08-17 09:27:04.397750 7f0ea26d4700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).writer finishing
  369. 2015-08-17 09:27:04.397768 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).discard_queue
  370. 2015-08-17 09:27:04.397772 7f0ea26d4700 10 -- 10.0.230.50:6877/22176 queue_reap 0x14535800
  371. 2015-08-17 09:27:04.397784 7f0ea25d3700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).reader done
  372. 2015-08-17 09:27:04.397784 7f0ea26d4700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).writer done
  373. 2015-08-17 09:27:04.397795 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  374. 2015-08-17 09:27:04.397789 7f0ea24d2700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).writer finishing
  375. 2015-08-17 09:27:04.397809 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x14535800 10.0.231.51:0/21016
  376. 2015-08-17 09:27:04.397816 7f0ea24d2700 10 -- 10.0.231.50:6877/22176 queue_reap 0x14571000
  377. 2015-08-17 09:27:04.397818 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).discard_queue
  378. 2015-08-17 09:27:04.397826 7f0ea24d2700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).writer done
  379. 2015-08-17 09:27:04.397835 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).unregister_pipe - not registered
  380. 2015-08-17 09:27:04.397834 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  381. 2015-08-17 09:27:04.397848 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x14571000 10.0.231.51:0/21016
  382. 2015-08-17 09:27:04.397848 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14535800 sd=239 :6877 s=4 pgs=41 cs=1 l=1 c=0x144c9a20).join
  383. 2015-08-17 09:27:04.397855 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).discard_queue
  384. 2015-08-17 09:27:04.397869 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).unregister_pipe - not registered
  385. 2015-08-17 09:27:04.397879 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.231.51:0/21016 pipe(0x14571000 sd=240 :6877 s=4 pgs=42 cs=1 l=1 c=0x144ce880).join
  386. 2015-08-17 09:27:04.397929 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x14535800 10.0.231.51:0/21016
  387. 2015-08-17 09:27:04.397942 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x14535800
  388. 2015-08-17 09:27:04.397947 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  389. 2015-08-17 09:27:04.397966 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x14571000 10.0.231.51:0/21016
  390. 2015-08-17 09:27:04.397984 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x14571000
  391. 2015-08-17 09:27:04.397989 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  392. 2015-08-17 09:27:04.527292 7f0ea6310700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader got MSG
  393. 2015-08-17 09:27:04.527333 7f0ea6310700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader got envelope type=70 src osd.61 front=47 data=0 off 0
  394. 2015-08-17 09:27:04.527624 7f0ea6411700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader got MSG
  395. 2015-08-17 09:27:04.527362 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader wants 47 from dispatch throttler 0/104857600
  396. 2015-08-17 09:27:04.527688 7f0ea6411700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader got envelope type=70 src osd.61 front=47 data=0 off 0
  397. 2015-08-17 09:27:04.527718 7f0ea6310700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader got front 47
  398. 2015-08-17 09:27:04.527754 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).aborted = 0
  399. 2015-08-17 09:27:04.527764 7f0ea6310700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader got 47 + 0 + 0 byte message
  400. 2015-08-17 09:27:04.527719 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader wants 47 from dispatch throttler 0/104857600
  401. 2015-08-17 09:27:04.527937 7f0ea6411700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader got front 47
  402. 2015-08-17 09:27:04.527953 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).aborted = 0
  403. 2015-08-17 09:27:04.527962 7f0ea6411700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader got 47 + 0 + 0 byte message
  404. 2015-08-17 09:27:04.527788 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader got message 132866 0x173c0200 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.521559) v2
  405. 2015-08-17 09:27:04.528024 7f0ea6310700 20 -- 10.0.230.50:6877/22176 queue 0x173c0200 prio 127
  406. 2015-08-17 09:27:04.528045 7f0ea6310700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader reading tag...
  407. 2015-08-17 09:27:04.528048 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.61 10.0.230.51:0/11920 132866 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.521559) v2 ==== 47+0+0 (4103026685 0 0) 0x173c0200 con 0x1396f0c0
  408. 2015-08-17 09:27:04.528070 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x173c0200
  409. 2015-08-17 09:27:04.528075 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  410. 2015-08-17 09:27:04.528051 7f0ea610e700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).writer: state = open policy.server=1
  411. 2015-08-17 09:27:04.528083 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x173c0200
  412. 2015-08-17 09:27:04.528086 7f0ea610e700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).write_ack 132866
  413. 2015-08-17 09:27:04.528124 7f0ea610e700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).writer: state = open policy.server=1
  414. 2015-08-17 09:27:04.528139 7f0ea610e700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).writer sleeping
  415. 2015-08-17 09:27:04.527995 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader got message 132866 0x159c3200 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.521559) v2
  416. 2015-08-17 09:27:04.528177 7f0ea6411700 20 -- 10.0.231.50:6877/22176 queue 0x159c3200 prio 127
  417. 2015-08-17 09:27:04.528203 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.61 10.0.230.51:0/11920 132866 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.521559) v2 ==== 47+0+0 (4103026685 0 0) 0x159c3200 con 0x13d6b9c0
  418. 2015-08-17 09:27:04.528232 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x159c3200
  419. 2015-08-17 09:27:04.528202 7f0ea6411700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader reading tag...
  420. 2015-08-17 09:27:04.528238 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  421. 2015-08-17 09:27:04.528247 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x159c3200
  422. 2015-08-17 09:27:04.528234 7f0ea620f700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).writer: state = open policy.server=1
  423. 2015-08-17 09:27:04.528255 7f0ea620f700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).write_ack 132866
  424. 2015-08-17 09:27:04.528277 7f0ea620f700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).writer: state = open policy.server=1
  425. 2015-08-17 09:27:04.528284 7f0ea620f700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).writer sleeping
  426. 2015-08-17 09:27:04.533726 7f0ea6310700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).reader couldn't read tag, (0) Success
  427. 2015-08-17 09:27:04.533776 7f0ea6411700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader couldn't read tag, (0) Success
  428. 2015-08-17 09:27:04.533794 7f0ea6310700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).fault (0) Success
  429. 2015-08-17 09:27:04.533806 7f0ea6411700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).fault (0) Success
  430. 2015-08-17 09:27:04.533810 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).fault on lossy channel, failing
  431. 2015-08-17 09:27:04.533819 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=2 pgs=58 cs=1 l=1 c=0x1396f0c0).stop
  432. 2015-08-17 09:27:04.533830 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).fault on lossy channel, failing
  433. 2015-08-17 09:27:04.533836 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=2 pgs=59 cs=1 l=1 c=0x13d6b9c0).stop
  434. 2015-08-17 09:27:04.533834 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).unregister_pipe
  435. 2015-08-17 09:27:04.533846 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).discard_queue
  436. 2015-08-17 09:27:04.533847 7f0ea620f700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).writer finishing
  437. 2015-08-17 09:27:04.533867 7f0ea6310700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).reader done
  438. 2015-08-17 09:27:04.533877 7f0ea620f700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).writer done
  439. 2015-08-17 09:27:04.533873 7f0ea610e700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).writer finishing
  440. 2015-08-17 09:27:04.533881 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).unregister_pipe
  441. 2015-08-17 09:27:04.533889 7f0ea610e700 10 -- 10.0.230.50:6877/22176 queue_reap 0x142bc800
  442. 2015-08-17 09:27:04.533888 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).discard_queue
  443. 2015-08-17 09:27:04.533896 7f0ea610e700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).writer done
  444. 2015-08-17 09:27:04.533902 7f0ea6411700 10 -- 10.0.231.50:6877/22176 queue_reap 0x14302000
  445. 2015-08-17 09:27:04.533908 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  446. 2015-08-17 09:27:04.533922 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x142bc800 10.0.230.51:0/11920
  447. 2015-08-17 09:27:04.533928 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).discard_queue
  448. 2015-08-17 09:27:04.533940 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).unregister_pipe - not registered
  449. 2015-08-17 09:27:04.533950 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x142bc800 sd=210 :6877 s=4 pgs=58 cs=1 l=1 c=0x1396f0c0).join
  450. 2015-08-17 09:27:04.533994 7f0ea6411700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).reader done
  451. 2015-08-17 09:27:04.534005 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  452. 2015-08-17 09:27:04.534018 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x14302000 10.0.230.51:0/11920
  453. 2015-08-17 09:27:04.534025 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).discard_queue
  454. 2015-08-17 09:27:04.534042 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).unregister_pipe - not registered
  455. 2015-08-17 09:27:04.534065 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x142bc800 10.0.230.51:0/11920
  456. 2015-08-17 09:27:04.534068 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/11920 pipe(0x14302000 sd=209 :6877 s=4 pgs=59 cs=1 l=1 c=0x13d6b9c0).join
  457. 2015-08-17 09:27:04.534079 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x142bc800
  458. 2015-08-17 09:27:04.534082 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  459. 2015-08-17 09:27:04.534163 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x14302000 10.0.230.51:0/11920
  460. 2015-08-17 09:27:04.534181 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x14302000
  461. 2015-08-17 09:27:04.534185 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  462. 2015-08-17 09:27:04.601194 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got MSG
  463. 2015-08-17 09:27:04.601242 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got envelope type=70 src osd.77 front=47 data=0 off 0
  464. 2015-08-17 09:27:04.601230 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got MSG
  465. 2015-08-17 09:27:04.601255 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader wants 47 from dispatch throttler 0/104857600
  466. 2015-08-17 09:27:04.601260 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got envelope type=70 src osd.77 front=47 data=0 off 0
  467. 2015-08-17 09:27:04.601268 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader wants 47 from dispatch throttler 0/104857600
  468. 2015-08-17 09:27:04.601266 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got front 47
  469. 2015-08-17 09:27:04.601274 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got front 47
  470. 2015-08-17 09:27:04.601273 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).aborted = 0
  471. 2015-08-17 09:27:04.601278 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).aborted = 0
  472. 2015-08-17 09:27:04.601279 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got 47 + 0 + 0 byte message
  473. 2015-08-17 09:27:04.601282 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got 47 + 0 + 0 byte message
  474. 2015-08-17 09:27:04.601314 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader got message 133031 0x230aba00 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.595478) v2
  475. 2015-08-17 09:27:04.601332 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 queue 0x230aba00 prio 127
  476. 2015-08-17 09:27:04.601324 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader got message 133031 0x234e5800 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.595478) v2
  477. 2015-08-17 09:27:04.601339 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 queue 0x234e5800 prio 127
  478. 2015-08-17 09:27:04.601345 7f0e9df8d700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader reading tag...
  479. 2015-08-17 09:27:04.601349 7f0e9de8c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader reading tag...
  480. 2015-08-17 09:27:04.601352 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).writer: state = open policy.server=1
  481. 2015-08-17 09:27:04.601365 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.77 10.0.230.51:0/30644 133031 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.595478) v2 ==== 47+0+0 (1509286384 0 0) 0x230aba00 con 0x14686040
  482. 2015-08-17 09:27:04.601377 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).write_ack 133031
  483. 2015-08-17 09:27:04.601384 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x230aba00
  484. 2015-08-17 09:27:04.601355 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).writer: state = open policy.server=1
  485. 2015-08-17 09:27:04.601389 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  486. 2015-08-17 09:27:04.601394 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x230aba00
  487. 2015-08-17 09:27:04.601390 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).writer: state = open policy.server=1
  488. 2015-08-17 09:27:04.601390 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).write_ack 133031
  489. 2015-08-17 09:27:04.601405 7f0e9dc8a700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).writer sleeping
  490. 2015-08-17 09:27:04.601414 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).writer: state = open policy.server=1
  491. 2015-08-17 09:27:04.601429 7f0e9dd8b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).writer sleeping
  492. 2015-08-17 09:27:04.601361 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.77 10.0.230.51:0/30644 133031 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.595478) v2 ==== 47+0+0 (1509286384 0 0) 0x234e5800 con 0x145c6ca0
  493. 2015-08-17 09:27:04.601444 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x234e5800
  494. 2015-08-17 09:27:04.601450 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  495. 2015-08-17 09:27:04.601459 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x234e5800
  496. 2015-08-17 09:27:04.609379 7f0e9a205700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader got MSG
  497. 2015-08-17 09:27:04.609404 7f0e9a205700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader got envelope type=70 src osd.99 front=47 data=0 off 0
  498. 2015-08-17 09:27:04.609419 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader wants 47 from dispatch throttler 0/104857600
  499. 2015-08-17 09:27:04.609430 7f0e9a205700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader got front 47
  500. 2015-08-17 09:27:04.609436 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).aborted = 0
  501. 2015-08-17 09:27:04.609430 7f0e988ec700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader got MSG
  502. 2015-08-17 09:27:04.609442 7f0e9a205700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader got 47 + 0 + 0 byte message
  503. 2015-08-17 09:27:04.609447 7f0e988ec700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader got envelope type=70 src osd.99 front=47 data=0 off 0
  504. 2015-08-17 09:27:04.609463 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader wants 47 from dispatch throttler 0/104857600
  505. 2015-08-17 09:27:04.609460 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader got message 105244 0x14d2a800 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.608827) v2
  506. 2015-08-17 09:27:04.609473 7f0e9a205700 20 -- 10.0.230.50:6877/22176 queue 0x14d2a800 prio 127
  507. 2015-08-17 09:27:04.609474 7f0e988ec700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader got front 47
  508. 2015-08-17 09:27:04.609483 7f0e9a205700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader reading tag...
  509. 2015-08-17 09:27:04.609523 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.99 10.0.230.52:0/6507 105244 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.608827) v2 ==== 47+0+0 (2646077074 0 0) 0x14d2a800 con 0x145c44c0
  510. 2015-08-17 09:27:04.609537 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x14d2a800
  511. 2015-08-17 09:27:04.609541 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  512. 2015-08-17 09:27:04.609546 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x14d2a800
  513. 2015-08-17 09:27:04.609484 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).aborted = 0
  514. 2015-08-17 09:27:04.609499 7f0ea36e4700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).writer: state = open policy.server=1
  515. 2015-08-17 09:27:04.609576 7f0ea36e4700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).write_ack 105244
  516. 2015-08-17 09:27:04.609589 7f0ea36e4700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).writer: state = open policy.server=1
  517. 2015-08-17 09:27:04.609569 7f0e988ec700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader got 47 + 0 + 0 byte message
  518. 2015-08-17 09:27:04.609595 7f0ea36e4700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).writer sleeping
  519. 2015-08-17 09:27:04.609607 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader got message 105244 0x1b270000 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.608827) v2
  520. 2015-08-17 09:27:04.609619 7f0e988ec700 20 -- 10.0.231.50:6877/22176 queue 0x1b270000 prio 127
  521. 2015-08-17 09:27:04.609640 7f0e988ec700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader reading tag...
  522. 2015-08-17 09:27:04.609648 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.99 10.0.230.52:0/6507 105244 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.608827) v2 ==== 47+0+0 (2646077074 0 0) 0x1b270000 con 0x13344780
  523. 2015-08-17 09:27:04.609676 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x1b270000
  524. 2015-08-17 09:27:04.609648 7f0ea0fbd700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).writer: state = open policy.server=1
  525. 2015-08-17 09:27:04.609706 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  526. 2015-08-17 09:27:04.609715 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x1b270000
  527. 2015-08-17 09:27:04.609713 7f0ea0fbd700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).write_ack 105244
  528. 2015-08-17 09:27:04.609730 7f0ea0fbd700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).writer: state = open policy.server=1
  529. 2015-08-17 09:27:04.609737 7f0ea0fbd700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).writer sleeping
  530. 2015-08-17 09:27:04.611434 7f0e9df8d700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).reader couldn't read tag, (0) Success
  531. 2015-08-17 09:27:04.611474 7f0e9de8c700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).reader couldn't read tag, (0) Success
  532. 2015-08-17 09:27:04.611471 7f0e9df8d700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).fault (0) Success
  533. 2015-08-17 09:27:04.611498 7f0e9de8c700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).fault (0) Success
  534. 2015-08-17 09:27:04.611505 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).fault on lossy channel, failing
  535. 2015-08-17 09:27:04.611510 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=2 pgs=4 cs=1 l=1 c=0x14686040).stop
  536. 2015-08-17 09:27:04.611514 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).fault on lossy channel, failing
  537. 2015-08-17 09:27:04.611518 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).unregister_pipe
  538. 2015-08-17 09:27:04.611519 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=2 pgs=3 cs=1 l=1 c=0x145c6ca0).stop
  539. 2015-08-17 09:27:04.611523 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).discard_queue
  540. 2015-08-17 09:27:04.611528 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).unregister_pipe
  541. 2015-08-17 09:27:04.611532 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).discard_queue
  542. 2015-08-17 09:27:04.611533 7f0e9df8d700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).reader done
  543. 2015-08-17 09:27:04.611542 7f0e9de8c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).reader done
  544. 2015-08-17 09:27:04.611539 7f0e9dd8b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).writer finishing
  545. 2015-08-17 09:27:04.611545 7f0e9dc8a700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).writer finishing
  546. 2015-08-17 09:27:04.611557 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 queue_reap 0x14872000
  547. 2015-08-17 09:27:04.611560 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 queue_reap 0x14899000
  548. 2015-08-17 09:27:04.611566 7f0e9dc8a700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).writer done
  549. 2015-08-17 09:27:04.611566 7f0e9dd8b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).writer done
  550. 2015-08-17 09:27:04.611573 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  551. 2015-08-17 09:27:04.611589 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x14872000 10.0.230.51:0/30644
  552. 2015-08-17 09:27:04.611593 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  553. 2015-08-17 09:27:04.611598 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).discard_queue
  554. 2015-08-17 09:27:04.611604 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x14899000 10.0.230.51:0/30644
  555. 2015-08-17 09:27:04.611611 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).discard_queue
  556. 2015-08-17 09:27:04.611611 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).unregister_pipe - not registered
  557. 2015-08-17 09:27:04.611620 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).unregister_pipe - not registered
  558. 2015-08-17 09:27:04.611630 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14899000 sd=277 :6877 s=4 pgs=3 cs=1 l=1 c=0x145c6ca0).join
  559. 2015-08-17 09:27:04.611628 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/30644 pipe(0x14872000 sd=276 :6877 s=4 pgs=4 cs=1 l=1 c=0x14686040).join
  560. 2015-08-17 09:27:04.611737 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x14899000 10.0.230.51:0/30644
  561. 2015-08-17 09:27:04.611763 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x14899000
  562. 2015-08-17 09:27:04.611766 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  563. 2015-08-17 09:27:04.611754 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x14872000 10.0.230.51:0/30644
  564. 2015-08-17 09:27:04.611773 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x14872000
  565. 2015-08-17 09:27:04.611779 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  566. 2015-08-17 09:27:04.619247 7f0e9a205700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).reader couldn't read tag, (0) Success
  567. 2015-08-17 09:27:04.619273 7f0e9a205700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).fault (0) Success
  568. 2015-08-17 09:27:04.619293 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).fault on lossy channel, failing
  569. 2015-08-17 09:27:04.619298 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=2 pgs=245 cs=1 l=1 c=0x145c44c0).stop
  570. 2015-08-17 09:27:04.619306 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).unregister_pipe
  571. 2015-08-17 09:27:04.619295 7f0e988ec700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).reader couldn't read tag, (0) Success
  572. 2015-08-17 09:27:04.619313 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).discard_queue
  573. 2015-08-17 09:27:04.619316 7f0e988ec700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).fault (0) Success
  574. 2015-08-17 09:27:04.619325 7f0e9a205700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).reader done
  575. 2015-08-17 09:27:04.619341 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).fault on lossy channel, failing
  576. 2015-08-17 09:27:04.619342 7f0ea36e4700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).writer finishing
  577. 2015-08-17 09:27:04.619346 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=2 pgs=246 cs=1 l=1 c=0x13344780).stop
  578. 2015-08-17 09:27:04.619358 7f0ea36e4700 10 -- 10.0.230.50:6877/22176 queue_reap 0x20589000
  579. 2015-08-17 09:27:04.619361 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).unregister_pipe
  580. 2015-08-17 09:27:04.619367 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).discard_queue
  581. 2015-08-17 09:27:04.619366 7f0ea36e4700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).writer done
  582. 2015-08-17 09:27:04.619380 7f0e988ec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).reader done
  583. 2015-08-17 09:27:04.619377 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  584. 2015-08-17 09:27:04.619388 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x20589000 10.0.230.52:0/6507
  585. 2015-08-17 09:27:04.619396 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).discard_queue
  586. 2015-08-17 09:27:04.619405 7f0ea0fbd700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).writer finishing
  587. 2015-08-17 09:27:04.619410 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).unregister_pipe - not registered
  588. 2015-08-17 09:27:04.619421 7f0ea0fbd700 10 -- 10.0.231.50:6877/22176 queue_reap 0x24760000
  589. 2015-08-17 09:27:04.619427 7f0ea0fbd700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).writer done
  590. 2015-08-17 09:27:04.619424 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x20589000 sd=73 :6877 s=4 pgs=245 cs=1 l=1 c=0x145c44c0).join
  591. 2015-08-17 09:27:04.619449 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  592. 2015-08-17 09:27:04.619458 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x24760000 10.0.230.52:0/6507
  593. 2015-08-17 09:27:04.619462 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).discard_queue
  594. 2015-08-17 09:27:04.619469 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).unregister_pipe - not registered
  595. 2015-08-17 09:27:04.619476 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.52:0/6507 pipe(0x24760000 sd=72 :6877 s=4 pgs=246 cs=1 l=1 c=0x13344780).join
  596. 2015-08-17 09:27:04.620047 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x20589000 10.0.230.52:0/6507
  597. 2015-08-17 09:27:04.620068 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x20589000
  598. 2015-08-17 09:27:04.620074 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  599. 2015-08-17 09:27:04.620211 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x24760000 10.0.230.52:0/6507
  600. 2015-08-17 09:27:04.620235 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x24760000
  601. 2015-08-17 09:27:04.620243 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  602. 2015-08-17 09:27:04.681321 7f0ea41ef700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader got MSG
  603. 2015-08-17 09:27:04.681281 7f0ea40ee700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader got MSG
  604. 2015-08-17 09:27:04.681350 7f0ea41ef700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader got envelope type=70 src osd.52 front=47 data=0 off 0
  605. 2015-08-17 09:27:04.681361 7f0ea40ee700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader got envelope type=70 src osd.52 front=47 data=0 off 0
  606. 2015-08-17 09:27:04.681373 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader wants 47 from dispatch throttler 0/104857600
  607. 2015-08-17 09:27:04.681624 7f0ea41ef700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader got front 47
  608. 2015-08-17 09:27:04.681641 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).aborted = 0
  609. 2015-08-17 09:27:04.681648 7f0ea41ef700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader got 47 + 0 + 0 byte message
  610. 2015-08-17 09:27:04.681380 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader wants 47 from dispatch throttler 0/104857600
  611. 2015-08-17 09:27:04.681676 7f0ea40ee700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader got front 47
  612. 2015-08-17 09:27:04.681688 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).aborted = 0
  613. 2015-08-17 09:27:04.681694 7f0ea40ee700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader got 47 + 0 + 0 byte message
  614. 2015-08-17 09:27:04.681663 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader got message 133131 0x236ccc00 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.675765) v2
  615. 2015-08-17 09:27:04.681808 7f0ea41ef700 20 -- 10.0.230.50:6877/22176 queue 0x236ccc00 prio 127
  616. 2015-08-17 09:27:04.681824 7f0ea41ef700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader reading tag...
  617. 2015-08-17 09:27:04.681831 7f0ea3fed700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).writer: state = open policy.server=1
  618. 2015-08-17 09:27:04.681844 7f0ec1fc0700 1 -- 10.0.230.50:6877/22176 <== osd.52 10.0.230.51:0/17341 133131 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.675765) v2 ==== 47+0+0 (2689664203 0 0) 0x236ccc00 con 0x4f37d20
  619. 2015-08-17 09:27:04.681870 7f0ea3fed700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).write_ack 133131
  620. 2015-08-17 09:27:04.681887 7f0ea3fed700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).writer: state = open policy.server=1
  621. 2015-08-17 09:27:04.681891 7f0ea3fed700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).writer sleeping
  622. 2015-08-17 09:27:04.681881 7f0ec1fc0700 30 osd.35 186424 heartbeat_dispatch 0x236ccc00
  623. 2015-08-17 09:27:04.681900 7f0ec1fc0700 10 -- 10.0.230.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  624. 2015-08-17 09:27:04.681710 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader got message 133131 0x1e1cfe00 osd_ping(ping e186424 stamp 2015-08-17 09:27:04.675765) v2
  625. 2015-08-17 09:27:04.681906 7f0ec1fc0700 20 -- 10.0.230.50:6877/22176 done calling dispatch on 0x236ccc00
  626. 2015-08-17 09:27:04.681911 7f0ea40ee700 20 -- 10.0.231.50:6877/22176 queue 0x1e1cfe00 prio 127
  627. 2015-08-17 09:27:04.681936 7f0ea40ee700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader reading tag...
  628. 2015-08-17 09:27:04.681941 7f0ea3eec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).writer: state = open policy.server=1
  629. 2015-08-17 09:27:04.681950 7f0ea3eec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).write_ack 133131
  630. 2015-08-17 09:27:04.681940 7f0ec37c3700 1 -- 10.0.231.50:6877/22176 <== osd.52 10.0.230.51:0/17341 133131 ==== osd_ping(ping e186424 stamp 2015-08-17 09:27:04.675765) v2 ==== 47+0+0 (2689664203 0 0) 0x1e1cfe00 con 0x4f36f60
  631. 2015-08-17 09:27:04.681957 7f0ec37c3700 30 osd.35 186424 heartbeat_dispatch 0x1e1cfe00
  632. 2015-08-17 09:27:04.681957 7f0ea3eec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).writer: state = open policy.server=1
  633. 2015-08-17 09:27:04.681960 7f0ec37c3700 10 -- 10.0.231.50:6877/22176 dispatch_throttle_release 47 to dispatch throttler 47/104857600
  634. 2015-08-17 09:27:04.681962 7f0ea3eec700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).writer sleeping
  635. 2015-08-17 09:27:04.681966 7f0ec37c3700 20 -- 10.0.231.50:6877/22176 done calling dispatch on 0x1e1cfe00
  636. 2015-08-17 09:27:04.688945 7f0ea41ef700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).reader couldn't read tag, (0) Success
  637. 2015-08-17 09:27:04.688978 7f0ea41ef700 2 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).fault (0) Success
  638. 2015-08-17 09:27:04.688999 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).fault on lossy channel, failing
  639. 2015-08-17 09:27:04.688972 7f0ea40ee700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).reader couldn't read tag, (0) Success
  640. 2015-08-17 09:27:04.689028 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=2 pgs=35 cs=1 l=1 c=0x4f37d20).stop
  641. 2015-08-17 09:27:04.689037 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).unregister_pipe
  642. 2015-08-17 09:27:04.689035 7f0ea40ee700 2 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).fault (0) Success
  643. 2015-08-17 09:27:04.689044 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).discard_queue
  644. 2015-08-17 09:27:04.689048 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).fault on lossy channel, failing
  645. 2015-08-17 09:27:04.689054 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=2 pgs=36 cs=1 l=1 c=0x4f36f60).stop
  646. 2015-08-17 09:27:04.689059 7f0ea41ef700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).reader done
  647. 2015-08-17 09:27:04.689067 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).unregister_pipe
  648. 2015-08-17 09:27:04.689075 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).discard_queue
  649. 2015-08-17 09:27:04.689066 7f0ea3fed700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).writer finishing
  650. 2015-08-17 09:27:04.689093 7f0ea3fed700 10 -- 10.0.230.50:6877/22176 queue_reap 0x1442d800
  651. 2015-08-17 09:27:04.689092 7f0ea40ee700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).reader done
  652. 2015-08-17 09:27:04.689100 7f0ea3fed700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).writer done
  653. 2015-08-17 09:27:04.689106 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper
  654. 2015-08-17 09:27:04.689106 7f0ea3eec700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).writer finishing
  655. 2015-08-17 09:27:04.689119 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaping pipe 0x1442d800 10.0.230.51:0/17341
  656. 2015-08-17 09:27:04.689123 7f0ea3eec700 10 -- 10.0.231.50:6877/22176 queue_reap 0x14424800
  657. 2015-08-17 09:27:04.689131 7f0ea3eec700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).writer done
  658. 2015-08-17 09:27:04.689127 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).discard_queue
  659. 2015-08-17 09:27:04.689142 7f0ed237b700 10 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).unregister_pipe - not registered
  660. 2015-08-17 09:27:04.689143 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper
  661. 2015-08-17 09:27:04.689153 7f0ed237b700 20 -- 10.0.230.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x1442d800 sd=226 :6877 s=4 pgs=35 cs=1 l=1 c=0x4f37d20).join
  662. 2015-08-17 09:27:04.689164 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaping pipe 0x14424800 10.0.230.51:0/17341
  663. 2015-08-17 09:27:04.689176 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).discard_queue
  664. 2015-08-17 09:27:04.689203 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).unregister_pipe - not registered
  665. 2015-08-17 09:27:04.689219 7f0ed2b7c700 20 -- 10.0.231.50:6877/22176 >> 10.0.230.51:0/17341 pipe(0x14424800 sd=227 :6877 s=4 pgs=36 cs=1 l=1 c=0x4f36f60).join
  666. 2015-08-17 09:27:04.689303 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper reaped pipe 0x1442d800 10.0.230.51:0/17341
  667. 2015-08-17 09:27:04.689322 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper deleted pipe 0x1442d800
  668. 2015-08-17 09:27:04.689329 7f0ed237b700 10 -- 10.0.230.50:6877/22176 reaper done
  669. 2015-08-17 09:27:04.689417 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper reaped pipe 0x14424800 10.0.230.51:0/17341
  670. 2015-08-17 09:27:04.689441 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper deleted pipe 0x14424800
  671. 2015-08-17 09:27:04.689453 7f0ed2b7c700 10 -- 10.0.231.50:6877/22176 reaper done
  672. 2015-08-17 09:27:06.527267 7f2da408c880 0 ceph version 0.94.1 (e4bfad3a3c51054df7e537a724c8d0bf9be972ff), process ceph-osd, pid 13128
  673. 2015-08-17 09:27:06.579991 7f2da408c880 0 filestore(/var/lib/ceph/osd/ceph-35) backend xfs (magic 0x58465342)
  674. 2015-08-17 09:27:06.670570 7f2da408c880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-35) detect_features: FIEMAP ioctl is supported and appears to work
  675. 2015-08-17 09:27:06.670584 7f2da408c880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-35) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
  676. 2015-08-17 09:27:06.841830 7f2da408c880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-35) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
  677. 2015-08-17 09:27:06.862149 7f2da408c880 0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-35) detect_feature: extsize is supported and kernel 3.10.0-229.el7.x86_64 >= 3.5
  678. 2015-08-17 09:27:07.326328 7f2da408c880 0 filestore(/var/lib/ceph/osd/ceph-35) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
  679. 2015-08-17 09:27:07.340887 7f2da408c880 1 journal _open /var/lib/ceph/osd/ceph-35/journal fd 20: 4999610368 bytes, block size 4096 bytes, directio = 1, aio = 1
  680. 2015-08-17 09:27:07.350291 7f2da408c880 1 journal _open /var/lib/ceph/osd/ceph-35/journal fd 20: 4999610368 bytes, block size 4096 bytes, directio = 1, aio = 1
  681. 2015-08-17 09:27:07.377605 7f2da408c880 0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
  682. 2015-08-17 09:27:07.441891 7f2da408c880 0 osd.35 186424 crush map has features 1107558400, adjusting msgr requires for clients
  683. 2015-08-17 09:27:07.441914 7f2da408c880 0 osd.35 186424 crush map has features 1107558400 was 8705, adjusting msgr requires for mons
  684. 2015-08-17 09:27:07.441926 7f2da408c880 0 osd.35 186424 crush map has features 1107558400, adjusting msgr requires for osds
  685. 2015-08-17 09:27:07.441963 7f2da408c880 0 osd.35 186424 load_pgs
  686. 2015-08-17 09:27:14.034614 7f2da408c880 0 osd.35 186424 load_pgs opened 174 pgs
  687. 2015-08-17 09:27:14.036307 7f2da408c880 -1 osd.35 186424 log_to_monitors {default=true}
  688. 2015-08-17 09:27:14.041756 7f2d90340700 0 osd.35 186424 ignoring osdmap until we have initialized
  689. 2015-08-17 09:27:14.041806 7f2d90340700 0 osd.35 186424 ignoring osdmap until we have initialized
  690. 2015-08-17 09:27:16.272655 7f2da408c880 0 osd.35 186424 done with init, starting boot process
Advertisement
Add Comment
Please, Sign In to add comment