API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jul 8th, 2014
234
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 64.57 KB | None | 0 0
raw download clone embed print report
  1. 2014-07-08 08:46:10.895532 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76664 fc 76054 pn 0 opn 0) v3 -- ?+0 0x8c5c580
  2. 2014-07-08 08:46:10.896581 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948113 ==== paxos(lease_ack lc 76664 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (3973105693 0 0) 0x8c5c580 con 0x1b3d8c0
  3. 2014-07-08 08:46:13.261177 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  4. 2014-07-08 08:46:13.261229 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  5. 2014-07-08 08:46:13.261239 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  6. 2014-07-08 08:46:13.261248 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:13.261249 lease_expire=2014-07-08 08:46:15.895523 has v0 lc 76664
  7. 2014-07-08 08:46:13.261264 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:13.261266 lease_expire=2014-07-08 08:46:15.895523 has v0 lc 76664
  8. 2014-07-08 08:46:13.261285 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:13.261286 lease_expire=2014-07-08 08:46:15.895523 has v0 lc 76664
  9. 2014-07-08 08:46:13.261924 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  10. 2014-07-08 08:46:13.261934 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  11. 2014-07-08 08:46:13.261940 7fe4af1d1700 10 mon.node-22@0(leader).auth v148 auth
  12. 2014-07-08 08:46:13.895621 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76664 fc 76054 pn 0 opn 0) v3 -- ?+0 0x47c9180
  13. 2014-07-08 08:46:13.896842 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948114 ==== paxos(lease_ack lc 76664 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (2160257776 0 0) 0x47c9180 con 0x1b3d8c0
  14. 2014-07-08 08:46:15.695159 7fe4aab80700 1 -- 192.168.0.4:6789/0 >> :/0 pipe(0x53b4300 sd=27 :6789 s=0 pgs=0 cs=0 l=0 c=0x2067340).accept sd=27 192.168.0.4:42151/0
  15. 2014-07-08 08:46:15.695356 7fe4aab80700 10 mon.node-22@0(leader) e4 ms_verify_authorizer 192.168.0.4:0/1404003061 client protocol 0
  16. 2014-07-08 08:46:15.695818 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1404003061 1 ==== auth(proto 0 32 bytes epoch 0) v1 ==== 62+0+0 (2376736627 0 0) 0xb677440 con 0x2067340
  17. 2014-07-08 08:46:15.695869 7fe4ae9d0700 10 mon.node-22@0(leader) e4 do not have session, making new one
  18. 2014-07-08 08:46:15.695878 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_dispatch new session MonSession: client.? 192.168.0.4:0/1404003061 is open for client.? 192.168.0.4:0/1404003061
  19. 2014-07-08 08:46:15.695891 7fe4ae9d0700 10 mon.node-22@0(leader) e4 setting timeout on session
  20. 2014-07-08 08:46:15.695896 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:15.695897 lease_expire=2014-07-08 08:46:18.895612 has v0 lc 76664
  21. 2014-07-08 08:46:15.695912 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 preprocess_query auth(proto 0 32 bytes epoch 0) v1 from client.? 192.168.0.4:0/1404003061
  22. 2014-07-08 08:46:15.695922 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 prep_auth() blob_size=32
  23. 2014-07-08 08:46:15.695937 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 AuthMonitor::assign_global_id m=auth(proto 0 32 bytes epoch 0) v1 mon=0/2 last_allocated=44220 max_global_id=44296
  24. 2014-07-08 08:46:15.695943 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 next_global_id should be 44222
  25. 2014-07-08 08:46:15.695955 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1404003061 -- mon_map v1 -- ?+0 0x2b0fbc20 con 0x2067340
  26. 2014-07-08 08:46:15.696013 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1404003061 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x8729000 con 0x2067340
  27. 2014-07-08 08:46:15.696750 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1404003061 2 ==== auth(proto 2 32 bytes epoch 0) v1 ==== 62+0+0 (1306191359 0 0) 0xb676fc0 con 0x2067340
  28. 2014-07-08 08:46:15.696804 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:15.696806 lease_expire=2014-07-08 08:46:18.895612 has v0 lc 76664
  29. 2014-07-08 08:46:15.696822 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 192.168.0.4:0/1404003061
  30. 2014-07-08 08:46:15.696832 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 prep_auth() blob_size=32
  31. 2014-07-08 08:46:15.697091 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1404003061 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x8729800 con 0x2067340
  32. 2014-07-08 08:46:15.697746 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1404003061 3 ==== auth(proto 2 181 bytes epoch 0) v1 ==== 211+0+0 (2660963330 0 0) 0xb679600 con 0x2067340
  33. 2014-07-08 08:46:15.697788 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:15.697790 lease_expire=2014-07-08 08:46:18.895612 has v0 lc 76664
  34. 2014-07-08 08:46:15.697805 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 preprocess_query auth(proto 2 181 bytes epoch 0) v1 from client.? 192.168.0.4:0/1404003061
  35. 2014-07-08 08:46:15.697814 7fe4ae9d0700 10 mon.node-22@0(leader).auth v148 prep_auth() blob_size=181
  36. 2014-07-08 08:46:15.698110 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1404003061 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x8728800 con 0x2067340
  37. 2014-07-08 08:46:15.698677 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1404003061 4 ==== mon_subscribe({monmap=0+}) v2 ==== 23+0+0 (1620593354 0 0) 0x3833880 con 0x2067340
  38. 2014-07-08 08:46:15.698726 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=0+}) v2
  39. 2014-07-08 08:46:15.698745 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 0 have 4
  40. 2014-07-08 08:46:15.698760 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1404003061 -- mon_map v1 -- ?+0 0x2b0fbe00 con 0x2067340
  41. 2014-07-08 08:46:15.698789 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.4:0/1404003061 -- mon_subscribe_ack(300s) v1 -- ?+0 0xa884bc0
  42. 2014-07-08 08:46:15.698919 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44222 192.168.0.4:0/1404003061 5 ==== mon_subscribe({monmap=5+,osdmap=0}) v2 ==== 42+0+0 (453657511 0 0) 0xa882000 con 0x2067340
  43. 2014-07-08 08:46:15.698963 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osdmap=0}) v2
  44. 2014-07-08 08:46:15.698977 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  45. 2014-07-08 08:46:15.698990 7fe4ae9d0700 10 mon.node-22@0(leader).osd e385 check_sub 0x2e10900 next 0 (onetime)
  46. 2014-07-08 08:46:15.699115 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.4:0/1404003061 -- osd_map(385..385 src has 1..385) v3 -- ?+0 0xb679600
  47. 2014-07-08 08:46:15.699165 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.44222 192.168.0.4:0/1404003061 -- mon_subscribe_ack(300s) v1 -- ?+0 0x3833880
  48. 2014-07-08 08:46:15.699200 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44222 192.168.0.4:0/1404003061 6 ==== mon_subscribe({monmap=5+,osdmap=0}) v2 ==== 42+0+0 (453657511 0 0) 0xa885b80 con 0x2067340
  49. 2014-07-08 08:46:15.699228 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osdmap=0}) v2
  50. 2014-07-08 08:46:15.699240 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  51. 2014-07-08 08:46:15.699251 7fe4ae9d0700 10 mon.node-22@0(leader).osd e385 check_sub 0x2e10980 next 0 (onetime)
  52. 2014-07-08 08:46:15.699356 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.4:0/1404003061 -- osd_map(385..385 src has 1..385) v3 -- ?+0 0xb676fc0
  53. 2014-07-08 08:46:15.699389 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.44222 192.168.0.4:0/1404003061 -- mon_subscribe_ack(300s) v1 -- ?+0 0xa882000
  54. 2014-07-08 08:46:15.700244 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44222 192.168.0.4:0/1404003061 7 ==== statfs(1 v0) v1 ==== 34+0+0 (1832097438 0 0) 0xa883340 con 0x2067340
  55. 2014-07-08 08:46:15.700288 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:15.700289 lease_expire=2014-07-08 08:46:18.895612 has v0 lc 76664
  56. 2014-07-08 08:46:15.700305 7fe4ae9d0700 10 mon.node-22@0(leader).pg v37964 preprocess_query statfs(1 v0) v1 from client.44222 192.168.0.4:0/1404003061
  57. 2014-07-08 08:46:15.700317 7fe4ae9d0700 10 mon.node-22@0(leader).pg v37964 handle_statfs statfs(1 v0) v1 from client.44222
  58. 2014-07-08 08:46:15.700325 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1404003061 -- statfs_reply(1) v1 -- ?+0 0x2b0fbfe0 con 0x2067340
  59. 2014-07-08 08:46:15.701671 7fe4aab80700 2 -- 192.168.0.4:6789/0 >> 192.168.0.4:0/1404003061 pipe(0x53b4300 sd=27 :6789 s=2 pgs=1 cs=1 l=1 c=0x2067340).reader couldn't read tag, Success
  60. 2014-07-08 08:46:15.701726 7fe4aab80700 2 -- 192.168.0.4:6789/0 >> 192.168.0.4:0/1404003061 pipe(0x53b4300 sd=27 :6789 s=2 pgs=1 cs=1 l=1 c=0x2067340).fault 0: Success
  61. 2014-07-08 08:46:15.701858 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_handle_reset 0x2067340 192.168.0.4:0/1404003061
  62. 2014-07-08 08:46:15.701898 7fe4ae9d0700 10 mon.node-22@0(leader) e4 reset/close on session client.? 192.168.0.4:0/1404003061
  63. 2014-07-08 08:46:15.701914 7fe4ae9d0700 10 mon.node-22@0(leader) e4 remove_session MonSession: client.? 192.168.0.4:0/1404003061 is openallow r client.? 192.168.0.4:0/1404003061
  64. 2014-07-08 08:46:16.895739 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76664 fc 76054 pn 0 opn 0) v3 -- ?+0 0x2173e00
  65. 2014-07-08 08:46:16.896952 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948115 ==== paxos(lease_ack lc 76664 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (2250471245 0 0) 0x2173e00 con 0x1b3d8c0
  66. 2014-07-08 08:46:18.262074 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  67. 2014-07-08 08:46:18.262125 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  68. 2014-07-08 08:46:18.262136 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  69. 2014-07-08 08:46:18.262144 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:18.262144 lease_expire=2014-07-08 08:46:21.895731 has v0 lc 76664
  70. 2014-07-08 08:46:18.262160 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:18.262161 lease_expire=2014-07-08 08:46:21.895731 has v0 lc 76664
  71. 2014-07-08 08:46:18.262178 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76664) is_readable now=2014-07-08 08:46:18.262179 lease_expire=2014-07-08 08:46:21.895731 has v0 lc 76664
  72. 2014-07-08 08:46:18.262813 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  73. 2014-07-08 08:46:18.262824 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  74. 2014-07-08 08:46:18.262830 7fe4af1d1700 10 mon.node-22@0(leader).auth v148 auth
  75. 2014-07-08 08:46:18.262937 7fe4af1d1700 10 mon.node-22@0(leader).auth v148 check_rotate updated rotating
  76. 2014-07-08 08:46:18.263078 7fe4af1d1700 10 mon.node-22@0(leader).auth v148 encode_pending v 149
  77. 2014-07-08 08:46:18.264021 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(begin lc 76664 fc 0 pn 9300 opn 0) v3 -- ?+0 0x7b65980
  78. 2014-07-08 08:46:18.266113 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948116 ==== paxos(accept lc 76664 fc 0 pn 9300 opn 0) v3 ==== 80+0+0 (4252097764 0 0) 0x7b65980 con 0x1b3d8c0
  79. 2014-07-08 08:46:18.267062 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(commit lc 76665 fc 0 pn 9300 opn 0) v3 -- ?+0 0x2173e00
  80. 2014-07-08 08:46:18.267139 7fe4ae9d0700 10 mon.node-22@0(leader) e4 refresh_from_paxos
  81. 2014-07-08 08:46:18.267352 7fe4ae9d0700 10 mon.node-22@0(leader).log v37563 update_from_paxos
  82. 2014-07-08 08:46:18.267362 7fe4ae9d0700 10 mon.node-22@0(leader).log v37563 update_from_paxos version 37563 summary v 37563
  83. 2014-07-08 08:46:18.267461 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 update_from_paxos
  84. 2014-07-08 08:46:18.267488 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 update_from_paxos version 149 keys ver 148 latest 143
  85. 2014-07-08 08:46:18.267494 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 update_from_paxos key server version 148
  86. 2014-07-08 08:46:18.267560 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 update_from_paxos() last_allocated_id=44222 max_global_id=44296 format_version 1
  87. 2014-07-08 08:46:18.267571 7fe4ae9d0700 10 mon.node-22@0(leader).pg v37964 map_pg_creates to 0 pgs -- no change
  88. 2014-07-08 08:46:18.267599 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 create_pending v 150
  89. 2014-07-08 08:46:18.267604 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 AuthMonitor::on_active()
  90. 2014-07-08 08:46:18.267617 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x47c9180
  91. 2014-07-08 08:46:18.269449 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948117 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (3023485680 0 0) 0x47c9180 con 0x1b3d8c0
  92. 2014-07-08 08:46:20.960762 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948118 ==== mon_health( service 1 op tell e 0 r 0 ) v1 ==== 62+0+0 (2751221335 0 0) 0x52261e0 con 0x1b3d8c0
  93. 2014-07-08 08:46:20.960812 7fe4ae9d0700 10 mon.node-22@0(leader).data_health(188) service_dispatch mon_health( service 1 op tell e 0 r 0 ) v1
  94. 2014-07-08 08:46:20.960820 7fe4ae9d0700 10 mon.node-22@0(leader).data_health(188) handle_tell mon_health( service 1 op tell e 0 r 0 ) v1
  95. 2014-07-08 08:46:21.267705 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x278a800
  96. 2014-07-08 08:46:21.268752 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948119 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (1282491083 0 0) 0x278a800 con 0x1b3d8c0
  97. 2014-07-08 08:46:23.264169 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  98. 2014-07-08 08:46:23.264221 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  99. 2014-07-08 08:46:23.264231 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  100. 2014-07-08 08:46:23.264240 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:23.264241 lease_expire=2014-07-08 08:46:26.267699 has v0 lc 76665
  101. 2014-07-08 08:46:23.264257 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:23.264258 lease_expire=2014-07-08 08:46:26.267699 has v0 lc 76665
  102. 2014-07-08 08:46:23.264274 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:23.264275 lease_expire=2014-07-08 08:46:26.267699 has v0 lc 76665
  103. 2014-07-08 08:46:23.264904 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  104. 2014-07-08 08:46:23.264916 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  105. 2014-07-08 08:46:23.264922 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  106. 2014-07-08 08:46:24.267839 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x29faf80
  107. 2014-07-08 08:46:24.268958 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948120 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (613046226 0 0) 0x29faf80 con 0x1b3d8c0
  108.  
  109. 2014-07-08 08:46:27.267942 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0xa1c6c80
  110. 2014-07-08 08:46:27.269056 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948121 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (704955706 0 0) 0xa1c6c80 con 0x1b3d8c0
  111.  
  112.  
  113. 2014-07-08 08:46:28.265046 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  114. 2014-07-08 08:46:28.265096 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  115. 2014-07-08 08:46:28.265105 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  116. 2014-07-08 08:46:28.265114 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:28.265115 lease_expire=2014-07-08 08:46:32.267934 has v0 lc 76665
  117. 2014-07-08 08:46:28.265130 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:28.265131 lease_expire=2014-07-08 08:46:32.267934 has v0 lc 76665
  118. 2014-07-08 08:46:28.265150 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:28.265152 lease_expire=2014-07-08 08:46:32.267934 has v0 lc 76665
  119. 2014-07-08 08:46:28.265785 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  120. 2014-07-08 08:46:28.265796 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  121. 2014-07-08 08:46:28.265802 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  122. 2014-07-08 08:46:28.475539 7fe4af1d1700 10 mon.node-22@0(leader).data_health(188) service_tick
  123. 2014-07-08 08:46:28.475575 7fe4af1d1700 0 mon.node-22@0(leader).data_health(188) update_stats avail 86% total 93604800 used 8025676 avail 80801192
  124. 2014-07-08 08:46:28.475584 7fe4af1d1700 10 mon.node-22@0(leader).data_health(188) share_stats
  125. 2014-07-08 08:46:28.475592 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- mon_health( service 1 op tell e 0 r 0 ) v1 -- ?+0 0x5226b40
  126. 2014-07-08 08:46:30.268058 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x8c57400
  127. 2014-07-08 08:46:30.269165 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948122 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (255561286 0 0) 0x8c57400 con 0x1b3d8c0
  128. ^C
  129. root@node-22:/etc/ceph# tail -f /var/log/ceph/ceph-mon.node-22.log
  130. 2014-07-08 08:46:28.265150 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:28.265152 lease_expire=2014-07-08 08:46:32.267934 has v0 lc 76665
  131. 2014-07-08 08:46:28.265785 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  132. 2014-07-08 08:46:28.265796 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  133. 2014-07-08 08:46:28.265802 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  134. 2014-07-08 08:46:28.475539 7fe4af1d1700 10 mon.node-22@0(leader).data_health(188) service_tick
  135. 2014-07-08 08:46:28.475575 7fe4af1d1700 0 mon.node-22@0(leader).data_health(188) update_stats avail 86% total 93604800 used 8025676 avail 80801192
  136. 2014-07-08 08:46:28.475584 7fe4af1d1700 10 mon.node-22@0(leader).data_health(188) share_stats
  137. 2014-07-08 08:46:28.475592 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- mon_health( service 1 op tell e 0 r 0 ) v1 -- ?+0 0x5226b40
  138. 2014-07-08 08:46:30.268058 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x8c57400
  139. 2014-07-08 08:46:30.269165 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948122 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (255561286 0 0) 0x8c57400 con 0x1b3d8c0
  140. 2014-07-08 08:46:33.265931 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  141. 2014-07-08 08:46:33.265982 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  142. 2014-07-08 08:46:33.265992 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  143. 2014-07-08 08:46:33.266000 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:33.266001 lease_expire=2014-07-08 08:46:35.268049 has v0 lc 76665
  144. 2014-07-08 08:46:33.266017 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:33.266019 lease_expire=2014-07-08 08:46:35.268049 has v0 lc 76665
  145. 2014-07-08 08:46:33.266035 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:33.266036 lease_expire=2014-07-08 08:46:35.268049 has v0 lc 76665
  146. 2014-07-08 08:46:33.266665 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  147. 2014-07-08 08:46:33.266676 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  148. 2014-07-08 08:46:33.266682 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  149. 2014-07-08 08:46:33.268164 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x2146c80
  150. 2014-07-08 08:46:33.269355 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948123 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (3917466010 0 0) 0x2146c80 con 0x1b3d8c0
  151. 2014-07-08 08:46:36.268261 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x652f200
  152. 2014-07-08 08:46:36.269398 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948124 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (4030713943 0 0) 0x652f200 con 0x1b3d8c0
  153. 2014-07-08 08:46:38.266816 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  154. 2014-07-08 08:46:38.266866 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  155. 2014-07-08 08:46:38.266876 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  156. 2014-07-08 08:46:38.266884 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:38.266885 lease_expire=2014-07-08 08:46:41.268252 has v0 lc 76665
  157. 2014-07-08 08:46:38.266901 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:38.266902 lease_expire=2014-07-08 08:46:41.268252 has v0 lc 76665
  158. 2014-07-08 08:46:38.266918 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:38.266920 lease_expire=2014-07-08 08:46:41.268252 has v0 lc 76665
  159. 2014-07-08 08:46:38.267563 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  160. 2014-07-08 08:46:38.267574 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  161. 2014-07-08 08:46:38.267580 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  162. 2014-07-08 08:46:39.268338 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x6e17200
  163. 2014-07-08 08:46:39.269529 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948125 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (1652474897 0 0) 0x6e17200 con 0x1b3d8c0
  164. 2014-07-08 08:46:42.268444 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x2148580
  165. 2014-07-08 08:46:42.269621 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948126 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (1131821524 0 0) 0x2148580 con 0x1b3d8c0
  166. 2014-07-08 08:46:43.267709 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  167. 2014-07-08 08:46:43.267760 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  168. 2014-07-08 08:46:43.267770 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  169. 2014-07-08 08:46:43.267779 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:43.267780 lease_expire=2014-07-08 08:46:47.268436 has v0 lc 76665
  170. 2014-07-08 08:46:43.267820 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:43.267823 lease_expire=2014-07-08 08:46:47.268436 has v0 lc 76665
  171. 2014-07-08 08:46:43.267852 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:43.267855 lease_expire=2014-07-08 08:46:47.268436 has v0 lc 76665
  172. 2014-07-08 08:46:43.268496 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  173. 2014-07-08 08:46:43.268514 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  174. 2014-07-08 08:46:43.268519 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  175. 2014-07-08 08:46:45.268559 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x28ce080
  176. 2014-07-08 08:46:45.269699 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948127 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (496152292 0 0) 0x28ce080 con 0x1b3d8c0
  177. 2014-07-08 08:46:45.785270 7fe4ab0c9700 2 -- 192.168.0.4:6789/0 >> 192.168.0.4:6802/3165 pipe(0x25f6800 sd=25 :6789 s=2 pgs=1 cs=1 l=1 c=0x5bbe2c0).reader couldn't read tag, Success
  178. 2014-07-08 08:46:45.785334 7fe4ab0c9700 2 -- 192.168.0.4:6789/0 >> 192.168.0.4:6802/3165 pipe(0x25f6800 sd=25 :6789 s=2 pgs=1 cs=1 l=1 c=0x5bbe2c0).fault 0: Success
  179. 2014-07-08 08:46:45.785587 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_handle_reset 0x5bbe2c0 192.168.0.4:6802/3165
  180. 2014-07-08 08:46:45.785611 7fe4ae9d0700 10 mon.node-22@0(leader) e4 reset/close on session osd.3 192.168.0.4:6802/3165
  181. 2014-07-08 08:46:45.785624 7fe4ae9d0700 10 mon.node-22@0(leader) e4 remove_session MonSession: osd.3 192.168.0.4:6802/3165 is openallow profile osd osd.3 192.168.0.4:6802/3165
  182. 2014-07-08 08:46:48.101815 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.5 192.168.0.6:6802/3793 4280 ==== auth(proto 2 2 bytes epoch 0) v1 ==== 32+0+0 (2260890001 0 0) 0x2160400 con 0x42f7e40
  183. 2014-07-08 08:46:48.101872 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:48.101875 lease_expire=2014-07-08 08:46:50.268550 has v0 lc 76665
  184. 2014-07-08 08:46:48.101896 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 2 bytes epoch 0) v1 from osd.5 192.168.0.6:6802/3793
  185. 2014-07-08 08:46:48.101913 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=2
  186. 2014-07-08 08:46:48.102046 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.6:6802/3793 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3e00 con 0x42f7e40
  187. 2014-07-08 08:46:48.102109 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.5 192.168.0.6:6802/3793 4281 ==== mon_subscribe({monmap=5+,osd_pg_creates=0}) v2 ==== 50+0+0 (2092913137 0 0) 0x6529dc0 con 0x42f7e40
  188. 2014-07-08 08:46:48.102154 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osd_pg_creates=0}) v2
  189. 2014-07-08 08:46:48.102172 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  190. 2014-07-08 08:46:48.102190 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.5 192.168.0.6:6802/3793 -- mon_subscribe_ack(300s) v1 -- ?+0 0xa883340
  191. 2014-07-08 08:46:48.268655 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  192. 2014-07-08 08:46:48.268699 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  193. 2014-07-08 08:46:48.268709 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  194. 2014-07-08 08:46:48.268717 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:48.268718 lease_expire=2014-07-08 08:46:50.268550 has v0 lc 76665
  195. 2014-07-08 08:46:48.268732 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:48.268733 lease_expire=2014-07-08 08:46:50.268550 has v0 lc 76665
  196. 2014-07-08 08:46:48.268750 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:48.268751 lease_expire=2014-07-08 08:46:50.268550 has v0 lc 76665
  197. 2014-07-08 08:46:48.269382 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  198. 2014-07-08 08:46:48.269393 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  199. 2014-07-08 08:46:48.269399 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  200. 2014-07-08 08:46:48.269422 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x3c9a780
  201. 2014-07-08 08:46:48.270548 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948128 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (4113752232 0 0) 0x3c9a780 con 0x1b3d8c0
  202. 2014-07-08 08:46:49.664076 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.6 192.168.0.3:6800/3764 14314 ==== auth(proto 2 2 bytes epoch 0) v1 ==== 32+0+0 (2260890001 0 0) 0x64bd3c0 con 0x2dcd4a0
  203. 2014-07-08 08:46:49.664134 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:49.664136 lease_expire=2014-07-08 08:46:53.269417 has v0 lc 76665
  204. 2014-07-08 08:46:49.664154 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 2 bytes epoch 0) v1 from osd.6 192.168.0.3:6800/3764
  205. 2014-07-08 08:46:49.664164 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=2
  206. 2014-07-08 08:46:49.664262 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.3:6800/3764 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3c00 con 0x2dcd4a0
  207. 2014-07-08 08:46:51.269533 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x2029700
  208. 2014-07-08 08:46:51.270723 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948129 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (2153181742 0 0) 0x2029700 con 0x1b3d8c0
  209. 2014-07-08 08:46:51.398623 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.7 192.168.0.6:6800/3781 16043 ==== auth(proto 2 2 bytes epoch 0) v1 ==== 32+0+0 (2260890001 0 0) 0x40ee480 con 0x42f6f20
  210. 2014-07-08 08:46:51.398670 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:51.398671 lease_expire=2014-07-08 08:46:56.269524 has v0 lc 76665
  211. 2014-07-08 08:46:51.398690 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 2 bytes epoch 0) v1 from osd.7 192.168.0.6:6800/3781
  212. 2014-07-08 08:46:51.398701 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=2
  213. 2014-07-08 08:46:51.398776 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.6:6800/3781 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3a00 con 0x42f6f20
  214.  
  215.  
  216.  
  217. 2014-07-08 08:46:53.269519 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  218. 2014-07-08 08:46:53.269570 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  219. 2014-07-08 08:46:53.269580 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  220. 2014-07-08 08:46:53.269589 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:53.269590 lease_expire=2014-07-08 08:46:56.269524 has v0 lc 76665
  221. 2014-07-08 08:46:53.269605 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:53.269606 lease_expire=2014-07-08 08:46:56.269524 has v0 lc 76665
  222. 2014-07-08 08:46:53.269623 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:53.269624 lease_expire=2014-07-08 08:46:56.269524 has v0 lc 76665
  223. 2014-07-08 08:46:53.270269 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  224. 2014-07-08 08:46:53.270288 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  225. 2014-07-08 08:46:53.270293 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  226. 2014-07-08 08:46:53.785609 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.2 192.168.0.4:6800/32433 36 ==== auth(proto 2 2 bytes epoch 0) v1 ==== 32+0+0 (2260890001 0 0) 0xb676fc0 con 0x329c420
  227. 2014-07-08 08:46:53.785655 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:53.785657 lease_expire=2014-07-08 08:46:56.269524 has v0 lc 76665
  228. 2014-07-08 08:46:53.785673 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 2 bytes epoch 0) v1 from osd.2 192.168.0.4:6800/32433
  229. 2014-07-08 08:46:53.785683 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=2
  230. 2014-07-08 08:46:53.785783 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6800/32433 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3800 con 0x329c420
  231. 2014-07-08 08:46:53.785824 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.2 192.168.0.4:6800/32433 37 ==== mon_subscribe({monmap=5+,osd_pg_creates=0}) v2 ==== 50+0+0 (2092913137 0 0) 0x3835480 con 0x329c420
  232. 2014-07-08 08:46:53.785844 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osd_pg_creates=0}) v2
  233. 2014-07-08 08:46:53.785854 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  234. 2014-07-08 08:46:53.785866 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.2 192.168.0.4:6800/32433 -- mon_subscribe_ack(300s) v1 -- ?+0 0x6529dc0
  235. 2014-07-08 08:46:54.269639 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x5db5400
  236. 2014-07-08 08:46:54.270805 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948130 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (1685078619 0 0) 0x5db5400 con 0x1b3d8c0
  237. 2014-07-08 08:46:54.988362 7fe4ab0c9700 1 -- 192.168.0.4:6789/0 >> :/0 pipe(0x4082280 sd=25 :6789 s=0 pgs=0 cs=0 l=0 c=0x2067ce0).accept sd=25 192.168.0.4:42154/0
  238. 2014-07-08 08:46:54.988606 7fe4ab0c9700 10 mon.node-22@0(leader) e4 ms_verify_authorizer 192.168.0.4:0/1007828 client protocol 0
  239. 2014-07-08 08:46:54.989076 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1007828 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (3146543200 0 0) 0xb6778c0 con 0x2067ce0
  240. 2014-07-08 08:46:54.989121 7fe4ae9d0700 10 mon.node-22@0(leader) e4 do not have session, making new one
  241. 2014-07-08 08:46:54.989130 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_dispatch new session MonSession: client.? 192.168.0.4:0/1007828 is open for client.? 192.168.0.4:0/1007828
  242. 2014-07-08 08:46:54.989142 7fe4ae9d0700 10 mon.node-22@0(leader) e4 setting timeout on session
  243. 2014-07-08 08:46:54.989147 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:54.989148 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  244. 2014-07-08 08:46:54.989163 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 0 26 bytes epoch 0) v1 from client.? 192.168.0.4:0/1007828
  245. 2014-07-08 08:46:54.989172 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=26
  246. 2014-07-08 08:46:54.989187 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 AuthMonitor::assign_global_id m=auth(proto 0 26 bytes epoch 0) v1 mon=0/2 last_allocated=44222 max_global_id=44296
  247. 2014-07-08 08:46:54.989194 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 next_global_id should be 44224
  248. 2014-07-08 08:46:54.989206 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- mon_map v1 -- ?+0 0x52261e0 con 0x2067ce0
  249. 2014-07-08 08:46:54.989264 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3600 con 0x2067ce0
  250. 2014-07-08 08:46:54.990204 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1007828 2 ==== auth(proto 2 32 bytes epoch 0) v1 ==== 62+0+0 (3374887874 0 0) 0xb676d80 con 0x2067ce0
  251. 2014-07-08 08:46:54.990245 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:54.990247 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  252. 2014-07-08 08:46:54.990262 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 192.168.0.4:0/1007828
  253. 2014-07-08 08:46:54.990272 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=32
  254. 2014-07-08 08:46:54.990526 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3400 con 0x2067ce0
  255. 2014-07-08 08:46:54.991135 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1007828 3 ==== auth(proto 2 165 bytes epoch 0) v1 ==== 195+0+0 (3925041868 0 0) 0xb677b00 con 0x2067ce0
  256. 2014-07-08 08:46:54.991168 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:54.991169 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  257. 2014-07-08 08:46:54.991182 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 192.168.0.4:0/1007828
  258. 2014-07-08 08:46:54.991191 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=165
  259. 2014-07-08 08:46:54.991466 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3200 con 0x2067ce0
  260. 2014-07-08 08:46:54.992057 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1007828 4 ==== mon_subscribe({monmap=0+}) v2 ==== 23+0+0 (1620593354 0 0) 0x7f3cbc0 con 0x2067ce0
  261. 2014-07-08 08:46:54.992098 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=0+}) v2
  262. 2014-07-08 08:46:54.992113 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 0 have 4
  263. 2014-07-08 08:46:54.992123 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- mon_map v1 -- ?+0 0x2b0fc1c0 con 0x2067ce0
  264. 2014-07-08 08:46:54.992143 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.4:0/1007828 -- mon_subscribe_ack(300s) v1 -- ?+0 0x3835480
  265. 2014-07-08 08:46:54.992171 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.4:0/1007828 5 ==== auth(proto 2 2 bytes epoch 0) v1 ==== 32+0+0 (2260890001 0 0) 0xb677f80 con 0x2067ce0
  266. 2014-07-08 08:46:54.992197 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:54.992200 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  267. 2014-07-08 08:46:54.992219 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 2 bytes epoch 0) v1 from client.? 192.168.0.4:0/1007828
  268. 2014-07-08 08:46:54.992234 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=2
  269. 2014-07-08 08:46:54.992316 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b3000 con 0x2067ce0
  270. 2014-07-08 08:46:54.992349 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44224 192.168.0.4:0/1007828 6 ==== mon_subscribe({monmap=5+,osdmap=0}) v2 ==== 42+0+0 (453657511 0 0) 0x3833880 con 0x2067ce0
  271. 2014-07-08 08:46:54.992374 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osdmap=0}) v2
  272. 2014-07-08 08:46:54.992385 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  273. 2014-07-08 08:46:54.992427 7fe4ae9d0700 10 mon.node-22@0(leader).osd e385 check_sub 0x29e16c0 next 0 (onetime)
  274. 2014-07-08 08:46:54.992522 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.4:0/1007828 -- osd_map(385..385 src has 1..385) v3 -- ?+0 0xb677f80
  275. 2014-07-08 08:46:54.992553 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.44224 192.168.0.4:0/1007828 -- mon_subscribe_ack(300s) v1 -- ?+0 0x7f3cbc0
  276. 2014-07-08 08:46:54.992613 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44224 192.168.0.4:0/1007828 7 ==== mon_subscribe({monmap=5+,osdmap=0}) v2 ==== 42+0+0 (453657511 0 0) 0x33308c0 con 0x2067ce0
  277. 2014-07-08 08:46:54.992637 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osdmap=0}) v2
  278. 2014-07-08 08:46:54.992645 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  279. 2014-07-08 08:46:54.992653 7fe4ae9d0700 10 mon.node-22@0(leader).osd e385 check_sub 0x2e0fa00 next 0 (onetime)
  280. 2014-07-08 08:46:54.992715 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.4:0/1007828 -- osd_map(385..385 src has 1..385) v3 -- ?+0 0xb677b00
  281. 2014-07-08 08:46:54.992763 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.44224 192.168.0.4:0/1007828 -- mon_subscribe_ack(300s) v1 -- ?+0 0x3833880
  282. 2014-07-08 08:46:54.996009 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44224 192.168.0.4:0/1007828 8 ==== mon_command({"prefix": "get_command_descriptions"} v 0) v1 ==== 80+0+0 (2649104315 0 0) 0x52261e0 con 0x2067ce0
  283. 2014-07-08 08:46:54.999466 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 -- ?+24204 0x2b0fc3a0 con 0x2067ce0
  284. 2014-07-08 08:46:55.070141 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44224 192.168.0.4:0/1007828 9 ==== mon_command({"prefix": "osd crush create-or-move", "args": ["root=default", "host=node-22"], "id": 3, "weight": 0.91} v 0) v1 ==== 147+0+0 (828653768 0 0) 0x5227680 con 0x2067ce0
  285. 2014-07-08 08:46:55.070214 7fe4ae9d0700 0 mon.node-22@0(leader) e4 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default", "host=node-22"], "id": 3, "weight": 0.91} v 0) v1
  286. 2014-07-08 08:46:55.070242 7fe4ae9d0700 10 mon.node-22@0(leader) e4 _allowed_command = 0
  287. 2014-07-08 08:46:55.070261 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:55.070262 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  288. 2014-07-08 08:46:55.070271 7fe4ae9d0700 10 mon.node-22@0(leader).osd e385 preprocess_query mon_command({"prefix": "osd crush create-or-move", "args": ["root=default", "host=node-22"], "id": 3, "weight": 0.91} v 0) v1 from client.44224 192.168.0.4:0/1007828
  289. 2014-07-08 08:46:55.070311 7fe4ae9d0700 7 mon.node-22@0(leader).osd e385 prepare_update mon_command({"prefix": "osd crush create-or-move", "args": ["root=default", "host=node-22"], "id": 3, "weight": 0.91} v 0) v1 from client.44224 192.168.0.4:0/1007828
  290. 2014-07-08 08:46:55.070354 7fe4ae9d0700 0 mon.node-22@0(leader).osd e385 create-or-move crush item name 'osd.3' initial_weight 0.91 at location {host=node-22,root=default}
  291. 2014-07-08 08:46:55.070419 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:0/1007828 -- mon_command_ack([{"prefix": "osd crush create-or-move", "args": ["root=default", "host=node-22"], "id": 3, "weight": 0.91}]=0 create-or-move updated item name 'osd.3' weight 0.91 at location {host=node-22,root=default} to crush map v385) v1 -- ?+0 0x52261e0 con 0x2067ce0
  292. 2014-07-08 08:46:55.074612 7fe4ab0c9700 2 -- 192.168.0.4:6789/0 >> 192.168.0.4:0/1007828 pipe(0x4082280 sd=25 :6789 s=2 pgs=1 cs=1 l=1 c=0x2067ce0).reader couldn't read tag, Success
  293. 2014-07-08 08:46:55.074649 7fe4ab0c9700 2 -- 192.168.0.4:6789/0 >> 192.168.0.4:0/1007828 pipe(0x4082280 sd=25 :6789 s=2 pgs=1 cs=1 l=1 c=0x2067ce0).fault 0: Success
  294. 2014-07-08 08:46:55.074737 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_handle_reset 0x2067ce0 192.168.0.4:0/1007828
  295. 2014-07-08 08:46:55.074760 7fe4ae9d0700 10 mon.node-22@0(leader) e4 reset/close on session client.? 192.168.0.4:0/1007828
  296. 2014-07-08 08:46:55.074768 7fe4ae9d0700 10 mon.node-22@0(leader) e4 remove_session MonSession: client.? 192.168.0.4:0/1007828 is openallow profile osd client.? 192.168.0.4:0/1007828
  297. 2014-07-08 08:46:55.353505 7fe4ab0c9700 1 -- 192.168.0.4:6789/0 >> :/0 pipe(0x2d06a80 sd=25 :6789 s=0 pgs=0 cs=0 l=0 c=0x2069180).accept sd=25 192.168.0.4:42155/0
  298. 2014-07-08 08:46:55.353594 7fe4ab0c9700 10 mon.node-22@0(leader) e4 ms_verify_authorizer 192.168.0.4:6802/7857 osd protocol 0
  299. 2014-07-08 08:46:55.353970 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.3 192.168.0.4:6802/7857 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (3146543200 0 0) 0xb676b40 con 0x2069180
  300. 2014-07-08 08:46:55.354014 7fe4ae9d0700 10 mon.node-22@0(leader) e4 do not have session, making new one
  301. 2014-07-08 08:46:55.354023 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_dispatch new session MonSession: osd.3 192.168.0.4:6802/7857 is open for osd.3 192.168.0.4:6802/7857
  302. 2014-07-08 08:46:55.354034 7fe4ae9d0700 10 mon.node-22@0(leader) e4 setting timeout on session
  303. 2014-07-08 08:46:55.354040 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:55.354041 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  304. 2014-07-08 08:46:55.354056 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 0 26 bytes epoch 0) v1 from osd.3 192.168.0.4:6802/7857
  305. 2014-07-08 08:46:55.354077 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=26
  306. 2014-07-08 08:46:55.354087 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 AuthMonitor::assign_global_id m=auth(proto 0 26 bytes epoch 0) v1 mon=0/2 last_allocated=44224 max_global_id=44296
  307. 2014-07-08 08:46:55.354092 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 next_global_id should be 44226
  308. 2014-07-08 08:46:55.354101 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6802/7857 -- mon_map v1 -- ?+0 0x5227680 con 0x2069180
  309. 2014-07-08 08:46:55.354136 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6802/7857 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b2e00 con 0x2069180
  310. 2014-07-08 08:46:55.354962 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.3 192.168.0.4:6802/7857 2 ==== auth(proto 2 32 bytes epoch 0) v1 ==== 62+0+0 (3140914950 0 0) 0xb677f80 con 0x2069180
  311. 2014-07-08 08:46:55.355008 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:55.355010 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  312. 2014-07-08 08:46:55.355025 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from osd.3 192.168.0.4:6802/7857
  313. 2014-07-08 08:46:55.355034 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=32
  314. 2014-07-08 08:46:55.355267 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6802/7857 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x26b2c00 con 0x2069180
  315. 2014-07-08 08:46:55.355966 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.3 192.168.0.4:6802/7857 3 ==== auth(proto 2 165 bytes epoch 0) v1 ==== 195+0+0 (3889274641 0 0) 0xb676900 con 0x2069180
  316. 2014-07-08 08:46:55.356008 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:55.356010 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  317. 2014-07-08 08:46:55.356024 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from osd.3 192.168.0.4:6802/7857
  318. 2014-07-08 08:46:55.356033 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=165
  319. 2014-07-08 08:46:55.356290 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6802/7857 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0xdf5f600 con 0x2069180
  320. 2014-07-08 08:46:55.357029 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.3 192.168.0.4:6802/7857 4 ==== mon_subscribe({monmap=0+}) v2 ==== 23+0+0 (1620593354 0 0) 0x3833880 con 0x2069180
  321. 2014-07-08 08:46:55.357073 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=0+}) v2
  322. 2014-07-08 08:46:55.357087 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 0 have 4
  323. 2014-07-08 08:46:55.357098 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6802/7857 -- mon_map v1 -- ?+0 0x2b0fc580 con 0x2069180
  324. 2014-07-08 08:46:55.357112 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.3 192.168.0.4:6802/7857 -- mon_subscribe_ack(300s) v1 -- ?+0 0x33308c0
  325. 2014-07-08 08:46:55.357164 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.3 192.168.0.4:6802/7857 5 ==== mon_subscribe({monmap=0+,osd_pg_creates=0}) v2 ==== 50+0+0 (2151744701 0 0) 0x7f3cbc0 con 0x2069180
  326. 2014-07-08 08:46:55.357177 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=0+,osd_pg_creates=0}) v2
  327. 2014-07-08 08:46:55.357182 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 0 have 4
  328. 2014-07-08 08:46:55.357187 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6802/7857 -- mon_map v1 -- ?+0 0x2b0fc760 con 0x2069180
  329. 2014-07-08 08:46:55.357216 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.3 192.168.0.4:6802/7857 -- mon_subscribe_ack(300s) v1 -- ?+0 0x3833880
  330. 2014-07-08 08:46:55.357228 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.3 192.168.0.4:6802/7857 6 ==== auth(proto 2 2 bytes epoch 0) v1 ==== 32+0+0 (2260890001 0 0) 0x1b27180 con 0x2069180
  331. 2014-07-08 08:46:55.357238 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:55.357239 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  332. 2014-07-08 08:46:55.357248 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 2 bytes epoch 0) v1 from osd.3 192.168.0.4:6802/7857
  333. 2014-07-08 08:46:55.357254 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=2
  334. 2014-07-08 08:46:55.357305 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.4:6802/7857 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0xdf5f400 con 0x2069180
  335. 2014-07-08 08:46:55.357948 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.3 192.168.0.4:6802/7857 7 ==== mon_get_version(what=osdmap handle=1) v1 ==== 18+0+0 (4194021778 0 0) 0x1f089400 con 0x2069180
  336. 2014-07-08 08:46:55.357990 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_get_version mon_get_version(what=osdmap handle=1) v1
  337. 2014-07-08 08:46:55.357999 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.3 192.168.0.4:6802/7857 -- mon_check_map_ack(handle=1 version=385) v2 -- ?+0 0x7f3cbc0
  338. 2014-07-08 08:46:56.673309 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.4 192.168.0.3:6802/3772 10651 ==== auth(proto 2 2 bytes epoch 0) v1 ==== 32+0+0 (2260890001 0 0) 0x2901d40 con 0x2634000
  339. 2014-07-08 08:46:56.673385 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:56.673389 lease_expire=2014-07-08 08:46:59.269632 has v0 lc 76665
  340. 2014-07-08 08:46:56.673415 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 2 bytes epoch 0) v1 from osd.4 192.168.0.3:6802/3772
  341. 2014-07-08 08:46:56.673435 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=2
  342. 2014-07-08 08:46:56.673566 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.3:6802/3772 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0xdf5f200 con 0x2634000
  343. 2014-07-08 08:46:56.673629 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.4 192.168.0.3:6802/3772 10652 ==== mon_subscribe({monmap=5+,osd_pg_creates=0}) v2 ==== 50+0+0 (2092913137 0 0) 0x284b9c0 con 0x2634000
  344. 2014-07-08 08:46:56.673662 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osd_pg_creates=0}) v2
  345. 2014-07-08 08:46:56.673678 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  346. 2014-07-08 08:46:56.673694 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.4 192.168.0.3:6802/3772 -- mon_subscribe_ack(300s) v1 -- ?+0 0xa885b80
  347. 2014-07-08 08:46:57.269754 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x5b8ca80
  348. 2014-07-08 08:46:57.270929 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948131 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (396556542 0 0) 0x5b8ca80 con 0x1b3d8c0
  349. 2014-07-08 08:46:58.270424 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  350. 2014-07-08 08:46:58.270475 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  351. 2014-07-08 08:46:58.270485 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  352. 2014-07-08 08:46:58.270494 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:58.270495 lease_expire=2014-07-08 08:47:02.269746 has v0 lc 76665
  353. 2014-07-08 08:46:58.270511 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:58.270512 lease_expire=2014-07-08 08:47:02.269746 has v0 lc 76665
  354. 2014-07-08 08:46:58.270531 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:46:58.270532 lease_expire=2014-07-08 08:47:02.269746 has v0 lc 76665
  355. 2014-07-08 08:46:58.271165 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  356. 2014-07-08 08:46:58.271176 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  357. 2014-07-08 08:46:58.271182 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  358. 2014-07-08 08:46:59.664137 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.6 192.168.0.3:6800/3764 14315 ==== mon_subscribe({monmap=5+,osd_pg_creates=0}) v2 ==== 50+0+0 (2092913137 0 0) 0x5f2a840 con 0x2dcd4a0
  359. 2014-07-08 08:46:59.664192 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osd_pg_creates=0}) v2
  360. 2014-07-08 08:46:59.664205 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  361. 2014-07-08 08:46:59.664219 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.6 192.168.0.3:6800/3764 -- mon_subscribe_ack(300s) v1 -- ?+0 0x284b9c0
  362. 2014-07-08 08:47:00.269863 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x29fad00
  363. 2014-07-08 08:47:00.271084 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948132 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (3291303824 0 0) 0x29fad00 con 0x1b3d8c0
  364. 2014-07-08 08:47:01.398849 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== osd.7 192.168.0.6:6800/3781 16044 ==== mon_subscribe({monmap=5+,osd_pg_creates=0}) v2 ==== 50+0+0 (2092913137 0 0) 0x4b1b2c0 con 0x42f6f20
  365. 2014-07-08 08:47:01.398920 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osd_pg_creates=0}) v2
  366. 2014-07-08 08:47:01.398940 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  367. 2014-07-08 08:47:01.398959 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> osd.7 192.168.0.6:6800/3781 -- mon_subscribe_ack(300s) v1 -- ?+0 0x5f2a840
  368. 2014-07-08 08:47:03.269953 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x2a1ea80
  369. 2014-07-08 08:47:03.271162 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948133 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (375246419 0 0) 0x2a1ea80 con 0x1b3d8c0
  370. 2014-07-08 08:47:03.271289 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  371. 2014-07-08 08:47:03.271335 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  372. 2014-07-08 08:47:03.271345 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  373. 2014-07-08 08:47:03.271353 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:03.271354 lease_expire=2014-07-08 08:47:08.269944 has v0 lc 76665
  374. 2014-07-08 08:47:03.271378 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:03.271379 lease_expire=2014-07-08 08:47:08.269944 has v0 lc 76665
  375. 2014-07-08 08:47:03.271395 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:03.271396 lease_expire=2014-07-08 08:47:08.269944 has v0 lc 76665
  376. 2014-07-08 08:47:03.272050 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  377. 2014-07-08 08:47:03.272062 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  378. 2014-07-08 08:47:03.272068 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  379. 2014-07-08 08:47:06.032605 7fe4aab80700 1 -- 192.168.0.4:6789/0 >> :/0 pipe(0x81e8a80 sd=27 :6789 s=0 pgs=0 cs=0 l=0 c=0x2069c80).accept sd=27 192.168.0.5:48704/0
  380. 2014-07-08 08:47:06.032939 7fe4aab80700 10 mon.node-22@0(leader) e4 ms_verify_authorizer 192.168.0.5:0/1451003060 client protocol 0
  381. 2014-07-08 08:47:06.033528 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.5:0/1451003060 1 ==== auth(proto 0 32 bytes epoch 0) v1 ==== 62+0+0 (2376736627 0 0) 0x3282640 con 0x2069c80
  382. 2014-07-08 08:47:06.033570 7fe4ae9d0700 10 mon.node-22@0(leader) e4 do not have session, making new one
  383. 2014-07-08 08:47:06.033577 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_dispatch new session MonSession: client.? 192.168.0.5:0/1451003060 is open for client.? 192.168.0.5:0/1451003060
  384. 2014-07-08 08:47:06.033588 7fe4ae9d0700 10 mon.node-22@0(leader) e4 setting timeout on session
  385. 2014-07-08 08:47:06.033593 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:06.033594 lease_expire=2014-07-08 08:47:08.269944 has v0 lc 76665
  386. 2014-07-08 08:47:06.033609 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 0 32 bytes epoch 0) v1 from client.? 192.168.0.5:0/1451003060
  387. 2014-07-08 08:47:06.033618 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=32
  388. 2014-07-08 08:47:06.033634 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 AuthMonitor::assign_global_id m=auth(proto 0 32 bytes epoch 0) v1 mon=0/2 last_allocated=44226 max_global_id=44296
  389. 2014-07-08 08:47:06.033641 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 next_global_id should be 44228
  390. 2014-07-08 08:47:06.033653 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.5:0/1451003060 -- mon_map v1 -- ?+0 0x2b0fc940 con 0x2069c80
  391. 2014-07-08 08:47:06.033710 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.5:0/1451003060 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0xdf5f000 con 0x2069c80
  392. 2014-07-08 08:47:06.034696 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.5:0/1451003060 2 ==== auth(proto 2 32 bytes epoch 0) v1 ==== 62+0+0 (3301876565 0 0) 0x3282ac0 con 0x2069c80
  393. 2014-07-08 08:47:06.034726 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:06.034727 lease_expire=2014-07-08 08:47:08.269944 has v0 lc 76665
  394. 2014-07-08 08:47:06.034740 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 192.168.0.5:0/1451003060
  395. 2014-07-08 08:47:06.034748 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=32
  396. 2014-07-08 08:47:06.034998 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.5:0/1451003060 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0xdf5ee00 con 0x2069c80
  397. 2014-07-08 08:47:06.035880 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.5:0/1451003060 3 ==== auth(proto 2 181 bytes epoch 0) v1 ==== 211+0+0 (2103871811 0 0) 0x3282d00 con 0x2069c80
  398. 2014-07-08 08:47:06.035921 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:06.035923 lease_expire=2014-07-08 08:47:08.269944 has v0 lc 76665
  399. 2014-07-08 08:47:06.035938 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 preprocess_query auth(proto 2 181 bytes epoch 0) v1 from client.? 192.168.0.5:0/1451003060
  400. 2014-07-08 08:47:06.035948 7fe4ae9d0700 10 mon.node-22@0(leader).auth v149 prep_auth() blob_size=181
  401. 2014-07-08 08:47:06.036240 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.5:0/1451003060 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0xdf5ec00 con 0x2069c80
  402. 2014-07-08 08:47:06.037112 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.? 192.168.0.5:0/1451003060 4 ==== mon_subscribe({monmap=0+}) v2 ==== 23+0+0 (1620593354 0 0) 0x5f29340 con 0x2069c80
  403. 2014-07-08 08:47:06.037157 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=0+}) v2
  404. 2014-07-08 08:47:06.037171 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 0 have 4
  405. 2014-07-08 08:47:06.037181 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.5:0/1451003060 -- mon_map v1 -- ?+0 0x2b0fcb20 con 0x2069c80
  406. 2014-07-08 08:47:06.037195 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.5:0/1451003060 -- mon_subscribe_ack(300s) v1 -- ?+0 0x4b1b2c0
  407. 2014-07-08 08:47:06.037216 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44228 192.168.0.5:0/1451003060 5 ==== mon_subscribe({monmap=5+,osdmap=0}) v2 ==== 42+0+0 (453657511 0 0) 0x5fbd2c0 con 0x2069c80
  408. 2014-07-08 08:47:06.037231 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osdmap=0}) v2
  409. 2014-07-08 08:47:06.037237 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  410. 2014-07-08 08:47:06.037245 7fe4ae9d0700 10 mon.node-22@0(leader).osd e385 check_sub 0x1c7dd40 next 0 (onetime)
  411. 2014-07-08 08:47:06.037327 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.5:0/1451003060 -- osd_map(385..385 src has 1..385) v3 -- ?+0 0x3282d00
  412. 2014-07-08 08:47:06.037351 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.44228 192.168.0.5:0/1451003060 -- mon_subscribe_ack(300s) v1 -- ?+0 0x5f29340
  413. 2014-07-08 08:47:06.037400 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44228 192.168.0.5:0/1451003060 6 ==== mon_subscribe({monmap=5+,osdmap=0}) v2 ==== 42+0+0 (453657511 0 0) 0x5f28fc0 con 0x2069c80
  414. 2014-07-08 08:47:06.037417 7fe4ae9d0700 10 mon.node-22@0(leader) e4 handle_subscribe mon_subscribe({monmap=5+,osdmap=0}) v2
  415. 2014-07-08 08:47:06.037423 7fe4ae9d0700 10 mon.node-22@0(leader) e4 check_sub monmap next 5 have 4
  416. 2014-07-08 08:47:06.037429 7fe4ae9d0700 10 mon.node-22@0(leader).osd e385 check_sub 0x1c7f680 next 0 (onetime)
  417. 2014-07-08 08:47:06.037489 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.? 192.168.0.5:0/1451003060 -- osd_map(385..385 src has 1..385) v3 -- ?+0 0x3282ac0
  418. 2014-07-08 08:47:06.037504 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> client.44228 192.168.0.5:0/1451003060 -- mon_subscribe_ack(300s) v1 -- ?+0 0x5fbd2c0
  419. 2014-07-08 08:47:06.038640 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== client.44228 192.168.0.5:0/1451003060 7 ==== statfs(1 v0) v1 ==== 34+0+0 (1832097438 0 0) 0x2da1f80 con 0x2069c80
  420. 2014-07-08 08:47:06.038684 7fe4ae9d0700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:06.038686 lease_expire=2014-07-08 08:47:08.269944 has v0 lc 76665
  421. 2014-07-08 08:47:06.038702 7fe4ae9d0700 10 mon.node-22@0(leader).pg v37964 preprocess_query statfs(1 v0) v1 from client.44228 192.168.0.5:0/1451003060
  422. 2014-07-08 08:47:06.038714 7fe4ae9d0700 10 mon.node-22@0(leader).pg v37964 handle_statfs statfs(1 v0) v1 from client.44228
  423. 2014-07-08 08:47:06.038722 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 --> 192.168.0.5:0/1451003060 -- statfs_reply(1) v1 -- ?+0 0x2b0fcd00 con 0x2069c80
  424. 2014-07-08 08:47:06.040565 7fe4aab80700 2 -- 192.168.0.4:6789/0 >> 192.168.0.5:0/1451003060 pipe(0x81e8a80 sd=27 :6789 s=2 pgs=1 cs=1 l=1 c=0x2069c80).reader couldn't read tag, Success
  425. 2014-07-08 08:47:06.040607 7fe4aab80700 2 -- 192.168.0.4:6789/0 >> 192.168.0.5:0/1451003060 pipe(0x81e8a80 sd=27 :6789 s=2 pgs=1 cs=1 l=1 c=0x2069c80).fault 0: Success
  426. 2014-07-08 08:47:06.040711 7fe4ae9d0700 10 mon.node-22@0(leader) e4 ms_handle_reset 0x2069c80 192.168.0.5:0/1451003060
  427. 2014-07-08 08:47:06.040737 7fe4ae9d0700 10 mon.node-22@0(leader) e4 reset/close on session client.? 192.168.0.5:0/1451003060
  428. 2014-07-08 08:47:06.040746 7fe4ae9d0700 10 mon.node-22@0(leader) e4 remove_session MonSession: client.? 192.168.0.5:0/1451003060 is openallow r client.? 192.168.0.5:0/1451003060
  429. 2014-07-08 08:47:06.270093 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x8aeb480
  430. 2014-07-08 08:47:06.271256 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948134 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (3917343726 0 0) 0x8aeb480 con 0x1b3d8c0
  431. 2014-07-08 08:47:06.271885 7fe4ad8cd700 2 -- 192.168.0.4:6789/0 >> 192.168.0.6:6789/0 pipe(0x1ca9180 sd=9 :42043 s=1 pgs=7 cs=2 l=0 c=0x1b3d600).connect error 192.168.0.6:6789/0, 110: Connection timed out
  432. 2014-07-08 08:47:06.272005 7fe4ad8cd700 2 -- 192.168.0.4:6789/0 >> 192.168.0.6:6789/0 pipe(0x1ca9180 sd=9 :42043 s=1 pgs=7 cs=2 l=0 c=0x1b3d600).fault 110: Connection timed out
  433. 2014-07-08 08:47:08.272199 7fe4af1d1700 10 mon.node-22@0(leader).pg v37964 v37964: 4800 pgs: 4800 active+clean; 21121 MB data, 78114 MB used, 3159 GB / 3236 GB avail
  434. 2014-07-08 08:47:08.272250 7fe4af1d1700 10 mon.node-22@0(leader).mds e1 e1: 0/0/1 up
  435. 2014-07-08 08:47:08.272260 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 e385: 8 osds: 7 up, 7 in
  436. 2014-07-08 08:47:08.272268 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:08.272269 lease_expire=2014-07-08 08:47:11.270087 has v0 lc 76665
  437. 2014-07-08 08:47:08.272286 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:08.272287 lease_expire=2014-07-08 08:47:11.270087 has v0 lc 76665
  438. 2014-07-08 08:47:08.272303 7fe4af1d1700 1 mon.node-22@0(leader).paxos(paxos active c 76054..76665) is_readable now=2014-07-08 08:47:08.272304 lease_expire=2014-07-08 08:47:11.270087 has v0 lc 76665
  439. 2014-07-08 08:47:08.272941 7fe4af1d1700 10 mon.node-22@0(leader).osd e385 min_last_epoch_clean 385
  440. 2014-07-08 08:47:08.272952 7fe4af1d1700 10 mon.node-22@0(leader).log v37563 log
  441. 2014-07-08 08:47:08.272958 7fe4af1d1700 10 mon.node-22@0(leader).auth v149 auth
  442. 2014-07-08 08:47:09.270188 7fe4af1d1700 1 -- 192.168.0.4:6789/0 --> mon.1 192.168.0.5:6789/0 -- paxos(lease lc 76665 fc 76054 pn 0 opn 0) v3 -- ?+0 0x2168f80
  443. 2014-07-08 08:47:09.271380 7fe4ae9d0700 1 -- 192.168.0.4:6789/0 <== mon.1 192.168.0.5:6789/0 1816948135 ==== paxos(lease_ack lc 76665 fc 76054 pn 0 opn 0) v3 ==== 80+0+0 (3652169895 0 0) 0x2168f80 con 0x1b3d8c0
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!