Advertisement
cetex

Untitled

Dec 6th, 2015
162
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 26.56 KB | None | 0 0
  1. 2015-12-06 11:08:13.245469 7f9def5dc900 0 ceph version 0.94.3 (95cefea9fd9ab740263bf8bb4796fd864d9afe2b), process ceph-osd, pid 68
  2. 2015-12-06 11:08:13.248274 7f9def5dc900 1 filestore(/data/ceph/) mkfs in /data/ceph/
  3. 2015-12-06 11:08:13.248306 7f9def5dc900 1 filestore(/data/ceph/) mkfs fsid is already set to 68fc1b93-4880-42e6-8b93-d735ae703bfa
  4. 2015-12-06 11:08:13.326076 7f9def5dc900 0 filestore(/data/ceph/) backend xfs (magic 0x58465342)
  5. 2015-12-06 11:08:13.368175 7f9def5dc900 1 filestore(/data/ceph/) leveldb db exists/created
  6. 2015-12-06 11:08:13.368266 7f9def5dc900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
  7. 2015-12-06 11:08:13.368271 7f9def5dc900 1 journal _open /data/journal fd 8: 0 bytes, block size 4096 bytes, directio = 1, aio = 0
  8. 2015-12-06 11:08:13.368301 7f9def5dc900 -1 journal check: ondisk fsid 00000000-0000-0000-0000-000000000000 doesn't match expected 68fc1b93-4880-42e6-8b93-d735ae703bfa, invalid (someone else's?) journal
  9. 2015-12-06 11:08:13.368847 7f9def5dc900 1 journal _open /data/journal fd 8: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  10. 2015-12-06 11:08:13.369032 7f9def5dc900 0 filestore(/data/ceph/) mkjournal created journal on /data/journal
  11. 2015-12-06 11:08:13.369043 7f9def5dc900 1 filestore(/data/ceph/) mkfs done in /data/ceph/
  12. 2015-12-06 11:08:13.369093 7f9def5dc900 0 filestore(/data/ceph/) backend xfs (magic 0x58465342)
  13. 2015-12-06 11:08:13.371888 7f9def5dc900 0 genericfilestorebackend(/data/ceph/) detect_features: FIEMAP ioctl is supported and appears to work
  14. 2015-12-06 11:08:13.371904 7f9def5dc900 0 genericfilestorebackend(/data/ceph/) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
  15. 2015-12-06 11:08:13.417905 7f9def5dc900 0 genericfilestorebackend(/data/ceph/) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
  16. 2015-12-06 11:08:13.418111 7f9def5dc900 0 xfsfilestorebackend(/data/ceph/) detect_feature: extsize is supported and kernel 4.0.9-040009-generic >= 3.5
  17. 2015-12-06 11:08:13.443265 7f9def5dc900 0 filestore(/data/ceph/) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
  18. 2015-12-06 11:08:13.443387 7f9def5dc900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
  19. 2015-12-06 11:08:13.443397 7f9def5dc900 1 journal _open /data/journal fd 14: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  20. 2015-12-06 11:08:13.443511 7f9def5dc900 1 journal _open /data/journal fd 14: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  21. 2015-12-06 11:08:13.443753 7f9def5dc900 -1 filestore(/data/ceph/) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
  22. 2015-12-06 11:08:13.601688 7f9def5dc900 1 journal close /data/journal
  23. 2015-12-06 11:08:13.602060 7f9def5dc900 -1 created object store /data/ceph/ journal /data/journal for osd.1 fsid ff9059de-dc21-4691-b85e-03101231b09a
  24. 2015-12-06 11:08:13.612604 7f7d8adee900 0 ceph version 0.94.3 (95cefea9fd9ab740263bf8bb4796fd864d9afe2b), process ceph-osd, pid 87
  25. 2015-12-06 11:08:13.614130 7f7d8adee900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
  26. 2015-12-06 11:08:13.614141 7f7d8adee900 1 journal _open /data/journal fd 6: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  27. 2015-12-06 11:08:13.614188 7f7d8adee900 1 journal check: header looks ok
  28. 2015-12-06 11:08:13.614203 7f7d8adee900 -1 created new journal /data/journal for object store /data/ceph
  29. create-or-move updating item name 'osd.1' weight 1 at location {datacenter=age,host=s4.r2.age,rack=r2,root=default,row=1} to crush map
  30. 2015-12-06 11:08:14.641240 7f360d439900 0 ceph version 0.94.3 (95cefea9fd9ab740263bf8bb4796fd864d9afe2b), process ceph-osd, pid 1
  31. starting osd.1 at :/0 osd_data /data/ceph/ /data/journal
  32. 2015-12-06 11:08:14.657233 7f360d439900 0 filestore(/data/ceph/) backend xfs (magic 0x58465342)
  33. 2015-12-06 11:08:14.660969 7f360d439900 0 genericfilestorebackend(/data/ceph/) detect_features: FIEMAP ioctl is supported and appears to work
  34. 2015-12-06 11:08:14.660984 7f360d439900 0 genericfilestorebackend(/data/ceph/) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
  35. 2015-12-06 11:08:14.709602 7f360d439900 0 genericfilestorebackend(/data/ceph/) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
  36. 2015-12-06 11:08:14.709745 7f360d439900 0 xfsfilestorebackend(/data/ceph/) detect_feature: extsize is supported and kernel 4.0.9-040009-generic >= 3.5
  37. 2015-12-06 11:08:14.751649 7f360d439900 0 filestore(/data/ceph/) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
  38. 2015-12-06 11:08:14.751855 7f360d439900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
  39. 2015-12-06 11:08:14.751864 7f360d439900 1 journal _open /data/journal fd 18: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  40. 2015-12-06 11:08:14.751939 7f360d439900 1 journal _open /data/journal fd 18: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  41. 2015-12-06 11:08:14.756284 7f360d439900 0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
  42. 2015-12-06 11:08:14.758594 7f360d439900 0 osd.1 0 crush map has features 33816576, adjusting msgr requires for clients
  43. 2015-12-06 11:08:14.758605 7f360d439900 0 osd.1 0 crush map has features 33816576 was 8705, adjusting msgr requires for mons
  44. 2015-12-06 11:08:14.758610 7f360d439900 0 osd.1 0 crush map has features 33816576, adjusting msgr requires for osds
  45. 2015-12-06 11:08:14.758637 7f360d439900 0 osd.1 0 load_pgs
  46. 2015-12-06 11:08:14.758694 7f360d439900 0 osd.1 0 load_pgs opened 0 pgs
  47. 2015-12-06 11:08:14.759151 7f360d439900 -1 osd.1 0 log_to_monitors {default=true}
  48. 2015-12-06 11:08:14.763241 7f360d439900 0 osd.1 0 done with init, starting boot process
  49. sh: 1: lsb_release: not found
  50. 2015-12-06 11:08:14.766706 7f35f2835700 -1 osd.1 0 lsb_release_parse - pclose failed: (0) Success
  51. 2015-12-06 11:08:14.767291 7f35fb046700 0 osd.1 5 crush map has features 1107558400, adjusting msgr requires for clients
  52. 2015-12-06 11:08:14.767299 7f35fb046700 0 osd.1 5 crush map has features 1107558400 was 33825281, adjusting msgr requires for mons
  53. 2015-12-06 11:08:14.767305 7f35fb046700 0 osd.1 5 crush map has features 1107558400, adjusting msgr requires for osds
  54. sh: 1: lsb_release: not found
  55. 2015-12-06 11:08:14.770571 7f35f2835700 -1 osd.1 5 lsb_release_parse - pclose failed: (0) Success
  56. 2015-12-06 11:08:16.460657 7f35e6a18700 0 -- <pub-ip-range>.71:6805/1 >> <pub-ip-range>.71:6801/1 pipe(0x492f000 sd=62 :6805 s=0 pgs=0 cs=0 l=0 c=0x4788260).accept connect_seq 0 vs existing 0 state connecting
  57. 2015-12-06 11:11:57.033812 7f35e5806700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4ec3000 sd=85 :64984 s=1 pgs=0 cs=0 l=1 c=0x4788c00).fault
  58. 2015-12-06 11:11:58.419453 7f35e5301700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x4f16000 sd=96 :9441 s=1 pgs=0 cs=0 l=1 c=0x4789c80).fault
  59. 2015-12-06 11:12:05.902516 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:05.902430) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f25200
  60. 2015-12-06 11:12:07.465970 7f35e20cf700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x4cb7000 sd=95 :47567 s=1 pgs=0 cs=0 l=1 c=0x47895a0).fault
  61. 2015-12-06 11:12:07.466235 7f35e2ddc700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x517e000 sd=94 :44531 s=1 pgs=0 cs=0 l=1 c=0x4789860).fault
  62. 2015-12-06 11:12:09.266336 7f35e5806700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x4cb7000 sd=95 :54836 s=4 pgs=0 cs=0 l=1 c=0x4789c80).connect got RESETSESSION but no longer connecting
  63. 2015-12-06 11:12:09.757768 7f35e5806700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x50b9000 sd=97 :56890 s=1 pgs=0 cs=0 l=1 c=0x4789440).fault
  64. 2015-12-06 11:12:10.295044 7f35e5907700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=94 :56001 s=1 pgs=0 cs=0 l=1 c=0x50a3440).fault
  65. 2015-12-06 11:12:10.952067 7f35e28d7700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=96 :58640 s=4 pgs=0 cs=0 l=1 c=0x4789de0).connect got RESETSESSION but no longer connecting
  66. 2015-12-06 11:12:11.003345 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:11.003244) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4b8c800
  67. 2015-12-06 11:12:11.003367 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:11.003244) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4b8c800
  68. 2015-12-06 11:12:24.605595 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:24.605483) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4be7400
  69. 2015-12-06 11:12:24.908624 7f35e3bea700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=94 :54914 s=1 pgs=0 cs=0 l=1 c=0x4789860).fault
  70. 2015-12-06 11:12:25.886895 7f35e6311700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x520d000 sd=94 :59022 s=1 pgs=0 cs=0 l=1 c=0x4789700).fault
  71. 2015-12-06 11:12:29.894958 7f35e5a08700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x4cb7000 sd=97 :14690 s=1 pgs=0 cs=0 l=1 c=0x4789440).fault
  72. 2015-12-06 11:12:32.807425 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:32.807361) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f24000
  73. 2015-12-06 11:12:32.807446 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:32.807361) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f24000
  74. 2015-12-06 11:12:33.271891 7f35e28d7700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=94 :26100 s=4 pgs=0 cs=0 l=1 c=0x4788c00).connect got RESETSESSION but no longer connecting
  75. 2015-12-06 11:12:34.107677 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:34.107627) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f26800
  76. 2015-12-06 11:12:34.107693 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:34.107627) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f26800
  77. 2015-12-06 11:12:36.007866 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:36.007824) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f26a00
  78. 2015-12-06 11:12:36.007879 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:36.007824) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f26a00
  79. 2015-12-06 11:12:38.798113 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:31.507034 front 2015-12-06 11:12:31.507034 (cutoff 2015-12-06 11:12:31.798111)
  80. 2015-12-06 11:12:39.008339 7f35ea825700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:31.507034 front 2015-12-06 11:12:31.507034 (cutoff 2015-12-06 11:12:32.008337)
  81. 2015-12-06 11:12:42.809330 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:42.809205) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f27800
  82. 2015-12-06 11:12:44.909581 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:44.909520) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f26000
  83. 2015-12-06 11:12:44.909596 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:44.909520) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f26000
  84. 2015-12-06 11:12:46.409895 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:46.409768) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f26600
  85. 2015-12-06 11:12:48.710099 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:48.710056) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f25400
  86. 2015-12-06 11:12:48.710112 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:48.710056) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f25400
  87. 2015-12-06 11:12:49.799407 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:42.799406)
  88. 2015-12-06 11:12:50.610317 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:50.610268) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f25000
  89. 2015-12-06 11:12:50.610331 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:50.610268) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f25000
  90. 2015-12-06 11:12:50.610338 7f35ea825700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:43.610336)
  91. 2015-12-06 11:12:50.799565 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:43.799563)
  92. 2015-12-06 11:12:51.799691 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:44.799689)
  93. 2015-12-06 11:12:52.799823 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:45.799821)
  94. 2015-12-06 11:12:52.910565 7f35ea825700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:45.910564)
  95. 2015-12-06 11:12:53.300790 7f35e38e7700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=94 :46688 s=1 pgs=0 cs=0 l=1 c=0x4787e40).fault
  96. 2015-12-06 11:12:53.795522 7f35e32e1700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=94 :48854 s=4 pgs=0 cs=0 l=1 c=0x4787e40).connect got RESETSESSION but no longer connecting
  97. 2015-12-06 11:12:53.799983 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:46.799981)
  98. 2015-12-06 11:12:54.010792 7f35ea825700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:12:42.108947 front 2015-12-06 11:12:42.108947 (cutoff 2015-12-06 11:12:47.010790)
  99. 2015-12-06 11:12:55.271387 7f35e5301700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5228000 sd=95 :55167 s=4 pgs=0 cs=0 l=1 c=0x4789700).connect got RESETSESSION but no longer connecting
  100. 2015-12-06 11:12:56.611385 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:56.611286) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4b8fa00
  101. 2015-12-06 11:12:56.611401 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:12:56.611286) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4b8fa00
  102. 2015-12-06 11:13:01.323447 7f35e1fce700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x5216000 sd=94 :20036 s=4 pgs=0 cs=0 l=1 c=0x4789440).connect got RESETSESSION but no longer connecting
  103. 2015-12-06 11:13:06.113062 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:06.112920) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x518cc00
  104. 2015-12-06 11:13:06.113130 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:06.112920) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x518cc00
  105. 2015-12-06 11:13:11.914004 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:11.913909) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x518b000
  106. 2015-12-06 11:13:11.914032 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:11.913909) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x518b000
  107. 2015-12-06 11:13:16.014726 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:16.014666) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4be7c00
  108. 2015-12-06 11:13:16.014740 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:16.014666) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4be7c00
  109. 2015-12-06 11:13:18.188863 7f35e21d0700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x5216000 sd=97 :28914 s=1 pgs=0 cs=0 l=1 c=0x4789b20).fault
  110. 2015-12-06 11:13:18.815139 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:18.815095) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x518aa00
  111. 2015-12-06 11:13:18.815152 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:18.815095) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x518aa00
  112. 2015-12-06 11:13:21.392430 7f35e27d6700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=95 :39494 s=1 pgs=0 cs=0 l=1 c=0x4789c80).fault
  113. 2015-12-06 11:13:21.821408 7f35e2bda700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5299000 sd=95 :41239 s=1 pgs=0 cs=0 l=1 c=0x4787e40).fault
  114. 2015-12-06 11:13:22.182922 7f35e5c0a700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x5294000 sd=97 :45746 s=1 pgs=0 cs=0 l=1 c=0x4789c80).fault
  115. 2015-12-06 11:13:22.560567 7f35e3fee700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x490a000 sd=95 :47414 s=1 pgs=0 cs=0 l=1 c=0x47892e0).fault
  116. 2015-12-06 11:13:24.178899 7f35e5a08700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x532e000 sd=96 :54286 s=1 pgs=0 cs=0 l=1 c=0x47895a0).fault
  117. 2015-12-06 11:13:29.958856 7f35e4bfa700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x531d000 sd=97 :11667 s=1 pgs=0 cs=0 l=1 c=0x4789440).fault
  118. 2015-12-06 11:13:31.217100 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:31.216814) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x518d400
  119. 2015-12-06 11:13:31.217128 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:31.216814) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x518d400
  120. 2015-12-06 11:13:31.619909 7f35e3bea700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x490a000 sd=97 :21675 s=4 pgs=0 cs=0 l=1 c=0x47892e0).connect got RESETSESSION but no longer connecting
  121. 2015-12-06 11:13:32.760353 7f35e5301700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5332000 sd=94 :23513 s=4 pgs=0 cs=0 l=1 c=0x4788c00).connect got RESETSESSION but no longer connecting
  122. 2015-12-06 11:13:33.231658 7f35e49f8700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5332000 sd=95 :25523 s=1 pgs=0 cs=0 l=1 c=0x4789b20).fault
  123. 2015-12-06 11:13:37.190919 7f35e1fce700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x5336000 sd=97 :45225 s=1 pgs=0 cs=0 l=1 c=0x4789b20).fault
  124. 2015-12-06 11:13:42.218941 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:42.218861) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4be6600
  125. 2015-12-06 11:13:42.218971 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:42.218861) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4be6600
  126. 2015-12-06 11:13:44.019391 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:44.019317) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4be9400
  127. 2015-12-06 11:13:44.019422 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:44.019317) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4be9400
  128. 2015-12-06 11:13:44.054682 7f35e5200700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x5332000 sd=94 :9834 s=1 pgs=0 cs=0 l=1 c=0x4787e40).fault
  129. 2015-12-06 11:13:45.158560 7f35e3ae9700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5337000 sd=94 :11526 s=1 pgs=0 cs=0 l=1 c=0x4788c00).fault
  130. 2015-12-06 11:13:46.670950 7f35e5402700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5332000 sd=95 :17939 s=1 pgs=0 cs=0 l=1 c=0x4787e40).fault
  131. 2015-12-06 11:13:48.019901 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:48.019858) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4755c00
  132. 2015-12-06 11:13:48.019915 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:48.019858) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4755c00
  133. 2015-12-06 11:13:55.420916 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:55.420740) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f1c000
  134. 2015-12-06 11:13:55.420950 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:55.420740) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f1c000
  135. 2015-12-06 11:13:57.521186 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:57.521082) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f1aa00
  136. 2015-12-06 11:13:57.521212 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:13:57.521082) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f1aa00
  137. 2015-12-06 11:13:58.102931 7f35e2cdb700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x490a000 sd=96 :1627 s=1 pgs=0 cs=0 l=1 c=0x4789de0).fault
  138. 2015-12-06 11:14:01.021908 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:14:01.021836) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f1ba00
  139. 2015-12-06 11:14:01.021932 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:14:01.021836) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f1ba00
  140. 2015-12-06 11:14:05.022387 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:14:05.022326) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4b8c400
  141. 2015-12-06 11:14:05.022401 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:14:05.022326) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4b8c400
  142. 2015-12-06 11:14:05.677718 7f35e1fce700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x532e000 sd=96 :36820 s=1 pgs=0 cs=0 l=1 c=0x4788260).fault
  143. 2015-12-06 11:14:05.808160 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:13:58.721626 front 2015-12-06 11:13:58.721626 (cutoff 2015-12-06 11:13:58.808158)
  144. 2015-12-06 11:14:06.266480 7f35e5200700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x4cb7000 sd=94 :35920 s=1 pgs=0 cs=0 l=1 c=0x4789700).fault
  145. 2015-12-06 11:14:06.808321 7f36021b2700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:13:58.721626 front 2015-12-06 11:13:58.721626 (cutoff 2015-12-06 11:13:59.808319)
  146. 2015-12-06 11:14:07.098932 7f35e5c0a700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x532e000 sd=95 :39105 s=1 pgs=0 cs=0 l=1 c=0x4789860).fault
  147. 2015-12-06 11:14:07.098981 7f35e45f4700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x490a000 sd=96 :42141 s=1 pgs=0 cs=0 l=1 c=0x47899c0).fault
  148. 2015-12-06 11:14:07.122662 7f35ea825700 -1 osd.1 12 heartbeat_check: no reply from osd.2 since back 2015-12-06 11:13:58.721626 front 2015-12-06 11:13:58.721626 (cutoff 2015-12-06 11:14:00.122661)
  149. 2015-12-06 11:14:07.126616 7f35e6311700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x5333000 sd=95 :42241 s=1 pgs=0 cs=0 l=1 c=0x4787e40).fault
  150. 2015-12-06 11:14:07.534870 7f35e48f7700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x4cb7000 sd=97 :43924 s=1 pgs=0 cs=0 l=1 c=0x4789700).fault
  151. 2015-12-06 11:14:07.584894 7f35e44f3700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x532e000 sd=96 :41053 s=1 pgs=0 cs=0 l=1 c=0x4788c00).fault
  152. 2015-12-06 11:14:07.589108 7f35e48f7700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x532e000 sd=94 :41070 s=4 pgs=0 cs=0 l=1 c=0x47899c0).connect got RESETSESSION but no longer connecting
  153. 2015-12-06 11:14:07.922555 7f35e46f5700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x532e000 sd=96 :45473 s=1 pgs=0 cs=0 l=1 c=0x52286e0).fault
  154. 2015-12-06 11:14:08.918936 7f35e28d7700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x490a000 sd=94 :46216 s=1 pgs=0 cs=0 l=1 c=0x4788260).fault
  155. 2015-12-06 11:14:08.985218 7f35e29d8700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5345000 sd=94 :46406 s=1 pgs=0 cs=0 l=1 c=0x5030f20).fault
  156. 2015-12-06 11:14:09.966048 7f35e2ddc700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x5345000 sd=95 :53056 s=1 pgs=0 cs=0 l=1 c=0x47895a0).fault
  157. 2015-12-06 11:14:10.224138 7f35e5806700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6802/1 pipe(0x5345000 sd=94 :51092 s=1 pgs=0 cs=0 l=1 c=0x4788260).fault
  158. 2015-12-06 11:14:11.423388 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:14:11.423323) v2 remote, <pub-ip-range>.80:6802/1, failed lossy con, dropping message 0x4f25a00
  159. 2015-12-06 11:14:11.423417 7f35ea825700 0 -- <pub-ip-range>.71:0/1 submit_message osd_ping(ping e12 stamp 2015-12-06 11:14:11.423323) v2 remote, <pub-ip-range>.80:6803/1, failed lossy con, dropping message 0x4f25a00
  160. 2015-12-06 11:14:12.694920 7f35e4cfb700 0 -- <pub-ip-range>.71:0/1 >> <pub-ip-range>.80:6803/1 pipe(0x4cb7000 sd=95 :64371 s=1 pgs=0 cs=0 l=1 c=0x4788c00).fault
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement