API tools faq
paste
Advertisement
cetex

Ceph b0rken

cetex
Nov 2nd, 2015
191
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 15.14 KB | None | 0 0
raw download clone embed print report
  1. {"log":"2015-11-01 23:39:45.993944 7fdbfd0ea900 0 ceph version 0.94.3 (95cefea9fd9ab740263bf8bb4796fd864d9afe2b), process ceph-osd, pid 6
  2. ","stream":"stdout","time":"2015-11-01T23:39:45.994178213Z"}
  3. {"log":"2015-11-01 23:39:45.996235 7fdbfd0ea900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
  4. ","stream":"stdout","time":"2015-11-01T23:39:45.996353322Z"}
  5. {"log":"2015-11-01 23:39:45.996247 7fdbfd0ea900 1 journal _open /data/journal fd 6: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  6. ","stream":"stdout","time":"2015-11-01T23:39:45.996368635Z"}
  7. {"log":"2015-11-01 23:39:45.996309 7fdbfd0ea900 1 journal check: header looks ok
  8. ","stream":"stdout","time":"2015-11-01T23:39:45.996376068Z"}
  9. {"log":"2015-11-01 23:39:45.996327 7fdbfd0ea900 -1 created new journal /data/journal for object store /data/ceph
  10. ","stream":"stdout","time":"2015-11-01T23:39:45.996525254Z"}
  11. {"log":"2015-11-01 23:39:46.129582 7f869573d700 0 monclient: hunting for new mon
  12. ","stream":"stdout","time":"2015-11-01T23:39:46.129902202Z"}
  13. {"log":"create-or-move updated item name 'osd.3' weight 1 at location {datacenter=age,host=s1.r1.age,rack=r1,root=default,row=1} to crush map
  14. ","stream":"stdout","time":"2015-11-01T23:39:46.197647436Z"}
  15. {"log":"2015-11-01 23:39:46.217238 7fa680641900 0 ceph version 0.94.3 (95cefea9fd9ab740263bf8bb4796fd864d9afe2b), process ceph-osd, pid 1
  16. ","stream":"stdout","time":"2015-11-01T23:39:46.21754392Z"}
  17. {"log":"starting osd.3 at :/0 osd_data /data/ceph/ /data/journal
  18. ","stream":"stdout","time":"2015-11-01T23:39:46.219525684Z"}
  19. {"log":"2015-11-01 23:39:46.230588 7fa680641900 0 filestore(/data/ceph/) backend xfs (magic 0x58465342)
  20. ","stream":"stdout","time":"2015-11-01T23:39:46.235835981Z"}
  21. {"log":"2015-11-01 23:39:46.261566 7fa680641900 0 genericfilestorebackend(/data/ceph/) detect_features: FIEMAP ioctl is supported and appears to work
  22. ","stream":"stdout","time":"2015-11-01T23:39:46.290444143Z"}
  23. {"log":"2015-11-01 23:39:46.261579 7fa680641900 0 genericfilestorebackend(/data/ceph/) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
  24. ","stream":"stdout","time":"2015-11-01T23:39:46.290475511Z"}
  25. {"log":"2015-11-01 23:39:46.321426 7fa680641900 0 genericfilestorebackend(/data/ceph/) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
  26. ","stream":"stdout","time":"2015-11-01T23:39:46.321713381Z"}
  27. {"log":"2015-11-01 23:39:46.321598 7fa680641900 0 xfsfilestorebackend(/data/ceph/) detect_feature: extsize is supported and kernel 4.0.9-040009-generic \u003e= 3.5
  28. ","stream":"stdout","time":"2015-11-01T23:39:46.32195516Z"}
  29. {"log":"2015-11-01 23:39:46.381167 7fa680641900 0 filestore(/data/ceph/) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
  30. ","stream":"stdout","time":"2015-11-01T23:39:46.381427692Z"}
  31. {"log":"2015-11-01 23:39:46.384900 7fa680641900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
  32. ","stream":"stdout","time":"2015-11-01T23:39:46.38502058Z"}
  33. {"log":"2015-11-01 23:39:46.384906 7fa680641900 1 journal _open /data/journal fd 18: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  34. ","stream":"stdout","time":"2015-11-01T23:39:46.385044398Z"}
  35. {"log":"2015-11-01 23:39:46.384963 7fa680641900 1 journal _open /data/journal fd 18: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 0
  36. ","stream":"stdout","time":"2015-11-01T23:39:46.385299385Z"}
  37. {"log":"2015-11-01 23:39:46.385754 7fa680641900 0 \u003ccls\u003e cls/hello/cls_hello.cc:271: loading cls_hello
  38. ","stream":"stdout","time":"2015-11-01T23:39:46.386109574Z"}
  39. {"log":"2015-11-01 23:39:46.391966 7fa680641900 0 osd.3 5318 crush map has features 1107558400, adjusting msgr requires for clients
  40. ","stream":"stdout","time":"2015-11-01T23:39:46.392074525Z"}
  41. {"log":"2015-11-01 23:39:46.391977 7fa680641900 0 osd.3 5318 crush map has features 1107558400 was 8705, adjusting msgr requires for mons
  42. ","stream":"stdout","time":"2015-11-01T23:39:46.39229459Z"}
  43. {"log":"2015-11-01 23:39:46.391982 7fa680641900 0 osd.3 5318 crush map has features 1107558400, adjusting msgr requires for osds
  44. ","stream":"stdout","time":"2015-11-01T23:39:46.392335223Z"}
  45. {"log":"2015-11-01 23:39:46.391991 7fa680641900 0 osd.3 5318 load_pgs
  46. ","stream":"stdout","time":"2015-11-01T23:39:46.392342184Z"}
  47. {"log":"2015-11-01 23:39:53.105260 7fa680641900 0 osd.3 5318 load_pgs opened 369 pgs
  48. ","stream":"stdout","time":"2015-11-01T23:39:53.105696834Z"}
  49. {"log":"2015-11-01 23:39:53.105989 7fa680641900 -1 osd.3 5318 log_to_monitors {default=true}
  50. ","stream":"stdout","time":"2015-11-01T23:39:53.106303861Z"}
  51. {"log":"2015-11-01 23:39:53.108695 7fa6546ae700 0 -- 0.0.0.0:6803/1 \u003e\u003e xx.yy.zz.70:6808/1 pipe(0x26bfb000 sd=28 :0 s=1 pgs=0 cs=0 l=0 c=0x1fe61700).fault with nothing to send, going to standby
  52. ","stream":"stdout","time":"2015-11-01T23:39:53.108774891Z"}
  53. {"log":"2015-11-01 23:39:53.614396 7fa6545ad700 0 -- 0.0.0.0:6803/1 \u003e\u003e xx.yy.zz.76:6816/1 pipe(0x26ede000 sd=24 :0 s=1 pgs=0 cs=0 l=0 c=0x1fe619c0).fault with nothing to send, going to standby
  54. ","stream":"stdout","time":"2015-11-01T23:39:53.61466426Z"}
  55. {"log":"2015-11-01 23:39:53.615568 7fa6544ac700 0 -- 0.0.0.0:6803/1 \u003e\u003e xx.yy.zz.73:6815/1 pipe(0x26f04000 sd=42 :0 s=1 pgs=0 cs=0 l=0 c=0x26f0e2c0).fault with nothing to send, going to standby
  56. ","stream":"stdout","time":"2015-11-01T23:39:53.615832974Z"}
  57. {"log":"2015-11-01 23:39:53.616693 7fa6541a9700 0 -- 0.0.0.0:6803/1 \u003e\u003e xx.yy.zz.76:6811/1 pipe(0x26f35000 sd=49 :0 s=1 pgs=0 cs=0 l=0 c=0x26f0e6e0).fault with nothing to send, going to standby
  58. ","stream":"stdout","time":"2015-11-01T23:39:53.61698197Z"}
  59. {"log":"2015-11-01 23:39:53.617134 7fa6540a8700 0 -- 0.0.0.0:6803/1 \u003e\u003e xx.yy.zz.71:6810/1 pipe(0x26f30000 sd=53 :0 s=1 pgs=0 cs=0 l=0 c=0x26f0f1e0).fault with nothing to send, going to standby
  60. ","stream":"stdout","time":"2015-11-01T23:39:53.617231557Z"}
  61. {"log":"2015-11-01 23:39:53.618161 7fa653fa7700 0 -- 0.0.0.0:6803/1 \u003e\u003e xx.yy.zz.75:6811/1 pipe(0x26f1e000 sd=55 :0 s=1 pgs=0 cs=0 l=0 c=0x26f0eb00).fault with nothing to send, going to standby
  62. ","stream":"stdout","time":"2015-11-01T23:39:53.618388974Z"}
  63. {"log":"2015-11-01 23:39:53.620537 7fa653ea6700 0 -- 0.0.0.0:6803/1 \u003e\u003e xx.yy.zz.71:6801/1 pipe(0x26f4f000 sd=60 :0 s=1 pgs=0 cs=0 l=0 c=0x26f0f080).fault with nothing to send, going to standby
  64. ","stream":"stdout","time":"2015-11-01T23:39:53.620845391Z"}
  65. {"log":"2015-11-01 23:39:53.628816 7fa65379f700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.73:6809/1 pipe(0x26f76000 sd=89 :0 s=1 pgs=0 cs=0 l=0 c=0x26f11c80).fault with nothing to send, going to standby
  66. ","stream":"stdout","time":"2015-11-01T23:39:53.629028456Z"}
  67. {"log":"2015-11-01 23:39:53.882239 7fa680641900 0 osd.3 5318 done with init, starting boot process
  68. ","stream":"stdout","time":"2015-11-01T23:39:53.882494168Z"}
  69. {"log":"sh: 1: lsb_release: not found
  70. ","stream":"stdout","time":"2015-11-01T23:39:53.996200111Z"}
  71. {"log":"2015-11-01 23:39:53.996087 7fa65f7c5700 -1 osd.3 5322 lsb_release_parse - pclose failed: (0) Success
  72. ","stream":"stdout","time":"2015-11-01T23:39:53.996467432Z"}
  73. {"log":"sh: 1: lsb_release: not found
  74. ","stream":"stdout","time":"2015-11-01T23:39:54.047031792Z"}
  75. {"log":"2015-11-01 23:39:54.046699 7fa65f7c5700 -1 osd.3 5323 lsb_release_parse - pclose failed: (0) Success
  76. ","stream":"stdout","time":"2015-11-01T23:39:54.047435209Z"}
  77. {"log":"sh: 1: lsb_release: not found
  78. ","stream":"stdout","time":"2015-11-01T23:39:54.073886945Z"}
  79. {"log":"2015-11-01 23:39:54.073908 7fa65f7c5700 -1 osd.3 5323 lsb_release_parse - pclose failed: (0) Success
  80. ","stream":"stdout","time":"2015-11-01T23:39:54.074248004Z"}
  81. {"log":"2015-11-01 23:39:55.080669 7fa6546ae700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.70:6808/1 pipe(0x26bfb000 sd=28 :0 s=1 pgs=0 cs=1 l=0 c=0x1fe61700).fault
  82. ","stream":"stdout","time":"2015-11-01T23:39:55.080873532Z"}
  83. {"log":"2015-11-01 23:39:55.081935 7fa652e9d700 0 -- :/1 \u003e\u003e xx.yy.zz.72:6803/1 pipe(0x27609000 sd=141 :0 s=1 pgs=0 cs=0 l=1 c=0x275d29a0).fault
  84. ","stream":"stdout","time":"2015-11-01T23:39:55.082141524Z"}
  85. {"log":"2015-11-01 23:39:55.081938 7fa6544ac700 0 -- :/1 \u003e\u003e xx.yy.zz.72:6802/1 pipe(0x275ff000 sd=140 :0 s=1 pgs=0 cs=0 l=1 c=0x275d2420).fault
  86. ","stream":"stdout","time":"2015-11-01T23:39:55.082169292Z"}
  87. {"log":"2015-11-01 23:39:55.082087 7fa652b9a700 0 -- xx.yy.zz.68:0/1 \u003e\u003e xx.yy.zz.68:6810/1 pipe(0x27612000 sd=140 :0 s=1 pgs=0 cs=0 l=1 c=0x275d2f20).fault
  88. ","stream":"stdout","time":"2015-11-01T23:39:55.082331658Z"}
  89. {"log":"2015-11-01 23:39:55.082149 7fa652a99700 0 -- xx.yy.zz.68:0/1 \u003e\u003e 10.255.254.11:6812/1 pipe(0x27625000 sd=171 :0 s=1 pgs=0 cs=0 l=1 c=0x275d2dc0).fault
  90. ","stream":"stdout","time":"2015-11-01T23:39:55.082349572Z"}
  91. {"log":"2015-11-01 23:39:55.083840 7fa652392700 0 -- xx.yy.zz.68:0/1 \u003e\u003e xx.yy.zz.70:6809/1 pipe(0x2763e000 sd=174 :0 s=1 pgs=0 cs=0 l=1 c=0x275d3600).fault
  92. ","stream":"stdout","time":"2015-11-01T23:39:55.084260499Z"}
  93. {"log":"2015-11-01 23:39:55.084225 7fa652291700 0 -- xx.yy.zz.68:0/1 \u003e\u003e xx.yy.zz.70:6810/1 pipe(0x2764d000 sd=175 :0 s=1 pgs=0 cs=0 l=1 c=0x275d34a0).fault
  94. ","stream":"stdout","time":"2015-11-01T23:39:55.084301693Z"}
  95. {"log":"2015-11-01 23:39:55.214336 7fa653ca4700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.72:6801/1 pipe(0x26f4a000 sd=67 :40900 s=1 pgs=0 cs=0 l=0 c=0x26f107e0).connect claims to be 0.0.0.0:6801/1 not xx.yy.zz.72:6801/1 - presumably this is the same node!
  96. ","stream":"stdout","time":"2015-11-01T23:39:55.21470631Z"}
  97. {"log":"2015-11-01 23:39:55.214592 7fa653ca4700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.72:6801/1 pipe(0x26f4a000 sd=67 :40900 s=1 pgs=0 cs=0 l=0 c=0x26f107e0).connect protocol version mismatch, my 10 != 0
  98. ","stream":"stdout","time":"2015-11-01T23:39:55.215117033Z"}
  99. {"log":"2015-11-01 23:39:55.214643 7fa653ca4700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.72:6801/1 pipe(0x26f4a000 sd=67 :40900 s=1 pgs=0 cs=0 l=0 c=0x26f107e0).fault
  100. ","stream":"stdout","time":"2015-11-01T23:39:55.215428335Z"}
  101. {"log":"2015-11-01 23:39:55.215826 7fa653ca4700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.72:6801/1 pipe(0x26f4a000 sd=67 :41046 s=1 pgs=0 cs=0 l=0 c=0x26f107e0).connect claims to be 0.0.0.0:6801/1 not xx.yy.zz.72:6801/1 - presumably this is the same node!
  102. ","stream":"stdout","time":"2015-11-01T23:39:55.216173608Z"}
  103. {"log":"2015-11-01 23:39:55.216144 7fa653ca4700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.72:6801/1 pipe(0x26f4a000 sd=67 :41046 s=1 pgs=0 cs=0 l=0 c=0x26f107e0).connect protocol version mismatch, my 10 != 0
  104. ","stream":"stdout","time":"2015-11-01T23:39:55.216447129Z"}
  105. {"log":"2015-11-01 23:39:55.417093 7fa653ca4700 0 -- xx.yy.zz.68:6803/1 \u003e\u003e xx.yy.zz.72:6801/1 pipe(0x26f4a000 sd=67 :41060 s=1 pgs=0 cs=0 l=0 c=0x26f107e0).connect protocol version mismatch, my 10 != 0
  106. ","stream":"stdout","time":"2015-11-01T23:39:55.417242612Z"}
  107. {"log":"2015-11-01 23:39:55.705203 7fa651f8e700 0 -- 10.255.254.11:6805/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x2797f000 sd=176 :6805 s=0 pgs=0 cs=0 l=1 c=0x27225760).accept replacing existing (lossy) channel (new one lossy=1)
  108. ","stream":"stdout","time":"2015-11-01T23:39:55.705548425Z"}
  109. {"log":"2015-11-01 23:39:55.705224 7fa651e8d700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x27a01000 sd=177 :6804 s=0 pgs=0 cs=0 l=1 c=0x272254a0).accept replacing existing (lossy) channel (new one lossy=1)
  110. ","stream":"stdout","time":"2015-11-01T23:39:55.705570457Z"}
  111. {"log":"2015-11-01 23:39:55.705979 7fa6545ad700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x279fc000 sd=109 :6804 s=0 pgs=0 cs=0 l=1 c=0x27225600).accept replacing existing (lossy) channel (new one lossy=1)
  112. ","stream":"stdout","time":"2015-11-01T23:39:55.706345825Z"}
  113. {"log":"2015-11-01 23:39:55.705982 7fa653da5700 0 -- 10.255.254.11:6805/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x2797a000 sd=123 :6805 s=0 pgs=0 cs=0 l=1 c=0x2724dfa0).accept replacing existing (lossy) channel (new one lossy=1)
  114. ","stream":"stdout","time":"2015-11-01T23:39:55.706373938Z"}
  115. {"log":"2015-11-01 23:39:55.707139 7fa651f8e700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x2797f000 sd=176 :6804 s=0 pgs=0 cs=0 l=1 c=0x272254a0).accept replacing existing (lossy) channel (new one lossy=1)
  116. ","stream":"stdout","time":"2015-11-01T23:39:55.707681876Z"}
  117. {"log":"2015-11-01 23:39:55.707458 7fa653aa2700 0 -- 10.255.254.11:6805/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x275cd000 sd=177 :6805 s=0 pgs=0 cs=0 l=1 c=0x272251e0).accept replacing existing (lossy) channel (new one lossy=1)
  118. ","stream":"stdout","time":"2015-11-01T23:39:55.70775708Z"}
  119. {"log":"2015-11-01 23:39:55.708778 7fa653ba3700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x27a01000 sd=109 :6804 s=0 pgs=0 cs=0 l=1 c=0x275d2160).accept replacing existing (lossy) channel (new one lossy=1)
  120. ","stream":"stdout","time":"2015-11-01T23:39:55.708882031Z"}
  121. {"log":"2015-11-01 23:39:55.708781 7fa651e8d700 0 -- 10.255.254.11:6805/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x275c8000 sd=123 :6805 s=0 pgs=0 cs=0 l=1 c=0x27225340).accept replacing existing (lossy) channel (new one lossy=1)
  122. ","stream":"stdout","time":"2015-11-01T23:39:55.709084759Z"}
  123. {"log":"2015-11-01 23:39:55.709642 7fa653aa2700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x279fc000 sd=176 :6804 s=0 pgs=0 cs=0 l=1 c=0x275d2000).accept replacing existing (lossy) channel (new one lossy=1)
  124. ","stream":"stdout","time":"2015-11-01T23:39:55.709791497Z"}
  125. {"log":"2015-11-01 23:39:55.709656 7fa653da5700 0 -- 10.255.254.11:6805/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x27a0b000 sd=177 :6805 s=0 pgs=0 cs=0 l=1 c=0x27225760).accept replacing existing (lossy) channel (new one lossy=1)
  126. ","stream":"stdout","time":"2015-11-01T23:39:55.710043377Z"}
  127. {"log":"2015-11-01 23:39:55.710651 7fa6545ad700 0 -- 10.255.254.11:6805/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x27a06000 sd=109 :6805 s=0 pgs=0 cs=0 l=1 c=0x272254a0).accept replacing existing (lossy) channel (new one lossy=1)
  128. ","stream":"stdout","time":"2015-11-01T23:39:55.711429029Z"}
  129. {"log":"2015-11-01 23:39:55.710658 7fa651f8e700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x275cd000 sd=123 :6804 s=0 pgs=0 cs=0 l=1 c=0x27224f20).accept replacing existing (lossy) channel (new one lossy=1)
  130. ","stream":"stdout","time":"2015-11-01T23:39:55.71162433Z"}
  131. {"log":"2015-11-01 23:39:55.711992 7fa653da5700 0 -- 10.255.254.11:6805/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x27a01000 sd=177 :6805 s=0 pgs=0 cs=0 l=1 c=0x27225340).accept replacing existing (lossy) channel (new one lossy=1)
  132. ","stream":"stdout","time":"2015-11-01T23:39:55.7122818Z"}
  133. {"log":"2015-11-01 23:39:55.712194 7fa653ba3700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x279fc000 sd=176 :6804 s=0 pgs=0 cs=0 l=1 c=0x27225080).accept replacing existing (lossy) channel (new one lossy=1)
  134. ","stream":"stdout","time":"2015-11-01T23:39:55.712316019Z"}
  135. {"log":"2015-11-01 23:39:55.713702 7fa651e8d700 0 -- xx.yy.zz.68:6804/1 \u003e\u003e xx.yy.zz.76:0/1 pipe(0x27a06000 sd=109 :6804 s=0 pgs=0 cs=0 l=1 c=0x27225600).accept replacing existing (lossy) channel (new one lossy=1)
  136. ","stream":"stdout","time":"2015-11-01T23:39:55.713989733Z"}
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!