API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Mar 27th, 2012
60
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.96 KB | None | 0 0
raw download clone embed print report
  1. 2012-03-27 10:46:52.826493 7ff39826d700 -- [2a00:f10:11b:cef0:225:90ff:fe33:49fe]:6802/6628 --> [2a00:f10:11b:cef0:225:90ff:fe33:49a4]:0/6223 -- osd_ping(heartbeat e0 as_of 27305) v1 -- ?+0 0x19852540 con 0x64fedc0
  2. 2012-03-27 10:46:52.826920 7ff39826d700 -- [2a00:f10:11b:cef0:225:90ff:fe33:49fe]:6802/6628 --> [2a00:f10:11b:cef0:225:90ff:fe33:49a4]:0/6295 -- osd_ping(heartbeat e0 as_of 27305) v1 -- ?+0 0x19852380 con 0x65443c0
  3. 2012-03-27 10:46:52.827126 7ff39826d700 -- [2a00:f10:11b:cef0:225:90ff:fe33:49fe]:6802/6628 --> [2a00:f10:11b:cef0:225:90ff:fe33:49a4]:0/6369 -- osd_ping(heartbeat e0 as_of 27305) v1 -- ?+0 0x198521c0 con 0x64e9280
  4. 2012-03-27 10:46:52.827305 7ff39826d700 -- [2a00:f10:11b:cef0:225:90ff:fe33:49fe]:6802/6628 --> [2a00:f10:11b:cef0:225:90ff:fe33:49a4]:0/6445 -- osd_ping(heartbeat e0 as_of 27305) v1 -- ?+0 0x19852000 con 0x652b500
  5. 2012-03-27 10:46:53.057494 7ff3a9491700 heartbeat_map is_healthy 'FileStore::op_tp thread 0x7ff3a047f700' had timed out after 60
  6. 2012-03-27 10:46:53.057570 7ff3a9491700 heartbeat_map is_healthy 'FileStore::op_tp thread 0x7ff3a047f700' had suicide timed out after 180
  7. common/HeartbeatMap.cc: In function 'bool ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d*, const char*, time_t)' thread 7ff3a9491700 time 2012-03-27 10:46:53.217748
  8. common/HeartbeatMap.cc: 78: FAILED assert(0 == "hit suicide timeout")
  9. ceph version 0.44-70-gc3dc6a6 (commit:c3dc6a6ebf0fc42dad3989a7e0f8a4184f93d396)
  10. 1: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d*, char const*, long)+0x21d) [0x766d0d]
  11. 2: (ceph::HeartbeatMap::is_healthy()+0x87) [0x7674e7]
  12. 3: (ceph::HeartbeatMap::check_touch_file()+0x16) [0x767706]
  13. 4: (CephContextServiceThread::entry()+0x57) [0x69a987]
  14. 5: (()+0x7efc) [0x7ff3ab15befc]
  15. 6: (clone()+0x6d) [0x7ff3a978c89d]
  16. ceph version 0.44-70-gc3dc6a6 (commit:c3dc6a6ebf0fc42dad3989a7e0f8a4184f93d396)
  17. 1: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d*, char const*, long)+0x21d) [0x766d0d]
  18. 2: (ceph::HeartbeatMap::is_healthy()+0x87) [0x7674e7]
  19. 3: (ceph::HeartbeatMap::check_touch_file()+0x16) [0x767706]
  20. 4: (CephContextServiceThread::entry()+0x57) [0x69a987]
  21. 5: (()+0x7efc) [0x7ff3ab15befc]
  22. 6: (clone()+0x6d) [0x7ff3a978c89d]
  23. *** Caught signal (Aborted) **
  24. in thread 7ff3a9491700
  25. ceph version 0.44-70-gc3dc6a6 (commit:c3dc6a6ebf0fc42dad3989a7e0f8a4184f93d396)
  26. 1: /usr/bin/ceph-osd() [0x6fd3f6]
  27. 2: (()+0x10060) [0x7ff3ab164060]
  28. 3: (gsignal()+0x35) [0x7ff3a96e13a5]
  29. 4: (abort()+0x17b) [0x7ff3a96e4b0b]
  30. 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7ff3a9f9fd7d]
  31. 6: (()+0xb9f26) [0x7ff3a9f9df26]
  32. 7: (()+0xb9f53) [0x7ff3a9f9df53]
  33. 8: (()+0xba04e) [0x7ff3a9f9e04e]
  34. 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x200) [0x691b40]
  35. 10: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d*, char const*, long)+0x21d) [0x766d0d]
  36. 11: (ceph::HeartbeatMap::is_healthy()+0x87) [0x7674e7]
  37. 12: (ceph::HeartbeatMap::check_touch_file()+0x16) [0x767706]
  38. 13: (CephContextServiceThread::entry()+0x57) [0x69a987]
  39. 14: (()+0x7efc) [0x7ff3ab15befc]
  40. 15: (clone()+0x6d) [0x7ff3a978c89d]
  41. root@atom0:~# service ceph stop osd.0
  42. === osd.0 ===
  43. Stopping Ceph osd.0 on atom0...done
  44. root@atom0:~# dmesg
  45. root@atom0:~# df -h
  46. Filesystem Size Used Avail Use% Mounted on
  47. /dev/mapper/data-root
  48. 9.3G 8.1G 757M 92% /
  49. udev 2.0G 4.0K 2.0G 1% /dev
  50. tmpfs 791M 308K 791M 1% /run
  51. none 5.0M 0 5.0M 0% /run/lock
  52. none 2.0G 0 2.0G 0% /run/shm
  53. /dev/mapper/data-tmp 4.7G 370M 4.1G 9% /tmp
  54. /dev/sda1 179M 90M 79M 54% /boot
  55. /dev/mapper/data-ceph--logs
  56. 25G 1.2G 23G 5% /var/log/ceph
  57. /dev/sdb 1.9T 22G 1.8T 2% /var/lib/ceph/osd.0
  58. /dev/sdc 1.9T 24G 1.8T 2% /var/lib/ceph/osd.1
  59. /dev/sdd 1.9T 23G 1.8T 2% /var/lib/ceph/osd.2
  60. /dev/sde 1.9T 16G 1.9T 1% /var/lib/ceph/osd.3
  61. root@atom0:~# umount /var/lib/ceph/osd.0
  62. root@atom0:~# sync
  63. root@atom0:~# dmesg
  64. [4449632.490139] ------------[ cut here ]------------
  65. [4449632.490184] WARNING: at fs/btrfs/extent-tree.c:4049 btrfs_free_block_groups+0x2ce/0x370 [btrfs]()
  66. [4449632.490193] Hardware name: X7SPA-HF
  67. [4449632.490197] Modules linked in: btrfs psmouse serio_raw w83627ehf hwmon_vid coretemp joydev ipmi_si ipmi_msghandler lp parport usbhid hid e1000e zlib_deflate libcrc32c [last unloaded: btrfs]
  68. [4449632.490240] Pid: 9021, comm: umount Tainted: G W 3.2.0-ceph+ #1
  69. [4449632.490245] Call Trace:
  70. [4449632.490258] [<ffffffff81062b2f>] warn_slowpath_common+0x7f/0xc0
  71. [4449632.490267] [<ffffffff81062b8a>] warn_slowpath_null+0x1a/0x20
  72. [4449632.490291] [<ffffffffa0182ece>] btrfs_free_block_groups+0x2ce/0x370 [btrfs]
  73. [4449632.490301] [<ffffffff81612c3d>] ? wait_for_completion+0x1d/0x20
  74. [4449632.490547] [<ffffffffa018dc5e>] close_ctree+0x1de/0x3a0 [btrfs]
  75. [4449632.490692] [<ffffffff81187701>] ? dispose_list+0x41/0x50
  76. [4449632.490785] [<ffffffff81187dfe>] ? evict_inodes+0xce/0x130
  77. [4449632.490815] [<ffffffffa016b4ed>] btrfs_put_super+0x1d/0x30 [btrfs]
  78. [4449632.490827] [<ffffffff8116f352>] generic_shutdown_super+0x62/0xe0
  79. [4449632.490837] [<ffffffff8116f466>] kill_anon_super+0x16/0x30
  80. [4449632.490847] [<ffffffff8116f83c>] deactivate_locked_super+0x3c/0xa0
  81. [4449632.490854] [<ffffffff8117030e>] deactivate_super+0x4e/0x70
  82. [4449632.490861] [<ffffffff8118b92d>] mntput_no_expire+0x9d/0xf0
  83. [4449632.490868] [<ffffffff8118c71c>] sys_umount+0x6c/0x380
  84. [4449632.490877] [<ffffffff8161d482>] system_call_fastpath+0x16/0x1b
  85. [4449632.490883] ---[ end trace f8f99b9ada46726c ]---
  86. [4449632.490888] ------------[ cut here ]------------
  87. [4449632.490912] WARNING: at fs/btrfs/extent-tree.c:4050 btrfs_free_block_groups+0x368/0x370 [btrfs]()
  88. [4449632.490918] Hardware name: X7SPA-HF
  89. [4449632.490921] Modules linked in: btrfs psmouse serio_raw w83627ehf hwmon_vid coretemp joydev ipmi_si ipmi_msghandler lp parport usbhid hid e1000e zlib_deflate libcrc32c [last unloaded: btrfs]
  90. [4449632.491069] Pid: 9021, comm: umount Tainted: G W 3.2.0-ceph+ #1
  91. [4449632.491076] Call Trace:
  92. [4449632.491091] [<ffffffff81062b2f>] warn_slowpath_common+0x7f/0xc0
  93. [4449632.491100] [<ffffffff81062b8a>] warn_slowpath_null+0x1a/0x20
  94. [4449632.491125] [<ffffffffa0182f68>] btrfs_free_block_groups+0x368/0x370 [btrfs]
  95. [4449632.491134] [<ffffffff81612c3d>] ? wait_for_completion+0x1d/0x20
  96. [4449632.491158] [<ffffffffa018dc5e>] close_ctree+0x1de/0x3a0 [btrfs]
  97. [4449632.491167] [<ffffffff81187701>] ? dispose_list+0x41/0x50
  98. [4449632.491174] [<ffffffff81187dfe>] ? evict_inodes+0xce/0x130
  99. [4449632.491193] [<ffffffffa016b4ed>] btrfs_put_super+0x1d/0x30 [btrfs]
  100. [4449632.491316] [<ffffffff8116f352>] generic_shutdown_super+0x62/0xe0
  101. [4449632.491327] [<ffffffff8116f466>] kill_anon_super+0x16/0x30
  102. [4449632.491338] [<ffffffff8116f83c>] deactivate_locked_super+0x3c/0xa0
  103. [4449632.491349] [<ffffffff8117030e>] deactivate_super+0x4e/0x70
  104. [4449632.491359] [<ffffffff8118b92d>] mntput_no_expire+0x9d/0xf0
  105. [4449632.491369] [<ffffffff8118c71c>] sys_umount+0x6c/0x380
  106. [4449632.491381] [<ffffffff8161d482>] system_call_fastpath+0x16/0x1b
  107. [4449632.491388] ---[ end trace f8f99b9ada46726d ]---
  108. [4449632.491393] ------------[ cut here ]------------
  109. [4449632.491419] WARNING: at fs/btrfs/extent-tree.c:7237 btrfs_free_block_groups+0x262/0x370 [btrfs]()
  110. [4449632.491425] Hardware name: X7SPA-HF
  111. [4449632.491428] Modules linked in: btrfs psmouse serio_raw w83627ehf hwmon_vid coretemp joydev ipmi_si ipmi_msghandler lp parport usbhid hid e1000e zlib_deflate libcrc32c [last unloaded: btrfs]
  112. [4449632.491585] Pid: 9021, comm: umount Tainted: G W 3.2.0-ceph+ #1
  113. [4449632.491591] Call Trace:
  114. [4449632.491606] [<ffffffff81062b2f>] warn_slowpath_common+0x7f/0xc0
  115. [4449632.491614] [<ffffffff81062b8a>] warn_slowpath_null+0x1a/0x20
  116. [4449632.491640] [<ffffffffa0182e62>] btrfs_free_block_groups+0x262/0x370 [btrfs]
  117. [4449632.491648] [<ffffffff81612c3d>] ? wait_for_completion+0x1d/0x20
  118. [4449632.491673] [<ffffffffa018dc5e>] close_ctree+0x1de/0x3a0 [btrfs]
  119. [4449632.491681] [<ffffffff81187701>] ? dispose_list+0x41/0x50
  120. [4449632.491802] [<ffffffff81187dfe>] ? evict_inodes+0xce/0x130
  121. [4449632.491832] [<ffffffffa016b4ed>] btrfs_put_super+0x1d/0x30 [btrfs]
  122. [4449632.491844] [<ffffffff8116f352>] generic_shutdown_super+0x62/0xe0
  123. [4449632.491854] [<ffffffff8116f466>] kill_anon_super+0x16/0x30
  124. [4449632.491861] [<ffffffff8116f83c>] deactivate_locked_super+0x3c/0xa0
  125. [4449632.491868] [<ffffffff8117030e>] deactivate_super+0x4e/0x70
  126. [4449632.491876] [<ffffffff8118b92d>] mntput_no_expire+0x9d/0xf0
  127. [4449632.491883] [<ffffffff8118c71c>] sys_umount+0x6c/0x380
  128. [4449632.491891] [<ffffffff8161d482>] system_call_fastpath+0x16/0x1b
  129. [4449632.491897] ---[ end trace f8f99b9ada46726e ]---
  130. [4449632.491903] space_info 4 has 974123008 free, is not full
  131. [4449632.491909] space_info total=1082130432, used=99553280, pinned=0, reserved=0, may_use=294912, readonly=8454144
  132. root@atom0:~#
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!