Advertisement
Guest User

MDS crash

a guest
Apr 12th, 2013
73
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.91 KB | None | 0 0
  1. root@ceph0:/var/lib/ceph/osd# ceph status detail
  2. health HEALTH_WARN mds a is laggy
  3. monmap e1: 1 mons at {a=192.168.178.10:6789/0}, election epoch 1, quorum 0 a
  4. osdmap e25: 2 osds: 2 up, 2 in
  5. pgmap v637: 576 pgs: 576 active+clean; 0 bytes data, 4978 MB used, 922 GB / 927 GB avail
  6. mdsmap e2273: 1/1/1 up {0=a=up:replay(laggy or crashed)}
  7.  
  8. root@ceph0:/var/lib/ceph/osd#
  9. root@ceph0:/var/log/ceph# tail -100 ceph-mds.a.log
  10. max_recent 10000
  11. max_new 1000
  12. log_file /var/log/ceph/ceph-mds.a.log
  13. --- end dump of recent events ---
  14. 2013-04-13 00:23:34.188173 7fa63dd29700 -1 *** Caught signal (Aborted) **
  15. in thread 7fa63dd29700
  16.  
  17. ceph version 0.60 (f26f7a39021dbf440c28d6375222e21c94fe8e5c)
  18. 1: /usr/bin/ceph-mds() [0x84364a]
  19. 2: (()+0xfcb0) [0x7fa64291fcb0]
  20. 3: (gsignal()+0x35) [0x7fa6416fb425]
  21. 4: (abort()+0x17b) [0x7fa6416feb8b]
  22. 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fa64204d69d]
  23. 6: (()+0xb5846) [0x7fa64204b846]
  24. 7: (()+0xb5873) [0x7fa64204b873]
  25. 8: (()+0xb596e) [0x7fa64204b96e]
  26. 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0x7a084f]
  27. 10: (MDSTable::load_2(int, ceph::buffer::list&, Context*)+0x421) [0x692ae1]
  28. 11: (Objecter::handle_osd_op_reply(MOSDOpReply*)+0xe38) [0x6e6f08]
  29. 12: (MDS::handle_core_message(Message*)+0xae8) [0x4d1018]
  30. 13: (MDS::_dispatch(Message*)+0x2f) [0x4d11df]
  31. 14: (MDS::ms_dispatch(Message*)+0x1db) [0x4d2c7b]
  32. 15: (DispatchQueue::entry()+0x341) [0x813491]
  33. 16: (DispatchQueue::DispatchThread::entry()+0xd) [0x7901ad]
  34. 17: (()+0x7e9a) [0x7fa642917e9a]
  35. 18: (clone()+0x6d) [0x7fa6417b8cbd]
  36. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  37.  
  38. --- begin dump of recent events ---
  39. 0> 2013-04-13 00:23:34.188173 7fa63dd29700 -1 *** Caught signal (Aborted) **
  40. in thread 7fa63dd29700
  41.  
  42. ceph version 0.60 (f26f7a39021dbf440c28d6375222e21c94fe8e5c)
  43. 1: /usr/bin/ceph-mds() [0x84364a]
  44. 2: (()+0xfcb0) [0x7fa64291fcb0]
  45. 3: (gsignal()+0x35) [0x7fa6416fb425]
  46. 4: (abort()+0x17b) [0x7fa6416feb8b]
  47. 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fa64204d69d]
  48. 6: (()+0xb5846) [0x7fa64204b846]
  49. 7: (()+0xb5873) [0x7fa64204b873]
  50. 8: (()+0xb596e) [0x7fa64204b96e]
  51. 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0x7a084f]
  52. 10: (MDSTable::load_2(int, ceph::buffer::list&, Context*)+0x421) [0x692ae1]
  53. 11: (Objecter::handle_osd_op_reply(MOSDOpReply*)+0xe38) [0x6e6f08]
  54. 12: (MDS::handle_core_message(Message*)+0xae8) [0x4d1018]
  55. 13: (MDS::_dispatch(Message*)+0x2f) [0x4d11df]
  56. 14: (MDS::ms_dispatch(Message*)+0x1db) [0x4d2c7b]
  57. 15: (DispatchQueue::entry()+0x341) [0x813491]
  58. 16: (DispatchQueue::DispatchThread::entry()+0xd) [0x7901ad]
  59. 17: (()+0x7e9a) [0x7fa642917e9a]
  60. 18: (clone()+0x6d) [0x7fa6417b8cbd]
  61. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  62.  
  63. --- logging levels ---
  64. 0/ 5 none
  65. 0/ 1 lockdep
  66. 0/ 1 context
  67. 1/ 1 crush
  68. 1/ 5 mds
  69. 1/ 5 mds_balancer
  70. 1/ 5 mds_locker
  71. 1/ 5 mds_log
  72. 1/ 5 mds_log_expire
  73. 1/ 5 mds_migrator
  74. 0/ 1 buffer
  75. 0/ 1 timer
  76. 0/ 1 filer
  77. 0/ 1 striper
  78. 0/ 1 objecter
  79. 0/ 5 rados
  80. 0/ 5 rbd
  81. 0/ 5 journaler
  82. 0/ 5 objectcacher
  83. 0/ 5 client
  84. 0/ 5 osd
  85. 0/ 5 optracker
  86. 0/ 5 objclass
  87. 1/ 3 filestore
  88. 1/ 3 journal
  89. 0/ 5 ms
  90. 1/ 5 mon
  91. 0/10 monc
  92. 0/ 5 paxos
  93. 0/ 5 tp
  94. 1/ 5 auth
  95. 1/ 5 crypto
  96. 1/ 1 finisher
  97. 1/ 5 heartbeatmap
  98. 1/ 5 perfcounter
  99. 1/ 5 rgw
  100. 1/ 5 hadoop
  101. 1/ 5 javaclient
  102. 1/ 5 asok
  103. 1/ 1 throttle
  104. -2/-2 (syslog threshold)
  105. -1/-1 (stderr threshold)
  106. max_recent 10000
  107. max_new 1000
  108. log_file /var/log/ceph/ceph-mds.a.log
  109. --- end dump of recent events ---
  110. root@ceph0:/var/log/ceph#
  111. root@ceph0:/var/log/ceph# cat /etc/ceph/ceph.conf
  112. [global]
  113.  
  114. # For version 0.55 and beyond, you must explicitly enable
  115. # or disable authentication with "auth" entries in [global].
  116.  
  117. auth cluster required = none
  118. auth service required = none
  119. auth client required = none
  120.  
  121. [osd]
  122. osd journal size = 1000
  123.  
  124. #The following assumes ext4 filesystem.
  125. filestore xattr use omap = false # false for XFS
  126.  
  127.  
  128. # For Bobtail (v 0.56) and subsequent versions, you may
  129. # add settings for mkcephfs so that it will create and mount
  130. # the file system on a particular OSD for you. Remove the comment `#`
  131. # character for the following settings and replace the values
  132. # in braces with appropriate values, or leave the following settings
  133. # commented out to accept the default values. You must specify the
  134. # --mkfs option with mkcephfs in order for the deployment script to
  135. # utilize the following settings, and you must define the 'devs'
  136. # option for each osd instance; see below.
  137.  
  138. #osd mkfs type = xfs
  139. #osd mkfs options {fs-type} = {mkfs options} # default for xfs is "-f"
  140. #osd mount options {fs-type} = {mount options} # default mount option is "rw,noatime"
  141.  
  142. # For example, for ext4, the mount option might look like this:
  143.  
  144. #osd mkfs options ext4 = user_xattr,rw,noatime
  145.  
  146. # Execute $ hostname to retrieve the name of your host,
  147. # and replace {hostname} with the name of your host.
  148. # For the monitor, replace {ip-address} with the IP
  149. # address of your host.
  150.  
  151. [mon.a]
  152.  
  153. host = ceph0
  154. mon addr = 192.168.178.10:6789
  155.  
  156. [osd.0]
  157. host = ceph0
  158.  
  159. # For Bobtail (v 0.56) and subsequent versions, you may
  160. # add settings for mkcephfs so that it will create and mount
  161. # the file system on a particular OSD for you. Remove the comment `#`
  162. # character for the following setting for each OSD and specify
  163. # a path to the device if you use mkcephfs with the --mkfs option.
  164.  
  165. #devs = /var/lib/ceph/osd/ceph-0
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement