API tools faq
paste
Advertisement
Guest User

CTDB recovery death loop

a guest
Jun 7th, 2012
138
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 35.65 KB | None | 0 0
raw download clone embed print report
  1. 2012/06/07 11:51:20.060419 [recoverd:12353]: server/ctdb_recoverd.c:2581 in the middle of recovery or ip reallocation. skipping public ip address check
  2. 2012/06/07 11:51:20.260787 [12305]: server/ctdb_server.c:331 ctdb request 0 of type 9 length 32 from node 1 to 0
  3. 2012/06/07 11:51:20.854961 [12305]: Added timed event "ctdb_statistics_update": 0x12634a0
  4. 2012/06/07 11:51:20.854986 [12305]: Ending timer event 0x125e7e0 "ctdb_statistics_update"
  5. 2012/06/07 11:51:21.010142 [12305]: CTDB_WAIT_UNTIL_RECOVERED
  6. 2012/06/07 11:51:21.010169 [12305]: Added timed event "ctdb_wait_until_recovered": 0x125e7e0
  7. 2012/06/07 11:51:21.010184 [12305]: Ending timer event 0x126c6f0 "ctdb_wait_until_recovered"
  8. 2012/06/07 11:51:21.010198 [12305]: Added timed event "ctdb_time_tick": 0x126c6f0
  9. 2012/06/07 11:51:21.010206 [12305]: Ending timer event 0x126d150 "ctdb_time_tick"
  10. 2012/06/07 11:51:21.058607 [12305]: server/ctdb_daemon.c:628 client request 495 of type 7 length 64 from node 0 to 4026531841
  11. 2012/06/07 11:51:21.058637 [12305]: Added timed event "queue_next_trigger": 0x126d290
  12. 2012/06/07 11:51:21.058651 [12305]: Added timed event "ctdb_control_timeout": 0x1265480
  13. 2012/06/07 11:51:21.058661 [12305]: server/ctdb_server.c:331 ctdb request 978 of type 7 length 64 from node 0 to 0
  14. 2012/06/07 11:51:21.058670 [12305]: Destroying timer event 0x126d390 "ctdb_recd_ping_timeout"
  15. 2012/06/07 11:51:21.058681 [12305]: Added timed event "ctdb_recd_ping_timeout": 0x12653a0
  16. 2012/06/07 11:51:21.058690 [12305]: Added timed event "queue_next_trigger": 0x125ea70
  17. 2012/06/07 11:51:21.058699 [12305]: Ending timer event 0x126d290 "queue_next_trigger"
  18. 2012/06/07 11:51:21.058708 [12305]: server/ctdb_server.c:331 ctdb request 978 of type 8 length 48 from node 0 to 0
  19. 2012/06/07 11:51:21.058725 [12305]: Destroying timer event 0x1265480 "ctdb_control_timeout"
  20. 2012/06/07 11:51:21.058734 [12305]: Ending timer event 0x125ea70 "queue_next_trigger"
  21. 2012/06/07 11:51:21.058887 [12305]: server/ctdb_daemon.c:628 client request 496 of type 7 length 64 from node 0 to 4026531841
  22. 2012/06/07 11:51:21.058915 [12305]: Added timed event "queue_next_trigger": 0x1264f90
  23. 2012/06/07 11:51:21.058929 [12305]: Added timed event "ctdb_control_timeout": 0x12650b0
  24. 2012/06/07 11:51:21.058940 [12305]: server/ctdb_server.c:331 ctdb request 979 of type 7 length 64 from node 0 to 0
  25. 2012/06/07 11:51:21.058951 [12305]: Added timed event "queue_next_trigger": 0x12656f0
  26. 2012/06/07 11:51:21.058960 [12305]: Ending timer event 0x1264f90 "queue_next_trigger"
  27. 2012/06/07 11:51:21.058968 [12305]: server/ctdb_server.c:331 ctdb request 979 of type 8 length 48 from node 0 to 0
  28. 2012/06/07 11:51:21.058984 [12305]: Destroying timer event 0x12650b0 "ctdb_control_timeout"
  29. 2012/06/07 11:51:21.058994 [12305]: Ending timer event 0x12656f0 "queue_next_trigger"
  30. 2012/06/07 11:51:21.059145 [12305]: server/ctdb_daemon.c:628 client request 497 of type 7 length 64 from node 0 to 4026531841
  31. 2012/06/07 11:51:21.059173 [12305]: Added timed event "queue_next_trigger": 0x125ea40
  32. 2012/06/07 11:51:21.059187 [12305]: Added timed event "ctdb_control_timeout": 0x1265880
  33. 2012/06/07 11:51:21.059198 [12305]: server/ctdb_server.c:331 ctdb request 980 of type 7 length 64 from node 0 to 0
  34. 2012/06/07 11:51:21.059209 [12305]: Added timed event "queue_next_trigger": 0x126c980
  35. 2012/06/07 11:51:21.059218 [12305]: Ending timer event 0x125ea40 "queue_next_trigger"
  36. 2012/06/07 11:51:21.059226 [12305]: server/ctdb_server.c:331 ctdb request 980 of type 8 length 228 from node 0 to 0
  37. 2012/06/07 11:51:21.059243 [12305]: Destroying timer event 0x1265880 "ctdb_control_timeout"
  38. 2012/06/07 11:51:21.059252 [12305]: Ending timer event 0x126c980 "queue_next_trigger"
  39. 2012/06/07 11:51:21.059422 [12305]: server/ctdb_daemon.c:628 client request 498 of type 7 length 64 from node 0 to 4026531841
  40. 2012/06/07 11:51:21.059450 [12305]: Added timed event "queue_next_trigger": 0x12650b0
  41. 2012/06/07 11:51:21.059465 [12305]: Added timed event "ctdb_control_timeout": 0x1265530
  42. 2012/06/07 11:51:21.059476 [12305]: server/ctdb_server.c:331 ctdb request 981 of type 7 length 64 from node 0 to 0
  43. 2012/06/07 11:51:21.059488 [12305]: Added timed event "queue_next_trigger": 0x126caa0
  44. 2012/06/07 11:51:21.059498 [12305]: Ending timer event 0x12650b0 "queue_next_trigger"
  45. 2012/06/07 11:51:21.059506 [12305]: server/ctdb_server.c:331 ctdb request 981 of type 8 length 61 from node 0 to 0
  46. 2012/06/07 11:51:21.059523 [12305]: Destroying timer event 0x1265530 "ctdb_control_timeout"
  47. 2012/06/07 11:51:21.059533 [12305]: Ending timer event 0x126caa0 "queue_next_trigger"
  48. 2012/06/07 11:51:21.059683 [12305]: server/ctdb_daemon.c:628 client request 499 of type 7 length 64 from node 0 to 4026531841
  49. 2012/06/07 11:51:21.059711 [12305]: Added timed event "queue_next_trigger": 0x12650b0
  50. 2012/06/07 11:51:21.059726 [12305]: Added timed event "ctdb_control_timeout": 0x126c920
  51. 2012/06/07 11:51:21.059736 [12305]: server/ctdb_server.c:331 ctdb request 982 of type 7 length 64 from node 0 to 0
  52. 2012/06/07 11:51:21.059756 [12305]: Added timed event "queue_next_trigger": 0x1262eb0
  53. 2012/06/07 11:51:21.059766 [12305]: Ending timer event 0x12650b0 "queue_next_trigger"
  54. 2012/06/07 11:51:21.059774 [12305]: server/ctdb_server.c:331 ctdb request 982 of type 8 length 48 from node 0 to 0
  55. 2012/06/07 11:51:21.059791 [12305]: Destroying timer event 0x126c920 "ctdb_control_timeout"
  56. 2012/06/07 11:51:21.059800 [12305]: Ending timer event 0x1262eb0 "queue_next_trigger"
  57. 2012/06/07 11:51:21.059951 [12305]: server/ctdb_daemon.c:628 client request 500 of type 7 length 64 from node 0 to 0
  58. 2012/06/07 11:51:21.059979 [12305]: Added timed event "queue_next_trigger": 0x126c920
  59. 2012/06/07 11:51:21.059994 [12305]: Added timed event "ctdb_control_timeout": 0x126cd10
  60. 2012/06/07 11:51:21.060004 [12305]: server/ctdb_server.c:331 ctdb request 983 of type 7 length 64 from node 0 to 0
  61. 2012/06/07 11:51:21.060015 [12305]: Added timed event "queue_next_trigger": 0x12631f0
  62. 2012/06/07 11:51:21.060024 [12305]: Ending timer event 0x126c920 "queue_next_trigger"
  63. 2012/06/07 11:51:21.060033 [12305]: server/ctdb_server.c:331 ctdb request 983 of type 8 length 60 from node 0 to 0
  64. 2012/06/07 11:51:21.060052 [12305]: Destroying timer event 0x126cd10 "ctdb_control_timeout"
  65. 2012/06/07 11:51:21.060061 [12305]: Ending timer event 0x12631f0 "queue_next_trigger"
  66. 2012/06/07 11:51:21.060210 [12305]: server/ctdb_daemon.c:628 client request 501 of type 7 length 64 from node 0 to 0
  67. 2012/06/07 11:51:21.060238 [12305]: Added timed event "queue_next_trigger": 0x1262f50
  68. 2012/06/07 11:51:21.060253 [12305]: Added timed event "ctdb_control_timeout": 0x1264f90
  69. 2012/06/07 11:51:21.060264 [12305]: server/ctdb_server.c:331 ctdb request 984 of type 7 length 64 from node 0 to 0
  70. 2012/06/07 11:51:21.060277 [12305]: Added timed event "queue_next_trigger": 0x1265520
  71. 2012/06/07 11:51:21.060286 [12305]: Ending timer event 0x1262f50 "queue_next_trigger"
  72. 2012/06/07 11:51:21.060295 [12305]: server/ctdb_server.c:331 ctdb request 984 of type 8 length 120 from node 0 to 0
  73. 2012/06/07 11:51:21.060312 [12305]: Destroying timer event 0x1264f90 "ctdb_control_timeout"
  74. 2012/06/07 11:51:21.060322 [12305]: Ending timer event 0x1265520 "queue_next_trigger"
  75. 2012/06/07 11:51:21.060469 [12305]: server/ctdb_daemon.c:628 client request 502 of type 7 length 64 from node 0 to 0
  76. 2012/06/07 11:51:21.060497 [12305]: Added timed event "queue_next_trigger": 0x1262eb0
  77. 2012/06/07 11:51:21.060512 [12305]: Added timed event "ctdb_control_timeout": 0x1262f60
  78. 2012/06/07 11:51:21.060522 [12305]: server/ctdb_server.c:331 ctdb request 985 of type 7 length 64 from node 0 to 0
  79. 2012/06/07 11:51:21.060533 [12305]: Added timed event "queue_next_trigger": 0x12656f0
  80. 2012/06/07 11:51:21.060542 [12305]: Ending timer event 0x1262eb0 "queue_next_trigger"
  81. 2012/06/07 11:51:21.060550 [12305]: server/ctdb_server.c:331 ctdb request 985 of type 8 length 48 from node 0 to 0
  82. 2012/06/07 11:51:21.060567 [12305]: Destroying timer event 0x1262f60 "ctdb_control_timeout"
  83. 2012/06/07 11:51:21.060577 [12305]: Ending timer event 0x12656f0 "queue_next_trigger"
  84. 2012/06/07 11:51:21.060725 [12305]: server/ctdb_daemon.c:628 client request 503 of type 7 length 64 from node 0 to 1
  85. 2012/06/07 11:51:21.060766 [12305]: Added timed event "ctdb_control_timeout": 0x125ea40
  86. 2012/06/07 11:51:21.060913 [12305]: server/ctdb_server.c:331 ctdb request 986 of type 8 length 120 from node 1 to 0
  87. 2012/06/07 11:51:21.060934 [12305]: Destroying timer event 0x125ea40 "ctdb_control_timeout"
  88. 2012/06/07 11:51:21.060986 [12305]: server/ctdb_daemon.c:628 client request 504 of type 7 length 64 from node 0 to 4026531841
  89. 2012/06/07 11:51:21.061005 [12305]: Added timed event "queue_next_trigger": 0x1262f50
  90. 2012/06/07 11:51:21.061015 [12305]: Added timed event "ctdb_control_timeout": 0x1265880
  91. 2012/06/07 11:51:21.061024 [12305]: server/ctdb_server.c:331 ctdb request 987 of type 7 length 64 from node 0 to 0
  92. 2012/06/07 11:51:21.061034 [12305]: Added timed event "queue_next_trigger": 0x1263250
  93. 2012/06/07 11:51:21.061043 [12305]: Ending timer event 0x1262f50 "queue_next_trigger"
  94. 2012/06/07 11:51:21.061060 [12305]: server/ctdb_server.c:331 ctdb request 987 of type 8 length 108 from node 0 to 0
  95. 2012/06/07 11:51:21.061075 [12305]: Destroying timer event 0x1265880 "ctdb_control_timeout"
  96. 2012/06/07 11:51:21.061084 [12305]: Ending timer event 0x1263250 "queue_next_trigger"
  97. 2012/06/07 11:51:21.061149 [12305]: server/ctdb_daemon.c:628 client request 505 of type 7 length 64 from node 0 to 4026531841
  98. 2012/06/07 11:51:21.061172 [12305]: Added timed event "queue_next_trigger": 0x1262eb0
  99. 2012/06/07 11:51:21.061187 [12305]: Added timed event "ctdb_control_timeout": 0x12630b0
  100. 2012/06/07 11:51:21.061200 [12305]: server/ctdb_server.c:331 ctdb request 988 of type 7 length 64 from node 0 to 0
  101. 2012/06/07 11:51:21.061212 [12305]: Added timed event "queue_next_trigger": 0x126c840
  102. 2012/06/07 11:51:21.061221 [12305]: Ending timer event 0x1262eb0 "queue_next_trigger"
  103. 2012/06/07 11:51:21.061230 [12305]: server/ctdb_server.c:331 ctdb request 988 of type 8 length 72 from node 0 to 0
  104. 2012/06/07 11:51:21.061244 [12305]: Destroying timer event 0x12630b0 "ctdb_control_timeout"
  105. 2012/06/07 11:51:21.061254 [12305]: Ending timer event 0x126c840 "queue_next_trigger"
  106. 2012/06/07 11:51:21.061292 [recoverd:12353]: The interfaces status has changed on local node 0 - force takeover run
  107. 2012/06/07 11:51:21.061388 [12305]: server/ctdb_daemon.c:628 client request 506 of type 7 length 64 from node 0 to 4026531841
  108. 2012/06/07 11:51:21.061410 [12305]: Added timed event "queue_next_trigger": 0x12630b0
  109. 2012/06/07 11:51:21.061425 [12305]: Added timed event "ctdb_control_timeout": 0x12631d0
  110. 2012/06/07 11:51:21.061438 [12305]: server/ctdb_server.c:331 ctdb request 989 of type 7 length 64 from node 0 to 0
  111. 2012/06/07 11:51:21.061449 [12305]: Added timed event "queue_next_trigger": 0x126cc80
  112. 2012/06/07 11:51:21.061458 [12305]: Ending timer event 0x12630b0 "queue_next_trigger"
  113. 2012/06/07 11:51:21.061466 [12305]: server/ctdb_server.c:331 ctdb request 989 of type 8 length 112 from node 0 to 0
  114. 2012/06/07 11:51:21.061481 [12305]: Destroying timer event 0x12631d0 "ctdb_control_timeout"
  115. 2012/06/07 11:51:21.061490 [12305]: Ending timer event 0x126cc80 "queue_next_trigger"
  116. 2012/06/07 11:51:21.061556 [12305]: server/ctdb_daemon.c:628 client request 507 of type 7 length 64 from node 0 to 4026531841
  117. 2012/06/07 11:51:21.061577 [12305]: Added timed event "queue_next_trigger": 0x126ca40
  118. 2012/06/07 11:51:21.061592 [12305]: Added timed event "ctdb_control_timeout": 0x126cb60
  119. 2012/06/07 11:51:21.061605 [12305]: server/ctdb_server.c:331 ctdb request 990 of type 7 length 64 from node 0 to 0
  120. 2012/06/07 11:51:21.061619 [12305]: Added timed event "queue_next_trigger": 0x12650a0
  121. 2012/06/07 11:51:21.061628 [12305]: Ending timer event 0x126ca40 "queue_next_trigger"
  122. 2012/06/07 11:51:21.061636 [12305]: server/ctdb_server.c:331 ctdb request 990 of type 8 length 108 from node 0 to 0
  123. 2012/06/07 11:51:21.061651 [12305]: Destroying timer event 0x126cb60 "ctdb_control_timeout"
  124. 2012/06/07 11:51:21.061660 [12305]: Ending timer event 0x12650a0 "queue_next_trigger"
  125. 2012/06/07 11:51:21.061698 [recoverd:12353]: server/ctdb_recoverd.c:2581 in the middle of recovery or ip reallocation. skipping public ip address check
  126. 2012/06/07 11:51:21.542955 [12305]: server/ctdb_daemon.c:666 Created SOCKET FD:25 to connected child
  127. 2012/06/07 11:51:21.542998 [12305]: server/ctdb_daemon.c:628 client request 2147483448 of type 7 length 64 from node 0 to 4026531841
  128. 2012/06/07 11:51:21.543018 [12305]: Added timed event "queue_next_trigger": 0x1265700
  129. 2012/06/07 11:51:21.543027 [12305]: Added timed event "ctdb_control_timeout": 0x1265820
  130. 2012/06/07 11:51:21.543036 [12305]: server/ctdb_server.c:331 ctdb request 992 of type 7 length 64 from node 0 to 0
  131. 2012/06/07 11:51:21.543046 [12305]: Added timed event "queue_next_trigger": 0x125ea60
  132. 2012/06/07 11:51:21.543055 [12305]: Ending timer event 0x1265700 "queue_next_trigger"
  133. 2012/06/07 11:51:21.543063 [12305]: server/ctdb_server.c:331 ctdb request 992 of type 8 length 48 from node 0 to 0
  134. 2012/06/07 11:51:21.543080 [12305]: Destroying timer event 0x1265820 "ctdb_control_timeout"
  135. 2012/06/07 11:51:21.543098 [12305]: Ending timer event 0x125ea60 "queue_next_trigger"
  136. 2012/06/07 11:51:21.543271 [12305]: server/ctdb_daemon.c:666 Created SOCKET FD:27 to connected child
  137. 2012/06/07 11:51:21.543313 [12305]: server/ctdb_daemon.c:628 client request 2147483449 of type 7 length 64 from node 0 to 4026531841
  138. 2012/06/07 11:51:21.543331 [12305]: Added timed event "queue_next_trigger": 0x126d2c0
  139. 2012/06/07 11:51:21.543340 [12305]: Added timed event "ctdb_control_timeout": 0x126d3e0
  140. 2012/06/07 11:51:21.543350 [12305]: server/ctdb_server.c:331 ctdb request 994 of type 7 length 64 from node 0 to 0
  141. 2012/06/07 11:51:21.543363 [12305]: Added timed event "queue_next_trigger": 0x126d6c0
  142. 2012/06/07 11:51:21.543372 [12305]: Ending timer event 0x126d2c0 "queue_next_trigger"
  143. 2012/06/07 11:51:21.543381 [12305]: server/ctdb_server.c:331 ctdb request 994 of type 8 length 48 from node 0 to 0
  144. 2012/06/07 11:51:21.543398 [12305]: Destroying timer event 0x126d3e0 "ctdb_control_timeout"
  145. 2012/06/07 11:51:21.543408 [12305]: Ending timer event 0x126d6c0 "queue_next_trigger"
  146. 2012/06/07 11:51:21.543556 [12305]: server/ctdb_daemon.c:628 client request 2147483450 of type 7 length 64 from node 0 to 0
  147. 2012/06/07 11:51:21.543585 [12305]: Added timed event "queue_next_trigger": 0x1265700
  148. 2012/06/07 11:51:21.543600 [12305]: Added timed event "ctdb_control_timeout": 0x126ccf0
  149. 2012/06/07 11:51:21.543610 [12305]: server/ctdb_server.c:331 ctdb request 995 of type 7 length 64 from node 0 to 0
  150. 2012/06/07 11:51:21.543621 [12305]: Added timed event "queue_next_trigger": 0x126d0e0
  151. 2012/06/07 11:51:21.543630 [12305]: Ending timer event 0x1265700 "queue_next_trigger"
  152. 2012/06/07 11:51:21.543639 [12305]: server/ctdb_server.c:331 ctdb request 995 of type 8 length 48 from node 0 to 0
  153. 2012/06/07 11:51:21.543655 [12305]: Destroying timer event 0x126ccf0 "ctdb_control_timeout"
  154. 2012/06/07 11:51:21.543665 [12305]: Ending timer event 0x126d0e0 "queue_next_trigger"
  155. 2012/06/07 11:51:21.543815 [12305]: server/ctdb_daemon.c:628 client request 2147483451 of type 7 length 64 from node 0 to 0
  156. 2012/06/07 11:51:21.543843 [12305]: Added timed event "queue_next_trigger": 0x1265700
  157. 2012/06/07 11:51:21.543858 [12305]: Added timed event "ctdb_control_timeout": 0x126ccf0
  158. 2012/06/07 11:51:21.543868 [12305]: server/ctdb_server.c:331 ctdb request 996 of type 7 length 64 from node 0 to 0
  159. 2012/06/07 11:51:21.543881 [12305]: Added timed event "queue_next_trigger": 0x126d330
  160. 2012/06/07 11:51:21.543890 [12305]: Ending timer event 0x1265700 "queue_next_trigger"
  161. 2012/06/07 11:51:21.543899 [12305]: server/ctdb_server.c:331 ctdb request 996 of type 8 length 120 from node 0 to 0
  162. 2012/06/07 11:51:21.543915 [12305]: Destroying timer event 0x126ccf0 "ctdb_control_timeout"
  163. 2012/06/07 11:51:21.543925 [12305]: Ending timer event 0x126d330 "queue_next_trigger"
  164. 2012/06/07 11:51:21.544129 [12305]: server/ctdb_daemon.c:628 client request 2147483452 of type 7 length 64 from node 0 to 0
  165. 2012/06/07 11:51:21.544156 [12305]: Added timed event "queue_next_trigger": 0x1265700
  166. 2012/06/07 11:51:21.544170 [12305]: Added timed event "ctdb_control_timeout": 0x126ccf0
  167. 2012/06/07 11:51:21.544181 [12305]: server/ctdb_server.c:331 ctdb request 997 of type 7 length 64 from node 0 to 0
  168. 2012/06/07 11:51:21.544192 [12305]: Added timed event "queue_next_trigger": 0x126d180
  169. 2012/06/07 11:51:21.544201 [12305]: Ending timer event 0x1265700 "queue_next_trigger"
  170. 2012/06/07 11:51:21.544210 [12305]: server/ctdb_server.c:331 ctdb request 997 of type 8 length 60 from node 0 to 0
  171. 2012/06/07 11:51:21.544225 [12305]: Destroying timer event 0x126ccf0 "ctdb_control_timeout"
  172. 2012/06/07 11:51:21.544235 [12305]: Ending timer event 0x126d180 "queue_next_trigger"
  173. 2012/06/07 11:51:21.544339 [12305]: server/ctdb_daemon.c:628 client request 1 of type 7 length 64 from node 0 to 0
  174. 2012/06/07 11:51:21.544355 [12305]: Added timed event "queue_next_trigger": 0x1265450
  175. 2012/06/07 11:51:21.544364 [12305]: Added timed event "ctdb_control_timeout": 0x126d0e0
  176. 2012/06/07 11:51:21.544374 [12305]: server/ctdb_server.c:331 ctdb request 998 of type 7 length 64 from node 0 to 0
  177. 2012/06/07 11:51:21.544397 [12305]: Added timed event "queue_next_trigger": 0x126d190
  178. 2012/06/07 11:51:21.544407 [12305]: Ending timer event 0x1265450 "queue_next_trigger"
  179. 2012/06/07 11:51:21.544415 [12305]: server/ctdb_server.c:331 ctdb request 998 of type 8 length 48 from node 0 to 0
  180. 2012/06/07 11:51:21.544430 [12305]: Destroying timer event 0x126d0e0 "ctdb_control_timeout"
  181. 2012/06/07 11:51:21.544440 [12305]: Ending timer event 0x126d190 "queue_next_trigger"
  182. 2012/06/07 11:51:21.544455 [12305]: server/ctdb_daemon.c:628 client request 0 of type 7 length 64 from node 0 to 4026531841
  183. 2012/06/07 11:51:21.544467 [12305]: Added timed event "queue_next_trigger": 0x1265700
  184. 2012/06/07 11:51:21.544475 [12305]: Added timed event "ctdb_control_timeout": 0x126ccf0
  185. 2012/06/07 11:51:21.544483 [12305]: server/ctdb_server.c:331 ctdb request 999 of type 7 length 64 from node 0 to 0
  186. 2012/06/07 11:51:21.544493 [12305]: Added timed event "queue_next_trigger": 0x126d0e0
  187. 2012/06/07 11:51:21.544501 [12305]: Ending timer event 0x1265700 "queue_next_trigger"
  188. 2012/06/07 11:51:21.544509 [12305]: server/ctdb_server.c:331 ctdb request 999 of type 8 length 48 from node 0 to 0
  189. 2012/06/07 11:51:21.544521 [12305]: Destroying timer event 0x126ccf0 "ctdb_control_timeout"
  190. 2012/06/07 11:51:21.544529 [12305]: Ending timer event 0x126d0e0 "queue_next_trigger"
  191. 2012/06/07 11:51:21.544543 [12305]: server/ctdb_daemon.c:628 client request 2 of type 7 length 64 from node 0 to 0
  192. 2012/06/07 11:51:21.544554 [12305]: Added timed event "queue_next_trigger": 0x1265450
  193. 2012/06/07 11:51:21.544562 [12305]: Added timed event "ctdb_control_timeout": 0x126d0e0
  194. 2012/06/07 11:51:21.544571 [12305]: server/ctdb_server.c:331 ctdb request 1000 of type 7 length 64 from node 0 to 0
  195. 2012/06/07 11:51:21.544580 [12305]: Added timed event "queue_next_trigger": 0x126d190
  196. 2012/06/07 11:51:21.544589 [12305]: Ending timer event 0x1265450 "queue_next_trigger"
  197. 2012/06/07 11:51:21.544597 [12305]: server/ctdb_server.c:331 ctdb request 1000 of type 8 length 48 from node 0 to 0
  198. 2012/06/07 11:51:21.544610 [12305]: Destroying timer event 0x126d0e0 "ctdb_control_timeout"
  199. 2012/06/07 11:51:21.544618 [12305]: Ending timer event 0x126d190 "queue_next_trigger"
  200. 2012/06/07 11:51:21.545836 [12305]: server/ctdb_daemon.c:666 Created SOCKET FD:25 to connected child
  201. 2012/06/07 11:51:21.545881 [12305]: server/ctdb_daemon.c:628 client request 2147483448 of type 7 length 64 from node 0 to 4026531841
  202. 2012/06/07 11:51:21.545901 [12305]: Added timed event "queue_next_trigger": 0x12659e0
  203. 2012/06/07 11:51:21.545910 [12305]: Added timed event "ctdb_control_timeout": 0x1265a90
  204. 2012/06/07 11:51:21.545921 [12305]: server/ctdb_server.c:331 ctdb request 1002 of type 7 length 64 from node 0 to 0
  205. 2012/06/07 11:51:21.545931 [12305]: Added timed event "queue_next_trigger": 0x126cbb0
  206. 2012/06/07 11:51:21.545940 [12305]: Ending timer event 0x12659e0 "queue_next_trigger"
  207. 2012/06/07 11:51:21.545948 [12305]: server/ctdb_server.c:331 ctdb request 1002 of type 8 length 48 from node 0 to 0
  208. 2012/06/07 11:51:21.545965 [12305]: Destroying timer event 0x1265a90 "ctdb_control_timeout"
  209. 2012/06/07 11:51:21.545974 [12305]: Ending timer event 0x126cbb0 "queue_next_trigger"
  210. 2012/06/07 11:51:21.546149 [12305]: server/ctdb_daemon.c:666 Created SOCKET FD:27 to connected child
  211. 2012/06/07 11:51:21.546191 [12305]: server/ctdb_daemon.c:628 client request 2147483449 of type 7 length 64 from node 0 to 4026531841
  212. 2012/06/07 11:51:21.546210 [12305]: Added timed event "queue_next_trigger": 0x1265af0
  213. 2012/06/07 11:51:21.546220 [12305]: Added timed event "ctdb_control_timeout": 0x126cc80
  214. 2012/06/07 11:51:21.546230 [12305]: server/ctdb_server.c:331 ctdb request 1004 of type 7 length 64 from node 0 to 0
  215. 2012/06/07 11:51:21.546241 [12305]: Added timed event "queue_next_trigger": 0x126ce50
  216. 2012/06/07 11:51:21.546250 [12305]: Ending timer event 0x1265af0 "queue_next_trigger"
  217. 2012/06/07 11:51:21.546258 [12305]: server/ctdb_server.c:331 ctdb request 1004 of type 8 length 48 from node 0 to 0
  218. 2012/06/07 11:51:21.546274 [12305]: Destroying timer event 0x126cc80 "ctdb_control_timeout"
  219. 2012/06/07 11:51:21.546291 [12305]: Ending timer event 0x126ce50 "queue_next_trigger"
  220. 2012/06/07 11:51:21.546425 [12305]: server/ctdb_daemon.c:628 client request 2147483450 of type 7 length 64 from node 0 to 0
  221. 2012/06/07 11:51:21.546453 [12305]: Added timed event "queue_next_trigger": 0x126cd10
  222. 2012/06/07 11:51:21.546467 [12305]: Added timed event "ctdb_control_timeout": 0x126ce30
  223. 2012/06/07 11:51:21.546478 [12305]: server/ctdb_server.c:331 ctdb request 1005 of type 7 length 64 from node 0 to 0
  224. 2012/06/07 11:51:21.546490 [12305]: Added timed event "queue_next_trigger": 0x126d110
  225. 2012/06/07 11:51:21.546499 [12305]: Ending timer event 0x126cd10 "queue_next_trigger"
  226. 2012/06/07 11:51:21.546507 [12305]: server/ctdb_server.c:331 ctdb request 1005 of type 8 length 112 from node 0 to 0
  227. 2012/06/07 11:51:21.546524 [12305]: Destroying timer event 0x126ce30 "ctdb_control_timeout"
  228. 2012/06/07 11:51:21.546533 [12305]: Ending timer event 0x126d110 "queue_next_trigger"
  229. 2012/06/07 11:51:21.546718 [12305]: server/ctdb_daemon.c:628 client request 2147483451 of type 7 length 88 from node 0 to 0
  230. 2012/06/07 11:51:21.546746 [12305]: Added timed event "queue_next_trigger": 0x126cc80
  231. 2012/06/07 11:51:21.546761 [12305]: Added timed event "ctdb_control_timeout": 0x126cd30
  232. 2012/06/07 11:51:21.546771 [12305]: server/ctdb_server.c:331 ctdb request 1006 of type 7 length 88 from node 0 to 0
  233. 2012/06/07 11:51:21.546784 [12305]: Added timed event "queue_next_trigger": 0x126cf80
  234. 2012/06/07 11:51:21.546794 [12305]: Ending timer event 0x126cc80 "queue_next_trigger"
  235. 2012/06/07 11:51:21.546802 [12305]: server/ctdb_server.c:331 ctdb request 1006 of type 8 length 108 from node 0 to 0
  236. 2012/06/07 11:51:21.546818 [12305]: Destroying timer event 0x126cd30 "ctdb_control_timeout"
  237. 2012/06/07 11:51:21.546828 [12305]: Ending timer event 0x126cf80 "queue_next_trigger"
  238. 2012/06/07 11:51:21.546939 [12305]: server/ctdb_daemon.c:628 client request 2147483452 of type 7 length 88 from node 0 to 0
  239. 2012/06/07 11:51:21.546962 [12305]: Added timed event "queue_next_trigger": 0x126cea0
  240. 2012/06/07 11:51:21.546977 [12305]: Added timed event "ctdb_control_timeout": 0x126cf50
  241. 2012/06/07 11:51:21.546990 [12305]: server/ctdb_server.c:331 ctdb request 1007 of type 7 length 88 from node 0 to 0
  242. 2012/06/07 11:51:21.547003 [12305]: Added timed event "queue_next_trigger": 0x126d170
  243. 2012/06/07 11:51:21.547012 [12305]: Ending timer event 0x126cea0 "queue_next_trigger"
  244. 2012/06/07 11:51:21.547020 [12305]: server/ctdb_server.c:331 ctdb request 1007 of type 8 length 108 from node 0 to 0
  245. 2012/06/07 11:51:21.547034 [12305]: Destroying timer event 0x126cf50 "ctdb_control_timeout"
  246. 2012/06/07 11:51:21.547044 [12305]: Ending timer event 0x126d170 "queue_next_trigger"
  247. 2012/06/07 11:51:21.855421 [12305]: Added timed event "ctdb_statistics_update": 0x1266390
  248. 2012/06/07 11:51:21.855446 [12305]: Ending timer event 0x12634a0 "ctdb_statistics_update"
  249. 2012/06/07 11:51:22.010598 [12305]: CTDB_WAIT_UNTIL_RECOVERED
  250. 2012/06/07 11:51:22.010627 [12305]: Added timed event "ctdb_wait_until_recovered": 0x125e9d0
  251. 2012/06/07 11:51:22.010642 [12305]: Ending timer event 0x125e7e0 "ctdb_wait_until_recovered"
  252. 2012/06/07 11:51:22.010655 [12305]: Added timed event "ctdb_time_tick": 0x125e7e0
  253. 2012/06/07 11:51:22.010664 [12305]: Ending timer event 0x126c6f0 "ctdb_time_tick"
  254. 2012/06/07 11:51:22.059893 [12305]: server/ctdb_daemon.c:628 client request 508 of type 7 length 64 from node 0 to 4026531841
  255. 2012/06/07 11:51:22.059922 [12305]: Added timed event "queue_next_trigger": 0x1265730
  256. 2012/06/07 11:51:22.059936 [12305]: Added timed event "ctdb_control_timeout": 0x1265850
  257. 2012/06/07 11:51:22.059946 [12305]: server/ctdb_server.c:331 ctdb request 1008 of type 7 length 64 from node 0 to 0
  258. 2012/06/07 11:51:22.059956 [12305]: Destroying timer event 0x12653a0 "ctdb_recd_ping_timeout"
  259. 2012/06/07 11:51:22.059965 [12305]: Added timed event "ctdb_recd_ping_timeout": 0x12653a0
  260. 2012/06/07 11:51:22.059974 [12305]: Added timed event "queue_next_trigger": 0x1265bc0
  261. 2012/06/07 11:51:22.059983 [12305]: Ending timer event 0x1265730 "queue_next_trigger"
  262. 2012/06/07 11:51:22.060000 [12305]: server/ctdb_server.c:331 ctdb request 1008 of type 8 length 48 from node 0 to 0
  263. 2012/06/07 11:51:22.060017 [12305]: Destroying timer event 0x1265850 "ctdb_control_timeout"
  264. 2012/06/07 11:51:22.060026 [12305]: Ending timer event 0x1265bc0 "queue_next_trigger"
  265. 2012/06/07 11:51:22.060172 [12305]: server/ctdb_daemon.c:628 client request 509 of type 7 length 64 from node 0 to 4026531841
  266. 2012/06/07 11:51:22.060199 [12305]: Added timed event "queue_next_trigger": 0x126c840
  267. 2012/06/07 11:51:22.060215 [12305]: Added timed event "ctdb_control_timeout": 0x1262f90
  268. 2012/06/07 11:51:22.060226 [12305]: server/ctdb_server.c:331 ctdb request 1009 of type 7 length 64 from node 0 to 0
  269. 2012/06/07 11:51:22.060237 [12305]: Added timed event "queue_next_trigger": 0x1263140
  270. 2012/06/07 11:51:22.060246 [12305]: Ending timer event 0x126c840 "queue_next_trigger"
  271. 2012/06/07 11:51:22.060254 [12305]: server/ctdb_server.c:331 ctdb request 1009 of type 8 length 48 from node 0 to 0
  272. 2012/06/07 11:51:22.060271 [12305]: Destroying timer event 0x1262f90 "ctdb_control_timeout"
  273. 2012/06/07 11:51:22.060281 [12305]: Ending timer event 0x1263140 "queue_next_trigger"
  274. 2012/06/07 11:51:22.060430 [12305]: server/ctdb_daemon.c:628 client request 510 of type 7 length 64 from node 0 to 4026531841
  275. 2012/06/07 11:51:22.060458 [12305]: Added timed event "queue_next_trigger": 0x126c840
  276. 2012/06/07 11:51:22.060473 [12305]: Added timed event "ctdb_control_timeout": 0x1263120
  277. 2012/06/07 11:51:22.060483 [12305]: server/ctdb_server.c:331 ctdb request 1010 of type 7 length 64 from node 0 to 0
  278. 2012/06/07 11:51:22.060495 [12305]: Added timed event "queue_next_trigger": 0x1263480
  279. 2012/06/07 11:51:22.060504 [12305]: Ending timer event 0x126c840 "queue_next_trigger"
  280. 2012/06/07 11:51:22.060512 [12305]: server/ctdb_server.c:331 ctdb request 1010 of type 8 length 228 from node 0 to 0
  281. 2012/06/07 11:51:22.060529 [12305]: Destroying timer event 0x1263120 "ctdb_control_timeout"
  282. 2012/06/07 11:51:22.060539 [12305]: Ending timer event 0x1263480 "queue_next_trigger"
  283. 2012/06/07 11:51:22.060687 [12305]: server/ctdb_daemon.c:628 client request 511 of type 7 length 64 from node 0 to 4026531841
  284. 2012/06/07 11:51:22.060715 [12305]: Added timed event "queue_next_trigger": 0x126cb20
  285. 2012/06/07 11:51:22.060730 [12305]: Added timed event "ctdb_control_timeout": 0x1263340
  286. 2012/06/07 11:51:22.060741 [12305]: server/ctdb_server.c:331 ctdb request 1011 of type 7 length 64 from node 0 to 0
  287. 2012/06/07 11:51:22.060754 [12305]: Added timed event "queue_next_trigger": 0x1263460
  288. 2012/06/07 11:51:22.060763 [12305]: Ending timer event 0x126cb20 "queue_next_trigger"
  289. 2012/06/07 11:51:22.060772 [12305]: server/ctdb_server.c:331 ctdb request 1011 of type 8 length 61 from node 0 to 0
  290. 2012/06/07 11:51:22.060788 [12305]: Destroying timer event 0x1263340 "ctdb_control_timeout"
  291. 2012/06/07 11:51:22.060798 [12305]: Ending timer event 0x1263460 "queue_next_trigger"
  292. 2012/06/07 11:51:22.060943 [12305]: server/ctdb_daemon.c:628 client request 512 of type 7 length 64 from node 0 to 4026531841
  293. 2012/06/07 11:51:22.060972 [12305]: Added timed event "queue_next_trigger": 0x126c8e0
  294. 2012/06/07 11:51:22.060987 [12305]: Added timed event "ctdb_control_timeout": 0x1264f90
  295. 2012/06/07 11:51:22.060997 [12305]: server/ctdb_server.c:331 ctdb request 1012 of type 7 length 64 from node 0 to 0
  296. 2012/06/07 11:51:22.061008 [12305]: Added timed event "queue_next_trigger": 0x1262f40
  297. 2012/06/07 11:51:22.061017 [12305]: Ending timer event 0x126c8e0 "queue_next_trigger"
  298. 2012/06/07 11:51:22.061026 [12305]: server/ctdb_server.c:331 ctdb request 1012 of type 8 length 48 from node 0 to 0
  299. 2012/06/07 11:51:22.061042 [12305]: Destroying timer event 0x1264f90 "ctdb_control_timeout"
  300. 2012/06/07 11:51:22.061051 [12305]: Ending timer event 0x1262f40 "queue_next_trigger"
  301. 2012/06/07 11:51:22.061195 [12305]: server/ctdb_daemon.c:628 client request 513 of type 7 length 64 from node 0 to 0
  302. 2012/06/07 11:51:22.061224 [12305]: Added timed event "queue_next_trigger": 0x1262eb0
  303. 2012/06/07 11:51:22.061239 [12305]: Added timed event "ctdb_control_timeout": 0x126c8b0
  304. 2012/06/07 11:51:22.061258 [12305]: server/ctdb_server.c:331 ctdb request 1013 of type 7 length 64 from node 0 to 0
  305. 2012/06/07 11:51:22.061271 [12305]: Added timed event "queue_next_trigger": 0x1263280
  306. 2012/06/07 11:51:22.061280 [12305]: Ending timer event 0x1262eb0 "queue_next_trigger"
  307. 2012/06/07 11:51:22.061288 [12305]: server/ctdb_server.c:331 ctdb request 1013 of type 8 length 60 from node 0 to 0
  308. 2012/06/07 11:51:22.061305 [12305]: Destroying timer event 0x126c8b0 "ctdb_control_timeout"
  309. 2012/06/07 11:51:22.061315 [12305]: Ending timer event 0x1263280 "queue_next_trigger"
  310. 2012/06/07 11:51:22.061465 [12305]: server/ctdb_daemon.c:628 client request 514 of type 7 length 64 from node 0 to 0
  311. 2012/06/07 11:51:22.061493 [12305]: Added timed event "queue_next_trigger": 0x125ea80
  312. 2012/06/07 11:51:22.061508 [12305]: Added timed event "ctdb_control_timeout": 0x12631e0
  313. 2012/06/07 11:51:22.061518 [12305]: server/ctdb_server.c:331 ctdb request 1014 of type 7 length 64 from node 0 to 0
  314. 2012/06/07 11:51:22.061530 [12305]: Added timed event "queue_next_trigger": 0x1265940
  315. 2012/06/07 11:51:22.061540 [12305]: Ending timer event 0x125ea80 "queue_next_trigger"
  316. 2012/06/07 11:51:22.061548 [12305]: server/ctdb_server.c:331 ctdb request 1014 of type 8 length 120 from node 0 to 0
  317. 2012/06/07 11:51:22.061564 [12305]: Destroying timer event 0x12631e0 "ctdb_control_timeout"
  318. 2012/06/07 11:51:22.061574 [12305]: Ending timer event 0x1265940 "queue_next_trigger"
  319. 2012/06/07 11:51:22.061719 [12305]: server/ctdb_daemon.c:628 client request 515 of type 7 length 64 from node 0 to 0
  320. 2012/06/07 11:51:22.061747 [12305]: Added timed event "queue_next_trigger": 0x125ea80
  321. 2012/06/07 11:51:22.061762 [12305]: Added timed event "ctdb_control_timeout": 0x1265b40
  322. 2012/06/07 11:51:22.061772 [12305]: server/ctdb_server.c:331 ctdb request 1015 of type 7 length 64 from node 0 to 0
  323. 2012/06/07 11:51:22.061783 [12305]: Added timed event "queue_next_trigger": 0x12658c0
  324. 2012/06/07 11:51:22.061792 [12305]: Ending timer event 0x125ea80 "queue_next_trigger"
  325. 2012/06/07 11:51:22.061800 [12305]: server/ctdb_server.c:331 ctdb request 1015 of type 8 length 48 from node 0 to 0
  326. 2012/06/07 11:51:22.061819 [12305]: Destroying timer event 0x1265b40 "ctdb_control_timeout"
  327. 2012/06/07 11:51:22.061829 [12305]: Ending timer event 0x12658c0 "queue_next_trigger"
  328. 2012/06/07 11:51:22.061977 [12305]: server/ctdb_daemon.c:628 client request 516 of type 7 length 64 from node 0 to 1
  329. 2012/06/07 11:51:22.062017 [12305]: Added timed event "ctdb_control_timeout": 0x1265730
  330. 2012/06/07 11:51:22.062230 [12305]: server/ctdb_server.c:331 ctdb request 1016 of type 8 length 120 from node 1 to 0
  331. 2012/06/07 11:51:22.062252 [12305]: Destroying timer event 0x1265730 "ctdb_control_timeout"
  332. 2012/06/07 11:51:22.062359 [12305]: server/ctdb_daemon.c:628 client request 517 of type 7 length 64 from node 0 to 4026531841
  333. 2012/06/07 11:51:22.062383 [12305]: Added timed event "queue_next_trigger": 0x1265730
  334. 2012/06/07 11:51:22.062398 [12305]: Added timed event "ctdb_control_timeout": 0x1265850
  335. 2012/06/07 11:51:22.062411 [12305]: server/ctdb_server.c:331 ctdb request 1017 of type 7 length 64 from node 0 to 0
  336. 2012/06/07 11:51:22.062423 [12305]: Added timed event "queue_next_trigger": 0x12630c0
  337. 2012/06/07 11:51:22.062432 [12305]: Ending timer event 0x1265730 "queue_next_trigger"
  338. 2012/06/07 11:51:22.062440 [12305]: server/ctdb_server.c:331 ctdb request 1017 of type 8 length 108 from node 0 to 0
  339. 2012/06/07 11:51:22.062455 [12305]: Destroying timer event 0x1265850 "ctdb_control_timeout"
  340. 2012/06/07 11:51:22.062464 [12305]: Ending timer event 0x12630c0 "queue_next_trigger"
  341. 2012/06/07 11:51:22.062610 [12305]: server/ctdb_daemon.c:628 client request 518 of type 7 length 64 from node 0 to 4026531841
  342. 2012/06/07 11:51:22.062637 [12305]: Added timed event "queue_next_trigger": 0x1265090
  343. 2012/06/07 11:51:22.062652 [12305]: Added timed event "ctdb_control_timeout": 0x1265a70
  344. 2012/06/07 11:51:22.062662 [12305]: server/ctdb_server.c:331 ctdb request 1018 of type 7 length 64 from node 0 to 0
  345. 2012/06/07 11:51:22.062683 [12305]: Added timed event "queue_next_trigger": 0x12632f0
  346. 2012/06/07 11:51:22.062693 [12305]: Ending timer event 0x1265090 "queue_next_trigger"
  347. 2012/06/07 11:51:22.062701 [12305]: server/ctdb_server.c:331 ctdb request 1018 of type 8 length 72 from node 0 to 0
  348. 2012/06/07 11:51:22.062718 [12305]: Destroying timer event 0x1265a70 "ctdb_control_timeout"
  349. 2012/06/07 11:51:22.062727 [12305]: Ending timer event 0x12632f0 "queue_next_trigger"
  350. 2012/06/07 11:51:22.062800 [recoverd:12353]: The interfaces status has changed on local node 0 - force takeover run
  351. 2012/06/07 11:51:22.062915 [12305]: server/ctdb_daemon.c:628 client request 519 of type 7 length 64 from node 0 to 4026531841
  352. 2012/06/07 11:51:22.062943 [12305]: Added timed event "queue_next_trigger": 0x1265090
  353. 2012/06/07 11:51:22.062958 [12305]: Added timed event "ctdb_control_timeout": 0x12632c0
  354. 2012/06/07 11:51:22.062969 [12305]: server/ctdb_server.c:331 ctdb request 1019 of type 7 length 64 from node 0 to 0
  355. 2012/06/07 11:51:22.062983 [12305]: Added timed event "queue_next_trigger": 0x1262eb0
  356. 2012/06/07 11:51:22.062993 [12305]: Ending timer event 0x1265090 "queue_next_trigger"
  357. 2012/06/07 11:51:22.063002 [12305]: server/ctdb_server.c:331 ctdb request 1019 of type 8 length 112 from node 0 to 0
  358. 2012/06/07 11:51:22.063019 [12305]: Destroying timer event 0x12632c0 "ctdb_control_timeout"
  359. 2012/06/07 11:51:22.063028 [12305]: Ending timer event 0x1262eb0 "queue_next_trigger"
  360. 2012/06/07 11:51:22.063154 [12305]: server/ctdb_daemon.c:628 client request 520 of type 7 length 64 from node 0 to 4026531841
  361. 2012/06/07 11:51:22.063183 [12305]: Added timed event "queue_next_trigger": 0x1265730
  362. 2012/06/07 11:51:22.063197 [12305]: Added timed event "ctdb_control_timeout": 0x1265850
  363. 2012/06/07 11:51:22.063208 [12305]: server/ctdb_server.c:331 ctdb request 1020 of type 7 length 64 from node 0 to 0
  364. 2012/06/07 11:51:22.063219 [12305]: Added timed event "queue_next_trigger": 0x1262eb0
  365. 2012/06/07 11:51:22.063228 [12305]: Ending timer event 0x1265730 "queue_next_trigger"
  366. 2012/06/07 11:51:22.063236 [12305]: server/ctdb_server.c:331 ctdb request 1020 of type 8 length 108 from node 0 to 0
  367. 2012/06/07 11:51:22.063253 [12305]: Destroying timer event 0x1265850 "ctdb_control_timeout"
  368. 2012/06/07 11:51:22.063263 [12305]: Ending timer event 0x1262eb0 "queue_next_trigger"
  369. 2012/06/07 11:51:22.063308 [recoverd:12353]: server/ctdb_recoverd.c:2581 in the middle of recovery or ip reallocation. skipping public ip address check
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!