Pastebin launched a little side project called VERYVIRAL.com, check it out ;-) Want more features on Pastebin? Sign Up, it's FREE!
Guest

waKKu

By: a guest on Apr 30th, 2009  |  syntax: None  |  size: 88.33 KB  |  views: 100  |  expires: Never
download  |  raw  |  embed  |  report abuse  |  print
Text below is selected. Please press Ctrl+C to copy to your clipboard. (⌘+C on Mac)
  1. Apr 30 13:26:44 athos kernel: DLM (built Mar 24 2009 12:06:38) installed
  2. Apr 30 13:26:44 athos kernel: GFS2 Overlay (built May 29 2008 16:48:00) installed
  3. Apr 30 13:26:44 athos kernel: Lock_DLM (built Mar 24 2009 12:07:36) installed
  4. Apr 30 13:26:44 athos ccsd[8558]: Starting ccsd 2.0.98:
  5. Apr 30 13:26:44 athos ccsd[8558]:  Built: Mar  5 2009 16:16:06
  6. Apr 30 13:26:44 athos ccsd[8558]:  Copyright (C) Red Hat, Inc.  2004  All rights reserved.
  7. Apr 30 13:26:44 athos ccsd[8558]: cluster.conf (cluster name = MUSKETEER, version = 18) found.
  8. Apr 30 13:26:46 athos openais[8569]: [MAIN ] AIS Executive Service RELEASE 'subrev 1358 version 0.80.3'
  9. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors.
  10. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
  11. Apr 30 13:26:46 athos openais[8569]: [MAIN ] AIS Executive Service: started and ready to provide service.
  12. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Using default multicast address of 239.192.158.31
  13. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_cpg loaded.
  14. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais cluster closed process group service v1.01'
  15. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_cfg loaded.
  16. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais configuration service'
  17. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_msg loaded.
  18. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais message service B.01.01'
  19. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_lck loaded.
  20. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais distributed locking service B.01.01'
  21. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_evt loaded.
  22. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais event service B.01.01'
  23. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_ckpt loaded.
  24. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais checkpoint service B.01.01'
  25. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_amf loaded.
  26. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais availability management framework B.01.01'
  27. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_clm loaded.
  28. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais cluster membership service B.01.01'
  29. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_evs loaded.
  30. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais extended virtual synchrony service'
  31. Apr 30 13:26:46 athos openais[8569]: [MAIN ] openais component openais_cman loaded.
  32. Apr 30 13:26:46 athos openais[8569]: [MAIN ] Registering service handler 'openais CMAN membership service 2.01'
  33. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Token Timeout (10000 ms) retransmit timeout (495 ms)
  34. Apr 30 13:26:46 athos openais[8569]: [TOTEM] token hold (386 ms) retransmits before loss (20 retrans)
  35. Apr 30 13:26:46 athos openais[8569]: [TOTEM] join (60 ms) send_join (0 ms) consensus (4800 ms) merge (200 ms)
  36. Apr 30 13:26:46 athos openais[8569]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs)
  37. Apr 30 13:26:46 athos openais[8569]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1500
  38. Apr 30 13:26:46 athos openais[8569]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages)
  39. Apr 30 13:26:46 athos openais[8569]: [TOTEM] send threads (0 threads)
  40. Apr 30 13:26:46 athos openais[8569]: [TOTEM] RRP token expired timeout (495 ms)
  41. Apr 30 13:26:46 athos openais[8569]: [TOTEM] RRP token problem counter (2000 ms)
  42. Apr 30 13:26:46 athos openais[8569]: [TOTEM] RRP threshold (10 problem count)
  43. Apr 30 13:26:46 athos openais[8569]: [TOTEM] RRP mode set to none.
  44. Apr 30 13:26:46 athos openais[8569]: [TOTEM] heartbeat_failures_allowed (0)
  45. Apr 30 13:26:46 athos openais[8569]: [TOTEM] max_network_delay (50 ms)
  46. Apr 30 13:26:46 athos openais[8569]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
  47. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Receive multicast socket recv buffer size (262142 bytes).
  48. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Transmit multicast socket send buffer size (262142 bytes).
  49. Apr 30 13:26:46 athos openais[8569]: [TOTEM] The network interface [172.16.1.1] is now up.
  50. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Created or loaded sequence id 9984.172.16.1.1 for this ring.
  51. Apr 30 13:26:46 athos openais[8569]: [TOTEM] entering GATHER state from 15.
  52. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais extended virtual synchrony service'
  53. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais cluster membership service B.01.01'
  54. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais availability management framework B.01.01'
  55. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais checkpoint service B.01.01'
  56. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais event service B.01.01'
  57. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais distributed locking service B.01.01'
  58. Apr 30 13:26:46 athos ccsd[8558]: Initial status:: Inquorate
  59. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais message service B.01.01'
  60. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais configuration service'
  61. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais cluster closed process group service v1.01'
  62. Apr 30 13:26:46 athos openais[8569]: [SERV ] Initialising service handler 'openais CMAN membership service 2.01'
  63. Apr 30 13:26:46 athos openais[8569]: [CMAN ] CMAN 2.0.98 (built Mar  5 2009 16:16:09) started
  64. Apr 30 13:26:46 athos openais[8569]: [SYNC ] Not using a virtual synchrony filter.
  65. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  66. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Saving state aru 0 high seq received 0
  67. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2704
  68. Apr 30 13:26:46 athos openais[8569]: [TOTEM] entering COMMIT state.
  69. Apr 30 13:26:46 athos openais[8569]: [TOTEM] entering RECOVERY state.
  70. Apr 30 13:26:46 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  71. Apr 30 13:26:46 athos openais[8569]: [TOTEM] previous ring seq 9984 rep 172.16.1.1
  72. Apr 30 13:26:46 athos openais[8569]: [TOTEM] aru 0 high delivered 0 received flag 1
  73. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  74. Apr 30 13:26:46 athos openais[8569]: [TOTEM] Sending initial ORF token
  75. Apr 30 13:26:46 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  76. Apr 30 13:26:46 athos openais[8569]: [CLM  ] New Configuration:
  77. Apr 30 13:26:46 athos openais[8569]: [CLM  ] Members Left:
  78. Apr 30 13:26:46 athos openais[8569]: [CLM  ] Members Joined:
  79. Apr 30 13:26:46 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  80. Apr 30 13:26:46 athos openais[8569]: [CLM  ] New Configuration:
  81. Apr 30 13:26:46 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  82. Apr 30 13:26:46 athos openais[8569]: [CLM  ] Members Left:
  83. Apr 30 13:26:46 athos openais[8569]: [CLM  ] Members Joined:
  84. Apr 30 13:26:46 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  85. Apr 30 13:26:46 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  86. Apr 30 13:26:46 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  87. Apr 30 13:26:46 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  88. Apr 30 13:26:47 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  89. Apr 30 13:26:47 athos ccsd[8558]: Error while processing connect: Connection refused
  90. Apr 30 13:26:47 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  91. Apr 30 13:26:47 athos ccsd[8558]: Error while processing connect: Connection refused
  92. Apr 30 13:26:48 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  93. Apr 30 13:26:48 athos ccsd[8558]: Error while processing connect: Connection refused
  94. Apr 30 13:26:48 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  95. Apr 30 13:26:48 athos ccsd[8558]: Error while processing connect: Connection refused
  96. Apr 30 13:26:48 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  97. Apr 30 13:26:48 athos ccsd[8558]: Error while processing connect: Connection refused
  98. Apr 30 13:26:49 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  99. Apr 30 13:26:49 athos ccsd[8558]: Error while processing connect: Connection refused
  100. Apr 30 13:26:49 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  101. Apr 30 13:26:49 athos ccsd[8558]: Error while processing connect: Connection refused
  102. Apr 30 13:26:50 athos qdiskd[5311]: <info> Quorum Daemon Initializing
  103. Apr 30 13:26:50 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  104. Apr 30 13:26:50 athos ccsd[8558]: Error while processing connect: Connection refused
  105. Apr 30 13:26:50 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  106. Apr 30 13:26:50 athos ccsd[8558]: Error while processing connect: Connection refused
  107. Apr 30 13:26:51 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  108. Apr 30 13:26:51 athos ccsd[8558]: Error while processing connect: Connection refused
  109. Apr 30 13:26:51 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  110. Apr 30 13:26:51 athos ccsd[8558]: Error while processing connect: Connection refused
  111. Apr 30 13:26:52 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  112. Apr 30 13:26:52 athos ccsd[8558]: Error while processing connect: Connection refused
  113. Apr 30 13:26:52 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  114. Apr 30 13:26:52 athos ccsd[8558]: Error while processing connect: Connection refused
  115. Apr 30 13:26:53 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  116. Apr 30 13:26:53 athos ccsd[8558]: Error while processing connect: Connection refused
  117. Apr 30 13:26:53 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  118. Apr 30 13:26:53 athos ccsd[8558]: Error while processing connect: Connection refused
  119. Apr 30 13:26:53 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  120. Apr 30 13:26:53 athos ccsd[8558]: Error while processing connect: Connection refused
  121. Apr 30 13:26:54 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  122. Apr 30 13:26:54 athos ccsd[8558]: Error while processing connect: Connection refused
  123. Apr 30 13:26:54 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  124. Apr 30 13:26:54 athos ccsd[8558]: Error while processing connect: Connection refused
  125. Apr 30 13:26:55 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  126. Apr 30 13:26:55 athos ccsd[8558]: Error while processing connect: Connection refused
  127. Apr 30 13:26:55 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  128. Apr 30 13:26:55 athos ccsd[8558]: Error while processing connect: Connection refused
  129. Apr 30 13:26:56 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  130. Apr 30 13:26:56 athos ccsd[8558]: Error while processing connect: Connection refused
  131. Apr 30 13:26:56 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  132. Apr 30 13:26:56 athos ccsd[8558]: Error while processing connect: Connection refused
  133. Apr 30 13:26:57 athos dlm_controld[8617]: connect to ccs error -111, check ccsd or cluster status
  134. Apr 30 13:26:57 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  135. Apr 30 13:26:57 athos ccsd[8558]: Error while processing connect: Connection refused
  136. Apr 30 13:26:57 athos gfs_controld[8623]: connect to ccs error -111, check ccsd or cluster status
  137. Apr 30 13:26:57 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  138. Apr 30 13:26:57 athos ccsd[8558]: Error while processing connect: Connection refused
  139. Apr 30 13:26:58 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  140. Apr 30 13:26:58 athos ccsd[8558]: Error while processing connect: Connection refused
  141. Apr 30 13:26:58 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  142. Apr 30 13:26:58 athos ccsd[8558]: Error while processing connect: Connection refused
  143. Apr 30 13:26:58 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  144. Apr 30 13:26:58 athos ccsd[8558]: Error while processing connect: Connection refused
  145. Apr 30 13:26:59 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  146. Apr 30 13:26:59 athos ccsd[8558]: Error while processing connect: Connection refused
  147. Apr 30 13:26:59 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  148. Apr 30 13:26:59 athos ccsd[8558]: Error while processing connect: Connection refused
  149. Apr 30 13:27:00 athos qdiskd[5311]: <info> Initial score 1/1
  150. Apr 30 13:27:00 athos qdiskd[5311]: <info> Initialization complete
  151. Apr 30 13:27:00 athos openais[8569]: [CMAN ] quorum device registered
  152. Apr 30 13:27:00 athos qdiskd[5311]: <notice> Score sufficient for master operation (1/1; required=1); upgrading
  153. Apr 30 13:27:00 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  154. Apr 30 13:27:00 athos ccsd[8558]: Error while processing connect: Connection refused
  155. Apr 30 13:27:00 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  156. Apr 30 13:27:00 athos ccsd[8558]: Error while processing connect: Connection refused
  157. Apr 30 13:27:01 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  158. Apr 30 13:27:01 athos ccsd[8558]: Error while processing connect: Connection refused
  159. Apr 30 13:27:01 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  160. Apr 30 13:27:01 athos ccsd[8558]: Error while processing connect: Connection refused
  161. Apr 30 13:27:02 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  162. Apr 30 13:27:02 athos ccsd[8558]: Error while processing connect: Connection refused
  163. Apr 30 13:27:02 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  164. Apr 30 13:27:02 athos ccsd[8558]: Error while processing connect: Connection refused
  165. Apr 30 13:27:03 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  166. Apr 30 13:27:03 athos ccsd[8558]: Error while processing connect: Connection refused
  167. Apr 30 13:27:03 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  168. Apr 30 13:27:03 athos ccsd[8558]: Error while processing connect: Connection refused
  169. Apr 30 13:27:03 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  170. Apr 30 13:27:03 athos ccsd[8558]: Error while processing connect: Connection refused
  171. Apr 30 13:27:04 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  172. Apr 30 13:27:04 athos ccsd[8558]: Error while processing connect: Connection refused
  173. Apr 30 13:27:04 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  174. Apr 30 13:27:04 athos ccsd[8558]: Error while processing connect: Connection refused
  175. Apr 30 13:27:05 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  176. Apr 30 13:27:05 athos ccsd[8558]: Error while processing connect: Connection refused
  177. Apr 30 13:27:05 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  178. Apr 30 13:27:05 athos ccsd[8558]: Error while processing connect: Connection refused
  179. Apr 30 13:27:06 athos qdiskd[5311]: <info> Assuming master role
  180. Apr 30 13:27:06 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  181. Apr 30 13:27:06 athos ccsd[8558]: Error while processing connect: Connection refused
  182. Apr 30 13:27:06 athos ccsd[8558]: Cluster is not quorate.  Refusing connection.
  183. Apr 30 13:27:06 athos ccsd[8558]: Error while processing connect: Connection refused
  184. Apr 30 13:27:07 athos qdiskd[5311]: <notice> Writing eviction notice for node 3
  185. Apr 30 13:27:07 athos openais[8569]: [CMAN ] quorum regained, resuming activity
  186. Apr 30 13:27:07 athos dlm_controld[8617]: connect to ccs error -111, check ccsd or cluster status
  187. Apr 30 13:27:07 athos gfs_controld[8623]: connect to ccs error -111, check ccsd or cluster status
  188. Apr 30 13:27:08 athos qdiskd[5311]: <notice> Node 3 evicted
  189. Apr 30 13:28:00 athos openais[8569]: [TOTEM] entering GATHER state from 11.
  190. Apr 30 13:28:00 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  191. Apr 30 13:28:00 athos openais[8569]: [TOTEM] Saving state aru f high seq received f
  192. Apr 30 13:28:00 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2708
  193. Apr 30 13:28:00 athos openais[8569]: [TOTEM] entering COMMIT state.
  194. Apr 30 13:28:00 athos openais[8569]: [TOTEM] entering RECOVERY state.
  195. Apr 30 13:28:00 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  196. Apr 30 13:28:00 athos openais[8569]: [TOTEM] previous ring seq 9988 rep 172.16.1.1
  197. Apr 30 13:28:00 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  198. Apr 30 13:28:00 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  199. Apr 30 13:28:00 athos openais[8569]: [TOTEM] previous ring seq 9968 rep 172.16.1.2
  200. Apr 30 13:28:00 athos openais[8569]: [TOTEM] aru a high delivered a received flag 1
  201. Apr 30 13:28:00 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  202. Apr 30 13:28:00 athos openais[8569]: [TOTEM] Sending initial ORF token
  203. Apr 30 13:28:00 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  204. Apr 30 13:28:00 athos openais[8569]: [CLM  ] New Configuration:
  205. Apr 30 13:28:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  206. Apr 30 13:28:00 athos openais[8569]: [CLM  ] Members Left:
  207. Apr 30 13:28:00 athos openais[8569]: [CLM  ] Members Joined:
  208. Apr 30 13:28:00 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  209. Apr 30 13:28:00 athos openais[8569]: [CLM  ] New Configuration:
  210. Apr 30 13:28:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  211. Apr 30 13:28:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  212. Apr 30 13:28:00 athos openais[8569]: [CLM  ] Members Left:
  213. Apr 30 13:28:00 athos openais[8569]: [CLM  ] Members Joined:
  214. Apr 30 13:28:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  215. Apr 30 13:28:00 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  216. Apr 30 13:28:00 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  217. Apr 30 13:28:00 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  218. Apr 30 13:28:00 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  219. Apr 30 13:28:00 athos openais[8569]: [CPG  ] got joinlist message from node 1
  220. Apr 30 13:28:52 athos openais[8569]: [TOTEM] entering GATHER state from 11.
  221. Apr 30 13:28:52 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  222. Apr 30 13:28:52 athos openais[8569]: [TOTEM] Saving state aru 1f high seq received 1f
  223. Apr 30 13:28:52 athos openais[8569]: [TOTEM] Storing new sequence id for ring 270c
  224. Apr 30 13:28:52 athos openais[8569]: [TOTEM] entering COMMIT state.
  225. Apr 30 13:28:52 athos openais[8569]: [TOTEM] entering RECOVERY state.
  226. Apr 30 13:28:52 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  227. Apr 30 13:28:52 athos openais[8569]: [TOTEM] previous ring seq 9992 rep 172.16.1.1
  228. Apr 30 13:28:52 athos openais[8569]: [TOTEM] aru 1f high delivered 1f received flag 1
  229. Apr 30 13:28:52 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  230. Apr 30 13:28:52 athos openais[8569]: [TOTEM] previous ring seq 9992 rep 172.16.1.1
  231. Apr 30 13:28:52 athos openais[8569]: [TOTEM] aru 1f high delivered 1f received flag 1
  232. Apr 30 13:28:52 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  233. Apr 30 13:28:52 athos openais[8569]: [TOTEM] previous ring seq 9992 rep 172.16.1.3
  234. Apr 30 13:28:52 athos openais[8569]: [TOTEM] aru 0 high delivered 0 received flag 1
  235. Apr 30 13:28:52 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  236. Apr 30 13:28:52 athos openais[8569]: [TOTEM] Sending initial ORF token
  237. Apr 30 13:28:52 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  238. Apr 30 13:28:52 athos openais[8569]: [CLM  ] New Configuration:
  239. Apr 30 13:28:52 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  240. Apr 30 13:28:52 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  241. Apr 30 13:28:52 athos openais[8569]: [CLM  ] Members Left:
  242. Apr 30 13:28:52 athos openais[8569]: [CLM  ] Members Joined:
  243. Apr 30 13:28:52 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  244. Apr 30 13:28:52 athos openais[8569]: [CLM  ] New Configuration:
  245. Apr 30 13:28:52 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  246. Apr 30 13:28:52 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  247. Apr 30 13:28:52 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  248. Apr 30 13:28:52 athos openais[8569]: [CLM  ] Members Left:
  249. Apr 30 13:28:52 athos openais[8569]: [CLM  ] Members Joined:
  250. Apr 30 13:28:52 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  251. Apr 30 13:28:52 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  252. Apr 30 13:28:52 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  253. Apr 30 13:28:52 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  254. Apr 30 13:28:52 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  255. Apr 30 13:28:52 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  256. Apr 30 13:28:52 athos openais[8569]: [TOTEM] Retransmit List: 15  
  257. Apr 30 13:28:52 athos last message repeated 26 times
  258. Apr 30 13:28:52 athos openais[8569]: [TOTEM] Retransmit List: 17 18  
  259. Apr 30 13:28:52 athos openais[8569]: [CPG  ] got joinlist message from node 1
  260. Apr 30 13:28:52 athos openais[8569]: [CPG  ] got joinlist message from node 2
  261. Apr 30 13:29:00 athos openais[8569]: [TOTEM] entering GATHER state from 12.
  262. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  263. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Saving state aru 21 high seq received 21
  264. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2710
  265. Apr 30 13:29:00 athos openais[8569]: [TOTEM] entering COMMIT state.
  266. Apr 30 13:29:00 athos openais[8569]: [TOTEM] entering RECOVERY state.
  267. Apr 30 13:29:00 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  268. Apr 30 13:29:00 athos openais[8569]: [TOTEM] previous ring seq 9996 rep 172.16.1.1
  269. Apr 30 13:29:00 athos openais[8569]: [TOTEM] aru 21 high delivered 21 received flag 1
  270. Apr 30 13:29:00 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  271. Apr 30 13:29:00 athos openais[8569]: [TOTEM] previous ring seq 9996 rep 172.16.1.1
  272. Apr 30 13:29:00 athos openais[8569]: [TOTEM] aru 21 high delivered 21 received flag 1
  273. Apr 30 13:29:00 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  274. Apr 30 13:29:00 athos openais[8569]: [TOTEM] previous ring seq 9996 rep 172.16.1.1
  275. Apr 30 13:29:00 athos openais[8569]: [TOTEM] aru 20 high delivered 20 received flag 0
  276. Apr 30 13:29:00 athos openais[8569]: [TOTEM] copying all old ring messages from 21-21.
  277. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Originated 1 messages in RECOVERY.
  278. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Originated for recovery: 21  
  279. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  280. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Sending initial ORF token
  281. Apr 30 13:29:00 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  282. Apr 30 13:29:00 athos openais[8569]: [CLM  ] New Configuration:
  283. Apr 30 13:29:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  284. Apr 30 13:29:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  285. Apr 30 13:29:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  286. Apr 30 13:29:00 athos openais[8569]: [CLM  ] Members Left:
  287. Apr 30 13:29:00 athos openais[8569]: [CLM  ] Members Joined:
  288. Apr 30 13:29:00 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  289. Apr 30 13:29:00 athos openais[8569]: [CLM  ] New Configuration:
  290. Apr 30 13:29:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  291. Apr 30 13:29:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  292. Apr 30 13:29:00 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  293. Apr 30 13:29:00 athos openais[8569]: [CLM  ] Members Left:
  294. Apr 30 13:29:00 athos openais[8569]: [CLM  ] Members Joined:
  295. Apr 30 13:29:00 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  296. Apr 30 13:29:00 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  297. Apr 30 13:29:00 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  298. Apr 30 13:29:00 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  299. Apr 30 13:29:00 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  300. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Retransmit List: b  
  301. Apr 30 13:29:00 athos openais[8569]: [TOTEM] Retransmit List: 16  
  302. Apr 30 13:29:00 athos last message repeated 24 times
  303. Apr 30 13:29:17 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  304. Apr 30 13:29:17 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  305. Apr 30 13:29:17 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  306. Apr 30 13:29:17 athos openais[8569]: [TOTEM] Saving state aru 1a high seq received 1a
  307. Apr 30 13:29:17 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2714
  308. Apr 30 13:29:17 athos openais[8569]: [TOTEM] entering COMMIT state.
  309. Apr 30 13:29:17 athos openais[8569]: [TOTEM] entering RECOVERY state.
  310. Apr 30 13:29:17 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  311. Apr 30 13:29:17 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  312. Apr 30 13:29:17 athos openais[8569]: [TOTEM] aru 1a high delivered 1a received flag 1
  313. Apr 30 13:29:17 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  314. Apr 30 13:29:17 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  315. Apr 30 13:29:17 athos openais[8569]: [TOTEM] aru 1a high delivered 1a received flag 1
  316. Apr 30 13:29:17 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  317. Apr 30 13:29:17 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  318. Apr 30 13:29:17 athos openais[8569]: [TOTEM] aru 17 high delivered 17 received flag 0
  319. Apr 30 13:29:17 athos openais[8569]: [TOTEM] copying all old ring messages from 18-1a.
  320. Apr 30 13:29:17 athos openais[8569]: [TOTEM] Originated 3 messages in RECOVERY.
  321. Apr 30 13:29:17 athos openais[8569]: [TOTEM] Originated for recovery: 18 19 1a  
  322. Apr 30 13:29:17 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  323. Apr 30 13:29:17 athos openais[8569]: [TOTEM] Sending initial ORF token
  324. Apr 30 13:29:25 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  325. Apr 30 13:29:25 athos openais[8569]: [TOTEM] Restoring instance->my_aru 1a my high seq received 1a
  326. Apr 30 13:29:25 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  327. Apr 30 13:29:25 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  328. Apr 30 13:29:25 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2718
  329. Apr 30 13:29:25 athos openais[8569]: [TOTEM] entering COMMIT state.
  330. Apr 30 13:29:25 athos openais[8569]: [TOTEM] entering RECOVERY state.
  331. Apr 30 13:29:25 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  332. Apr 30 13:29:25 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  333. Apr 30 13:29:25 athos openais[8569]: [TOTEM] aru 1a high delivered 1a received flag 1
  334. Apr 30 13:29:25 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  335. Apr 30 13:29:25 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  336. Apr 30 13:29:25 athos openais[8569]: [TOTEM] aru 1a high delivered 1a received flag 1
  337. Apr 30 13:29:25 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  338. Apr 30 13:29:25 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  339. Apr 30 13:29:25 athos openais[8569]: [TOTEM] aru 17 high delivered 17 received flag 0
  340. Apr 30 13:29:25 athos openais[8569]: [TOTEM] copying all old ring messages from 18-1a.
  341. Apr 30 13:29:25 athos openais[8569]: [TOTEM] Originated 3 messages in RECOVERY.
  342. Apr 30 13:29:25 athos openais[8569]: [TOTEM] Originated for recovery: 18 19 1a  
  343. Apr 30 13:29:25 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  344. Apr 30 13:29:25 athos openais[8569]: [TOTEM] Sending initial ORF token
  345. Apr 30 13:29:25 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  346. Apr 30 13:29:25 athos openais[8569]: [CLM  ] New Configuration:
  347. Apr 30 13:29:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  348. Apr 30 13:29:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  349. Apr 30 13:29:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  350. Apr 30 13:29:25 athos openais[8569]: [CLM  ] Members Left:
  351. Apr 30 13:29:25 athos openais[8569]: [CLM  ] Members Joined:
  352. Apr 30 13:29:25 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  353. Apr 30 13:29:25 athos openais[8569]: [CLM  ] New Configuration:
  354. Apr 30 13:29:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  355. Apr 30 13:29:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  356. Apr 30 13:29:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  357. Apr 30 13:29:25 athos openais[8569]: [CLM  ] Members Left:
  358. Apr 30 13:29:25 athos openais[8569]: [CLM  ] Members Joined:
  359. Apr 30 13:29:25 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  360. Apr 30 13:29:25 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  361. Apr 30 13:29:32 athos openais[8569]: [TOTEM] entering GATHER state from 12.
  362. Apr 30 13:29:33 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  363. Apr 30 13:29:33 athos openais[8569]: [TOTEM] Saving state aru 7 high seq received 7
  364. Apr 30 13:29:33 athos openais[8569]: [TOTEM] Storing new sequence id for ring 271c
  365. Apr 30 13:29:33 athos openais[8569]: [TOTEM] entering COMMIT state.
  366. Apr 30 13:29:33 athos openais[8569]: [TOTEM] entering RECOVERY state.
  367. Apr 30 13:29:33 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  368. Apr 30 13:29:33 athos openais[8569]: [TOTEM] previous ring seq 10008 rep 172.16.1.1
  369. Apr 30 13:29:33 athos openais[8569]: [TOTEM] aru 7 high delivered 7 received flag 1
  370. Apr 30 13:29:33 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  371. Apr 30 13:29:33 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  372. Apr 30 13:29:33 athos openais[8569]: [TOTEM] aru 1a high delivered 1a received flag 1
  373. Apr 30 13:29:33 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  374. Apr 30 13:29:33 athos openais[8569]: [TOTEM] previous ring seq 10000 rep 172.16.1.1
  375. Apr 30 13:29:33 athos openais[8569]: [TOTEM] aru 17 high delivered 17 received flag 0
  376. Apr 30 13:29:33 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  377. Apr 30 13:29:33 athos openais[8569]: [TOTEM] Sending initial ORF token
  378. Apr 30 13:29:33 athos openais[8569]: [TOTEM] -not adding msg with seq no 18
  379. Apr 30 13:29:33 athos openais[8569]: [TOTEM] -not adding msg with seq no 19
  380. Apr 30 13:29:33 athos openais[8569]: [TOTEM] -not adding msg with seq no 1a
  381. Apr 30 13:29:33 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  382. Apr 30 13:29:33 athos openais[8569]: [CLM  ] New Configuration:
  383. Apr 30 13:29:33 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  384. Apr 30 13:29:33 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  385. Apr 30 13:29:33 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  386. Apr 30 13:29:33 athos openais[8569]: [CLM  ] Members Left:
  387. Apr 30 13:29:33 athos openais[8569]: [CLM  ] Members Joined:
  388. Apr 30 13:29:33 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  389. Apr 30 13:29:33 athos openais[8569]: [CLM  ] New Configuration:
  390. Apr 30 13:29:33 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  391. Apr 30 13:29:33 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  392. Apr 30 13:29:33 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  393. Apr 30 13:29:33 athos openais[8569]: [CLM  ] Members Left:
  394. Apr 30 13:29:33 athos openais[8569]: [CLM  ] Members Joined:
  395. Apr 30 13:29:33 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  396. Apr 30 13:29:33 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  397. Apr 30 13:29:33 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  398. Apr 30 13:29:33 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  399. Apr 30 13:29:33 athos openais[8569]: [TOTEM] Retransmit List: 7  
  400. Apr 30 13:29:33 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  401. Apr 30 13:29:33 athos openais[8569]: [TOTEM] Retransmit List: 7 9  
  402. Apr 30 13:29:33 athos last message repeated 6 times
  403. Apr 30 13:29:42 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  404. Apr 30 13:29:42 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  405. Apr 30 13:29:42 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  406. Apr 30 13:29:42 athos openais[8569]: [TOTEM] Saving state aru e high seq received e
  407. Apr 30 13:29:42 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2720
  408. Apr 30 13:29:42 athos openais[8569]: [TOTEM] entering COMMIT state.
  409. Apr 30 13:29:42 athos openais[8569]: [TOTEM] entering RECOVERY state.
  410. Apr 30 13:29:42 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  411. Apr 30 13:29:42 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  412. Apr 30 13:29:42 athos openais[8569]: [TOTEM] aru e high delivered e received flag 1
  413. Apr 30 13:29:42 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  414. Apr 30 13:29:42 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  415. Apr 30 13:29:42 athos openais[8569]: [TOTEM] aru e high delivered e received flag 1
  416. Apr 30 13:29:42 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  417. Apr 30 13:29:42 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  418. Apr 30 13:29:42 athos openais[8569]: [TOTEM] aru a high delivered a received flag 0
  419. Apr 30 13:29:42 athos openais[8569]: [TOTEM] copying all old ring messages from b-e.
  420. Apr 30 13:29:42 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  421. Apr 30 13:29:42 athos openais[8569]: [TOTEM] Originated for recovery: b c d e  
  422. Apr 30 13:29:42 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  423. Apr 30 13:29:42 athos openais[8569]: [TOTEM] Sending initial ORF token
  424. Apr 30 13:29:50 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  425. Apr 30 13:29:50 athos openais[8569]: [TOTEM] Restoring instance->my_aru e my high seq received e
  426. Apr 30 13:29:50 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  427. Apr 30 13:29:50 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  428. Apr 30 13:29:50 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2724
  429. Apr 30 13:29:50 athos openais[8569]: [TOTEM] entering COMMIT state.
  430. Apr 30 13:29:50 athos openais[8569]: [TOTEM] entering RECOVERY state.
  431. Apr 30 13:29:50 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  432. Apr 30 13:29:50 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  433. Apr 30 13:29:50 athos openais[8569]: [TOTEM] aru e high delivered e received flag 1
  434. Apr 30 13:29:50 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  435. Apr 30 13:29:50 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  436. Apr 30 13:29:50 athos openais[8569]: [TOTEM] aru e high delivered e received flag 1
  437. Apr 30 13:29:50 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  438. Apr 30 13:29:50 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  439. Apr 30 13:29:50 athos openais[8569]: [TOTEM] aru a high delivered a received flag 0
  440. Apr 30 13:29:50 athos openais[8569]: [TOTEM] copying all old ring messages from b-e.
  441. Apr 30 13:29:50 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  442. Apr 30 13:29:50 athos openais[8569]: [TOTEM] Originated for recovery: b c d e  
  443. Apr 30 13:29:50 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  444. Apr 30 13:29:50 athos openais[8569]: [TOTEM] Sending initial ORF token
  445. Apr 30 13:29:50 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  446. Apr 30 13:29:50 athos openais[8569]: [CLM  ] New Configuration:
  447. Apr 30 13:29:50 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  448. Apr 30 13:29:50 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  449. Apr 30 13:29:50 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  450. Apr 30 13:29:50 athos openais[8569]: [CLM  ] Members Left:
  451. Apr 30 13:29:50 athos openais[8569]: [CLM  ] Members Joined:
  452. Apr 30 13:29:50 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  453. Apr 30 13:29:50 athos openais[8569]: [CLM  ] New Configuration:
  454. Apr 30 13:29:50 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  455. Apr 30 13:29:50 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  456. Apr 30 13:29:50 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  457. Apr 30 13:29:50 athos openais[8569]: [CLM  ] Members Left:
  458. Apr 30 13:29:50 athos openais[8569]: [CLM  ] Members Joined:
  459. Apr 30 13:29:50 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  460. Apr 30 13:29:50 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  461. Apr 30 13:29:57 athos openais[8569]: [TOTEM] entering GATHER state from 12.
  462. Apr 30 13:29:58 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  463. Apr 30 13:29:58 athos openais[8569]: [TOTEM] Saving state aru 9 high seq received 9
  464. Apr 30 13:29:58 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2728
  465. Apr 30 13:29:58 athos openais[8569]: [TOTEM] entering COMMIT state.
  466. Apr 30 13:29:58 athos openais[8569]: [TOTEM] entering RECOVERY state.
  467. Apr 30 13:29:58 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  468. Apr 30 13:29:58 athos openais[8569]: [TOTEM] previous ring seq 10020 rep 172.16.1.1
  469. Apr 30 13:29:58 athos openais[8569]: [TOTEM] aru 9 high delivered 9 received flag 1
  470. Apr 30 13:29:58 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  471. Apr 30 13:29:58 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  472. Apr 30 13:29:58 athos openais[8569]: [TOTEM] aru e high delivered e received flag 1
  473. Apr 30 13:29:58 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  474. Apr 30 13:29:58 athos openais[8569]: [TOTEM] previous ring seq 10012 rep 172.16.1.1
  475. Apr 30 13:29:58 athos openais[8569]: [TOTEM] aru a high delivered a received flag 0
  476. Apr 30 13:29:58 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  477. Apr 30 13:29:58 athos openais[8569]: [TOTEM] Sending initial ORF token
  478. Apr 30 13:29:58 athos openais[8569]: [TOTEM] -not adding msg with seq no b
  479. Apr 30 13:29:58 athos openais[8569]: [TOTEM] -not adding msg with seq no c
  480. Apr 30 13:29:58 athos openais[8569]: [TOTEM] -not adding msg with seq no d
  481. Apr 30 13:29:58 athos openais[8569]: [TOTEM] -not adding msg with seq no e
  482. Apr 30 13:29:58 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  483. Apr 30 13:29:58 athos openais[8569]: [CLM  ] New Configuration:
  484. Apr 30 13:29:58 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  485. Apr 30 13:29:58 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  486. Apr 30 13:29:58 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  487. Apr 30 13:29:58 athos openais[8569]: [CLM  ] Members Left:
  488. Apr 30 13:29:58 athos openais[8569]: [CLM  ] Members Joined:
  489. Apr 30 13:29:58 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  490. Apr 30 13:29:58 athos openais[8569]: [CLM  ] New Configuration:
  491. Apr 30 13:29:58 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  492. Apr 30 13:29:58 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  493. Apr 30 13:29:58 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  494. Apr 30 13:29:58 athos openais[8569]: [CLM  ] Members Left:
  495. Apr 30 13:29:58 athos openais[8569]: [CLM  ] Members Joined:
  496. Apr 30 13:29:58 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  497. Apr 30 13:29:58 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  498. Apr 30 13:29:58 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  499. Apr 30 13:29:58 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  500. Apr 30 13:29:58 athos openais[8569]: [TOTEM] Retransmit List: 8  
  501. Apr 30 13:29:58 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  502. Apr 30 13:29:58 athos openais[8569]: [TOTEM] Retransmit List: 8 a  
  503. Apr 30 13:29:58 athos last message repeated 7 times
  504. Apr 30 13:30:07 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  505. Apr 30 13:30:07 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  506. Apr 30 13:30:08 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  507. Apr 30 13:30:08 athos openais[8569]: [TOTEM] Saving state aru f high seq received f
  508. Apr 30 13:30:08 athos openais[8569]: [TOTEM] Storing new sequence id for ring 272c
  509. Apr 30 13:30:08 athos openais[8569]: [TOTEM] entering COMMIT state.
  510. Apr 30 13:30:08 athos openais[8569]: [TOTEM] entering RECOVERY state.
  511. Apr 30 13:30:08 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  512. Apr 30 13:30:08 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  513. Apr 30 13:30:08 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  514. Apr 30 13:30:08 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  515. Apr 30 13:30:08 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  516. Apr 30 13:30:08 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  517. Apr 30 13:30:08 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  518. Apr 30 13:30:08 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  519. Apr 30 13:30:08 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  520. Apr 30 13:30:08 athos openais[8569]: [TOTEM] copying all old ring messages from c-f.
  521. Apr 30 13:30:08 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  522. Apr 30 13:30:08 athos openais[8569]: [TOTEM] Originated for recovery: c d e f  
  523. Apr 30 13:30:08 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  524. Apr 30 13:30:08 athos openais[8569]: [TOTEM] Sending initial ORF token
  525. Apr 30 13:30:15 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  526. Apr 30 13:30:15 athos openais[8569]: [TOTEM] Restoring instance->my_aru f my high seq received f
  527. Apr 30 13:30:15 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  528. Apr 30 13:30:15 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  529. Apr 30 13:30:15 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2730
  530. Apr 30 13:30:15 athos openais[8569]: [TOTEM] entering COMMIT state.
  531. Apr 30 13:30:15 athos openais[8569]: [TOTEM] entering RECOVERY state.
  532. Apr 30 13:30:15 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  533. Apr 30 13:30:15 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  534. Apr 30 13:30:15 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  535. Apr 30 13:30:15 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  536. Apr 30 13:30:15 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  537. Apr 30 13:30:15 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  538. Apr 30 13:30:15 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  539. Apr 30 13:30:15 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  540. Apr 30 13:30:15 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  541. Apr 30 13:30:15 athos openais[8569]: [TOTEM] copying all old ring messages from c-f.
  542. Apr 30 13:30:15 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  543. Apr 30 13:30:15 athos openais[8569]: [TOTEM] Originated for recovery: c d e f  
  544. Apr 30 13:30:15 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  545. Apr 30 13:30:15 athos openais[8569]: [TOTEM] Sending initial ORF token
  546. Apr 30 13:30:15 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  547. Apr 30 13:30:15 athos openais[8569]: [CLM  ] New Configuration:
  548. Apr 30 13:30:15 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  549. Apr 30 13:30:15 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  550. Apr 30 13:30:16 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  551. Apr 30 13:30:16 athos openais[8569]: [CLM  ] Members Left:
  552. Apr 30 13:30:16 athos openais[8569]: [CLM  ] Members Joined:
  553. Apr 30 13:30:16 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  554. Apr 30 13:30:16 athos openais[8569]: [CLM  ] New Configuration:
  555. Apr 30 13:30:16 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  556. Apr 30 13:30:16 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  557. Apr 30 13:30:16 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  558. Apr 30 13:30:16 athos openais[8569]: [CLM  ] Members Left:
  559. Apr 30 13:30:16 athos openais[8569]: [CLM  ] Members Joined:
  560. Apr 30 13:30:16 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  561. Apr 30 13:30:16 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  562. Apr 30 13:30:23 athos openais[8569]: [TOTEM] entering GATHER state from 12.
  563. Apr 30 13:30:23 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  564. Apr 30 13:30:23 athos openais[8569]: [TOTEM] Saving state aru 9 high seq received 9
  565. Apr 30 13:30:23 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2734
  566. Apr 30 13:30:23 athos openais[8569]: [TOTEM] entering COMMIT state.
  567. Apr 30 13:30:23 athos openais[8569]: [TOTEM] entering RECOVERY state.
  568. Apr 30 13:30:23 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  569. Apr 30 13:30:23 athos openais[8569]: [TOTEM] previous ring seq 10032 rep 172.16.1.1
  570. Apr 30 13:30:23 athos openais[8569]: [TOTEM] aru 9 high delivered 9 received flag 1
  571. Apr 30 13:30:23 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  572. Apr 30 13:30:23 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  573. Apr 30 13:30:23 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  574. Apr 30 13:30:23 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  575. Apr 30 13:30:23 athos openais[8569]: [TOTEM] previous ring seq 10024 rep 172.16.1.1
  576. Apr 30 13:30:23 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  577. Apr 30 13:30:23 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  578. Apr 30 13:30:23 athos openais[8569]: [TOTEM] Sending initial ORF token
  579. Apr 30 13:30:23 athos openais[8569]: [TOTEM] -not adding msg with seq no c
  580. Apr 30 13:30:23 athos openais[8569]: [TOTEM] -not adding msg with seq no d
  581. Apr 30 13:30:23 athos openais[8569]: [TOTEM] -not adding msg with seq no e
  582. Apr 30 13:30:23 athos openais[8569]: [TOTEM] -not adding msg with seq no f
  583. Apr 30 13:30:23 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  584. Apr 30 13:30:23 athos openais[8569]: [CLM  ] New Configuration:
  585. Apr 30 13:30:23 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  586. Apr 30 13:30:23 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  587. Apr 30 13:30:23 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  588. Apr 30 13:30:23 athos openais[8569]: [CLM  ] Members Left:
  589. Apr 30 13:30:23 athos openais[8569]: [CLM  ] Members Joined:
  590. Apr 30 13:30:23 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  591. Apr 30 13:30:23 athos openais[8569]: [CLM  ] New Configuration:
  592. Apr 30 13:30:23 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  593. Apr 30 13:30:23 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  594. Apr 30 13:30:23 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  595. Apr 30 13:30:23 athos openais[8569]: [CLM  ] Members Left:
  596. Apr 30 13:30:23 athos openais[8569]: [CLM  ] Members Joined:
  597. Apr 30 13:30:23 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  598. Apr 30 13:30:23 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  599. Apr 30 13:30:23 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  600. Apr 30 13:30:23 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  601. Apr 30 13:30:23 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  602. Apr 30 13:30:23 athos openais[8569]: [TOTEM] Retransmit List: a  
  603. Apr 30 13:30:23 athos last message repeated 27 times
  604. Apr 30 13:30:41 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  605. Apr 30 13:30:41 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  606. Apr 30 13:30:41 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  607. Apr 30 13:30:41 athos openais[8569]: [TOTEM] Saving state aru f high seq received f
  608. Apr 30 13:30:41 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2738
  609. Apr 30 13:30:41 athos openais[8569]: [TOTEM] entering COMMIT state.
  610. Apr 30 13:30:41 athos openais[8569]: [TOTEM] entering RECOVERY state.
  611. Apr 30 13:30:41 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  612. Apr 30 13:30:41 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  613. Apr 30 13:30:41 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  614. Apr 30 13:30:41 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  615. Apr 30 13:30:41 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  616. Apr 30 13:30:41 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  617. Apr 30 13:30:41 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  618. Apr 30 13:30:41 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  619. Apr 30 13:30:41 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  620. Apr 30 13:30:41 athos openais[8569]: [TOTEM] copying all old ring messages from c-f.
  621. Apr 30 13:30:41 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  622. Apr 30 13:30:41 athos openais[8569]: [TOTEM] Originated for recovery: c d e f  
  623. Apr 30 13:30:41 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  624. Apr 30 13:30:41 athos openais[8569]: [TOTEM] Sending initial ORF token
  625. Apr 30 13:30:49 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  626. Apr 30 13:30:49 athos openais[8569]: [TOTEM] Restoring instance->my_aru f my high seq received f
  627. Apr 30 13:30:49 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  628. Apr 30 13:30:49 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  629. Apr 30 13:30:49 athos openais[8569]: [TOTEM] Storing new sequence id for ring 273c
  630. Apr 30 13:30:49 athos openais[8569]: [TOTEM] entering COMMIT state.
  631. Apr 30 13:30:49 athos openais[8569]: [TOTEM] entering RECOVERY state.
  632. Apr 30 13:30:49 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  633. Apr 30 13:30:49 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  634. Apr 30 13:30:49 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  635. Apr 30 13:30:49 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  636. Apr 30 13:30:49 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  637. Apr 30 13:30:49 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  638. Apr 30 13:30:49 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  639. Apr 30 13:30:49 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  640. Apr 30 13:30:49 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  641. Apr 30 13:30:49 athos openais[8569]: [TOTEM] copying all old ring messages from c-f.
  642. Apr 30 13:30:49 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  643. Apr 30 13:30:49 athos openais[8569]: [TOTEM] Originated for recovery: c d e f  
  644. Apr 30 13:30:49 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  645. Apr 30 13:30:49 athos openais[8569]: [TOTEM] Sending initial ORF token
  646. Apr 30 13:30:49 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  647. Apr 30 13:30:49 athos openais[8569]: [CLM  ] New Configuration:
  648. Apr 30 13:30:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  649. Apr 30 13:30:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  650. Apr 30 13:30:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  651. Apr 30 13:30:49 athos openais[8569]: [CLM  ] Members Left:
  652. Apr 30 13:30:49 athos openais[8569]: [CLM  ] Members Joined:
  653. Apr 30 13:30:49 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  654. Apr 30 13:30:49 athos openais[8569]: [CLM  ] New Configuration:
  655. Apr 30 13:30:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  656. Apr 30 13:30:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  657. Apr 30 13:30:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  658. Apr 30 13:30:49 athos openais[8569]: [CLM  ] Members Left:
  659. Apr 30 13:30:49 athos openais[8569]: [CLM  ] Members Joined:
  660. Apr 30 13:30:49 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  661. Apr 30 13:30:49 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  662. Apr 30 13:30:56 athos openais[8569]: [TOTEM] entering GATHER state from 12.
  663. Apr 30 13:30:56 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  664. Apr 30 13:30:56 athos openais[8569]: [TOTEM] Saving state aru 9 high seq received 9
  665. Apr 30 13:30:56 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2740
  666. Apr 30 13:30:56 athos openais[8569]: [TOTEM] entering COMMIT state.
  667. Apr 30 13:30:56 athos openais[8569]: [TOTEM] entering RECOVERY state.
  668. Apr 30 13:30:56 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  669. Apr 30 13:30:56 athos openais[8569]: [TOTEM] previous ring seq 10044 rep 172.16.1.1
  670. Apr 30 13:30:56 athos openais[8569]: [TOTEM] aru 9 high delivered 9 received flag 1
  671. Apr 30 13:30:56 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  672. Apr 30 13:30:56 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  673. Apr 30 13:30:56 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  674. Apr 30 13:30:56 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  675. Apr 30 13:30:56 athos openais[8569]: [TOTEM] previous ring seq 10036 rep 172.16.1.1
  676. Apr 30 13:30:56 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  677. Apr 30 13:30:56 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  678. Apr 30 13:30:56 athos openais[8569]: [TOTEM] Sending initial ORF token
  679. Apr 30 13:30:56 athos openais[8569]: [TOTEM] -not adding msg with seq no c
  680. Apr 30 13:30:56 athos openais[8569]: [TOTEM] -not adding msg with seq no d
  681. Apr 30 13:30:56 athos openais[8569]: [TOTEM] -not adding msg with seq no e
  682. Apr 30 13:30:56 athos openais[8569]: [TOTEM] -not adding msg with seq no f
  683. Apr 30 13:30:56 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  684. Apr 30 13:30:56 athos openais[8569]: [CLM  ] New Configuration:
  685. Apr 30 13:30:56 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  686. Apr 30 13:30:56 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  687. Apr 30 13:30:56 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  688. Apr 30 13:30:56 athos openais[8569]: [CLM  ] Members Left:
  689. Apr 30 13:30:56 athos openais[8569]: [CLM  ] Members Joined:
  690. Apr 30 13:30:56 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  691. Apr 30 13:30:56 athos openais[8569]: [CLM  ] New Configuration:
  692. Apr 30 13:30:56 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  693. Apr 30 13:30:56 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  694. Apr 30 13:30:56 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  695. Apr 30 13:30:56 athos openais[8569]: [CLM  ] Members Left:
  696. Apr 30 13:30:56 athos openais[8569]: [CLM  ] Members Joined:
  697. Apr 30 13:30:56 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  698. Apr 30 13:30:56 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  699. Apr 30 13:30:56 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  700. Apr 30 13:30:56 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  701. Apr 30 13:30:56 athos openais[8569]: [TOTEM] Retransmit List: 8  
  702. Apr 30 13:30:56 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  703. Apr 30 13:30:56 athos openais[8569]: [TOTEM] Retransmit List: 8 a  
  704. Apr 30 13:30:57 athos last message repeated 14 times
  705. Apr 30 13:31:09 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  706. Apr 30 13:31:09 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  707. Apr 30 13:31:09 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  708. Apr 30 13:31:09 athos openais[8569]: [TOTEM] Saving state aru f high seq received f
  709. Apr 30 13:31:09 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2744
  710. Apr 30 13:31:09 athos openais[8569]: [TOTEM] entering COMMIT state.
  711. Apr 30 13:31:09 athos openais[8569]: [TOTEM] entering RECOVERY state.
  712. Apr 30 13:31:09 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  713. Apr 30 13:31:09 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  714. Apr 30 13:31:09 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  715. Apr 30 13:31:09 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  716. Apr 30 13:31:09 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  717. Apr 30 13:31:09 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  718. Apr 30 13:31:09 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  719. Apr 30 13:31:09 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  720. Apr 30 13:31:09 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  721. Apr 30 13:31:09 athos openais[8569]: [TOTEM] copying all old ring messages from c-f.
  722. Apr 30 13:31:09 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  723. Apr 30 13:31:09 athos openais[8569]: [TOTEM] Originated for recovery: c d e f  
  724. Apr 30 13:31:09 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  725. Apr 30 13:31:09 athos openais[8569]: [TOTEM] Sending initial ORF token
  726. Apr 30 13:31:17 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  727. Apr 30 13:31:17 athos openais[8569]: [TOTEM] Restoring instance->my_aru f my high seq received f
  728. Apr 30 13:31:17 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  729. Apr 30 13:31:17 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  730. Apr 30 13:31:17 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2748
  731. Apr 30 13:31:17 athos openais[8569]: [TOTEM] entering COMMIT state.
  732. Apr 30 13:31:17 athos openais[8569]: [TOTEM] entering RECOVERY state.
  733. Apr 30 13:31:17 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  734. Apr 30 13:31:17 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  735. Apr 30 13:31:17 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  736. Apr 30 13:31:17 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  737. Apr 30 13:31:17 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  738. Apr 30 13:31:17 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  739. Apr 30 13:31:17 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  740. Apr 30 13:31:17 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  741. Apr 30 13:31:17 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  742. Apr 30 13:31:17 athos openais[8569]: [TOTEM] copying all old ring messages from c-f.
  743. Apr 30 13:31:17 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  744. Apr 30 13:31:17 athos openais[8569]: [TOTEM] Originated for recovery: c d e f  
  745. Apr 30 13:31:17 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  746. Apr 30 13:31:17 athos openais[8569]: [TOTEM] Sending initial ORF token
  747. Apr 30 13:31:17 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  748. Apr 30 13:31:17 athos openais[8569]: [CLM  ] New Configuration:
  749. Apr 30 13:31:17 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  750. Apr 30 13:31:17 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  751. Apr 30 13:31:17 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  752. Apr 30 13:31:17 athos openais[8569]: [CLM  ] Members Left:
  753. Apr 30 13:31:17 athos openais[8569]: [CLM  ] Members Joined:
  754. Apr 30 13:31:17 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  755. Apr 30 13:31:17 athos openais[8569]: [CLM  ] New Configuration:
  756. Apr 30 13:31:17 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  757. Apr 30 13:31:17 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  758. Apr 30 13:31:17 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  759. Apr 30 13:31:17 athos openais[8569]: [CLM  ] Members Left:
  760. Apr 30 13:31:17 athos openais[8569]: [CLM  ] Members Joined:
  761. Apr 30 13:31:17 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  762. Apr 30 13:31:17 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  763. Apr 30 13:31:25 athos openais[8569]: [TOTEM] entering GATHER state from 12.
  764. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  765. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Saving state aru 9 high seq received 9
  766. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Storing new sequence id for ring 274c
  767. Apr 30 13:31:25 athos openais[8569]: [TOTEM] entering COMMIT state.
  768. Apr 30 13:31:25 athos openais[8569]: [TOTEM] entering RECOVERY state.
  769. Apr 30 13:31:25 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  770. Apr 30 13:31:25 athos openais[8569]: [TOTEM] previous ring seq 10056 rep 172.16.1.1
  771. Apr 30 13:31:25 athos openais[8569]: [TOTEM] aru 9 high delivered 9 received flag 1
  772. Apr 30 13:31:25 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  773. Apr 30 13:31:25 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  774. Apr 30 13:31:25 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  775. Apr 30 13:31:25 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  776. Apr 30 13:31:25 athos openais[8569]: [TOTEM] previous ring seq 10048 rep 172.16.1.1
  777. Apr 30 13:31:25 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  778. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  779. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Sending initial ORF token
  780. Apr 30 13:31:25 athos openais[8569]: [TOTEM] -not adding msg with seq no c
  781. Apr 30 13:31:25 athos openais[8569]: [TOTEM] -not adding msg with seq no d
  782. Apr 30 13:31:25 athos openais[8569]: [TOTEM] -not adding msg with seq no e
  783. Apr 30 13:31:25 athos openais[8569]: [TOTEM] -not adding msg with seq no f
  784. Apr 30 13:31:25 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  785. Apr 30 13:31:25 athos openais[8569]: [CLM  ] New Configuration:
  786. Apr 30 13:31:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  787. Apr 30 13:31:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  788. Apr 30 13:31:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  789. Apr 30 13:31:25 athos openais[8569]: [CLM  ] Members Left:
  790. Apr 30 13:31:25 athos openais[8569]: [CLM  ] Members Joined:
  791. Apr 30 13:31:25 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  792. Apr 30 13:31:25 athos openais[8569]: [CLM  ] New Configuration:
  793. Apr 30 13:31:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  794. Apr 30 13:31:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  795. Apr 30 13:31:25 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  796. Apr 30 13:31:25 athos openais[8569]: [CLM  ] Members Left:
  797. Apr 30 13:31:25 athos openais[8569]: [CLM  ] Members Joined:
  798. Apr 30 13:31:25 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  799. Apr 30 13:31:25 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  800. Apr 30 13:31:25 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  801. Apr 30 13:31:25 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  802. Apr 30 13:31:25 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  803. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Retransmit List: f  
  804. Apr 30 13:31:25 athos last message repeated 26 times
  805. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Retransmit List: 11 12 13  
  806. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Retransmit List: 17 18  
  807. Apr 30 13:31:25 athos last message repeated 24 times
  808. Apr 30 13:31:25 athos openais[8569]: [TOTEM] Retransmit List: 1b 1c  
  809. Apr 30 13:31:25 athos openais[8569]: [CPG  ] got joinlist message from node 1
  810. Apr 30 13:31:25 athos openais[8569]: [CPG  ] got joinlist message from node 2
  811. Apr 30 13:31:32 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  812. Apr 30 13:31:32 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  813. Apr 30 13:31:32 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  814. Apr 30 13:31:32 athos openais[8569]: [TOTEM] Saving state aru 25 high seq received 25
  815. Apr 30 13:31:32 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2750
  816. Apr 30 13:31:32 athos openais[8569]: [TOTEM] entering COMMIT state.
  817. Apr 30 13:31:32 athos openais[8569]: [TOTEM] entering RECOVERY state.
  818. Apr 30 13:31:32 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  819. Apr 30 13:31:32 athos openais[8569]: [TOTEM] previous ring seq 10060 rep 172.16.1.1
  820. Apr 30 13:31:32 athos openais[8569]: [TOTEM] aru 25 high delivered 25 received flag 1
  821. Apr 30 13:31:32 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  822. Apr 30 13:31:32 athos openais[8569]: [TOTEM] previous ring seq 10060 rep 172.16.1.1
  823. Apr 30 13:31:32 athos openais[8569]: [TOTEM] aru 25 high delivered 25 received flag 1
  824. Apr 30 13:31:32 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  825. Apr 30 13:31:32 athos openais[8569]: [TOTEM] previous ring seq 10060 rep 172.16.1.1
  826. Apr 30 13:31:32 athos openais[8569]: [TOTEM] aru 23 high delivered 23 received flag 0
  827. Apr 30 13:31:32 athos openais[8569]: [TOTEM] copying all old ring messages from 24-25.
  828. Apr 30 13:31:32 athos openais[8569]: [TOTEM] Originated 2 messages in RECOVERY.
  829. Apr 30 13:31:32 athos openais[8569]: [TOTEM] Originated for recovery: 24 25  
  830. Apr 30 13:31:32 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  831. Apr 30 13:31:32 athos openais[8569]: [TOTEM] Sending initial ORF token
  832. Apr 30 13:31:32 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  833. Apr 30 13:31:32 athos openais[8569]: [CLM  ] New Configuration:
  834. Apr 30 13:31:32 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  835. Apr 30 13:31:32 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  836. Apr 30 13:31:32 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  837. Apr 30 13:31:32 athos openais[8569]: [CLM  ] Members Left:
  838. Apr 30 13:31:32 athos openais[8569]: [CLM  ] Members Joined:
  839. Apr 30 13:31:32 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  840. Apr 30 13:31:32 athos openais[8569]: [CLM  ] New Configuration:
  841. Apr 30 13:31:32 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  842. Apr 30 13:31:32 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  843. Apr 30 13:31:32 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  844. Apr 30 13:31:32 athos openais[8569]: [CLM  ] Members Left:
  845. Apr 30 13:31:32 athos openais[8569]: [CLM  ] Members Joined:
  846. Apr 30 13:31:32 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  847. Apr 30 13:31:32 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  848. Apr 30 13:31:32 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  849. Apr 30 13:31:32 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  850. Apr 30 13:31:32 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  851. Apr 30 13:31:39 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  852. Apr 30 13:31:39 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  853. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  854. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Saving state aru f high seq received f
  855. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2754
  856. Apr 30 13:31:39 athos openais[8569]: [TOTEM] entering COMMIT state.
  857. Apr 30 13:31:39 athos openais[8569]: [TOTEM] entering RECOVERY state.
  858. Apr 30 13:31:39 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  859. Apr 30 13:31:39 athos openais[8569]: [TOTEM] previous ring seq 10064 rep 172.16.1.1
  860. Apr 30 13:31:39 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  861. Apr 30 13:31:39 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  862. Apr 30 13:31:39 athos openais[8569]: [TOTEM] previous ring seq 10064 rep 172.16.1.1
  863. Apr 30 13:31:39 athos openais[8569]: [TOTEM] aru f high delivered f received flag 1
  864. Apr 30 13:31:39 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  865. Apr 30 13:31:39 athos openais[8569]: [TOTEM] previous ring seq 10064 rep 172.16.1.1
  866. Apr 30 13:31:39 athos openais[8569]: [TOTEM] aru b high delivered b received flag 0
  867. Apr 30 13:31:39 athos openais[8569]: [TOTEM] copying all old ring messages from c-f.
  868. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Originated 4 messages in RECOVERY.
  869. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Originated for recovery: c d e f  
  870. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  871. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Sending initial ORF token
  872. Apr 30 13:31:39 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  873. Apr 30 13:31:39 athos openais[8569]: [CLM  ] New Configuration:
  874. Apr 30 13:31:39 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  875. Apr 30 13:31:39 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  876. Apr 30 13:31:39 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  877. Apr 30 13:31:39 athos openais[8569]: [CLM  ] Members Left:
  878. Apr 30 13:31:39 athos openais[8569]: [CLM  ] Members Joined:
  879. Apr 30 13:31:39 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  880. Apr 30 13:31:39 athos openais[8569]: [CLM  ] New Configuration:
  881. Apr 30 13:31:39 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  882. Apr 30 13:31:39 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  883. Apr 30 13:31:39 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  884. Apr 30 13:31:39 athos openais[8569]: [CLM  ] Members Left:
  885. Apr 30 13:31:39 athos openais[8569]: [CLM  ] Members Joined:
  886. Apr 30 13:31:39 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  887. Apr 30 13:31:39 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  888. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Retransmit List: 9 a  
  889. Apr 30 13:31:39 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  890. Apr 30 13:31:39 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.2
  891. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Retransmit List: 9 a  
  892. Apr 30 13:31:39 athos last message repeated 13 times
  893. Apr 30 13:31:39 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  894. Apr 30 13:31:39 athos openais[8569]: [TOTEM] Retransmit List: c d e f  
  895. Apr 30 13:31:45 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  896. Apr 30 13:31:45 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  897. Apr 30 13:31:45 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  898. Apr 30 13:31:45 athos openais[8569]: [TOTEM] Saving state aru 1c high seq received 1c
  899. Apr 30 13:31:45 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2758
  900. Apr 30 13:31:45 athos openais[8569]: [TOTEM] entering COMMIT state.
  901. Apr 30 13:31:45 athos openais[8569]: [TOTEM] entering RECOVERY state.
  902. Apr 30 13:31:45 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  903. Apr 30 13:31:45 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  904. Apr 30 13:31:45 athos openais[8569]: [TOTEM] aru 1c high delivered 1c received flag 1
  905. Apr 30 13:31:45 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  906. Apr 30 13:31:45 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  907. Apr 30 13:31:45 athos openais[8569]: [TOTEM] aru 1c high delivered 1c received flag 1
  908. Apr 30 13:31:45 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  909. Apr 30 13:31:45 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  910. Apr 30 13:31:45 athos openais[8569]: [TOTEM] aru 16 high delivered 16 received flag 0
  911. Apr 30 13:31:45 athos openais[8569]: [TOTEM] copying all old ring messages from 17-1c.
  912. Apr 30 13:31:45 athos openais[8569]: [TOTEM] Originated 6 messages in RECOVERY.
  913. Apr 30 13:31:45 athos openais[8569]: [TOTEM] Originated for recovery: 17 18 19 1a 1b 1c  
  914. Apr 30 13:31:45 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  915. Apr 30 13:31:45 athos openais[8569]: [TOTEM] Sending initial ORF token
  916. Apr 30 13:31:53 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  917. Apr 30 13:31:53 athos openais[8569]: [TOTEM] Restoring instance->my_aru 1c my high seq received 1c
  918. Apr 30 13:31:53 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  919. Apr 30 13:31:53 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  920. Apr 30 13:31:53 athos openais[8569]: [TOTEM] Storing new sequence id for ring 275c
  921. Apr 30 13:31:53 athos openais[8569]: [TOTEM] entering COMMIT state.
  922. Apr 30 13:31:53 athos openais[8569]: [TOTEM] entering RECOVERY state.
  923. Apr 30 13:31:53 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  924. Apr 30 13:31:53 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  925. Apr 30 13:31:53 athos openais[8569]: [TOTEM] aru 1c high delivered 1c received flag 1
  926. Apr 30 13:31:53 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  927. Apr 30 13:31:53 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  928. Apr 30 13:31:53 athos openais[8569]: [TOTEM] aru 1c high delivered 1c received flag 1
  929. Apr 30 13:31:53 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  930. Apr 30 13:31:53 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  931. Apr 30 13:31:53 athos openais[8569]: [TOTEM] aru 16 high delivered 16 received flag 0
  932. Apr 30 13:31:53 athos openais[8569]: [TOTEM] copying all old ring messages from 17-1c.
  933. Apr 30 13:31:53 athos openais[8569]: [TOTEM] Originated 6 messages in RECOVERY.
  934. Apr 30 13:31:53 athos openais[8569]: [TOTEM] Originated for recovery: 17 18 19 1a 1b 1c  
  935. Apr 30 13:31:53 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  936. Apr 30 13:31:53 athos openais[8569]: [TOTEM] Sending initial ORF token
  937. Apr 30 13:31:53 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  938. Apr 30 13:31:53 athos openais[8569]: [CLM  ] New Configuration:
  939. Apr 30 13:31:53 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  940. Apr 30 13:31:53 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  941. Apr 30 13:31:53 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  942. Apr 30 13:31:53 athos openais[8569]: [CLM  ] Members Left:
  943. Apr 30 13:31:53 athos openais[8569]: [CLM  ] Members Joined:
  944. Apr 30 13:31:53 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  945. Apr 30 13:31:53 athos openais[8569]: [CLM  ] New Configuration:
  946. Apr 30 13:31:53 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  947. Apr 30 13:31:53 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  948. Apr 30 13:31:53 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  949. Apr 30 13:31:53 athos openais[8569]: [CLM  ] Members Left:
  950. Apr 30 13:31:53 athos openais[8569]: [CLM  ] Members Joined:
  951. Apr 30 13:31:53 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  952. Apr 30 13:31:53 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  953. Apr 30 13:32:00 athos openais[8569]: [TOTEM] entering GATHER state from 12.
  954. Apr 30 13:32:00 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  955. Apr 30 13:32:00 athos openais[8569]: [TOTEM] Saving state aru d high seq received d
  956. Apr 30 13:32:00 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2760
  957. Apr 30 13:32:00 athos openais[8569]: [TOTEM] entering COMMIT state.
  958. Apr 30 13:32:00 athos openais[8569]: [TOTEM] entering RECOVERY state.
  959. Apr 30 13:32:00 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  960. Apr 30 13:32:00 athos openais[8569]: [TOTEM] previous ring seq 10076 rep 172.16.1.1
  961. Apr 30 13:32:00 athos openais[8569]: [TOTEM] aru d high delivered d received flag 1
  962. Apr 30 13:32:00 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  963. Apr 30 13:32:00 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  964. Apr 30 13:32:00 athos openais[8569]: [TOTEM] aru 1c high delivered 1c received flag 1
  965. Apr 30 13:32:00 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  966. Apr 30 13:32:00 athos openais[8569]: [TOTEM] previous ring seq 10068 rep 172.16.1.1
  967. Apr 30 13:32:00 athos openais[8569]: [TOTEM] aru 16 high delivered 16 received flag 0
  968. Apr 30 13:32:00 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  969. Apr 30 13:32:00 athos openais[8569]: [TOTEM] Sending initial ORF token
  970. Apr 30 13:32:00 athos openais[8569]: [TOTEM] Retransmit List: 5 6 7  
  971. Apr 30 13:32:00 athos last message repeated 8 times
  972. Apr 30 13:32:00 athos openais[8569]: [TOTEM] Retransmit List: 5 6  
  973. Apr 30 13:32:08 athos last message repeated 39 times
  974. Apr 30 13:32:08 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  975. Apr 30 13:32:08 athos openais[8569]: [TOTEM] Restoring instance->my_aru d my high seq received d
  976. Apr 30 13:32:08 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  977. Apr 30 13:32:08 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  978. Apr 30 13:32:08 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2764
  979. Apr 30 13:32:08 athos openais[8569]: [TOTEM] entering COMMIT state.
  980. Apr 30 13:32:08 athos openais[8569]: [TOTEM] entering RECOVERY state.
  981. Apr 30 13:32:08 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  982. Apr 30 13:32:08 athos openais[8569]: [TOTEM] previous ring seq 10076 rep 172.16.1.1
  983. Apr 30 13:32:08 athos openais[8569]: [TOTEM] aru d high delivered d received flag 1
  984. Apr 30 13:32:08 athos openais[8569]: [TOTEM] position [1] member 172.16.1.2:
  985. Apr 30 13:32:08 athos openais[8569]: [TOTEM] previous ring seq 10080 rep 172.16.1.1
  986. Apr 30 13:32:08 athos openais[8569]: [TOTEM] aru 8 high delivered 8 received flag 1
  987. Apr 30 13:32:08 athos openais[8569]: [TOTEM] position [2] member 172.16.1.3:
  988. Apr 30 13:32:08 athos openais[8569]: [TOTEM] previous ring seq 10080 rep 172.16.1.1
  989. Apr 30 13:32:08 athos openais[8569]: [TOTEM] aru 4 high delivered 4 received flag 0
  990. Apr 30 13:32:08 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  991. Apr 30 13:32:08 athos openais[8569]: [TOTEM] Sending initial ORF token
  992. Apr 30 13:32:09 athos last message repeated 2 times
  993. Apr 30 13:32:09 athos qdiskd[5311]: <info> Node 2 shutdown
  994. Apr 30 13:32:09 athos openais[8569]: [TOTEM] Sending initial ORF token
  995. Apr 30 13:32:17 athos last message repeated 16 times
  996. Apr 30 13:32:18 athos openais[8569]: [TOTEM] Restoring instance->my_aru d my high seq received d
  997. Apr 30 13:32:18 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  998. Apr 30 13:32:18 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2768
  999. Apr 30 13:32:18 athos openais[8569]: [TOTEM] entering COMMIT state.
  1000. Apr 30 13:32:18 athos openais[8569]: [TOTEM] entering GATHER state from 14.
  1001. Apr 30 13:32:22 athos openais[8569]: [TOTEM] entering GATHER state from 11.
  1002. Apr 30 13:32:22 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  1003. Apr 30 13:32:22 athos openais[8569]: [TOTEM] Storing new sequence id for ring 276c
  1004. Apr 30 13:32:22 athos openais[8569]: [TOTEM] entering COMMIT state.
  1005. Apr 30 13:32:22 athos openais[8569]: [TOTEM] entering RECOVERY state.
  1006. Apr 30 13:32:22 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  1007. Apr 30 13:32:22 athos openais[8569]: [TOTEM] previous ring seq 10076 rep 172.16.1.1
  1008. Apr 30 13:32:22 athos openais[8569]: [TOTEM] aru d high delivered d received flag 1
  1009. Apr 30 13:32:22 athos openais[8569]: [TOTEM] position [1] member 172.16.1.3:
  1010. Apr 30 13:32:22 athos openais[8569]: [TOTEM] previous ring seq 10080 rep 172.16.1.1
  1011. Apr 30 13:32:22 athos openais[8569]: [TOTEM] aru 4 high delivered 4 received flag 0
  1012. Apr 30 13:32:22 athos openais[8569]: [TOTEM] Did not need to originate any messages in recovery.
  1013. Apr 30 13:32:22 athos openais[8569]: [TOTEM] Sending initial ORF token
  1014. Apr 30 13:32:22 athos openais[8569]: [TOTEM] -not adding msg with seq no 7
  1015. Apr 30 13:32:22 athos kernel: dlm: closing connection to node 2
  1016. Apr 30 13:32:22 athos openais[8569]: [TOTEM] -not adding msg with seq no 8
  1017. Apr 30 13:32:22 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  1018. Apr 30 13:32:22 athos openais[8569]: [CLM  ] New Configuration:
  1019. Apr 30 13:32:22 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  1020. Apr 30 13:32:22 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  1021. Apr 30 13:32:22 athos openais[8569]: [CLM  ] Members Left:
  1022. Apr 30 13:32:22 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.2)  
  1023. Apr 30 13:32:22 athos openais[8569]: [CLM  ] Members Joined:
  1024. Apr 30 13:32:22 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  1025. Apr 30 13:32:22 athos openais[8569]: [CLM  ] New Configuration:
  1026. Apr 30 13:32:22 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  1027. Apr 30 13:32:22 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  1028. Apr 30 13:32:22 athos openais[8569]: [CLM  ] Members Left:
  1029. Apr 30 13:32:22 athos openais[8569]: [CLM  ] Members Joined:
  1030. Apr 30 13:32:22 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  1031. Apr 30 13:32:22 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  1032. Apr 30 13:32:22 athos openais[8569]: [TOTEM] Retransmit List: 3 4  
  1033. Apr 30 13:32:22 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  1034. Apr 30 13:32:22 athos openais[8569]: [TOTEM] Retransmit List: 4  
  1035. Apr 30 13:32:22 athos last message repeated 6 times
  1036. Apr 30 13:32:23 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  1037. Apr 30 13:32:23 athos openais[8569]: [TOTEM] Retransmit List: 6 7  
  1038. Apr 30 13:32:23 athos groupd[8604]: cpg_mcast_joined retry 100
  1039. Apr 30 13:32:23 athos groupd[8604]: cpg_mcast_joined retry 200
  1040. Apr 30 13:32:23 athos groupd[8604]: cpg_mcast_joined retry 300
  1041. Apr 30 13:32:23 athos groupd[8604]: cpg_mcast_joined retry 400
  1042. Apr 30 13:32:23 athos groupd[8604]: cpg_mcast_joined retry 500
  1043. Apr 30 13:32:24 athos groupd[8604]: cpg_mcast_joined retry 600
  1044. Apr 30 13:32:24 athos groupd[8604]: cpg_mcast_joined retry 700
  1045. Apr 30 13:32:24 athos groupd[8604]: cpg_mcast_joined retry 800
  1046. Apr 30 13:32:24 athos groupd[8604]: cpg_mcast_joined retry 900
  1047. Apr 30 13:32:24 athos groupd[8604]: cpg_mcast_joined retry 1000
  1048. Apr 30 13:32:25 athos groupd[8604]: cpg_mcast_joined retry 1100
  1049. Apr 30 13:32:25 athos groupd[8604]: cpg_mcast_joined retry 1200
  1050. Apr 30 13:32:25 athos groupd[8604]: cpg_mcast_joined retry 1300
  1051. Apr 30 13:32:25 athos groupd[8604]: cpg_mcast_joined retry 1400
  1052. Apr 30 13:32:25 athos groupd[8604]: cpg_mcast_joined retry 1500
  1053. Apr 30 13:32:26 athos groupd[8604]: cpg_mcast_joined retry 1600
  1054. Apr 30 13:32:26 athos groupd[8604]: cpg_mcast_joined retry 1700
  1055. Apr 30 13:32:26 athos groupd[8604]: cpg_mcast_joined retry 1800
  1056. Apr 30 13:32:26 athos groupd[8604]: cpg_mcast_joined retry 1900
  1057. Apr 30 13:32:26 athos groupd[8604]: cpg_mcast_joined retry 2000
  1058. Apr 30 13:32:27 athos groupd[8604]: cpg_mcast_joined retry 2100
  1059. Apr 30 13:32:27 athos groupd[8604]: cpg_mcast_joined retry 2200
  1060. Apr 30 13:32:27 athos groupd[8604]: cpg_mcast_joined retry 2300
  1061. Apr 30 13:32:27 athos groupd[8604]: cpg_mcast_joined retry 2400
  1062. Apr 30 13:32:27 athos groupd[8604]: cpg_mcast_joined retry 2500
  1063. Apr 30 13:32:28 athos groupd[8604]: cpg_mcast_joined retry 2600
  1064. Apr 30 13:32:28 athos groupd[8604]: cpg_mcast_joined retry 2700
  1065. Apr 30 13:32:28 athos groupd[8604]: cpg_mcast_joined retry 2800
  1066. Apr 30 13:32:28 athos groupd[8604]: cpg_mcast_joined retry 2900
  1067. Apr 30 13:32:28 athos groupd[8604]: cpg_mcast_joined retry 3000
  1068. Apr 30 13:32:29 athos groupd[8604]: cpg_mcast_joined retry 3100
  1069. Apr 30 13:32:29 athos groupd[8604]: cpg_mcast_joined retry 3200
  1070. Apr 30 13:32:29 athos groupd[8604]: cpg_mcast_joined retry 3300
  1071. Apr 30 13:32:29 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  1072. Apr 30 13:32:29 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  1073. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  1074. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Saving state aru 15 high seq received 15
  1075. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2770
  1076. Apr 30 13:32:29 athos openais[8569]: [TOTEM] entering COMMIT state.
  1077. Apr 30 13:32:29 athos openais[8569]: [TOTEM] entering RECOVERY state.
  1078. Apr 30 13:32:29 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  1079. Apr 30 13:32:29 athos openais[8569]: [TOTEM] previous ring seq 10092 rep 172.16.1.1
  1080. Apr 30 13:32:29 athos openais[8569]: [TOTEM] aru 15 high delivered 15 received flag 1
  1081. Apr 30 13:32:29 athos openais[8569]: [TOTEM] position [1] member 172.16.1.3:
  1082. Apr 30 13:32:29 athos openais[8569]: [TOTEM] previous ring seq 10092 rep 172.16.1.1
  1083. Apr 30 13:32:29 athos openais[8569]: [TOTEM] aru 13 high delivered 13 received flag 0
  1084. Apr 30 13:32:29 athos openais[8569]: [TOTEM] copying all old ring messages from 14-15.
  1085. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Originated 2 messages in RECOVERY.
  1086. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Originated for recovery: 14 15  
  1087. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  1088. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Sending initial ORF token
  1089. Apr 30 13:32:29 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  1090. Apr 30 13:32:29 athos openais[8569]: [CLM  ] New Configuration:
  1091. Apr 30 13:32:29 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  1092. Apr 30 13:32:29 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  1093. Apr 30 13:32:29 athos openais[8569]: [CLM  ] Members Left:
  1094. Apr 30 13:32:29 athos openais[8569]: [CLM  ] Members Joined:
  1095. Apr 30 13:32:29 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  1096. Apr 30 13:32:29 athos openais[8569]: [CLM  ] New Configuration:
  1097. Apr 30 13:32:29 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  1098. Apr 30 13:32:29 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  1099. Apr 30 13:32:29 athos openais[8569]: [CLM  ] Members Left:
  1100. Apr 30 13:32:29 athos openais[8569]: [CLM  ] Members Joined:
  1101. Apr 30 13:32:29 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  1102. Apr 30 13:32:29 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  1103. Apr 30 13:32:29 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  1104. Apr 30 13:32:29 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  1105. Apr 30 13:32:29 athos openais[8569]: [CPG  ] got joinlist message from node 1
  1106. Apr 30 13:32:29 athos openais[8569]: [TOTEM] Retransmit List: 16  
  1107. Apr 30 13:32:29 athos last message repeated 36 times
  1108. Apr 30 13:32:34 athos fenced[8611]: porthos-priv not a cluster member after 5 sec post_fail_delay
  1109. Apr 30 13:32:34 athos fenced[8611]: fencing node "porthos-priv"
  1110. Apr 30 13:32:40 athos ntpd[5785]: time reset -0.465908 s
  1111. Apr 30 13:32:49 athos openais[8569]: [TOTEM] FAILED TO RECEIVE
  1112. Apr 30 13:32:49 athos openais[8569]: [TOTEM] entering GATHER state from 6.
  1113. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Creating commit token because I am the rep.
  1114. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Saving state aru 19 high seq received 19
  1115. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Storing new sequence id for ring 2774
  1116. Apr 30 13:32:49 athos openais[8569]: [TOTEM] entering COMMIT state.
  1117. Apr 30 13:32:49 athos openais[8569]: [TOTEM] entering RECOVERY state.
  1118. Apr 30 13:32:49 athos openais[8569]: [TOTEM] position [0] member 172.16.1.1:
  1119. Apr 30 13:32:49 athos openais[8569]: [TOTEM] previous ring seq 10096 rep 172.16.1.1
  1120. Apr 30 13:32:49 athos openais[8569]: [TOTEM] aru 19 high delivered 19 received flag 1
  1121. Apr 30 13:32:49 athos openais[8569]: [TOTEM] position [1] member 172.16.1.3:
  1122. Apr 30 13:32:49 athos openais[8569]: [TOTEM] previous ring seq 10096 rep 172.16.1.1
  1123. Apr 30 13:32:49 athos openais[8569]: [TOTEM] aru 17 high delivered 17 received flag 0
  1124. Apr 30 13:32:49 athos openais[8569]: [TOTEM] copying all old ring messages from 18-19.
  1125. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Originated 2 messages in RECOVERY.
  1126. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Originated for recovery: 18 19  
  1127. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Not Originated for recovery:  
  1128. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Sending initial ORF token
  1129. Apr 30 13:32:49 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  1130. Apr 30 13:32:49 athos openais[8569]: [CLM  ] New Configuration:
  1131. Apr 30 13:32:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  1132. Apr 30 13:32:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  1133. Apr 30 13:32:49 athos openais[8569]: [CLM  ] Members Left:
  1134. Apr 30 13:32:49 athos openais[8569]: [CLM  ] Members Joined:
  1135. Apr 30 13:32:49 athos openais[8569]: [CLM  ] CLM CONFIGURATION CHANGE
  1136. Apr 30 13:32:49 athos openais[8569]: [CLM  ] New Configuration:
  1137. Apr 30 13:32:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.1)  
  1138. Apr 30 13:32:49 athos openais[8569]: [CLM  ]    r(0) ip(172.16.1.3)  
  1139. Apr 30 13:32:49 athos openais[8569]: [CLM  ] Members Left:
  1140. Apr 30 13:32:49 athos openais[8569]: [CLM  ] Members Joined:
  1141. Apr 30 13:32:49 athos openais[8569]: [SYNC ] This node is within the primary component and will provide service.
  1142. Apr 30 13:32:49 athos openais[8569]: [TOTEM] entering OPERATIONAL state.
  1143. Apr 30 13:32:49 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.3
  1144. Apr 30 13:32:49 athos openais[8569]: [CLM  ] got nodejoin message 172.16.1.1
  1145. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Retransmit List: e  
  1146. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Retransmit List: e 10  
  1147. Apr 30 13:32:49 athos last message repeated 25 times
  1148. Apr 30 13:32:49 athos openais[8569]: [TOTEM] Retransmit List: 12  
  1149. Apr 30 13:32:49 athos openais[8569]: [CPG  ] got joinlist message from node 1
  1150. Apr 30 13:34:00 athos ccsd[8558]: Attempt to close an unopened CCS descriptor (2250).
  1151. Apr 30 13:34:00 athos ccsd[8558]: Error while processing disconnect: Invalid request descriptor
  1152. Apr 30 13:34:00 athos fenced[8611]: fence "porthos-priv" success