Advertisement
Guest User

corosync.log

a guest
Jan 25th, 2011
139
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 19.39 KB | None | 0 0
  1. # cat /var/log/cluster/corosync.log
  2. Jan 25 11:19:39 corosync [MAIN ] Corosync Cluster Engine ('1.3.0'): started and ready to provide service.
  3. Jan 25 11:19:39 corosync [MAIN ] Corosync built-in features: nss rdma
  4. Jan 25 11:19:39 corosync [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
  5. Jan 25 11:19:39 corosync [TOTEM ] Initializing transport (UDP/IP Unicast).
  6. Jan 25 11:19:39 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
  7. Jan 25 11:19:39 corosync [TOTEM ] Initializing transport (UDP/IP Unicast).
  8. Jan 25 11:19:39 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
  9. Jan 25 11:19:39 corosync [TOTEM ] The network interface [10.0.2.11] is now up.
  10. Jan 25 11:19:39 corosync [pcmk ] info: process_ais_conf: Reading configure
  11. Jan 25 11:19:39 corosync [pcmk ] info: config_find_init: Local handle: 2697991128409440260 for logging
  12. Jan 25 11:19:39 corosync [pcmk ] info: config_find_next: Processing additional logging options...
  13. Jan 25 11:19:39 corosync [pcmk ] info: get_config_opt: Found 'off' for option: debug
  14. Jan 25 11:19:39 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: to_logfile
  15. Set r/w permissions for uid=0, gid=0 on /var/log/cluster/corosync.log
  16. Jan 25 11:19:39 corosync [pcmk ] info: get_config_opt: Found '/var/log/cluster/corosync.log' for option: logfile
  17. Jan 25 11:19:39 corosync [pcmk ] info: get_config_opt: Found 'no' for option: to_syslog
  18. Jan 25 11:19:39 corosync [pcmk ] info: process_ais_conf: User configured file based logging and explicitly disabled syslog.
  19. Jan 25 11:19:39 corosync [pcmk ] info: config_find_init: Local handle: 7114519016932114437 for service
  20. Jan 25 11:19:39 corosync [pcmk ] info: config_find_next: Processing additional service options...
  21. Jan 25 11:19:39 corosync [pcmk ] info: get_config_opt: Defaulting to 'pcmk' for option: clustername
  22. Jan 25 11:19:39 corosync [pcmk ] info: get_config_opt: Found 'no' for option: use_logd
  23. Jan 25 11:19:39 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: use_mgmtd
  24. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_startup: CRM: Initialized
  25. Jan 25 11:19:39 corosync [pcmk ] Logging: Initialized pcmk_startup
  26. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_startup: Maximum core file size is: 18446744073709551615
  27. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_startup: Service: 9
  28. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_startup: Local hostname: cluster1
  29. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_update_nodeid: Local node id: 184680458
  30. Jan 25 11:19:39 corosync [pcmk ] info: update_member: Creating entry for node 184680458 born on 0
  31. Jan 25 11:19:39 corosync [pcmk ] info: update_member: 0x179fbec0 Node 184680458 now known as cluster1 (was: (null))
  32. Jan 25 11:19:39 corosync [pcmk ] info: update_member: Node cluster1 now has 1 quorum votes (was 0)
  33. Jan 25 11:19:39 corosync [pcmk ] info: update_member: Node 184680458/cluster1 is now: member
  34. Jan 25 11:19:39 corosync [pcmk ] info: spawn_child: Forked child 9717 for process stonithd
  35. Jan 25 11:19:39 corosync [pcmk ] info: spawn_child: Forked child 9718 for process cib
  36. Jan 25 11:19:39 corosync [pcmk ] info: spawn_child: Forked child 9719 for process lrmd
  37. Jan 25 11:19:39 corosync [pcmk ] info: spawn_child: Forked child 9720 for process attrd
  38. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: G_main_add_SignalHandler: Added signal handler for signal 10
  39. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: G_main_add_SignalHandler: Added signal handler for signal 12
  40. Jan 25 11:19:39 cluster1 cib: [9718]: info: Invoked: /usr/lib64/heartbeat/cib
  41. Jan 25 11:19:39 cluster1 cib: [9718]: info: G_main_add_TriggerHandler: Added signal manual handler
  42. Jan 25 11:19:39 cluster1 cib: [9718]: info: G_main_add_SignalHandler: Added signal handler for signal 17
  43. Jan 25 11:19:39 cluster1 cib: [9718]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
  44. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: crm_cluster_connect: Connecting to OpenAIS
  45. Jan 25 11:19:39 corosync [pcmk ] info: spawn_child: Forked child 9721 for process pengine
  46. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: init_ais_connection_once: Creating connection to our AIS plugin
  47. Jan 25 11:19:39 cluster1 lrmd: [9429]: info: lrmd is shutting down
  48. Jan 25 11:19:39 cluster1 lrmd: [9719]: info: Signal sent to pid=9429, waiting for process to exit
  49. Jan 25 11:19:39 cluster1 attrd: [9720]: info: Invoked: /usr/lib64/heartbeat/attrd
  50. Jan 25 11:19:39 cluster1 attrd: [9720]: info: main: Starting up
  51. Jan 25 11:19:39 cluster1 attrd: [9720]: info: crm_cluster_connect: Connecting to OpenAIS
  52. Jan 25 11:19:39 cluster1 attrd: [9720]: info: init_ais_connection_once: Creating connection to our AIS plugin
  53. Jan 25 11:19:39 corosync [pcmk ] info: spawn_child: Forked child 9722 for process crmd
  54. Jan 25 11:19:39 corosync [pcmk ] info: spawn_child: Forked child 9723 for process mgmtd
  55. Jan 25 11:19:39 corosync [SERV ] Service engine loaded: Pacemaker Cluster Manager 1.0.9
  56. Jan 25 11:19:39 cluster1 pengine: [9721]: info: Invoked: /usr/lib64/heartbeat/pengine
  57. Jan 25 11:19:39 cluster1 crmd: [9722]: info: Invoked: /usr/lib64/heartbeat/crmd
  58. Jan 25 11:19:39 cluster1 pengine: [9721]: WARN: main: Terminating previous PE instance
  59. Jan 25 11:19:39 cluster1 crmd: [9722]: info: main: CRM Hg Version: da7075976b5ff0bee71074385f8fd02f296ec8a3
  60.  
  61. Jan 25 11:19:39 cluster1 pengine: [9431]: WARN: process_pe_message: Received quit message, terminating
  62. Jan 25 11:19:39 cluster1 crmd: [9722]: info: crmd_init: Starting crmd
  63. Jan 25 11:19:39 cluster1 crmd: [9722]: info: G_main_add_SignalHandler: Added signal handler for signal 17
  64. Jan 25 11:19:39 corosync [SERV ] Service engine loaded: corosync extended virtual synchrony service
  65. Jan 25 11:19:39 corosync [SERV ] Service engine loaded: corosync configuration service
  66. Jan 25 11:19:39 corosync [SERV ] Service engine loaded: corosync cluster closed process group service v1.01
  67. Jan 25 11:19:39 corosync [SERV ] Service engine loaded: corosync cluster config database access v1.01
  68. Jan 25 11:19:39 corosync [SERV ] Service engine loaded: corosync profile loading service
  69. Jan 25 11:19:39 corosync [SERV ] Service engine loaded: corosync cluster quorum service v0.1
  70. Jan 25 11:19:39 corosync [MAIN ] Compatibility mode set to none. Using V2 of the synchronization engine.
  71. Jan 25 11:19:39 corosync [TOTEM ] The network interface [192.168.146.11] is now up.
  72. Jan 25 11:19:39 cluster1 cib: [9718]: info: startCib: CIB Initialization completed successfully
  73. Jan 25 11:19:39 cluster1 cib: [9718]: info: crm_cluster_connect: Connecting to OpenAIS
  74. Jan 25 11:19:39 cluster1 cib: [9718]: info: init_ais_connection_once: Creating connection to our AIS plugin
  75. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: init_ais_connection_once: AIS connection established
  76. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x17a05da0 for stonithd/9717
  77. Jan 25 11:19:39 cluster1 attrd: [9720]: info: init_ais_connection_once: AIS connection established
  78. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: get_ais_nodeid: Server details: id=184680458 uname=cluster1 cname=pcmk
  79. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: crm_new_peer: Node cluster1 now has id: 184680458
  80. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: crm_new_peer: Node 184680458 is now known as cluster1
  81. Jan 25 11:19:39 cluster1 stonithd: [9717]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
  82. Jan 25 11:19:39 cluster1 cib: [9718]: info: init_ais_connection_once: AIS connection established
  83. Jan 25 11:19:39 cluster1 stonithd: [9717]: info: G_main_add_SignalHandler: Added signal handler for signal 17
  84. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x17a0a100 for attrd/9720
  85. Jan 25 11:19:39 cluster1 attrd: [9720]: info: get_ais_nodeid: Server details: id=184680458 uname=cluster1 cname=pcmk
  86. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x17a0ea80 for cib/9718
  87. Jan 25 11:19:39 corosync [pcmk ] info: update_member: Node cluster1 now has process list: 00000000000000000000000000053312 (340754)
  88. Jan 25 11:19:39 corosync [pcmk ] info: pcmk_ipc: Sending membership update 0 to cib
  89. Jan 25 11:19:39 cluster1 attrd: [9720]: info: crm_new_peer: Node cluster1 now has id: 184680458
  90. Jan 25 11:19:39 cluster1 cib: [9718]: info: get_ais_nodeid: Server details: id=184680458 uname=cluster1 cname=pcmk
  91. Jan 25 11:19:39 cluster1 attrd: [9720]: info: crm_new_peer: Node 184680458 is now known as cluster1
  92. Jan 25 11:19:39 cluster1 cib: [9718]: info: crm_new_peer: Node cluster1 now has id: 184680458
  93. Jan 25 11:19:39 cluster1 attrd: [9720]: info: main: Cluster connection active
  94. Jan 25 11:19:39 cluster1 cib: [9718]: info: crm_new_peer: Node 184680458 is now known as cluster1
  95. Jan 25 11:19:39 cluster1 attrd: [9720]: info: main: Accepting attribute updates
  96. Jan 25 11:19:39 cluster1 attrd: [9720]: info: main: Starting mainloop...
  97. Jan 25 11:19:39 cluster1 cib: [9718]: info: cib_init: Starting cib mainloop
  98. Jan 25 11:19:39 cluster1 cib: [9718]: info: ais_dispatch: Membership 0: quorum still lost
  99. Jan 25 11:19:39 cluster1 cib: [9718]: info: crm_update_peer: Node cluster1: id=184680458 state=member (new) addr=(null) votes=1 (new) born=0 seen=0 proc=00000000000000000000000000053312 (new)
  100. Jan 25 11:19:39 cluster1 cib: [9727]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-4.raw
  101. Jan 25 11:19:39 cluster1 cib: [9727]: info: write_cib_contents: Wrote version 0.4.0 of the CIB to disk (digest: ca63e9835b30e13fa7dbdcf172f7ddd9)
  102. Jan 25 11:19:39 cluster1 cib: [9727]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.w4wzvY (digest: /var/lib/heartbeat/crm/cib.3FsIS9)
  103. Jan 25 11:19:40 corosync [pcmk ] ERROR: pcmk_wait_dispatch: Child process mgmtd exited (pid=9723, rc=100)
  104. Jan 25 11:19:40 corosync [pcmk ] notice: pcmk_wait_dispatch: Child process mgmtd no longer wishes to be respawned
  105. Jan 25 11:19:40 corosync [pcmk ] info: update_member: Node cluster1 now has process list: 00000000000000000000000000013312 (78610)
  106. Jan 25 11:19:40 cluster1 lrmd: [9719]: info: G_main_add_SignalHandler: Added signal handler for signal 15
  107. Jan 25 11:19:40 cluster1 lrmd: [9719]: info: G_main_add_SignalHandler: Added signal handler for signal 17
  108. Jan 25 11:19:40 cluster1 lrmd: [9719]: info: enabling coredumps
  109. Jan 25 11:19:40 cluster1 lrmd: [9719]: info: G_main_add_SignalHandler: Added signal handler for signal 10
  110. Jan 25 11:19:40 cluster1 lrmd: [9719]: info: G_main_add_SignalHandler: Added signal handler for signal 12
  111. Jan 25 11:19:40 cluster1 lrmd: [9719]: info: Started.
  112. Jan 25 11:19:40 cluster1 crmd: [9722]: info: do_cib_control: CIB connection established
  113. Jan 25 11:19:40 cluster1 crmd: [9722]: info: crm_cluster_connect: Connecting to OpenAIS
  114. Jan 25 11:19:40 cluster1 crmd: [9722]: info: init_ais_connection_once: Creating connection to our AIS plugin
  115. Jan 25 11:19:40 cluster1 crmd: [9722]: info: init_ais_connection_once: AIS connection established
  116. Jan 25 11:19:40 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x17a150b0 for crmd/9722
  117. Jan 25 11:19:40 corosync [pcmk ] info: pcmk_ipc: Sending membership update 0 to crmd
  118. Jan 25 11:19:40 cluster1 crmd: [9722]: info: get_ais_nodeid: Server details: id=184680458 uname=cluster1 cname=pcmk
  119. Jan 25 11:19:40 cluster1 crmd: [9722]: info: crm_new_peer: Node cluster1 now has id: 184680458
  120. Jan 25 11:19:40 cluster1 crmd: [9722]: info: crm_new_peer: Node 184680458 is now known as cluster1
  121. Jan 25 11:19:40 cluster1 crmd: [9722]: info: do_ha_control: Connected to the cluster
  122. Jan 25 11:19:40 cluster1 crmd: [9722]: info: do_started: Delaying start, CCM (0000000000100000) not connected
  123. Jan 25 11:19:40 cluster1 crmd: [9722]: info: crmd_init: Starting crmd's mainloop
  124. Jan 25 11:19:40 cluster1 crmd: [9722]: info: config_query_callback: Checking for expired actions every 900000ms
  125. Jan 25 11:19:40 cluster1 crmd: [9722]: info: config_query_callback: Sending expected-votes=2 to corosync
  126. Jan 25 11:19:40 cluster1 crmd: [9722]: info: ais_dispatch: Membership 0: quorum still lost
  127. Jan 25 11:19:40 cluster1 crmd: [9722]: info: crm_update_peer: Node cluster1: id=184680458 state=member (new) addr=(null) votes=1 (new) born=0 seen=0 proc=00000000000000000000000000013312 (new)
  128. Jan 25 11:19:40 cluster1 crmd: [9722]: info: do_started: The local CRM is operational
  129. Jan 25 11:19:40 cluster1 crmd: [9722]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
  130. Jan 25 11:19:41 cluster1 pengine: [9721]: info: main: Starting pengine
  131. Jan 25 11:19:41 cluster1 crmd: [9722]: info: ais_dispatch: Membership 0: quorum still lost
  132. Jan 25 11:19:44 cluster1 attrd: [9720]: info: cib_connect: Connected to the CIB after 1 signon attempts
  133. Jan 25 11:19:44 cluster1 attrd: [9720]: info: cib_connect: Sending full refresh
  134. Jan 25 11:20:41 cluster1 crmd: [9722]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
  135. Jan 25 11:20:41 cluster1 crmd: [9722]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
  136. Jan 25 11:20:41 cluster1 crmd: [9722]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
  137. Jan 25 11:22:41 cluster1 crmd: [9722]: ERROR: crm_timer_popped: Election Timeout (I_ELECTION_DC) just popped!
  138. Jan 25 11:22:41 cluster1 crmd: [9722]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_TIMER_POPPED origin=crm_timer_popped ]
  139. Jan 25 11:22:41 cluster1 crmd: [9722]: info: do_te_control: Registering TE UUID: 9c1beca9-e6da-4c56-8b85-e99564611087
  140. Jan 25 11:22:41 cluster1 crmd: [9722]: WARN: cib_client_add_notify_callback: Callback already present
  141. Jan 25 11:22:41 cluster1 crmd: [9722]: info: set_graph_functions: Setting custom graph functions
  142. Jan 25 11:22:41 cluster1 crmd: [9722]: info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses
  143. Jan 25 11:22:41 cluster1 crmd: [9722]: info: do_dc_takeover: Taking over DC status for this partition
  144. Jan 25 11:22:41 cluster1 cib: [9718]: info: cib_process_readwrite: We are now in R/W mode
  145. Jan 25 11:22:41 cluster1 cib: [9718]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/6, version=0.4.0): ok (rc=0)
  146. Jan 25 11:22:41 cluster1 cib: [9718]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/7, version=0.4.0): ok (rc=0)
  147. Jan 25 11:22:41 cluster1 cib: [9718]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/9, version=0.4.0): ok (rc=0)
  148. Jan 25 11:22:41 cluster1 crmd: [9722]: info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks
  149. Jan 25 11:22:41 cluster1 crmd: [9722]: info: ais_dispatch: Membership 0: quorum still lost
  150. Jan 25 11:22:41 cluster1 cib: [9718]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/11, version=0.4.0): ok (rc=0)
  151. Jan 25 11:22:41 cluster1 crmd: [9722]: info: crm_ais_dispatch: Setting expected votes to 2
  152. Jan 25 11:22:41 cluster1 crmd: [9722]: info: config_query_callback: Checking for expired actions every 900000ms
  153. Jan 25 11:22:41 cluster1 crmd: [9722]: info: config_query_callback: Sending expected-votes=2 to corosync
  154. Jan 25 11:22:41 cluster1 crmd: [9722]: info: ais_dispatch: Membership 0: quorum still lost
  155. Jan 25 11:22:41 cluster1 cib: [9718]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/14, version=0.4.0): ok (rc=0)
  156. Jan 25 11:22:41 cluster1 crmd: [9722]: info: crm_ais_dispatch: Setting expected votes to 2
  157. Jan 25 11:22:41 cluster1 crmd: [9722]: info: te_connect_stonith: Attempting connection to fencing daemon...
  158. Jan 25 11:22:41 cluster1 cib: [9718]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/16, version=0.4.0): ok (rc=0)
  159. Jan 25 11:22:42 cluster1 crmd: [9722]: info: te_connect_stonith: Connected
  160. # crm_mon -fr1
  161. ============
  162. Last updated: Tue Jan 25 11:24:31 2011
  163. Stack: openais
  164. Current DC: NONE
  165. 0 Nodes configured, 2 expected votes
  166. 0 Resources configured.
  167. ============
  168.  
  169.  
  170. Full list of resources:
  171.  
  172.  
  173. Migration summary:
  174.  
  175. # netstat -tupan | grep corosync
  176. udp 0 0 10.0.2.11:5405 0.0.0.0:* 9712/corosync
  177. udp 0 0 192.168.146.11:5407 0.0.0.0:* 9712/corosync
  178. udp 0 0 0.0.0.0:54316 0.0.0.0:* 9712/corosync
  179. udp 0 0 0.0.0.0:55759 0.0.0.0:* 9712/corosync
  180. # cat /etc/corosync/corosync.conf
  181. # Please read the corosync.conf.5 manual page
  182. compatibility: none
  183.  
  184. aisexec {
  185. # Run as root - this is necessary to be able to manage resources with Pacemaker
  186. user: root
  187. group: root
  188. }
  189.  
  190. service {
  191. # Load the Pacemaker Cluster Resource Manager
  192. ver: 0
  193. name: pacemaker
  194. use_mgmtd: yes
  195. use_logd: no
  196. }
  197.  
  198. totem {
  199. version: 2
  200. # How long before declaring a token lost (ms)
  201. token: 5000
  202. # How many token retransmits before forming a new configuration
  203. token_retransmits_before_loss_const: 10
  204. # How long to wait for join messages in the membership protocol (ms)
  205. join: 1000
  206. # How long to wait for consensus to be achieved before starting a new round of membership configuration (ms)
  207. consensus: 2500
  208. # Turn off the virtual synchrony filter
  209. vsftype: none
  210. # Number of messages that may be sent by one processor on receipt of the token
  211. max_messages: 25
  212. # Stagger sending the node join messages by 1..send_join ms
  213. send_join: 45
  214. # Limit generated nodeids to 31-bits (positive signed integers)
  215. clear_node_high_bit: yes
  216. # Disable encryption
  217. secauth: on
  218. # How many threads to use for encryption/decryption
  219. threads: 16
  220. # set transport mode for udpu (User Datagram Protocol Unicast)
  221. transport: udpu
  222. # set Redundant Ring Protocol mode
  223. rrp_mode: active
  224.  
  225. interface {
  226. member {
  227. memberaddr: 10.0.1.11
  228. }
  229. member {
  230. memberaddr: 10.0.1.12
  231. }
  232. ringnumber: 0
  233. bindnetaddr: 10.0.1.0
  234. mcastport: 5405
  235. }
  236.  
  237. interface {
  238. member {
  239. memberaddr: 192.168.146.11
  240. }
  241. member {
  242. memberaddr: 192.168.146.12
  243. }
  244. ringnumber: 1
  245. bindnetaddr: 192.168.146.0
  246. mcastport: 5407
  247. }
  248. }
  249.  
  250. logging {
  251. debug: off
  252. fileline: off
  253. to_syslog: no
  254. to_stderr: no
  255. syslog_facility: local6
  256. to_logfile: yes
  257. logfile: /var/log/cluster/corosync.log
  258. timestamp: on
  259. logger_subsys {
  260. subsys: AMF
  261. debug: off
  262. }
  263. }
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement