API tools faq
paste
Advertisement
lolomin

20130506_SST_joiner_node_error_log

lolomin
May 6th, 2013
105
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 9.18 KB | None | 0 0
raw download clone embed print report
  1. 130506 11:47:11 mysqld_safe Starting mysqld daemon with databases from /opt/mysql-galera/data
  2. 130506 11:47:11 mysqld_safe WSREP: Running position recovery with --log_error=/tmp/tmp.J24jBKzmBv
  3. 130506 11:47:17 mysqld_safe WSREP: Recovered position 00000000-0000-0000-0000-000000000000:-1
  4. 130506 11:47:17 [Note] WSREP: wsrep_start_position var submitted: '00000000-0000-0000-0000-000000000000:-1'
  5. 130506 11:47:17 [Note] WSREP: Read nil XID from storage engines, skipping position init
  6. 130506 11:47:17 [Note] WSREP: wsrep_load(): loading provider library '/opt/mysql-galera/lib/libgalera_smm.so'
  7. 130506 11:47:17 [Note] WSREP: wsrep_load(): Galera 2.5(r150) by Codership Oy <info@codership.com> loaded succesfully.
  8. 130506 11:47:17 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1
  9. 130506 11:47:17 [Note] WSREP: Reusing existing '/opt/mysql-galera/data//galera.cache'.
  10. 130506 11:47:17 [Note] WSREP: Passing config to GCS: base_host = 192.168.0.1; base_port = 4567; cert.log_conflicts = no; gcache.dir = /opt/mysql-galera/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /opt/mysql-galera/data//galera.cache; gcache.page_size = 128M; gcache.size = 1024M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3
  11. 130506 11:47:17 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
  12. 130506 11:47:17 [Note] WSREP: wsrep_sst_grab()
  13. 130506 11:47:17 [Note] WSREP: Start replication
  14. 130506 11:47:17 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
  15. 130506 11:47:17 [Note] WSREP: protonet asio version 0
  16. 130506 11:47:17 [Note] WSREP: backend: asio
  17. 130506 11:47:17 [Note] WSREP: GMCast version 0
  18. 130506 11:47:17 [Note] WSREP: (f08050a0-b631-11e2-0800-d07aa53fd241, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
  19. 130506 11:47:17 [Note] WSREP: (f08050a0-b631-11e2-0800-d07aa53fd241, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
  20. 130506 11:47:17 [Note] WSREP: EVS version 0
  21. 130506 11:47:17 [Note] WSREP: PC version 0
  22. 130506 11:47:17 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '192.168.0.1:4567,192.168.0.5:4567,192.168.0.10:4567'
  23. 130506 11:47:17 [Warning] WSREP: (f08050a0-b631-11e2-0800-d07aa53fd241, 'tcp://0.0.0.0:4567') address 'tcp://192.168.0.1:4567' points to own listening address, blacklisting
  24. 130506 11:47:17 [Note] WSREP: (f08050a0-b631-11e2-0800-d07aa53fd241, 'tcp://0.0.0.0:4567') address 'tcp://192.168.0.1:4567' pointing to uuid f08050a0-b631-11e2-0800-d07aa53fd241 is blacklisted, skipping
  25. 130506 11:47:17 [Note] WSREP: (f08050a0-b631-11e2-0800-d07aa53fd241, 'tcp://0.0.0.0:4567') address 'tcp://192.168.0.1:4567' pointing to uuid f08050a0-b631-11e2-0800-d07aa53fd241 is blacklisted, skipping
  26. 130506 11:47:17 [Note] WSREP: (f08050a0-b631-11e2-0800-d07aa53fd241, 'tcp://0.0.0.0:4567') address 'tcp://192.168.0.1:4567' pointing to uuid f08050a0-b631-11e2-0800-d07aa53fd241 is blacklisted, skipping
  27. 130506 11:47:17 [Note] WSREP: (f08050a0-b631-11e2-0800-d07aa53fd241, 'tcp://0.0.0.0:4567') address 'tcp://192.168.0.1:4567' pointing to uuid f08050a0-b631-11e2-0800-d07aa53fd241 is blacklisted, skipping
  28. 130506 11:47:19 [Note] WSREP: declaring 49b91606-b61c-11e2-0800-302b366e5284 stable
  29. 130506 11:47:19 [Note] WSREP: declaring 9a19f697-b62b-11e2-0800-ffa070f929a8 stable
  30. 130506 11:47:19 [Note] WSREP: Node 49b91606-b61c-11e2-0800-302b366e5284 state prim
  31. 130506 11:47:19 [Note] WSREP: view(view_id(PRIM,49b91606-b61c-11e2-0800-302b366e5284,13) memb {
  32. 49b91606-b61c-11e2-0800-302b366e5284,
  33. 9a19f697-b62b-11e2-0800-ffa070f929a8,
  34. f08050a0-b631-11e2-0800-d07aa53fd241,
  35. } joined {
  36. } left {
  37. } partitioned {
  38. })
  39. 130506 11:47:19 [Note] WSREP: gcomm: connected
  40. 130506 11:47:19 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
  41. 130506 11:47:19 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
  42. 130506 11:47:19 [Note] WSREP: Opened channel 'my_wsrep_cluster'
  43. 130506 11:47:19 [Note] WSREP: Waiting for SST to complete.
  44. 130506 11:47:19 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
  45. 130506 11:47:19 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
  46. 130506 11:47:19 [Note] WSREP: STATE EXCHANGE: sent state msg: f1680394-b631-11e2-0800-af8feb5a7563
  47. 130506 11:47:19 [Note] WSREP: STATE EXCHANGE: got state msg: f1680394-b631-11e2-0800-af8feb5a7563 from 0 (laurane.lolomin.net)
  48. 130506 11:47:19 [Note] WSREP: STATE EXCHANGE: got state msg: f1680394-b631-11e2-0800-af8feb5a7563 from 1 (vmfedora1)
  49. 130506 11:47:19 [Note] WSREP: STATE EXCHANGE: got state msg: f1680394-b631-11e2-0800-af8feb5a7563 from 2 (cygnus.lolomin.net)
  50. 130506 11:47:19 [Note] WSREP: Quorum results:
  51. version = 2,
  52. component = PRIMARY,
  53. conf_id = 12,
  54. members = 2/3 (joined/total),
  55. act_id = 6794249,
  56. last_appl. = -1,
  57. protocols = 0/4/2 (gcs/repl/appl),
  58. group UUID = 00e584e7-a01b-11e2-0800-313733667695
  59. 130506 11:47:19 [Note] WSREP: Flow-control interval: [28, 28]
  60. 130506 11:47:19 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 6794249)
  61. 130506 11:47:19 [Note] WSREP: State transfer required:
  62. Group state: 00e584e7-a01b-11e2-0800-313733667695:6794249
  63. Local state: 00000000-0000-0000-0000-000000000000:-1
  64. 130506 11:47:19 [Note] WSREP: New cluster view: global state: 00e584e7-a01b-11e2-0800-313733667695:6794249, view# 13: Primary, number of nodes: 3, my index: 2, protocol version 2
  65. 130506 11:47:19 [Warning] WSREP: Gap in state sequence. Need state transfer.
  66. 130506 11:47:21 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'joiner' --address '192.168.0.1' --auth 'username:XXXXXX' --datadir '/opt/mysql-galera/data/' --defaults-file '/etc/my-galera.cnf' --parent '12548''
  67. Ncat: Invalid -d delay "l" (must be greater than 0). QUITTING.
  68. tar: This does not look like a tar archive
  69. tar: Exiting with failure status due to previous errors
  70. 130506 11:47:32 [Note] WSREP: Prepared SST request: xtrabackup|192.168.0.1:4444/xtrabackup_sst
  71. 130506 11:47:32 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
  72. 130506 11:47:32 [Note] WSREP: Assign initial position for certification: 6794249, protocol version: 2
  73. 130506 11:47:32 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (00e584e7-a01b-11e2-0800-313733667695): 1 (Operation not permitted)
  74. at galera/src/replicator_str.cpp:prepare_for_IST():436. IST will be unavailable.
  75. WSREP_SST: [ERROR] Error while getting st data from donor node: 2, 2 (20130506 11:47:32.893)
  76. 130506 11:47:32 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'joiner' --address '192.168.0.1' --auth 'username:XXXXXX' --datadir '/opt/mysql-galera/data/' --defaults-file '/etc/my-galera.cnf' --parent '12548': 32 (Broken pipe)
  77. 130506 11:47:32 [ERROR] WSREP: Failed to read uuid:seqno from joiner script.
  78. 130506 11:47:32 [ERROR] WSREP: SST failed: 32 (Broken pipe)
  79. 130506 11:47:32 [ERROR] Aborting
  80.  
  81. 130506 11:47:32 [Note] WSREP: Node 2 (cygnus.lolomin.net) requested state transfer from '*any*'. Selected 0 (laurane.lolomin.net)(SYNCED) as donor.
  82. 130506 11:47:32 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 6794249)
  83. 130506 11:47:32 [Note] WSREP: Requesting state transfer: success, donor: 0
  84. 130506 11:47:34 [Note] WSREP: Closing send monitor...
  85. 130506 11:47:34 [Note] WSREP: Closed send monitor.
  86. 130506 11:47:34 [Note] WSREP: gcomm: terminating thread
  87. 130506 11:47:34 [Note] WSREP: gcomm: joining thread
  88. 130506 11:47:34 [Note] WSREP: gcomm: closing backend
  89. 130506 11:47:34 [Note] WSREP: view(view_id(NON_PRIM,49b91606-b61c-11e2-0800-302b366e5284,13) memb {
  90. f08050a0-b631-11e2-0800-d07aa53fd241,
  91. } joined {
  92. } left {
  93. } partitioned {
  94. 49b91606-b61c-11e2-0800-302b366e5284,
  95. 9a19f697-b62b-11e2-0800-ffa070f929a8,
  96. })
  97. 130506 11:47:34 [Note] WSREP: view((empty))
  98. 130506 11:47:34 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
  99. 130506 11:47:34 [Note] WSREP: gcomm: closed
  100. 130506 11:47:34 [Note] WSREP: Flow-control interval: [16, 16]
  101. 130506 11:47:34 [Note] WSREP: Received NON-PRIMARY.
  102. 130506 11:47:34 [Note] WSREP: Shifting JOINER -> OPEN (TO: 6794249)
  103. 130506 11:47:34 [Note] WSREP: Received self-leave message.
  104. 130506 11:47:34 [Note] WSREP: Flow-control interval: [0, 0]
  105. 130506 11:47:34 [Note] WSREP: Received SELF-LEAVE. Closing connection.
  106. 130506 11:47:34 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 6794249)
  107. 130506 11:47:34 [Note] WSREP: RECV thread exiting 0: Success
  108. 130506 11:47:34 [Note] WSREP: recv_thread() joined.
  109. 130506 11:47:34 [Note] WSREP: Closing slave action queue.
  110. 130506 11:47:34 [Note] WSREP: Service disconnected.
  111. 130506 11:47:34 [Note] WSREP: rollbacker thread exiting
  112. 130506 11:47:35 [Note] WSREP: Some threads may fail to exit.
  113. 130506 11:47:35 [Note] /opt/mysql-galera/bin/mysqld: Shutdown complete
  114.  
  115. Error in my_thread_global_end(): 2 threads didn't exit
  116. 130506 11:47:40 mysqld_safe mysqld from pid file /opt/mysql-galera/data/mysqld.pid ended
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!