Advertisement
Guest User

mysqld-f1-grand-prix

a guest
May 4th, 2016
47
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 3.54 KB | None | 0 0
  1. ocf ra log:
  2. May 4 10:11:35 n2 ocf-mysql-wss: INFO: p_mysql: mysql_start(): Starting MySQL
  3.  
  4. mysql log:
  5. 160504 10:11:36 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
  6. 160504 10:11:39 [Note] WSREP: Waiting for SST to complete.
  7. 160504 10:12:04 [Note] WSREP: Requesting state transfer: success after 26 tries, donor: 0
  8. WSREP_SST: [INFO] NOTE: Joiner-Recv-gtid took 25 seconds (20160504 10:12:04.984)
  9. WSREP_SST: [INFO] Proceeding with SST (20160504 10:12:04.988)
  10. WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20160504 10:12:04.989)
  11. removed '/var/lib/mysql/ib_logfile0'
  12. removed '/var/lib/mysql/ib_logfile1'
  13. removed '/var/lib/mysql/ibdata1'
  14. WSREP_SST: [INFO] Waiting for SST streaming to complete! (20160504 10:12:05.030)
  15.  
  16. ocf ra log:
  17. May 4 10:12:05 n2 ocf-mysql-wss: INFO: p_mysql: check_if_sst(): SST is in progress
  18. May 4 10:12:05 n2 ocf-mysql-wss: INFO: p_mysql: mysql_start(): MySQL started
  19. May 4 10:12:06 n2 crmd[154]: notice: process_lrm_event: Operation p_mysql_start_0: ok (node=n2, call=15, rc=0, cib-update=26, confirmed=true)
  20.  
  21. (a broken logic, it fails to detect an SST without a pidfile created, restarts mysql and races to the SST in progress)
  22. May 4 10:12:12 n2 ocf-mysql-wss: ERROR: p_mysql: mysql_status(): MySQL is not running
  23. May 4 10:12:12 n2 ocf-mysql-wss: INFO: p_mysql: check_if_sst(): SST is in progress
  24. May 4 10:12:12 n2 ocf-mysql-wss: WARNING: p_mysql: mysql_monitor(): found and purged a stale sst_in_progress file
  25. May 4 10:12:12 n2 crmd[154]: notice: process_lrm_event: Operation p_mysql_monitor_60000: not running (node=n2, call=16, rc=7, cib-update=27, confirmed=false)
  26. May 4 10:12:12 n2 ocf-mysql-wss: INFO: p_mysql: mysql_stop(): MySQL is not running
  27. May 4 10:12:12 n2 crmd[154]: notice: process_lrm_event: Operation p_mysql_stop_0: ok (node=n2, call=18, rc=0, cib-update=28, confirmed=true)
  28. May 4 10:12:29 n2 ocf-mysql-wss: INFO: p_mysql: mysql_start(): Starting MySQL
  29.  
  30. mysql log (sst's in progress since 10:11:36):
  31. 160504 10:12:29 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
  32. 160504 10:12:31 [ERROR] WSREP: gcs connect failed: Address already in use
  33. 160504 10:12:31 [ERROR] Aborting
  34. 160504 10:12:32 [Note] /usr/sbin/mysqld: Shutdown complete
  35.  
  36. (a racing one continues and fails as well)
  37. WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/mysql/my.cnf --defaults-group=mysqld --no-version-check --move-back --force-non-empty-directories ${DATA} &>${DATA}/innobackup.move.log (20160504 10:12:37.446)
  38. WSREP_SST: [ERROR] Cleanup after exit with status:1 (20160504 10:12:37.450)
  39. 160504 10:12:37 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '10.10.10.3' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --defaults-group-suffix '' --parent '2437' --binlog '/var/lib/mysql/mysql-bin' : 1 (Operation not permitted)
  40. 160504 10:12:37 [ERROR] WSREP: Failed to read uuid:seqno from joiner script.
  41. 160504 10:12:37 [ERROR] WSREP: SST failed: 1 (Operation not permitted)
  42. 160504 10:12:37 [ERROR] Aborting
  43.  
  44. ...because of the /var/lib/mysql/.sst/innobackup.move.log:
  45. 160504 10:12:37 innobackupex: Starting the move-back operation
  46.  
  47. IMPORTANT: Please check that the move-back run completes successfully.
  48. At the end of a successful move-back run innobackupex
  49. prints "completed OK!".
  50.  
  51. innobackupex version 2.3.4 based on MySQL server 5.6.24 Linux (x86_64) (revision id: e80c779)
  52. Error: Move file ib_logfile0 to /var/lib/mysql/ib_logfile0 failed: Destination file exists
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement