API tools faq
paste
Advertisement
Guest User

Untitled

a guest
May 1st, 2017
199
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.51 KB | None | 0 0
raw download clone embed print report
  1. Feb 4 12:31:23 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: mysql-master:monitor process (PID 21648) timed out (try 1). Killing with signal SIGTERM (15).
  2.  
  3.  
  4.  
  5.  
  6.  
  7.  
  8.  
  9.  
  10.  
  11. Feb 4 12:31:23 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: operation monitor[36] on ocf::mysql::mysql-master for client 12623, its parameters: CRM_meta_interval=[10000] socket=[/tmp/mysql-acd-test.sock] test_passwd=[testcluster] binary=[/packages/11.1/mysql/libexec/mysqld] group=[mysql] additional_parameters=[--skip-external-locking] test_user=[clustertestuser] CRM_meta_timeout=[10000] crm_feature_set=[3.0.1] pid=[/packages/11.1/mysql/var/INACD-DB-SVR1-TEST.pid] test_table=[ACD_Configuration.ACD_Mandator] user=[mysql] CRM_meta_name=[monitor] config=[/packages/11.1: pid [21648] timed out
  12. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: ERROR: process_lrm_event: LRM operation mysql-master_monitor_10000 (36) Timed Out (timeout=10000ms)
  13. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: info: process_graph_event: Action mysql-master_monitor_10000/15 (2:-2;15:88:0:dbd63ebb-5656-4cf3-b4bd-0745c1a59954) initiated by a different transitioner
  14. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: info: abort_transition_graph: process_graph_event:456 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=mysql-master_monitor_10000, magic=2:-2;15:88:0:dbd63ebb-5656-4cf3-b4bd-0745c1a59954, cib=0.56.19) : Foreign event
  15. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: WARN: update_failcount: Updating failcount for mysql-master on INACD-DB-SVR1-TEST after failed monitor: rc=-2 (update=value++, time=1265283083)
  16. Feb 4 12:31:23 INACD-DB-SVR1-TEST attrd: [12621]: info: attrd_local_callback: Expanded fail-count-mysql-master=value++ to 1
  17. Feb 4 12:31:23 INACD-DB-SVR1-TEST attrd: [12621]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-mysql-master (1)
  18. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
  19. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
  20. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: info: do_pe_invoke: Query 115: Requesting the current CIB: S_POLICY_ENGINE
  21.  
  22.  
  23.  
  24.  
  25.  
  26.  
  27.  
  28.  
  29.  
  30.  
  31.  
  32.  
  33.  
  34.  
  35.  
  36. Feb 4 12:31:23 INACD-DB-SVR1-TEST attrd: [12621]: info: attrd_perform_update: Sent update 174: fail-count-mysql-master=1
  37. Feb 4 12:31:23 INACD-DB-SVR1-TEST attrd: [12621]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-mysql-master (1265283083)
  38. Feb 4 12:31:23 INACD-DB-SVR1-TEST crmd: [12623]: info: do_pe_invoke_callback: Invoking the PE: query=115, ref=pe_calc-dc-1265283083-40, seq=108, quorate=1
  39. Feb 4 12:31:23 INACD-DB-SVR1-TEST pengine: [12622]: notice: unpack_config: On loss of CCM Quorum: Ignore
  40. Feb 4 12:32:33 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: mysql-slave-ip:monitor process (PID 21858) timed out (try 1). Killing with signal SIGTERM (15).
  41. Feb 4 12:33:37 INACD-DB-SVR1-TEST pengine: [12622]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
  42. Feb 4 12:33:37 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 63940 ms (> 100 ms) before being called (GSource: 0x618570)
  43. Feb 4 12:33:37 INACD-DB-SVR1-TEST pengine: [12622]: info: determine_online_status: Node INACD-DB-SVR1-TEST is online
  44. Feb 4 12:33:37 INACD-DB-SVR1-TEST attrd: [12621]: info: attrd_perform_update: Sent update 176: last-failure-mysql-master=1265283083
  45. Feb 4 12:33:37 INACD-DB-SVR1-TEST lrmd: [12620]: info: G_SIG_dispatch: started at 1718474780 should have started at 1718468386
  46. Feb 4 12:33:37 INACD-DB-SVR1-TEST pengine: [12622]: WARN: unpack_rsc_op: Processing failed op mysql-master_monitor_10000 on INACD-DB-SVR1-TEST: unknown exec error (-2)
  47. Feb 4 12:33:37 INACD-DB-SVR1-TEST crmd: [12623]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=INACD-DB-SVR1-TEST, magic=NA, cib=0.56.20) : Transient attribute: update
  48. Feb 4 12:33:37 INACD-DB-SVR1-TEST pengine: [12622]: info: determine_online_status: Node INACD-DB-SVR2-TEST is online
  49. Feb 4 12:34:00 INACD-DB-SVR1-TEST mysql[22526]: INFO: MySQL monitor succeded
  50. Feb 4 12:34:02 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: mysql-slave-ip:monitor process (PID 22577) timed out (try 1). Killing with signal SIGTERM (15).
  51. Feb 4 12:34:22 INACD-DB-SVR1-TEST crmd: [12623]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=INACD-DB-SVR1-TEST, magic=NA, cib=0.56.21) : Transient attribute: update
  52. Feb 4 12:34:22 INACD-DB-SVR1-TEST pengine: [12622]: notice: native_print: mysql-master (ocf::dk:mysql): Started INACD-DB-SVR1-TEST FAILED
  53. Feb 4 12:34:22 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 19650 ms (> 100 ms) before being called (GSource: 0x618570)
  54. Feb 4 12:34:22 INACD-DB-SVR1-TEST pengine: [12622]: notice: native_print: mysql-master-ip (ocf::dk:IPaddr2): Started INACD-DB-SVR1-TEST
  55. Feb 4 12:34:22 INACD-DB-SVR1-TEST lrmd: [12620]: info: G_SIG_dispatch: started at 1718479255 should have started at 1718477290
  56. Feb 4 12:34:22 INACD-DB-SVR1-TEST pengine: [12622]: notice: native_print: mysql-slave (ocf::dk:mysql): Started INACD-DB-SVR2-TEST
  57. Feb 4 12:34:22 INACD-DB-SVR1-TEST crmd: [12623]: info: do_pe_invoke: Query 116: Requesting the current CIB: S_POLICY_ENGINE
  58. Feb 4 12:34:22 INACD-DB-SVR1-TEST pengine: [12622]: notice: native_print: mysql-slave-ip (ocf::dk:IPaddr2): Started INACD-DB-SVR1-TEST
  59. Feb 4 12:34:22 INACD-DB-SVR1-TEST cib: [12619]: info: cib_stats: Processed 196 operations (2091.00us average, 0% utilization) in the last 10min
  60. Feb 4 12:34:22 INACD-DB-SVR1-TEST lrmd: [12620]: info: RA output: (mysql-master:monitor:stderr) 2010/02/04_12:34:22 INFO: MySQL monitor succeded
  61. Feb 4 12:35:29 INACD-DB-SVR1-TEST pengine: [12622]: notice: clone_print: Clone Set: cl-pingd
  62. Feb 4 12:35:29 INACD-DB-SVR1-TEST crmd: [12623]: info: do_pe_invoke: Query 117: Requesting the current CIB: S_POLICY_ENGINE
  63. Feb 4 12:35:29 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 66810 ms (> 100 ms) before being called (GSource: 0x618570)
  64. Feb 4 12:35:29 INACD-DB-SVR1-TEST pengine: [12622]: notice: short_print: Started: [ INACD-DB-SVR1-TEST INACD-DB-SVR2-TEST ]
  65. Feb 4 12:35:29 INACD-DB-SVR1-TEST lrmd: [12620]: info: G_SIG_dispatch: started at 1718485950 should have started at 1718479269
  66. Feb 4 12:35:29 INACD-DB-SVR1-TEST pengine: [12622]: notice: native_print: apcstonith-INACD-DB-SVR2-TEST (stonith:apcmastersnmp): Started INACD-DB-SVR1-TEST
  67. Feb 4 12:35:29 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: perform_ra_op: the operation operation monitor[36] on ocf::mysql::mysql-master for client 12623, its parameters: CRM_meta_interval=[10000] socket=[/tmp/mysql-acd-test.sock] test_passwd=[testcluster] binary=[/packages/11.1/mysql/libexec/mysqld] group=[mysql] additional_parameters=[--skip-external-locking] test_user=[clustertestuser] CRM_meta_timeout=[10000] crm_feature_set=[3.0.1] pid=[/packages/11.1/mysql/var/INACD-DB-SVR1-TEST.pid] test_table=[ACD_Configuration.ACD_Mandator] user=[mysql] CRM_meta_name=[monitor] config=[/packages/11.1 stayed in operation list for 101690 ms (longer than 10000 ms)
  68. Feb 4 12:35:29 INACD-DB-SVR1-TEST pengine: [12622]: notice: native_print: apcstonith-INACD-DB-SVR1-TEST (stonith:apcmastersnmp): Started INACD-DB-SVR1-TEST
  69. Feb 4 12:35:29 INACD-DB-SVR1-TEST crmd: [12623]: info: do_pe_invoke_callback: Invoking the PE: query=117, ref=pe_calc-dc-1265283329-41, seq=108, quorate=1
  70. Feb 4 12:39:01 INACD-DB-SVR1-TEST sshd[23376]: Accepted publickey for root from 172.16.0.20 port 56065 ssh2
  71. Feb 4 12:41:06 INACD-DB-SVR1-TEST pengine: [12622]: info: get_failcount: cl-pingd has failed 1 times on INACD-DB-SVR1-TEST
  72. Feb 4 12:41:06 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 336850 ms (> 300 ms) (GSource: 0x618570)
  73. Feb 4 12:41:06 INACD-DB-SVR1-TEST pengine: [12622]: notice: RecurringOp: Start recurring monitor (10s) for mysql-master on INACD-DB-SVR1-TEST
  74. Feb 4 12:41:06 INACD-DB-SVR1-TEST pengine: [12622]: notice: RecurringOp: Start recurring monitor (180s) for mysql-master on INACD-DB-SVR1-TEST
  75. Feb 4 12:41:06 INACD-DB-SVR1-TEST lrmd: [12620]: info: perform_op:2873: operations on resource mysql-master already delayed
  76. Feb 4 12:41:06 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Recover resource mysql-master (Started INACD-DB-SVR1-TEST)
  77. Feb 4 12:41:06 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Leave resource mysql-master-ip (Started INACD-DB-SVR1-TEST)
  78. Feb 4 12:41:07 INACD-DB-SVR1-TEST mysql[24091]: INFO: MySQL monitor succeded
  79. Feb 4 12:41:16 INACD-DB-SVR1-TEST lrmd: [12620]: info: perform_op:2873: operations on resource mysql-master already delayed
  80. Feb 4 12:41:51 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Leave resource mysql-slave (Started INACD-DB-SVR2-TEST)
  81. Feb 4 12:41:51 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Leave resource mysql-slave-ip (Started INACD-DB-SVR1-TEST)
  82. Feb 4 12:41:51 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Leave resource pingd:0 (Started INACD-DB-SVR1-TEST)
  83. Feb 4 12:41:51 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Leave resource pingd:1 (Started INACD-DB-SVR2-TEST)
  84. Feb 4 12:41:51 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Leave resource apcstonith-INACD-DB-SVR2-TEST (Started INACD-DB-SVR1-TEST)
  85. Feb 4 12:41:51 INACD-DB-SVR1-TEST pengine: [12622]: notice: LogActions: Leave resource apcstonith-INACD-DB-SVR1-TEST (Started INACD-DB-SVR1-TEST)
  86. Feb 4 12:41:51 INACD-DB-SVR1-TEST lrmd: [12620]: info: RA output: (mysql-master:monitor:stderr) 2010/02/04_12:41:51 INFO: MySQL monitor succeded
  87. Feb 4 12:41:51 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: perform_ra_op: the operation operation monitor[36] on ocf::mysql::mysql-master for client 12623, its parameters: CRM_meta_interval=[10000] socket=[/tmp/mysql-acd-test.sock] test_passwd=[testcluster] binary=[/packages/11.1/mysql/libexec/mysqld] group=[mysql] additional_parameters=[--skip-external-locking] test_user=[clustertestuser] CRM_meta_timeout=[10000] crm_feature_set=[3.0.1] pid=[/packages/11.1/mysql/var/INACD-DB-SVR1-TEST.pid] test_table=[ACD_Configuration.ACD_Mandator] user=[mysql] CRM_meta_name=[monitor] config=[/packages/11.1 stayed in operation list for 34410 ms (longer than 10000 ms)
  88. Feb 4 12:42:13 INACD-DB-SVR1-TEST crmd: [12623]: info: handle_response: pe_calc calculation pe_calc-dc-1265283083-40 is obsolete
  89. Feb 4 12:42:32 INACD-DB-SVR1-TEST pengine: [12622]: info: process_pe_message: Transition 4: PEngine Input stored in: /var/lib/pengine/pe-input-34.bz2
  90. Feb 4 12:44:22 INACD-DB-SVR1-TEST cib: [12619]: info: cib_stats: Processed 1 operations (10000.00us average, 0% utilization) in the last 10min
  91. Feb 4 12:45:31 INACD-DB-SVR1-TEST lrmd: [12620]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 220670 ms (> 300 ms) (GSource: 0x618570)
  92. Feb 4 12:45:31 INACD-DB-SVR1-TEST pengine: [12622]: notice: unpack_config: On loss of CCM Quorum: Ignore
  93. Feb 4 12:45:32 INACD-DB-SVR1-TEST lrmd: [12620]: info: perform_op:2873: operations on resource mysql-master already delayed
  94. Feb 4 12:45:32 INACD-DB-SVR1-TEST pengine: [12622]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
  95. Feb 4 12:45:32 INACD-DB-SVR1-TEST pengine: [12622]: info: determine_online_status: Node INACD-DB-SVR1-TEST is online
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!