Advertisement
Guest User

123

a guest
Aug 27th, 2015
38
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 10.61 KB | None | 0 0
  1. 2015-08-26T20:28:24.964587+00:00 node-3 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-3.domain.tld, call=124, rc=1, cib-update=189, confirmed=true)
  2. 2015-08-26T20:28:37.150895+00:00 node-3 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-3.domain.tld, call=134, rc=1, cib-update=199, confirmed=true)
  3. 2015-08-26T20:29:18.601567+00:00 node-3 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_27000: master (node=node-3.domain.tld, call=142, rc=8, cib-update=206, confirmed=false)
  4. 2015-08-26T20:32:50.124800+00:00 node-1 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-1.domain.tld, call=117, rc=1, cib-update=177, confirmed=true)
  5. 2015-08-26T20:33:02.477838+00:00 node-1 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-1.domain.tld, call=126, rc=1, cib-update=187, confirmed=true)
  6. 2015-08-26T20:33:44.323605+00:00 node-1 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_27000: master (node=node-1.domain.tld, call=134, rc=8, cib-update=194, confirmed=false)
  7. 2015-08-26T20:54:41.703012+00:00 node-5 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-5.domain.tld, call=42, rc=1, cib-update=17, confirmed=true)
  8. 2015-08-26T20:54:45.847586+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-4.domain.tld, call=42, rc=1, cib-update=17, confirmed=true)
  9. 2015-08-26T20:59:39.219736+00:00 node-6 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-6.domain.tld, call=42, rc=1, cib-update=17, confirmed=true)
  10. 2015-08-26T20:59:52.830294+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-7.domain.tld, call=42, rc=1, cib-update=17, confirmed=true)
  11. 2015-08-26T21:03:45.817318+00:00 node-5 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-5.domain.tld, call=165, rc=1, cib-update=134, confirmed=true)
  12. 2015-08-26T21:03:49.373904+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: ok (node=node-4.domain.tld, call=167, rc=0, cib-update=136, confirmed=true)
  13. 2015-08-26T21:04:26.933806+00:00 node-5 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-5.domain.tld, call=170, rc=0, cib-update=137, confirmed=false)
  14. 2015-08-26T21:04:27.123635+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-4.domain.tld, call=172, rc=0, cib-update=137, confirmed=false)
  15. 2015-08-26T21:04:32.293742+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-4.domain.tld, call=173, rc=0, cib-update=138, confirmed=false)
  16. 2015-08-26T21:04:33.551673+00:00 node-5 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-5.domain.tld, call=171, rc=0, cib-update=138, confirmed=false)
  17. 2015-08-26T21:06:49.896498+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: unknown error (node=node-7.domain.tld, call=159, rc=1, cib-update=131, confirmed=true)
  18. 2015-08-26T21:06:53.418645+00:00 node-6 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_0: ok (node=node-6.domain.tld, call=164, rc=0, cib-update=135, confirmed=true)
  19. 2015-08-26T21:07:29.081600+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-7.domain.tld, call=164, rc=0, cib-update=134, confirmed=false)
  20. 2015-08-26T21:07:30.270409+00:00 node-6 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-6.domain.tld, call=169, rc=0, cib-update=136, confirmed=false)
  21. 2015-08-26T21:07:34.695023+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-7.domain.tld, call=165, rc=0, cib-update=135, confirmed=false)
  22. 2015-08-26T21:07:35.842928+00:00 node-6 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-6.domain.tld, call=170, rc=0, cib-update=137, confirmed=false)
  23. 2015-08-27T11:12:18.039325+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: unknown error (node=node-4.domain.tld, call=172, rc=1, cib-update=303, confirmed=false)
  24. 2015-08-27T11:13:11.047214+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: unknown error (node=node-4.domain.tld, call=173, rc=1, cib-update=313, confirmed=false)
  25. 2015-08-27T11:16:28.553113+00:00 node-6 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: unknown error (node=node-6.domain.tld, call=170, rc=1, cib-update=283, confirmed=false)
  26. 2015-08-27T11:16:29.394778+00:00 node-6 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: unknown error (node=node-6.domain.tld, call=169, rc=1, cib-update=284, confirmed=false)
  27.  
  28. ^^ the last one for the node-6, but cannot be seen in the output of "crm_mon -fotAW -1"
  29.  
  30. pacemaker Failed actions:
  31. p_neutron-l3-agent_monitor_20000 on node-1.domain.tld 'unknown error' (1): call=191, status=Timed Out, last-rc-change='Thu Aug 27 11:16:14 2015', queued=0ms, exec=0ms
  32. p_mysql_monitor_60000 on node-1.domain.tld 'unknown error' (1): call=147, status=complete, last-rc-change='Thu Aug 27 11:17:15 2015', queued=0ms, exec=0ms
  33. p_neutron-dhcp-agent_monitor_20000 on node-1.domain.tld 'unknown error' (1): call=183, status=Timed Out, last-rc-change='Thu Aug 27 11:16:15 2015', queued=0ms, exec=0ms
  34. p_neutron-plugin-openvswitch-agent_monitor_20000 on node-6.domain.tld 'unknown error' (1): call=192, status=Timed Out, last-rc-change='Thu Aug 27 11:16:21 2015', queued=0ms, exec=0ms
  35. p_neutron-l3-agent_monitor_20000 on node-6.domain.tld 'not running' (7): call=359, status=complete, last-rc-change='Thu Aug 27 13:39:46 2015', queued=0ms, exec=0ms
  36. p_mysql_monitor_60000 on node-6.domain.tld 'unknown error' (1): call=181, status=complete, last-rc-change='Thu Aug 27 11:17:22 2015', queued=0ms, exec=0ms
  37. p_mysql_start_0 on node-7.domain.tld 'unknown error' (1): call=305, status=Timed Out, last-rc-change='Thu Aug 27 11:17:03 2015', queued=0ms, exec=300003ms
  38.  
  39.  
  40. (continuation of logs)
  41. 2015-08-27T11:16:39.767950+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: unknown error (node=node-7.domain.tld, call=292, rc=1, cib-update=326, confirmed=false)
  42. 2015-08-27T11:16:40.536918+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: unknown error (node=node-7.domain.tld, call=293, rc=1, cib-update=327, confirmed=false)
  43. 2015-08-27T11:21:41.336279+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-4.domain.tld, call=316, rc=0, cib-update=407, confirmed=false)
  44. 2015-08-27T11:21:42.491269+00:00 node-3 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_27000: ok (node=node-3.domain.tld, call=141, rc=0, cib-update=84, confirmed=false)
  45. 2015-08-27T11:21:42.997355+00:00 node-5 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-5.domain.tld, call=353, rc=0, cib-update=375, confirmed=false)
  46. 2015-08-27T11:21:46.671476+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-4.domain.tld, call=317, rc=0, cib-update=408, confirmed=false)
  47. 2015-08-27T11:21:49.238622+00:00 node-5 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-5.domain.tld, call=354, rc=0, cib-update=376, confirmed=false)
  48. 2015-08-27T11:23:46.663496+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-7.domain.tld, call=315, rc=0, cib-update=343, confirmed=false)
  49. 2015-08-27T11:23:52.412143+00:00 node-7 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-7.domain.tld, call=316, rc=0, cib-update=344, confirmed=false)
  50. 2015-08-27T11:25:04.337563+00:00 node-3 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-3.domain.tld, call=162, rc=0, cib-update=92, confirmed=false)
  51. 2015-08-27T11:25:04.817076+00:00 node-5 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_27000: master (node=node-5.domain.tld, call=374, rc=8, cib-update=383, confirmed=false)
  52. 2015-08-27T11:25:09.955515+00:00 node-3 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-3.domain.tld, call=163, rc=0, cib-update=93, confirmed=false)
  53. 2015-08-27T11:25:18.286463+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: unknown error (node=node-4.domain.tld, call=317, rc=1, cib-update=419, confirmed=false)
  54. 2015-08-27T11:26:06.004966+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_103000: ok (node=node-4.domain.tld, call=341, rc=0, cib-update=427, confirmed=false)
  55. 2015-08-27T11:26:12.393274+00:00 node-4 crmd notice: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: ok (node=node-4.domain.tld, call=342, rc=0, cib-update=428, confirmed=false)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement