Advertisement
Guest User

Untitled

a guest
Aug 29th, 2013
106
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 46.99 KB | None | 0 0
  1. 2013-08-29 13:50:00-0700 [] INFO: Log opened.
  2. 2013-08-29 13:50:00-0700 [] INFO: twistd 10.2.0 (/usr/bin/python2.6 2.6.6) starting up.
  3. 2013-08-29 13:50:00-0700 [] INFO: reactor class: twisted.internet.selectreactor.SelectReactor.
  4. 2013-08-29 13:50:00-0700 [] INFO: set uid/gid 496/491
  5. 2013-08-29 13:50:00-0700 [] INFO: Logging level set to 'info'
  6. 2013-08-29 13:50:00-0700 [] INFO: OpsCenter version: 3.2.1
  7. 2013-08-29 13:50:00-0700 [] INFO: Compatible agent version: 3.2.1
  8. 2013-08-29 13:50:00-0700 [] INFO: Cluster config dir '/etc/opscenter/clusters' does not exist yet
  9. 2013-08-29 13:50:00-0700 [] INFO: No clusters are configured yet, checking to see if a config migration is needed
  10. 2013-08-29 13:50:00-0700 [] INFO: Main config does not appear to include a cluster configuration, skipping migration
  11. 2013-08-29 13:50:00-0700 [] INFO: Cluster config dir '/etc/opscenter/clusters' does not exist yet
  12. 2013-08-29 13:50:00-0700 [] INFO: No clusters are configured
  13. 2013-08-29 13:50:00-0700 [] INFO: HTTP BASIC authentication disabled
  14. 2013-08-29 13:50:00-0700 [] INFO: Starting webserver with ssl disabled.
  15. 2013-08-29 13:50:00-0700 [] INFO: SSL disabled
  16. 2013-08-29 13:50:00-0700 [] INFO: opscenterd.WebServer.OpsCenterdWebServer starting on 8888
  17. 2013-08-29 13:50:00-0700 [] INFO: Starting factory <opscenterd.WebServer.OpsCenterdWebServer instance at 0x33e0cb0>
  18. 2013-08-29 13:50:00-0700 [] INFO: morbid.morbid.StompFactory starting on 61619
  19. 2013-08-29 13:50:00-0700 [] INFO: Starting factory <morbid.morbid.StompFactory instance at 0x340b2d8>
  20. 2013-08-29 13:50:00-0700 [] INFO: Configuring agent communication with ssl support disabled.
  21. 2013-08-29 13:50:00-0700 [] INFO: morbid.morbid.StompFactory starting on 61620
  22. 2013-08-29 13:50:00-0700 [] INFO: OS Version: Linux version 2.6.39-400.109.1.el6uek.x86_64 (mockbuild@ca-build44.us.oracle.com) (gcc version 4.4.6 20110731 (Red Hat 4.4.6-3) (GCC) ) #1 SMP Tue Jun 4 23:21:51 PDT 2013
  23. 2013-08-29 13:50:00-0700 [] INFO: CPU Info: ['2261.000', '2261.000']
  24. 2013-08-29 13:50:00-0700 [] INFO: Mem Info: 16082MB
  25. 2013-08-29 13:50:00-0700 [] INFO: Package Manager: Unknown
  26. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/2101500611/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  27. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/2101500611/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  28. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1155346281/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  29. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/822552770/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  30. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/822552770/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  31. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1155346281/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  32. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1563724407/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  33. 2013-08-29 13:51:02-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1563724407/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  34. 2013-08-29 13:51:03-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1658963265/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  35. 2013-08-29 13:51:03-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1658963265/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  36. 2013-08-29 13:51:04-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/2101500611/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  37. 2013-08-29 13:51:04-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/822552770/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  38. 2013-08-29 13:51:04-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1155346281/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  39. 2013-08-29 13:51:04-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1563724407/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  40. 2013-08-29 13:51:05-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1658963265/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  41. 2013-08-29 13:51:08-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/2101500611/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  42. 2013-08-29 13:51:08-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/822552770/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  43. 2013-08-29 13:51:08-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1155346281/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  44. 2013-08-29 13:51:08-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1563724407/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  45. 2013-08-29 13:51:09-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1658963265/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  46. 2013-08-29 13:51:16-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/2101500611/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  47. 2013-08-29 13:51:16-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/822552770/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  48. 2013-08-29 13:51:16-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1155346281/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  49. 2013-08-29 13:51:16-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1563724407/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  50. 2013-08-29 13:51:17-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1658963265/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  51. 2013-08-29 13:51:50-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/497857918/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  52. 2013-08-29 13:51:50-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/497857918/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  53. 2013-08-29 13:51:50-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1315149865/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  54. 2013-08-29 13:51:50-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1315149865/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  55. 2013-08-29 13:51:51-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1425281323/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  56. 2013-08-29 13:51:51-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1425281323/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  57. 2013-08-29 13:51:51-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1320920931/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  58. 2013-08-29 13:51:51-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1320920931/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  59. 2013-08-29 13:51:51-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1164062347/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  60. 2013-08-29 13:51:51-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1164062347/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  61. 2013-08-29 13:51:52-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/497857918/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  62. 2013-08-29 13:51:52-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1315149865/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  63. 2013-08-29 13:51:53-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1425281323/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  64. 2013-08-29 13:51:53-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1320920931/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  65. 2013-08-29 13:51:53-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1164062347/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  66. 2013-08-29 13:51:54-0700 [] INFO: Starting factory <opscenterd.ThriftService.NoReconnectCassandraClientFactory instance at 0x2e9fb00>
  67. 2013-08-29 13:51:54-0700 [] INFO: Adding new cluster 'prod': {u'jmx': {u'username': u'', u'password': u'', u'port': u'7199'}, 'kerberos_client_principals': {}, 'kerberos': {}, u'agents': {}, 'kerberos_hostnames': {}, 'kerberos_services': {}, u'cassandra': {u'username': u'', u'seed_hosts': u'172.29.50.27,172.29.50.28,172.29.50.29,172.29.50.30,172.29.50.31', u'api_port': u'9160', u'password': u''}}
  68. 2013-08-29 13:51:54-0700 [] INFO: Starting new cluster services for prod
  69. 2013-08-29 13:51:54-0700 [prod] INFO: Starting services for cluster prod
  70. 2013-08-29 13:51:54-0700 [] INFO: Metric caching enabled with 50 points and 1000 metrics cached
  71. 2013-08-29 13:51:54-0700 [] INFO: Starting PushService
  72. 2013-08-29 13:51:54-0700 [prod] INFO: Starting CassandraCluster service
  73. 2013-08-29 13:51:54-0700 [prod] INFO: agent_config items: {'cassandra_log_location': '/var/log/cassandra/system.log', 'thrift_port': 9160, 'thrift_ssl_truststore': None, 'rollups300_ttl': 2419200, 'rollups86400_ttl': -1, 'jmx_port': 7199, 'metrics_ignored_solr_cores': '', 'api_port': '61621', 'metrics_enabled': 1, 'thrift_ssl_truststore_type': 'JKS', 'kerberos_use_ticket_cache': True, 'kerberos_renew_tgt': True, 'rollups60_ttl': 604800, 'cassandra_install_location': '', 'rollups7200_ttl': 31536000, 'kerberos_debug': False, 'storage_keyspace': 'OpsCenter', 'ec2_metadata_api_host': '169.254.169.254', 'provisioning': 0, 'kerberos_use_keytab': True, 'metrics_ignored_column_families': '', 'thrift_ssl_truststore_password': None, 'metrics_ignored_keyspaces': 'system, system_traces, system_auth, dse_auth, OpsCenter'}
  74. 2013-08-29 13:51:54-0700 [] INFO: Stopping factory <opscenterd.ThriftService.NoReconnectCassandraClientFactory instance at 0x2e9fb00>
  75. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 1 pending requests. Expected candidate node retry in 0.1 seconds.)
  76. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 1 pending requests. Expected candidate node retry in 0.1 seconds.)
  77. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 1 pending requests. Expected candidate node retry in 0.1 seconds.)
  78. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 1 pending requests. Expected candidate node retry in 0.1 seconds.)
  79. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 1 pending requests. Expected candidate node retry in 0.1 seconds.)
  80. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  81. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  82. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  83. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  84. 2013-08-29 13:51:54-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  85. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  86. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  87. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  88. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  89. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  90. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  91. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  92. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  93. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  94. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  95. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  96. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  97. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  98. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  99. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  100. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  101. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  102. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  103. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  104. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  105. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  106. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  107. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  108. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  109. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  110. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  111. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  112. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  113. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  114. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  115. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.6 seconds.)
  116. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.6 seconds.)
  117. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.6 seconds.)
  118. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.6 seconds.)
  119. 2013-08-29 13:51:55-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.6 seconds.)
  120. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  121. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  122. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  123. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  124. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  125. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  126. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  127. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  128. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  129. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  130. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  131. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  132. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  133. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  134. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  135. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.6 seconds.)
  136. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.5 seconds.)
  137. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.5 seconds.)
  138. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.5 seconds.)
  139. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.5 seconds.)
  140. 2013-08-29 13:51:56-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/497857918/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  141. 2013-08-29 13:51:56-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1315149865/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  142. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.1 seconds.)
  143. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.1 seconds.)
  144. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.1 seconds.)
  145. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.1 seconds.)
  146. 2013-08-29 13:51:56-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.1 seconds.)
  147. 2013-08-29 13:51:57-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1425281323/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  148. 2013-08-29 13:51:57-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1320920931/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  149. 2013-08-29 13:51:57-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1164062347/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  150. 2013-08-29 13:51:57-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  151. 2013-08-29 13:51:57-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  152. 2013-08-29 13:51:57-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  153. 2013-08-29 13:51:57-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  154. 2013-08-29 13:51:57-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.2 seconds.)
  155. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  156. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  157. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  158. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  159. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.0 seconds.)
  160. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.8 seconds.)
  161. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.8 seconds.)
  162. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.8 seconds.)
  163. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.8 seconds.)
  164. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.8 seconds.)
  165. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.4 seconds.)
  166. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.4 seconds.)
  167. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.4 seconds.)
  168. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.4 seconds.)
  169. 2013-08-29 13:51:58-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.4 seconds.)
  170. 2013-08-29 13:52:00-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.0 seconds.)
  171. 2013-08-29 13:52:00-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.0 seconds.)
  172. 2013-08-29 13:52:00-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.0 seconds.)
  173. 2013-08-29 13:52:00-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.0 seconds.)
  174. 2013-08-29 13:52:00-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.0 seconds.)
  175. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  176. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  177. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  178. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  179. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 0.1 seconds.)
  180. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.2 seconds.)
  181. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.2 seconds.)
  182. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.2 seconds.)
  183. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.2 seconds.)
  184. 2013-08-29 13:52:02-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.2 seconds.)
  185. 2013-08-29 13:52:04-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.6 seconds.)
  186. 2013-08-29 13:52:04-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.6 seconds.)
  187. 2013-08-29 13:52:04-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.6 seconds.)
  188. 2013-08-29 13:52:04-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.6 seconds.)
  189. 2013-08-29 13:52:04-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.6 seconds.)
  190. 2013-08-29 13:52:04-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/497857918/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  191. 2013-08-29 13:52:04-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1315149865/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  192. 2013-08-29 13:52:05-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.30', u'fe80:0:0:0:a6ba:dbff:fe1e:80%2', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1425281323/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  193. 2013-08-29 13:52:05-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.29', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:73%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1320920931/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  194. 2013-08-29 13:52:05-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:59%2', u'172.29.50.27', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/1164062347/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  195. 2013-08-29 13:52:06-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.6 seconds.)
  196. 2013-08-29 13:52:06-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.6 seconds.)
  197. 2013-08-29 13:52:06-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.6 seconds.)
  198. 2013-08-29 13:52:06-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.6 seconds.)
  199. 2013-08-29 13:52:06-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 2.6 seconds.)
  200. 2013-08-29 13:52:08-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 4.0 seconds.)
  201. 2013-08-29 13:52:08-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 4.0 seconds.)
  202. 2013-08-29 13:52:08-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 4.0 seconds.)
  203. 2013-08-29 13:52:08-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 4.0 seconds.)
  204. 2013-08-29 13:52:08-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 4.0 seconds.)
  205. 2013-08-29 13:52:12-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.5 seconds.)
  206. 2013-08-29 13:52:12-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.5 seconds.)
  207. 2013-08-29 13:52:12-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.5 seconds.)
  208. 2013-08-29 13:52:12-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.5 seconds.)
  209. 2013-08-29 13:52:12-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 1.5 seconds.)
  210. 2013-08-29 13:52:14-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 9.9 seconds.)
  211. 2013-08-29 13:52:14-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 9.9 seconds.)
  212. 2013-08-29 13:52:14-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 9.9 seconds.)
  213. 2013-08-29 13:52:14-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 9.9 seconds.)
  214. 2013-08-29 13:52:14-0700 [prod] INFO: (No candidate nodes to expand pool to target size 5 from 0; there are 0 pending requests. Expected candidate node retry in 9.9 seconds.)
  215. 2013-08-29 13:52:20-0700 [] WARN: Unable to find a matching cluster for node with IP [u'fe80:0:0:0:a6ba:dbff:fe1e:8d%2', u'172.29.50.31', u'0:0:0:0:0:0:0:1%1', u'127.0.0.1']; the message was [u'3.2.1', u'/497857918/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  216. 2013-08-29 13:52:20-0700 [] WARN: Unable to find a matching cluster for node with IP [u'172.29.50.28', u'0:0:0:0:0:0:0:1%1', u'fe80:0:0:0:a6ba:dbff:fe1e:66%2', u'127.0.0.1']; the message was [u'3.2.1', u'/1315149865/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  217. 2013-08-29 13:52:20-0700 [] INFO: Received SIGTERM, shutting down.
  218. 2013-08-29 13:52:20-0700 [prod] INFO: Stopping CassandraCluster service
  219. 2013-08-29 13:52:20-0700 [] INFO: (TCP Port 61620 Closed)
  220. 2013-08-29 13:52:20-0700 [] INFO: (TCP Port 61619 Closed)
  221. 2013-08-29 13:52:20-0700 [] INFO: Stopping factory <morbid.morbid.StompFactory instance at 0x340b2d8>
  222. 2013-08-29 13:52:20-0700 [] INFO: (TCP Port 8888 Closed)
  223. 2013-08-29 13:52:20-0700 [] INFO: Stopping factory <opscenterd.WebServer.OpsCenterdWebServer instance at 0x33e0cb0>
  224. 2013-08-29 13:52:20-0700 [] INFO: Main loop terminated.
  225. 2013-08-29 13:52:20-0700 [] INFO: Server Shut Down.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement