Advertisement
Guest User

Untitled

a guest
Aug 24th, 2015
380
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 29.47 KB | None | 0 0
  1. 2015-08-24 23:13:18+0000 [] INFO: Log opened.
  2. 2015-08-24 23:13:18+0000 [] INFO: twistd 10.2.0 (/usr/bin/python2.7 2.7.9) starting up.
  3. 2015-08-24 23:13:18+0000 [] INFO: reactor class: twisted.internet.epollreactor.EPollReactor.
  4. 2015-08-24 23:13:19+0000 [] INFO: set uid/gid 0/0
  5. 2015-08-24 23:13:19+0000 [] INFO: Logging level set to 'info'
  6. 2015-08-24 23:13:19+0000 [] INFO: OpsCenter version: 5.2.0
  7. 2015-08-24 23:13:19+0000 [] INFO: Compatible agent version: 5.2.0
  8. 2015-08-24 23:13:19+0000 [] INFO: Loading per-cluster config file /etc/opscenter/clusters/Test_Cluster.conf
  9. 2015-08-24 23:13:19+0000 [] INFO: Authentication disabled
  10. 2015-08-24 23:13:19+0000 [] INFO: Starting webserver with ssl disabled.
  11. 2015-08-24 23:13:19+0000 [] INFO: Stats Reporter is connected via HTTPS
  12. 2015-08-24 23:13:19+0000 [] INFO: SSL disabled
  13. 2015-08-24 23:13:19+0000 [] INFO: Starting Definition Update Service
  14. 2015-08-24 23:13:19+0000 [] INFO: opscenterd.WebServer.OpsCenterdWebServer starting on 8888
  15. 2015-08-24 23:13:19+0000 [] INFO: Starting factory <opscenterd.WebServer.OpsCenterdWebServer instance at 0x7fa6f3142998>
  16. 2015-08-24 23:13:19+0000 [] INFO: morbid.morbid.StompFactory starting on 61619
  17. 2015-08-24 23:13:19+0000 [] INFO: Starting factory <morbid.morbid.StompFactory instance at 0x7fa6f30a47e8>
  18. 2015-08-24 23:13:19+0000 [] INFO: Starting cluster Test_Cluster
  19. 2015-08-24 23:13:19+0000 [] INFO: Cluster Test_Cluster started
  20. 2015-08-24 23:13:19+0000 [] INFO: Configuring agent communication with ssl support disabled.
  21. 2015-08-24 23:13:19+0000 [] INFO: morbid.morbid.StompFactory starting on 61620
  22. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Starting services for cluster Test_Cluster
  23. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Loading event plugins
  24. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Loading event plugin conf /etc/opscenter/event-plugins/email.conf
  25. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Successfully loaded event plugin conf /etc/opscenter/event-plugins/email.conf
  26. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Loading event plugin conf /etc/opscenter/event-plugins/posturl.conf
  27. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Successfully loaded event plugin conf /etc/opscenter/event-plugins/posturl.conf
  28. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Done loading event plugins
  29. 2015-08-24 23:13:19+0000 [] INFO: Metric caching enabled with 50 points and 1000 metrics cached
  30. 2015-08-24 23:13:19+0000 [] INFO: Starting PushService
  31. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: Starting CassandraCluster service
  32. 2015-08-24 23:13:19+0000 [Test_Cluster] INFO: agent_config items: {'restore_req_update_period': 1, 'cassandra_log_location': '/var/log/cassandra/system.log', 'thrift_port': 9160, 'jmx_pass': '*****', 'rollups86400_ttl': -1, 'ssl_keystore': None, 'max_pending_repairs': 5, 'api_port': '61621', 'use_ssl': 0, 'rollups7200_ttl': 31536000, 'storage_keyspace': 'OpsCenter', 'jmx_operations_pool_size': 4, 'backup_staging_dir': '', 'provisioning': 0, 'metrics_ignored_column_families': '', 'metrics_ignored_keyspaces': 'system, system_traces, system_auth, dse_auth, OpsCenter', 'jmx_user': '', 'cassandra_install_location': '', 'rollups300_ttl': 2419200, 'jmx_port': 7199, 'cassandra_port': 9042, 'metrics_ignored_solr_cores': '', 'metrics_enabled': 1, 'cassandra_pass': '*****', 'rollups60_ttl': 604800, 'ec2_metadata_api_host': '169.254.169.254', 'cassandra_user': '', 'ssl_keystore_password': '*****'}
  33. 2015-08-24 23:13:21+0000 [] INFO: Starting factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f850a248>
  34. 2015-08-24 23:13:21+0000 [] INFO: OS Version: Linux version 3.16.0-4-amd64 (debian-kernel@lists.debian.org) (gcc version 4.8.4 (Debian 4.8.4-1) ) #1 SMP Debian 3.16.7-ckt11-1 (2015-05-24)
  35. 2015-08-24 23:13:21+0000 [] INFO: CPU Info: ['3193.255']
  36. 2015-08-24 23:13:21+0000 [] INFO: Mem Info: 1000MB
  37. 2015-08-24 23:13:21+0000 [] Unhandled Error
  38. Traceback (most recent call last):
  39. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/python/log.py", line 84, in callWithLogger
  40. return callWithContext({"system": lp}, func, *args, **kw)
  41. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/python/log.py", line 69, in callWithContext
  42. return context.call({ILogContext: newCtx}, func, *args, **kw)
  43. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/python/context.py", line 59, in callWithContext
  44. return self.currentContext().callWithContext(ctx, func, *args, **kw)
  45. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/python/context.py", line 37, in callWithContext
  46. return func(*args,**kw)
  47. --- <exception caught here> ---
  48. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/epollreactor.py", line 220, in _doReadOrWrite
  49. why = selectable.doWrite()
  50. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/tcp.py", line 177, in doWrite
  51. return Connection.doWrite(self)
  52. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/tcp.py", line 428, in doWrite
  53. result = abstract.FileDescriptor.doWrite(self)
  54. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/abstract.py", line 208, in doWrite
  55. l = self.writeSomeData(self.dataBuffer)
  56. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/tcp.py", line 181, in writeSomeData
  57. return Connection.writeSomeData(self, data)
  58. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/tcp.py", line 474, in writeSomeData
  59. return self.socket.send(buffer(data, 0, self.SEND_LIMIT))
  60. File "/usr/lib/python2.7/dist-packages/OpenSSL/SSL.py", line 947, in send
  61. raise TypeError("data must be a byte string")
  62. exceptions.TypeError: data must be a byte string
  63.  
  64. 2015-08-24 23:13:22+0000 [] WARN: Trying to download definition file hash https://opscenter.datastax.com:443/definitions/5.2.0/version.md5 resulted in following error: Traceback (most recent call last):
  65. File "/usr/lib/python2.7/dist-packages/opscenterd/Definitions.py", line 130, in getNewHash
  66. ResponseFailed: [<twisted.python.failure.Failure <type 'exceptions.TypeError'>>]
  67.  
  68. 2015-08-24 23:13:25+0000 [] INFO: Starting factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f301c998>
  69. 2015-08-24 23:13:25+0000 [] INFO: Starting factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f756aa70>
  70. 2015-08-24 23:13:25+0000 [] INFO: Stopping factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f850a248>
  71. 2015-08-24 23:13:25+0000 [] INFO: Stopping factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f301c998>
  72. 2015-08-24 23:13:25+0000 [] INFO: Stopping factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f756aa70>
  73. 2015-08-24 23:13:25+0000 [] INFO: Starting factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f779b950>
  74. 2015-08-24 23:13:25+0000 [] INFO: Starting factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f307b3b0>
  75. 2015-08-24 23:13:25+0000 [] INFO: Starting factory <cassandra.io.twistedreactor.TwistedConnectionClientFactory instance at 0x7fa6f6d8b7e8>
  76. 2015-08-24 23:13:26+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was [u'5.2.0', u'/270534081/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  77. 2015-08-24 23:13:26+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was {u'inmemory': None, u'down-nodes': [], u'os-load': 0.59, u'kmip-errors': []}. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  78. 2015-08-24 23:13:26+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was {u'bootstrapping-nodes': {}, u'tasks': {}, u'version': {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}, u'streams': {}, u'mode': u'normal', u'snitch': u'org.apache.cassandra.locator.DynamicEndpointSnitch', u'data-held': None}. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  79. 2015-08-24 23:13:27+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was [u'5.2.0', u'/1556142114/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  80. 2015-08-24 23:13:27+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was {u'os-load': 0.67}. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  81. 2015-08-24 23:13:27+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was {u'inmemory': None, u'down-nodes': [], u'os-load': 0.67, u'kmip-errors': []}. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  82. 2015-08-24 23:13:27+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was {u'bootstrapping-nodes': {}, u'tasks': {}, u'version': {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}, u'streams': {}, u'mode': u'normal', u'snitch': u'org.apache.cassandra.locator.DynamicEndpointSnitch', u'data-held': None}. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  83. 2015-08-24 23:13:27+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was [u'5.2.0', u'/1709795397/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  84. 2015-08-24 23:13:27+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was {u'os-load': 1.26}. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  85. 2015-08-24 23:13:28+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was [u'5.2.0', u'/929964114/conf']. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  86. 2015-08-24 23:13:28+0000 [] WARN: Unable to find a matching cluster for node with IP 127.0.0.1; the message was {u'inmemory': None, u'down-nodes': [], u'os-load': 1.48, u'kmip-errors': []}. This usually indicates that an OpsCenter agent is still running on an old node that was decommissioned or is part of a cluster that OpsCenter is no longer monitoring.
  87. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Enterprise functionality: False
  88. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Recognizing new node 127.0.0.1 ('-6574032654670847999')
  89. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Node 127.0.0.1 has multiple tokens (vnodes). Only one picked for display.
  90. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Cluster Name: Test Cluster
  91. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Partitioner: org.apache.cassandra.dht.Murmur3Partitioner
  92. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Keyspaces: [u'system_traces', u'system_auth', u'system', u'OpsCenter', u'system_distributed']
  93. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Got opscenterd IP from guess_my_ip_wrt_remote: 127.0.0.1
  94. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Agent for ip 127.0.0.1 is version None
  95. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Version: {'search': None, 'jobtracker': None, 'tasktracker': None, 'spark': {u'master': None, u'version': None, u'worker': None}, 'dse': None, 'cassandra': u'2.2.0'}
  96. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {'search': None, 'jobtracker': None, 'tasktracker': None, 'spark': {u'master': None, u'version': None, u'worker': None}, 'dse': None, 'cassandra': u'2.2.0'}
  97. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  98. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}
  99. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  100. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Node 127.0.0.1 changed its mode to normal
  101. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Snitch: org.apache.cassandra.locator.DynamicEndpointSnitch (was None)
  102. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: clusterSnitchObtained cluster: <opscenterd.Cluster.CassandraCluster object at 0x7fa6f3017e90>
  103. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: snitch: u'org.apache.cassandra.locator.DynamicEndpointSnitch'
  104. 2015-08-24 23:13:28+0000 [Test_Cluster] INFO: Cluster not using Ec2MultiRegionSnitch
  105. 2015-08-24 23:13:30+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {'search': None, 'jobtracker': None, 'tasktracker': None, 'spark': {u'master': None, u'version': None, u'worker': None}, 'dse': None, 'cassandra': u'2.2.0'}
  106. 2015-08-24 23:13:30+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  107. 2015-08-24 23:13:30+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}
  108. 2015-08-24 23:13:30+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  109. 2015-08-24 23:13:30+0000 [Test_Cluster] INFO: Node 127.0.0.1 changed its mode to normal
  110. 2015-08-24 23:13:36+0000 [Test_Cluster] INFO: Using 192.168.50.5 as the RPC address for node 127.0.0.1
  111. 2015-08-24 23:13:36+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {'search': None, 'jobtracker': None, 'tasktracker': None, 'spark': {u'master': None, u'version': None, u'worker': None}, 'dse': None, 'cassandra': u'2.2.0'}
  112. 2015-08-24 23:13:36+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  113. 2015-08-24 23:13:36+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}
  114. 2015-08-24 23:13:36+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  115. 2015-08-24 23:13:36+0000 [Test_Cluster] INFO: Node 127.0.0.1 changed its mode to normal
  116. 2015-08-24 23:13:37+0000 [Test_Cluster] INFO: Agent for ip 127.0.0.1 is version u'5.2.0'
  117. 2015-08-24 23:13:38+0000 [Test_Cluster] INFO: Persisting agent configuration to Cassandra
  118. 2015-08-24 23:13:38+0000 [Test_Cluster] INFO: Initializing event storage.
  119. 2015-08-24 23:13:38+0000 [Test_Cluster] INFO: Initializing backup event storage.
  120. 2015-08-24 23:13:38+0000 [Test_Cluster] INFO: Attempting to load all persisted alert rules
  121. 2015-08-24 23:13:38+0000 [Test_Cluster] INFO: Done initializing backup event storage.
  122. 2015-08-24 23:13:38+0000 [Test_Cluster] INFO: Done initializing event storage.
  123. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  124. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  125. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  126. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  127. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  128. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  129. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  130. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  131. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  132. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  133. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  134. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  135. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  136. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  137. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  138. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  139. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  140. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  141. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  142. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  143. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  144. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  145. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  146. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  147. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  148. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  149. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  150. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  151. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  152. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  153. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  154. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  155. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  156. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  157. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  158. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  159. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  160. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  161. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  162. 2015-08-24 23:13:38+0000 [Test_Cluster] WARN: Ignoring scheduled job with type=best-practice, which is only supported with DataStax Enterprise.
  163. 2015-08-24 23:13:38+0000 [Test_Cluster] INFO: Done loading persisted scheduled job descriptions
  164. 2015-08-24 23:13:40+0000 [Test_Cluster] INFO: Using 192.168.50.4 as the RPC address for node 127.0.0.1
  165. 2015-08-24 23:13:40+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {'search': None, 'jobtracker': None, 'tasktracker': None, 'spark': {u'master': None, u'version': None, u'worker': None}, 'dse': None, 'cassandra': u'2.2.0'}
  166. 2015-08-24 23:13:40+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  167. 2015-08-24 23:13:40+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}
  168. 2015-08-24 23:13:40+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  169. 2015-08-24 23:13:40+0000 [Test_Cluster] INFO: Node 127.0.0.1 changed its mode to normal
  170. 2015-08-24 23:13:40+0000 [Test_Cluster] INFO: Done loading persisted alert rules
  171. 2015-08-24 23:13:41+0000 [Test_Cluster] INFO: OpsCenter starting up.
  172. 2015-08-24 23:13:42+0000 [Test_Cluster] INFO: Using 192.168.50.2 as the RPC address for node 127.0.0.1
  173. 2015-08-24 23:13:42+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {'search': None, 'jobtracker': None, 'tasktracker': None, 'spark': {u'master': None, u'version': None, u'worker': None}, 'dse': None, 'cassandra': u'2.2.0'}
  174. 2015-08-24 23:13:42+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  175. 2015-08-24 23:13:42+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}
  176. 2015-08-24 23:13:42+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  177. 2015-08-24 23:13:42+0000 [Test_Cluster] INFO: Node 127.0.0.1 changed its mode to normal
  178. 2015-08-24 23:13:42+0000 [] INFO: Starting to update agents' configuration
  179. 2015-08-24 23:13:47+0000 [Test_Cluster] INFO: Using 192.168.50.5 as the RPC address for node 127.0.0.1
  180. 2015-08-24 23:13:48+0000 [Test_Cluster] INFO: Using 192.168.50.4 as the RPC address for node 127.0.0.1
  181. 2015-08-24 23:13:49+0000 [Test_Cluster] INFO: Using 192.168.50.3 as the RPC address for node 127.0.0.1
  182. 2015-08-24 23:13:49+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {'search': None, 'jobtracker': None, 'tasktracker': None, 'spark': {u'master': None, u'version': None, u'worker': None}, 'dse': None, 'cassandra': u'2.2.0'}
  183. 2015-08-24 23:13:49+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  184. 2015-08-24 23:13:49+0000 [Test_Cluster] INFO: Node <Node 127.0.0.1='-6574032654670847999'> changed version to {u'search': None, u'jobtracker': None, u'tasktracker': None, u'spark': {u'master': None, u'version': None, u'worker': None}, u'dse': None, u'cassandra': u'2.2.0'}
  185. 2015-08-24 23:13:49+0000 [Test_Cluster] INFO: Processing spark version {u'master': None, u'version': None, u'worker': None}
  186. 2015-08-24 23:13:49+0000 [Test_Cluster] INFO: Node 127.0.0.1 changed its mode to normal
  187. 2015-08-24 23:13:58+0000 [Test_Cluster] INFO: Using 192.168.50.3 as the RPC address for node 127.0.0.1
  188. 2015-08-24 23:13:58+0000 [Test_Cluster] INFO: Using 192.168.50.2 as the RPC address for node 127.0.0.1
  189. 2015-08-24 23:14:22+0000 [] INFO: Testing SSH connectivity to 192.168.50.4
  190. 2015-08-24 23:14:23+0000 [] INFO: Testing SSH login to 192.168.50.4
  191. 2015-08-24 23:14:29+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  192. Traceback (most recent call last):
  193. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  194.  
  195. 2015-08-24 23:14:29+0000 [] INFO: Sleeping before retrying ssh login.
  196. 2015-08-24 23:14:41+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  197. Traceback (most recent call last):
  198. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  199.  
  200. 2015-08-24 23:14:41+0000 [] INFO: Sleeping before retrying ssh login.
  201. 2015-08-24 23:14:52+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  202. Traceback (most recent call last):
  203. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  204.  
  205. 2015-08-24 23:14:52+0000 [] INFO: Sleeping before retrying ssh login.
  206. 2015-08-24 23:15:03+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  207. Traceback (most recent call last):
  208. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  209.  
  210. 2015-08-24 23:15:03+0000 [] INFO: Sleeping before retrying ssh login.
  211. 2015-08-24 23:15:14+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  212. Traceback (most recent call last):
  213. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  214.  
  215. 2015-08-24 23:15:14+0000 [] INFO: Sleeping before retrying ssh login.
  216. 2015-08-24 23:15:26+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  217. Traceback (most recent call last):
  218. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  219.  
  220. 2015-08-24 23:15:26+0000 [] INFO: Sleeping before retrying ssh login.
  221. 2015-08-24 23:15:38+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  222. Traceback (most recent call last):
  223. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  224.  
  225. 2015-08-24 23:15:38+0000 [] INFO: Sleeping before retrying ssh login.
  226. 2015-08-24 23:15:50+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  227. Traceback (most recent call last):
  228. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  229.  
  230. 2015-08-24 23:15:50+0000 [] INFO: Sleeping before retrying ssh login.
  231. 2015-08-24 23:16:01+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  232. Traceback (most recent call last):
  233. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  234.  
  235. 2015-08-24 23:16:01+0000 [] INFO: Sleeping before retrying ssh login.
  236. 2015-08-24 23:16:13+0000 [] There was a problem verifying an ssh login on 192.168.50.4
  237. Traceback (most recent call last):
  238. Failure: opscenterd.SecureShell.SshFailed: ssh to u'192.168.50.4' failed
  239.  
  240. 2015-08-24 23:16:13+0000 [] ERROR: Unexpected error when attempting to login to 192.168.50.4: Timed out verifying ssh login for 192.168.50.4. Previous exception was: SshFailed: ssh to u'192.168.50.4' failed
  241. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1018, in _inlineCallbacks
  242. result = result.throwExceptionIntoGenerator(g)
  243.  
  244. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/python/failure.py", line 349, in throwExceptionIntoGenerator
  245. return g.throw(self.type, self.value, self.tb)
  246.  
  247. File "/usr/lib/python2.7/dist-packages/opscenterd/SecureShell.py", line 339, in _verify_ssh_login
  248.  
  249. 2015-08-24 23:16:13+0000 [] ERROR: Problem while calling ExpandClusterController (RuntimeError): Request.finish called on a request after its connection was lost; use Request.notifyFinish to keep track of this.
  250. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks
  251. result = g.send(result)
  252.  
  253. File "/usr/lib/python2.7/dist-packages/opscenterd/WebServer.py", line 3130, in ExpandClusterController
  254.  
  255. File "/usr/lib/python2.7/dist-packages/opscenterd/WebServer.py", line 1122, in respond_with_data
  256.  
  257. File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/web/http.py", line 900, in finish
  258. "Request.finish called on a request after its connection was lost; "
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement