API tools faq
paste
Advertisement
panzon

Untitled

panzon
Sep 8th, 2016
426
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 15.09 KB | None | 0 0
raw download clone embed print report
  1. oc describe pods -n openshift-infra
  2. Name: hawkular-cassandra-1-xwadz
  3. Namespace: openshift-infra
  4. Node: ip-172-31-42-19.us-west-2.compute.internal/172.31.42.19
  5. Start Time: Thu, 08 Sep 2016 11:12:36 -0400
  6. Labels: metrics-infra=hawkular-cassandra,name=hawkular-cassandra-1,type=hawkular-cassandra
  7. Status: Pending
  8. IP:
  9. Controllers: ReplicationController/hawkular-cassandra-1
  10. Containers:
  11. hawkular-cassandra-1:
  12. Container ID:
  13. Image: registry.access.redhat.com/openshift3/metrics-cassandra:3.2.1
  14. Image ID:
  15. Ports: 9042/TCP, 9160/TCP, 7000/TCP, 7001/TCP
  16. Command:
  17. /opt/apache-cassandra/bin/cassandra-docker.sh
  18. --cluster_name=hawkular-metrics
  19. --data_volume=/cassandra_data
  20. --internode_encryption=all
  21. --require_node_auth=true
  22. --enable_client_encryption=true
  23. --require_client_auth=true
  24. --keystore_file=/secret/cassandra.keystore
  25. --keystore_password_file=/secret/cassandra.keystore.password
  26. --truststore_file=/secret/cassandra.truststore
  27. --truststore_password_file=/secret/cassandra.truststore.password
  28. --cassandra_pem_file=/secret/cassandra.pem
  29. QoS Tier:
  30. cpu: BestEffort
  31. memory: BestEffort
  32. State: Waiting
  33. Reason: ContainerCreating
  34. Ready: False
  35. Restart Count: 0
  36. Readiness: exec [/opt/apache-cassandra/bin/cassandra-docker-ready.sh] delay=0s timeout=1s period=10s #success=1 #failure=3
  37. Environment Variables:
  38. CASSANDRA_MASTER: true
  39. POD_NAMESPACE: openshift-infra (v1:metadata.namespace)
  40. Conditions:
  41. Type Status
  42. Ready False
  43. Volumes:
  44. cassandra-data:
  45. Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
  46. ClaimName: metrics-cassandra-1
  47. ReadOnly: false
  48. hawkular-cassandra-secrets:
  49. Type: Secret (a volume populated by a Secret)
  50. SecretName: hawkular-cassandra-secrets
  51. cassandra-token-86x4i:
  52. Type: Secret (a volume populated by a Secret)
  53. SecretName: cassandra-token-86x4i
  54. Events:
  55. FirstSeen LastSeen Count From SubobjectPath Type Reason Message
  56. --------- -------- ----- ---- ------------- -------- ------ -------
  57. 3h 3s 886 {kubelet ip-172-31-42-19.us-west-2.compute.internal} Warning FailedMount Unable to mount volumes for pod "hawkular-cassandra-1-xwadz_openshift-infra(ad1d595d-75d6-11e6-a4db-06396fc1a69b)": failed to instantiate volume builder for cassandra-data: The claim metrics-cassandra-1 is not yet bound to a volume
  58. 3h 3s 886 {kubelet ip-172-31-42-19.us-west-2.compute.internal} Warning FailedSync Error syncing pod, skipping: failed to instantiate volume builder for cassandra-data: The claim metrics-cassandra-1 is not yet bound to a volume
  59.  
  60.  
  61. Name: hawkular-metrics-mdsqe
  62. Namespace: openshift-infra
  63. Node: ip-172-31-42-19.us-west-2.compute.internal/172.31.42.19
  64. Start Time: Thu, 08 Sep 2016 11:12:51 -0400
  65. Labels: metrics-infra=hawkular-metrics,name=hawkular-metrics
  66. Status: Running
  67. IP: 10.1.0.2
  68. Controllers: ReplicationController/hawkular-metrics
  69. Containers:
  70. hawkular-metrics:
  71. Container ID: docker://1a27da3d26076a5b5c9781a458f9d47ddaf5115cd7beac20919c32896175d57b
  72. Image: registry.access.redhat.com/openshift3/metrics-hawkular-metrics:3.2.1
  73. Image ID: docker://sha256:219e26f45297076a110390153f59f12f76dbb082d7ecab01bfae9c4495a1b55e
  74. Ports: 8080/TCP, 8444/TCP
  75. Command:
  76. /opt/hawkular/scripts/hawkular-metrics-wrapper.sh
  77. -b
  78. 0.0.0.0
  79. -Dhawkular-metrics.cassandra-nodes=hawkular-cassandra
  80. -Dhawkular-metrics.cassandra-use-ssl
  81. -Dorg.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true
  82. -Dorg.apache.catalina.connector.CoyoteAdapter.ALLOW_BACKSLASH=true
  83. -Dhawkular-metrics.openshift.auth-methods=openshift-oauth,htpasswd
  84. -Dhawkular-metrics.openshift.htpasswd-file=/secrets/hawkular-metrics.htpasswd.file
  85. -Dhawkular.metrics.allowed-cors-access-control-allow-headers=authorization
  86. -Dhawkular.metrics.default-ttl=7
  87. -DKUBERNETES_MASTER_URL=https://kubernetes.default.svc:443
  88. --hmw.keystore=/secrets/hawkular-metrics.keystore
  89. --hmw.truststore=/secrets/hawkular-metrics.truststore
  90. --hmw.keystore_password_file=/secrets/hawkular-metrics.keystore.password
  91. --hmw.truststore_password_file=/secrets/hawkular-metrics.truststore.password
  92. QoS Tier:
  93. cpu: BestEffort
  94. memory: BestEffort
  95. State: Waiting
  96. Reason: CrashLoopBackOff
  97. Last State: Terminated
  98. Reason: Completed
  99. Exit Code: 0
  100. Started: Thu, 08 Sep 2016 14:17:54 -0400
  101. Finished: Thu, 08 Sep 2016 14:20:24 -0400
  102. Ready: False
  103. Restart Count: 40
  104. Liveness: exec [/opt/hawkular/scripts/hawkular-metrics-liveness.py] delay=0s timeout=1s period=10s #success=1 #failure=3
  105. Readiness: exec [/opt/hawkular/scripts/hawkular-metrics-readiness.py] delay=0s timeout=1s period=10s #success=1 #failure=3
  106. Environment Variables:
  107. POD_NAMESPACE: openshift-infra (v1:metadata.namespace)
  108. Conditions:
  109. Type Status
  110. Ready False
  111. Volumes:
  112. hawkular-metrics-secrets:
  113. Type: Secret (a volume populated by a Secret)
  114. SecretName: hawkular-metrics-secrets
  115. hawkular-token-yeqas:
  116. Type: Secret (a volume populated by a Secret)
  117. SecretName: hawkular-token-yeqas
  118. Events:
  119. FirstSeen LastSeen Count From SubobjectPath Type Reason Message
  120. --------- -------- ----- ---- ------------- -------- ------ -------
  121. 1h 1h 1 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Liveness probe failed: Hawkular metrics has been running for 146
  122. seconds. Aborting
  123.  
  124. 1h 1h 1 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Liveness probe failed: Hawkular metrics has been running for 134
  125. seconds. Aborting
  126.  
  127. 1h 1h 1 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Liveness probe failed: Hawkular metrics has been running for 126
  128. seconds. Aborting
  129.  
  130. 3h 43m 8 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Liveness probe failed: Hawkular metrics has been running for 139
  131. seconds. Aborting
  132.  
  133. 3h 23m 8 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Liveness probe failed: Hawkular metrics has been running for 129
  134. seconds. Aborting
  135.  
  136. 3h 22m 9 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Liveness probe failed: Hawkular metrics has been running for 149
  137. seconds. Aborting
  138.  
  139. 2h 17m 7 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Readiness probe failed: Failed to access the status endpoint : HTTP Error 404: Not Found.
  140.  
  141. 1h 15m 2 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Liveness probe failed: Hawkular metrics has been running for 148
  142. seconds. Aborting
  143.  
  144. 2h 5m 116 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy (events with common reason combined)
  145. 3h 5m 40 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Normal Pulled Container image "registry.access.redhat.com/openshift3/metrics-hawkular-metrics:3.2.1" already present on machine
  146. 2h 5m 32 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Normal Created (events with common reason combined)
  147. 2h 5m 32 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Normal Started (events with common reason combined)
  148. 3h 4m 53 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Readiness probe failed: Failed to access the status endpoint : <urlopen error [Errno 111] Connection refused>.
  149.  
  150. 3h 2m 518 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning Unhealthy Readiness probe failed:
  151. 2h 2m 32 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Normal Killing (events with common reason combined)
  152. 2h 5s 405 {kubelet ip-172-31-42-19.us-west-2.compute.internal} Warning FailedSync Error syncing pod, skipping: failed to "StartContainer" for "hawkular-metrics" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=hawkular-metrics pod=hawkular-metrics-mdsqe_openshift-infra(b607d28e-75d6-11e6-a4db-06396fc1a69b)"
  153.  
  154. 2h 5s 418 {kubelet ip-172-31-42-19.us-west-2.compute.internal} spec.containers{hawkular-metrics} Warning BackOff Back-off restarting failed docker container
  155.  
  156.  
  157. Name: heapster-eje3m
  158. Namespace: openshift-infra
  159. Node: ip-172-31-36-130.us-west-2.compute.internal/172.31.36.130
  160. Start Time: Thu, 08 Sep 2016 11:12:38 -0400
  161. Labels: metrics-infra=heapster,name=heapster
  162. Status: Running
  163. IP: 10.1.1.3
  164. Controllers: ReplicationController/heapster
  165. Containers:
  166. heapster:
  167. Container ID: docker://b4848cc72971ba6ee6d0ab67495ddb7dd93b4a0c38bac429c56c2b9adb265956
  168. Image: registry.access.redhat.com/openshift3/metrics-heapster:3.2.1
  169. Image ID: docker://sha256:eac7eb4e46c4b8f23b032388c21896ac0f3aab0ad10300f373fdcfb254b04f7a
  170. Port: 8082/TCP
  171. Command:
  172. heapster-wrapper.sh
  173. --wrapper.username_file=/hawkular-account/hawkular-metrics.username
  174. --wrapper.password_file=/hawkular-account/hawkular-metrics.password
  175. --wrapper.allowed_users_file=/secrets/heapster.allowed-users
  176. --wrapper.endpoint_check=https://hawkular-metrics:443/hawkular/metrics/status
  177. --source=kubernetes:https://kubernetes.default.svc:443?useServiceAccount=true&kubeletHttps=true&kubeletPort=10250
  178. --sink=hawkular:https://hawkular-metrics:443?tenant=_system&labelToTenant=pod_namespace&labelNodeId=nodename&caCert=/hawkular-cert/hawkular-metrics-ca.certificate&user=%username%&pass=%password%&filter=label(container_name:^system.slice.*|^user.slice)
  179. --tls_cert=/secrets/heapster.cert
  180. --tls_key=/secrets/heapster.key
  181. --tls_client_ca=/secrets/heapster.client-ca
  182. --allowed_users=%allowed_users%
  183. --metric_resolution=10s
  184. QoS Tier:
  185. cpu: BestEffort
  186. memory: BestEffort
  187. State: Running
  188. Started: Thu, 08 Sep 2016 14:22:08 -0400
  189. Last State: Terminated
  190. Reason: Error
  191. Exit Code: 1
  192. Started: Thu, 08 Sep 2016 14:15:00 -0400
  193. Finished: Thu, 08 Sep 2016 14:17:02 -0400
  194. Ready: False
  195. Restart Count: 30
  196. Readiness: exec [/opt/heapster-readiness.sh] delay=0s timeout=1s period=10s #success=1 #failure=3
  197. Environment Variables:
  198. Conditions:
  199. Type Status
  200. Ready False
  201. Volumes:
  202. heapster-secrets:
  203. Type: Secret (a volume populated by a Secret)
  204. SecretName: heapster-secrets
  205. hawkular-metrics-certificate:
  206. Type: Secret (a volume populated by a Secret)
  207. SecretName: hawkular-metrics-certificate
  208. hawkular-metrics-account:
  209. Type: Secret (a volume populated by a Secret)
  210. SecretName: hawkular-metrics-account
  211. heapster-token-i7t4j:
  212. Type: Secret (a volume populated by a Secret)
  213. SecretName: heapster-token-i7t4j
  214. Events:
  215. FirstSeen LastSeen Count From SubobjectPath Type ReasonMessage
  216. --------- -------- ----- ---- ------------- -------- -------------
  217. 1h 1h 1 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Warning Unhealthy Readiness probe errored: failed to run in container - Exec setup failed - API error (500): Container 0f516315a4df4c3524290451a24920e8fb1c030eaa08021300a389ef2e1b155e is not running
  218.  
  219. 1h 1h 1 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Warning Unhealthy Readiness probe errored: failed to run in container - Exec setup failed - API error (500): Container e6e9ee57abf471547ffa1f813f93c84aadf801c45d619f36b4af6a8c440c661e is not running
  220.  
  221. 13m 13m 1 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Warning Unhealthy Readiness probe errored: failed to run in container - Exec setup failed - API error (500): Container 2fd6c2dab343357f0ad29b0e7c991648a529dab9dcdf4b30f24b620b9accf721 is not running
  222.  
  223. 3h 1m 592 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Warning BackOff Back-off restarting failed docker container
  224. 2h 1m 565 {kubelet ip-172-31-36-130.us-west-2.compute.internal} Warning FailedSync Error syncing pod, skipping: failed to "StartContainer" for "heapster" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=heapster pod=heapster-eje3m_openshift-infra(ae3c116b-75d6-11e6-a4db-06396fc1a69b)"
  225.  
  226. 3h 51s 30 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Normal Pulled Container image "registry.access.redhat.com/openshift3/metrics-heapster:3.2.1" already present on machine
  227. 2h 50s 22 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Normal Created (events with common reason combined)
  228. 2h 50s 22 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Normal Started (events with common reason combined)
  229. 3h 10s 364 {kubelet ip-172-31-36-130.us-west-2.compute.internal} spec.containers{heapster} Warning Unhealthy Readiness probe failed: The heapster process is not yet started, it is waiting for the Hawkular Metrics to start.
  230.  
  231.  
  232.  
  233. Name: metrics-deployer-ymibj
  234. Namespace: openshift-infra
  235. Node: ip-172-31-36-130.us-west-2.compute.internal/172.31.36.130
  236. Start Time: Thu, 08 Sep 2016 11:11:43 -0400
  237. Labels: component=deployer,metrics-infra=deployer,provider=openshift
  238. Status: Succeeded
  239. IP: 10.1.1.2
  240. Controllers: <none>
  241. Containers:
  242. deployer:
  243. Container ID: docker://cf31e2279250662ec500c6716236b33db85b22ee6b11b828d2a06d54207e0309
  244. Image: registry.access.redhat.com/openshift3/metrics-deployer:3.2.1
  245. Image ID: docker://sha256:6b7f57e2c4963a858ac6792eb0dba30ec3cb34f211b3ee4990c5b5c92a96c289
  246. Port:
  247. QoS Tier:
  248. cpu: BestEffort
  249. memory: BestEffort
  250. State: Terminated
  251. Reason: Completed
  252. Exit Code: 0
  253. Started: Thu, 08 Sep 2016 11:12:27 -0400
  254. Finished: Thu, 08 Sep 2016 11:12:38 -0400
  255. Ready: False
  256. Restart Count: 0
  257. Environment Variables:
  258. PROJECT: openshift-infra (v1:metadata.namespace)
  259. IMAGE_PREFIX: registry.access.redhat.com/openshift3/
  260. IMAGE_VERSION: 3.2.1
  261. MASTER_URL: https://kubernetes.default.svc:443
  262. MODE: deploy
  263. REDEPLOY: false
  264. USE_PERSISTENT_STORAGE: true
  265. HAWKULAR_METRICS_HOSTNAME: hawkular-metrics.knowledgemen.com
  266. CASSANDRA_NODES: 1
  267. CASSANDRA_PV_SIZE: 10Gi
  268. METRIC_DURATION: 7
  269. METRIC_RESOLUTION: 10s
  270. Conditions:
  271. Type Status
  272. Ready False
  273. Volumes:
  274. empty:
  275. Type: EmptyDir (a temporary directory that shares a pod's lifetime)
  276. Medium:
  277. secret:
  278. Type: Secret (a volume populated by a Secret)
  279. SecretName: metrics-deployer
  280. metrics-deployer-token-6abi1:
  281. Type: Secret (a volume populated by a Secret)
  282. SecretName: metrics-deployer-token-6abi1
  283. No events.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!