Advertisement
lbrigman124

OKD 3.10 install failure

Aug 8th, 2018
241
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 88.85 KB | None | 0 0
  1. TASK [openshift_control_plane : Get events in the kube-system namespace] **************************************************
  2. Wednesday 08 August 2018 10:25:14 -0700 (0:00:00.265) 0:18:50.989 ******
  3. fatal: [lbgsm9.lab.c-cor.com]: FAILED! => {"changed": true, "cmd": ["oc", "get", "events", "--config=/etc/origin/master/admin.kubeconfig", "-n", "kube-system"], "delta": "0:00:00.156520", "end": "2018-08-08 10:25:14.880320", "msg": "non-zero return code", "rc": 1, "start": "2018-08-08 10:25:14.723800", "stderr": "The connection to the server lbgsm9.lab.c-cor.com:8443 was refused - did you specify the right host or port?", "stderr_lines": ["The connection to the server lbgsm9.lab.c-cor.com:8443 was refused - did you specify the right host or port?"], "stdout": "", "stdout_lines": []}
  4. ...ignoring
  5.  
  6. TASK [openshift_control_plane : debug] ************************************************************************************
  7. Wednesday 08 August 2018 10:25:15 -0700 (0:00:00.742) 0:18:51.732 ******
  8. ok: [lbgsm9.lab.c-cor.com] => {
  9. "msg": []
  10. }
  11.  
  12. TASK [openshift_control_plane : Get node logs] ****************************************************************************
  13. Wednesday 08 August 2018 10:25:15 -0700 (0:00:00.132) 0:18:51.864 ******
  14. changed: [lbgsm9.lab.c-cor.com]
  15.  
  16. TASK [openshift_control_plane : debug] ************************************************************************************
  17. Wednesday 08 August 2018 10:25:15 -0700 (0:00:00.414) 0:18:52.279 ******
  18. ok: [lbgsm9.lab.c-cor.com] => {
  19. "msg": [
  20. "-- Logs begin at Mon 2018-08-06 11:50:20 PDT, end at Wed 2018-08-08 10:25:15 PDT. --",
  21. "Aug 08 10:24:46 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:46.887157 17937 pod_workers.go:186] Error syncing pod 360556e3b47fddd253ba2104e990214f (\"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"), skipping: failed to \"StartContainer\" for \"controllers\" with CrashLoopBackOff: \"Back-off 5m0s restarting failed container=controllers pod=master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"",
  22. "Aug 08 10:24:47 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:47.345245 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  23. "Aug 08 10:24:47 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:47.345895 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  24. "Aug 08 10:24:47 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:47.347265 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  25. "Aug 08 10:24:48 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:48.345990 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  26. "Aug 08 10:24:48 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:48.346897 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  27. "Aug 08 10:24:48 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:48.347987 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  28. "Aug 08 10:24:49 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:49.346882 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  29. "Aug 08 10:24:49 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:49.348297 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  30. "Aug 08 10:24:49 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:49.349313 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  31. "Aug 08 10:24:50 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:24:50.054751 17937 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d",
  32. "Aug 08 10:24:50 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:50.054922 17937 kubelet.go:2143] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized",
  33. "Aug 08 10:24:50 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:50.347865 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  34. "Aug 08 10:24:50 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:50.349429 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  35. "Aug 08 10:24:50 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:50.349832 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  36. "Aug 08 10:24:51 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:51.348814 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  37. "Aug 08 10:24:51 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:51.350047 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  38. "Aug 08 10:24:51 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:51.351068 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  39. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:52.349607 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  40. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:52.350582 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  41. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:52.351498 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  42. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:52.642693 17937 cloud_request_manager.go:89] Requesting node addresses from cloud provider for node \"lbgsm9.lab.c-cor.com\"",
  43. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:52.643009 17937 cloud_request_manager.go:108] Node addresses from cloud provider for node \"lbgsm9.lab.c-cor.com\" collected",
  44. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:52.681522 17937 event.go:209] Unable to write event: 'Patch https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/default/events/lbgsm9.lab.c-cor.com.1548f7cf43b5bf39: dial tcp 10.109.180.9:8443: getsockopt: connection refused' (may retry after sleeping)",
  45. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:52.681575 17937 event.go:144] Unable to write event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"lbgsm9.lab.c-cor.com.1548f7cf4fd0bf33\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, InvolvedObject:v1.ObjectReference{Kind:\"Node\", Namespace:\"\", Name:\"lbgsm9.lab.c-cor.com\", UID:\"lbgsm9.lab.c-cor.com\", APIVersion:\"\", ResourceVersion:\"\", FieldPath:\"\"}, Reason:\"NodeHasSufficientPID\", Message:\"Node lbgsm9.lab.c-cor.com status is now: NodeHasSufficientPID\", Source:v1.EventSource{Component:\"kubelet\", Host:\"lbgsm9.lab.c-cor.com\"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed2e6cbb4fd7333, ext:591778361, loc:(*time.Location)(0x8faf2c0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed2e6cbb4fd7333, ext:591778361, loc:(*time.Location)(0x8faf2c0)}}, Count:1, Type:\"Normal\", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:\"\", Related:(*v1.ObjectReference)(nil), ReportingController:\"\", ReportingInstance:\"\"}' (retry limit exceeded!)",
  46. "Aug 08 10:24:52 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:52.681997 17937 event.go:209] Unable to write event: 'Patch https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/default/events/lbgsm9.lab.c-cor.com.1548f7cf43b4a887: dial tcp 10.109.180.9:8443: getsockopt: connection refused' (may retry after sleeping)",
  47. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:53.350376 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  48. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:53.351170 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  49. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:53.352391 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  50. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:53.734707 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  51. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:53.734768 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  52. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:53.737511 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  53. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:53.737555 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  54. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:53.737572 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  55. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:53.737586 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  56. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:53.737612 17937 kubelet_node_status.go:82] Attempting to register node lbgsm9.lab.c-cor.com",
  57. "Aug 08 10:24:53 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:53.738456 17937 kubelet_node_status.go:106] Unable to register node \"lbgsm9.lab.c-cor.com\" with API server: Post https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  58. "Aug 08 10:24:54 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:54.186838 17937 event.go:209] Unable to write event: 'Patch https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/default/events/lbgsm9.lab.c-cor.com.1548f7cf43b4a887: dial tcp 10.109.180.9:8443: getsockopt: connection refused' (may retry after sleeping)",
  59. "Aug 08 10:24:54 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:54.351277 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  60. "Aug 08 10:24:54 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:54.351979 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  61. "Aug 08 10:24:54 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:54.353066 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  62. "Aug 08 10:24:54 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:54.746945 17937 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node \"lbgsm9.lab.c-cor.com\" not found",
  63. "Aug 08 10:24:55 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:24:55.056371 17937 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d",
  64. "Aug 08 10:24:55 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:55.057169 17937 kubelet.go:2143] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized",
  65. "Aug 08 10:24:55 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:55.352146 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  66. "Aug 08 10:24:55 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:55.353162 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  67. "Aug 08 10:24:55 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:55.354002 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  68. "Aug 08 10:24:56 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:56.352893 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  69. "Aug 08 10:24:56 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:56.354154 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  70. "Aug 08 10:24:56 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:56.355182 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  71. "Aug 08 10:24:57 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:57.353664 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  72. "Aug 08 10:24:57 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:57.354595 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  73. "Aug 08 10:24:57 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:57.355599 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  74. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:58.354565 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  75. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:58.356070 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  76. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:58.356470 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  77. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.583855 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  78. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.583901 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  79. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.586083 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  80. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.586120 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  81. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.586138 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  82. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.586167 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  83. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.886807 17937 kuberuntime_manager.go:513] Container {Name:api Image:docker.io/openshift/origin-control-plane:v3.10.0 Command:[/bin/bash -c] Args:[#!/bin/bash",
  84. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: set -euo pipefail",
  85. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: if [[ -f /etc/origin/master/master.env ]]; then",
  86. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: set -o allexport",
  87. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: source /etc/origin/master/master.env",
  88. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: fi",
  89. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: exec openshift start master api --config=/etc/origin/master/master-config.yaml --loglevel=${DEBUG_LOGLEVEL:-2}",
  90. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: ] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:master-config ReadOnly:false MountPath:/etc/origin/master/ SubPath: MountPropagation:<nil>} {Name:master-cloud-provider ReadOnly:false MountPath:/etc/origin/cloudprovider/ SubPath: MountPropagation:<nil>} {Name:master-data ReadOnly:false MountPath:/var/lib/origin/ SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:45,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz/ready,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.",
  91. "Aug 08 10:24:58 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:58.886941 17937 kuberuntime_manager.go:757] checking backoff for container \"api\" in pod \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  92. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:59.355407 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  93. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:59.356522 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  94. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:24:59.357755 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  95. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.583620 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  96. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.583645 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  97. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.586396 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  98. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.586418 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  99. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.586427 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  100. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.586437 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  101. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.887153 17937 kuberuntime_manager.go:513] Container {Name:controllers Image:docker.io/openshift/origin-control-plane:v3.10.0 Command:[/bin/bash -c] Args:[#!/bin/bash",
  102. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: set -euo pipefail",
  103. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: if [[ -f /etc/origin/master/master.env ]]; then",
  104. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: set -o allexport",
  105. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: source /etc/origin/master/master.env",
  106. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: fi",
  107. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: exec openshift start master controllers --config=/etc/origin/master/master-config.yaml --listen=https://0.0.0.0:8444 --loglevel=${DEBUG_LOGLEVEL:-2}",
  108. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: ] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:master-config ReadOnly:false MountPath:/etc/origin/master/ SubPath: MountPropagation:<nil>} {Name:master-cloud-provider ReadOnly:false MountPath:/etc/origin/cloudprovider/ SubPath: MountPropagation:<nil>} {Name:signature-import ReadOnly:false MountPath:/etc/containers/registries.d/ SubPath: MountPropagation:<nil>} {Name:kubelet-plugins ReadOnly:false MountPath:/usr/libexec/kubernetes/kubelet-plugins SubPath: MountPropagation:0xc4209b7700}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:8444,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.",
  109. "Aug 08 10:24:59 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:24:59.887327 17937 kuberuntime_manager.go:757] checking backoff for container \"controllers\" in pod \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"",
  110. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:00.058678 17937 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d",
  111. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:00.059023 17937 kubelet.go:2143] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized",
  112. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.212537 17937 kubelet.go:1919] SyncLoop (PLEG): \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\", event: &pleg.PodLifecycleEvent{ID:\"9ca23c5815da8ed1d3dca61d87e1f6ab\", Type:\"ContainerStarted\", Data:\"c21641cde0b74d23f214082ac49303293ef921b7569f7509cbb9d7687d7de111\"}",
  113. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.212657 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  114. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.212679 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  115. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.214136 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  116. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.214162 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  117. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.214176 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  118. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.214191 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  119. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:00.215105 17937 status_manager.go:461] Failed to get status for pod \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\": Get https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/kube-system/pods/master-api-lbgsm9.lab.c-cor.com: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  120. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:00.356361 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  121. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:00.357222 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  122. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:00.358311 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  123. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.738672 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  124. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.738718 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  125. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.741889 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  126. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.741927 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  127. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.741946 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  128. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.741961 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  129. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:00.741990 17937 kubelet_node_status.go:82] Attempting to register node lbgsm9.lab.c-cor.com",
  130. "Aug 08 10:25:00 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:00.742550 17937 kubelet_node_status.go:106] Unable to register node \"lbgsm9.lab.c-cor.com\" with API server: Post https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  131. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.226780 17937 kubelet.go:1919] SyncLoop (PLEG): \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\", event: &pleg.PodLifecycleEvent{ID:\"360556e3b47fddd253ba2104e990214f\", Type:\"ContainerStarted\", Data:\"339de40e2c59837023d0ad3e2759140a31a65ddce396d308831cb40141853918\"}",
  132. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.226889 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  133. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.226911 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  134. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.228400 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  135. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.228427 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  136. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.228445 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  137. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.228459 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  138. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:01.229282 17937 status_manager.go:461] Failed to get status for pod \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\": Get https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/kube-system/pods/master-controllers-lbgsm9.lab.c-cor.com: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  139. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:01.360703 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  140. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:01.360791 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  141. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:01.360814 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  142. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:01.740259 17937 certificate_manager.go:287] Rotating certificates",
  143. "Aug 08 10:25:01 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:01.741392 17937 certificate_manager.go:299] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://lbgsm9.lab.c-cor.com:8443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  144. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.239230 17937 kubelet.go:1919] SyncLoop (PLEG): \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\", event: &pleg.PodLifecycleEvent{ID:\"9ca23c5815da8ed1d3dca61d87e1f6ab\", Type:\"ContainerDied\", Data:\"c21641cde0b74d23f214082ac49303293ef921b7569f7509cbb9d7687d7de111\"}",
  145. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.239368 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  146. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.239387 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  147. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.239600 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  148. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.239616 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  149. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.240964 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  150. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.240992 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  151. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.241009 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  152. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.241046 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  153. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.241508 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  154. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.241523 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  155. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.241531 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  156. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.241539 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  157. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:02.242206 17937 status_manager.go:461] Failed to get status for pod \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\": Get https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/kube-system/pods/master-api-lbgsm9.lab.c-cor.com: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  158. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:02.361421 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  159. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:02.362316 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  160. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:02.363382 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  161. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.542151 17937 kuberuntime_manager.go:513] Container {Name:api Image:docker.io/openshift/origin-control-plane:v3.10.0 Command:[/bin/bash -c] Args:[#!/bin/bash",
  162. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: set -euo pipefail",
  163. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: if [[ -f /etc/origin/master/master.env ]]; then",
  164. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: set -o allexport",
  165. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: source /etc/origin/master/master.env",
  166. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: fi",
  167. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: exec openshift start master api --config=/etc/origin/master/master-config.yaml --loglevel=${DEBUG_LOGLEVEL:-2}",
  168. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: ] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:master-config ReadOnly:false MountPath:/etc/origin/master/ SubPath: MountPropagation:<nil>} {Name:master-cloud-provider ReadOnly:false MountPath:/etc/origin/cloudprovider/ SubPath: MountPropagation:<nil>} {Name:master-data ReadOnly:false MountPath:/var/lib/origin/ SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:45,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz/ready,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.",
  169. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.542282 17937 kuberuntime_manager.go:757] checking backoff for container \"api\" in pod \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  170. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.542444 17937 kuberuntime_manager.go:767] Back-off 5m0s restarting failed container=api pod=master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)",
  171. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:02.542475 17937 pod_workers.go:186] Error syncing pod 9ca23c5815da8ed1d3dca61d87e1f6ab (\"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"), skipping: failed to \"StartContainer\" for \"api\" with CrashLoopBackOff: \"Back-off 5m0s restarting failed container=api pod=master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  172. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.643284 17937 cloud_request_manager.go:89] Requesting node addresses from cloud provider for node \"lbgsm9.lab.c-cor.com\"",
  173. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.643692 17937 cloud_request_manager.go:108] Node addresses from cloud provider for node \"lbgsm9.lab.c-cor.com\" collected",
  174. "Aug 08 10:25:02 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:02.724352 17937 kubelet.go:1952] SyncLoop (container unhealthy): \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  175. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.248109 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  176. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.248131 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  177. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.250500 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  178. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.250531 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  179. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.250551 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  180. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.250564 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  181. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:03.251259 17937 status_manager.go:461] Failed to get status for pod \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\": Get https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/kube-system/pods/master-api-lbgsm9.lab.c-cor.com: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  182. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.255743 17937 kubelet.go:1919] SyncLoop (PLEG): \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\", event: &pleg.PodLifecycleEvent{ID:\"360556e3b47fddd253ba2104e990214f\", Type:\"ContainerDied\", Data:\"339de40e2c59837023d0ad3e2759140a31a65ddce396d308831cb40141853918\"}",
  183. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.255852 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  184. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.255873 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  185. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.255924 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  186. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.255937 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  187. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257390 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  188. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257407 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  189. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257415 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  190. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257424 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  191. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257658 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  192. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257672 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  193. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257679 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  194. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.257688 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  195. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:03.258353 17937 status_manager.go:461] Failed to get status for pod \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\": Get https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/kube-system/pods/master-controllers-lbgsm9.lab.c-cor.com: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  196. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:03.362132 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  197. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:03.362926 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  198. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:03.364087 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  199. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.551182 17937 kuberuntime_manager.go:513] Container {Name:api Image:docker.io/openshift/origin-control-plane:v3.10.0 Command:[/bin/bash -c] Args:[#!/bin/bash",
  200. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: set -euo pipefail",
  201. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: if [[ -f /etc/origin/master/master.env ]]; then",
  202. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: set -o allexport",
  203. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: source /etc/origin/master/master.env",
  204. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: fi",
  205. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: exec openshift start master api --config=/etc/origin/master/master-config.yaml --loglevel=${DEBUG_LOGLEVEL:-2}",
  206. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: ] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:master-config ReadOnly:false MountPath:/etc/origin/master/ SubPath: MountPropagation:<nil>} {Name:master-cloud-provider ReadOnly:false MountPath:/etc/origin/cloudprovider/ SubPath: MountPropagation:<nil>} {Name:master-data ReadOnly:false MountPath:/var/lib/origin/ SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:45,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz/ready,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.",
  207. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.551343 17937 kuberuntime_manager.go:757] checking backoff for container \"api\" in pod \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  208. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.551512 17937 kuberuntime_manager.go:767] Back-off 5m0s restarting failed container=api pod=master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)",
  209. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:03.551550 17937 pod_workers.go:186] Error syncing pod 9ca23c5815da8ed1d3dca61d87e1f6ab (\"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"), skipping: failed to \"StartContainer\" for \"api\" with CrashLoopBackOff: \"Back-off 5m0s restarting failed container=api pod=master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  210. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.558223 17937 kuberuntime_manager.go:513] Container {Name:controllers Image:docker.io/openshift/origin-control-plane:v3.10.0 Command:[/bin/bash -c] Args:[#!/bin/bash",
  211. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: set -euo pipefail",
  212. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: if [[ -f /etc/origin/master/master.env ]]; then",
  213. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: set -o allexport",
  214. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: source /etc/origin/master/master.env",
  215. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: fi",
  216. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: exec openshift start master controllers --config=/etc/origin/master/master-config.yaml --listen=https://0.0.0.0:8444 --loglevel=${DEBUG_LOGLEVEL:-2}",
  217. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: ] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:master-config ReadOnly:false MountPath:/etc/origin/master/ SubPath: MountPropagation:<nil>} {Name:master-cloud-provider ReadOnly:false MountPath:/etc/origin/cloudprovider/ SubPath: MountPropagation:<nil>} {Name:signature-import ReadOnly:false MountPath:/etc/containers/registries.d/ SubPath: MountPropagation:<nil>} {Name:kubelet-plugins ReadOnly:false MountPath:/usr/libexec/kubernetes/kubelet-plugins SubPath: MountPropagation:0xc4209b7700}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:8444,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.",
  218. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.558359 17937 kuberuntime_manager.go:757] checking backoff for container \"controllers\" in pod \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"",
  219. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:03.558515 17937 kuberuntime_manager.go:767] Back-off 5m0s restarting failed container=controllers pod=master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)",
  220. "Aug 08 10:25:03 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:03.558556 17937 pod_workers.go:186] Error syncing pod 360556e3b47fddd253ba2104e990214f (\"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"), skipping: failed to \"StartContainer\" for \"controllers\" with CrashLoopBackOff: \"Back-off 5m0s restarting failed container=controllers pod=master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"",
  221. "Aug 08 10:25:04 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:04.187526 17937 event.go:209] Unable to write event: 'Patch https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/default/events/lbgsm9.lab.c-cor.com.1548f7cf43b4a887: dial tcp 10.109.180.9:8443: getsockopt: connection refused' (may retry after sleeping)",
  222. "Aug 08 10:25:04 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:04.362908 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  223. "Aug 08 10:25:04 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:04.363834 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  224. "Aug 08 10:25:04 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:04.364736 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  225. "Aug 08 10:25:04 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:04.747247 17937 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node \"lbgsm9.lab.c-cor.com\" not found",
  226. "Aug 08 10:25:05 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:05.060289 17937 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d",
  227. "Aug 08 10:25:05 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:05.060452 17937 kubelet.go:2143] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized",
  228. "Aug 08 10:25:05 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:05.363781 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  229. "Aug 08 10:25:05 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:05.364845 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  230. "Aug 08 10:25:05 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:05.365634 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  231. "Aug 08 10:25:06 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:06.364700 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  232. "Aug 08 10:25:06 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:06.365362 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  233. "Aug 08 10:25:06 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:06.366471 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  234. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:07.365471 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  235. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:07.366312 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  236. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:07.367409 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  237. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:07.742821 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  238. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:07.742874 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  239. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:07.744910 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  240. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:07.744943 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  241. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:07.744954 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  242. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:07.744962 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  243. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:07.744983 17937 kubelet_node_status.go:82] Attempting to register node lbgsm9.lab.c-cor.com",
  244. "Aug 08 10:25:07 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:07.745473 17937 kubelet_node_status.go:106] Unable to register node \"lbgsm9.lab.c-cor.com\" with API server: Post https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  245. "Aug 08 10:25:08 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:08.366478 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  246. "Aug 08 10:25:08 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:08.367229 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  247. "Aug 08 10:25:08 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:08.368543 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  248. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.303052 17937 kubelet.go:1952] SyncLoop (container unhealthy): \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"",
  249. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.303221 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  250. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.303243 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  251. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.305847 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  252. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.305889 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  253. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.305912 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  254. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.305926 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  255. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:09.306769 17937 status_manager.go:461] Failed to get status for pod \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\": Get https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/kube-system/pods/master-controllers-lbgsm9.lab.c-cor.com: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  256. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:09.367270 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  257. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:09.368941 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  258. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:09.370000 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  259. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.606719 17937 kuberuntime_manager.go:513] Container {Name:controllers Image:docker.io/openshift/origin-control-plane:v3.10.0 Command:[/bin/bash -c] Args:[#!/bin/bash",
  260. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: set -euo pipefail",
  261. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: if [[ -f /etc/origin/master/master.env ]]; then",
  262. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: set -o allexport",
  263. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: source /etc/origin/master/master.env",
  264. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: fi",
  265. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: exec openshift start master controllers --config=/etc/origin/master/master-config.yaml --listen=https://0.0.0.0:8444 --loglevel=${DEBUG_LOGLEVEL:-2}",
  266. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: ] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:master-config ReadOnly:false MountPath:/etc/origin/master/ SubPath: MountPropagation:<nil>} {Name:master-cloud-provider ReadOnly:false MountPath:/etc/origin/cloudprovider/ SubPath: MountPropagation:<nil>} {Name:signature-import ReadOnly:false MountPath:/etc/containers/registries.d/ SubPath: MountPropagation:<nil>} {Name:kubelet-plugins ReadOnly:false MountPath:/usr/libexec/kubernetes/kubelet-plugins SubPath: MountPropagation:0xc4209b7700}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:8444,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.",
  267. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.606897 17937 kuberuntime_manager.go:757] checking backoff for container \"controllers\" in pod \"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"",
  268. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:09.607095 17937 kuberuntime_manager.go:767] Back-off 5m0s restarting failed container=controllers pod=master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)",
  269. "Aug 08 10:25:09 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:09.607141 17937 pod_workers.go:186] Error syncing pod 360556e3b47fddd253ba2104e990214f (\"master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"), skipping: failed to \"StartContainer\" for \"controllers\" with CrashLoopBackOff: \"Back-off 5m0s restarting failed container=controllers pod=master-controllers-lbgsm9.lab.c-cor.com_kube-system(360556e3b47fddd253ba2104e990214f)\"",
  270. "Aug 08 10:25:10 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:10.061981 17937 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d",
  271. "Aug 08 10:25:10 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:10.062142 17937 kubelet.go:2143] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized",
  272. "Aug 08 10:25:10 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:10.368257 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  273. "Aug 08 10:25:10 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:10.369828 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  274. "Aug 08 10:25:10 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:10.370732 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  275. "Aug 08 10:25:11 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:11.369153 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  276. "Aug 08 10:25:11 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:11.370312 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  277. "Aug 08 10:25:11 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:11.371383 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  278. "Aug 08 10:25:12 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:12.370185 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  279. "Aug 08 10:25:12 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:12.371242 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  280. "Aug 08 10:25:12 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:12.372044 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  281. "Aug 08 10:25:12 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:12.643886 17937 cloud_request_manager.go:89] Requesting node addresses from cloud provider for node \"lbgsm9.lab.c-cor.com\"",
  282. "Aug 08 10:25:12 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:12.644249 17937 cloud_request_manager.go:108] Node addresses from cloud provider for node \"lbgsm9.lab.c-cor.com\" collected",
  283. "Aug 08 10:25:13 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:13.370945 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  284. "Aug 08 10:25:13 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:13.371935 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  285. "Aug 08 10:25:13 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:13.373144 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  286. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:14.188201 17937 event.go:209] Unable to write event: 'Patch https://lbgsm9.lab.c-cor.com:8443/api/v1/namespaces/default/events/lbgsm9.lab.c-cor.com.1548f7cf43b4a887: dial tcp 10.109.180.9:8443: getsockopt: connection refused' (may retry after sleeping)",
  287. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:14.372991 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  288. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:14.373098 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  289. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:14.373559 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  290. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.583698 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  291. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.583730 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  292. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.585485 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  293. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.585504 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  294. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.585514 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  295. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.585522 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  296. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.745972 17937 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach",
  297. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.746030 17937 vsphere.go:702] The vSphere cloud provider does not support zones",
  298. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:14.747543 17937 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node \"lbgsm9.lab.c-cor.com\" not found",
  299. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.749876 17937 kubelet_node_status.go:448] Recording NodeHasSufficientDisk event message for node lbgsm9.lab.c-cor.com",
  300. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.749902 17937 kubelet_node_status.go:448] Recording NodeHasSufficientMemory event message for node lbgsm9.lab.c-cor.com",
  301. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.749918 17937 kubelet_node_status.go:448] Recording NodeHasNoDiskPressure event message for node lbgsm9.lab.c-cor.com",
  302. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.749931 17937 kubelet_node_status.go:448] Recording NodeHasSufficientPID event message for node lbgsm9.lab.c-cor.com",
  303. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.749954 17937 kubelet_node_status.go:82] Attempting to register node lbgsm9.lab.c-cor.com",
  304. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:14.750464 17937 kubelet_node_status.go:106] Unable to register node \"lbgsm9.lab.c-cor.com\" with API server: Post https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  305. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.886286 17937 kuberuntime_manager.go:513] Container {Name:api Image:docker.io/openshift/origin-control-plane:v3.10.0 Command:[/bin/bash -c] Args:[#!/bin/bash",
  306. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: set -euo pipefail",
  307. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: if [[ -f /etc/origin/master/master.env ]]; then",
  308. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: set -o allexport",
  309. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: source /etc/origin/master/master.env",
  310. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: fi",
  311. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: exec openshift start master api --config=/etc/origin/master/master-config.yaml --loglevel=${DEBUG_LOGLEVEL:-2}",
  312. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: ] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:master-config ReadOnly:false MountPath:/etc/origin/master/ SubPath: MountPropagation:<nil>} {Name:master-cloud-provider ReadOnly:false MountPath:/etc/origin/cloudprovider/ SubPath: MountPropagation:<nil>} {Name:master-data ReadOnly:false MountPath:/var/lib/origin/ SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:45,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz/ready,Port:8443,Host:,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.",
  313. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.886441 17937 kuberuntime_manager.go:757] checking backoff for container \"api\" in pod \"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  314. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: I0808 10:25:14.886677 17937 kuberuntime_manager.go:767] Back-off 5m0s restarting failed container=api pod=master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)",
  315. "Aug 08 10:25:14 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:14.886760 17937 pod_workers.go:186] Error syncing pod 9ca23c5815da8ed1d3dca61d87e1f6ab (\"master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"), skipping: failed to \"StartContainer\" for \"api\" with CrashLoopBackOff: \"Back-off 5m0s restarting failed container=api pod=master-api-lbgsm9.lab.c-cor.com_kube-system(9ca23c5815da8ed1d3dca61d87e1f6ab)\"",
  316. "Aug 08 10:25:15 lbgsm9.lab.c-cor.com origin-node[17937]: W0808 10:25:15.063468 17937 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d",
  317. "Aug 08 10:25:15 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:15.063654 17937 kubelet.go:2143] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized",
  318. "Aug 08 10:25:15 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:15.373800 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:452: Failed to list *v1.Service: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  319. "Aug 08 10:25:15 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:15.375910 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/kubelet.go:461: Failed to list *v1.Node: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/nodes?fieldSelector=metadata.name%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused",
  320. "Aug 08 10:25:15 lbgsm9.lab.c-cor.com origin-node[17937]: E0808 10:25:15.377496 17937 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://lbgsm9.lab.c-cor.com:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dlbgsm9.lab.c-cor.com&limit=500&resourceVersion=0: dial tcp 10.109.180.9:8443: getsockopt: connection refused"
  321. ]
  322. }
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement