shirishatideal

Untitled

Sep 5th, 2019
266
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 54.90 KB | None | 0 0
  1. $ kubectl get all -n elastic-system
  2. NAME READY STATUS RESTARTS AGE
  3. pod/elastic-operator-0 1/1 Running 1 8m38s
  4.  
  5. NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
  6. service/elastic-webhook-service ClusterIP 10.98.37.144 <none> 443/TCP 8m36s
  7.  
  8. NAME READY AGE
  9. statefulset.apps/elastic-operator 1/1 8m39s
  10.  
  11.  
  12. $ kubectl get events -n elastic-system
  13. LAST SEEN TYPE REASON OBJECT MESSAGE
  14. 7m47s Normal Pulled pod/elastic-operator-0 Container image "docker.elastic.co/eck/eck-operator:0.9.0" already present on machine
  15. 7m47s Normal Created pod/elastic-operator-0 Created container manager
  16. 7m48s Normal Scheduled pod/elastic-operator-0 Successfully assigned elastic-system/elastic-operator-0 to ip-10-0-2-226.us-east-2.compute.internal
  17. 7m47s Normal Started pod/elastic-operator-0 Started container manager
  18. 7m49s Warning FailedCreate statefulset/elastic-operator create Pod elastic-operator-0 in StatefulSet elastic-operator failed error: pods "elastic-operator-0" is forbidden: error looking up service account elastic-system/elastic-operator: serviceaccount "elastic-operator" not found
  19. 7m48s Normal SuccessfulCreate statefulset/elastic-operator create Pod elastic-operator-0 in StatefulSet elastic-operator successful
  20.  
  21.  
  22. $ kubectl describe pods -n elastic-system
  23. Name: elastic-operator-0
  24. Namespace: elastic-system
  25. Priority: 0
  26. Node: ip-10-0-2-226.us-east-2.compute.internal/10.0.2.226
  27. Start Time: Fri, 06 Sep 2019 02:07:19 +0000
  28. Labels: control-plane=elastic-operator
  29. controller-revision-hash=elastic-operator-5fc6f94fc
  30. statefulset.kubernetes.io/pod-name=elastic-operator-0
  31. Annotations: <none>
  32. Status: Running
  33. IP: 10.244.1.10
  34. Controlled By: StatefulSet/elastic-operator
  35. Containers:
  36. manager:
  37. Container ID: docker://de9a9be55921ffd399770f8ba44aad83137a74ad3fc467e3ca50805d53217a85
  38. Image: docker.elastic.co/eck/eck-operator:0.9.0
  39. Image ID: docker-pullable://docker.elastic.co/eck/eck-operator@sha256:9f134a7647371fc4e627c592496ff1ef1c3d50d6206fa6fb3571aacdb6ade574
  40. Port: 9876/TCP
  41. Host Port: 0/TCP
  42. Args:
  43. manager
  44. --operator-roles
  45. all
  46. --enable-debug-logs=false
  47. State: Running
  48. Started: Fri, 06 Sep 2019 02:07:21 +0000
  49. Last State: Terminated
  50. Reason: Error
  51. Exit Code: 1
  52. Started: Fri, 06 Sep 2019 02:07:20 +0000
  53. Finished: Fri, 06 Sep 2019 02:07:21 +0000
  54. Ready: True
  55. Restart Count: 1
  56. Limits:
  57. cpu: 1
  58. memory: 100Mi
  59. Requests:
  60. cpu: 100m
  61. memory: 20Mi
  62. Environment:
  63. OPERATOR_NAMESPACE: elastic-system (v1:metadata.namespace)
  64. WEBHOOK_SECRET: webhook-server-secret
  65. WEBHOOK_PODS_LABEL: elastic-operator
  66. OPERATOR_IMAGE: docker.elastic.co/eck/eck-operator:0.9.0
  67. Mounts:
  68. /tmp/cert from cert (ro)
  69. /var/run/secrets/kubernetes.io/serviceaccount from elastic-operator-token-fdtd5 (ro)
  70. Conditions:
  71. Type Status
  72. Initialized True
  73. Ready True
  74. ContainersReady True
  75. PodScheduled True
  76. Volumes:
  77. cert:
  78. Type: Secret (a volume populated by a Secret)
  79. SecretName: webhook-server-secret
  80. Optional: false
  81. elastic-operator-token-fdtd5:
  82. Type: Secret (a volume populated by a Secret)
  83. SecretName: elastic-operator-token-fdtd5
  84. Optional: false
  85. QoS Class: Burstable
  86. Node-Selectors: <none>
  87. Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
  88. node.kubernetes.io/unreachable:NoExecute for 300s
  89. Events:
  90. Type Reason Age From Message
  91. ---- ------ ---- ---- -------
  92. Normal Scheduled 9m8s default-scheduler Successfully assigned elastic-system/elastic-operator-0 to ip-10-0-2-226.us-east-2.compute.internal
  93. Normal Pulled 9m7s (x2 over 9m8s) kubelet, ip-10-0-2-226.us-east-2.compute.internal Container image "docker.elastic.co/eck/eck-operator:0.9.0" already present on machine
  94. Normal Created 9m7s (x2 over 9m8s) kubelet, ip-10-0-2-226.us-east-2.compute.internal Created container manager
  95. Normal Started 9m7s (x2 over 9m8s) kubelet, ip-10-0-2-226.us-east-2.compute.internal Started container manager
  96.  
  97. $ kubectl -n elastic-system logs statefulset.apps/elastic-operator
  98. {"level":"info","ts":1567735641.6141272,"logger":"manager","msg":"Setting up client for manager"}
  99. {"level":"info","ts":1567735641.614334,"logger":"manager","msg":"Setting up manager"}
  100. {"level":"info","ts":1567735641.6143475,"logger":"manager","msg":"Exposing Prometheus metrics on /metrics","port":8080}
  101. {"level":"info","ts":1567735641.6570077,"logger":"manager","msg":"Setting up scheme"}
  102. {"level":"info","ts":1567735641.6611297,"logger":"manager","msg":"Setting up controllers","roles":["all"]}
  103. {"level":"info","ts":1567735641.6612186,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  104. {"level":"info","ts":1567735641.6613305,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  105. {"level":"info","ts":1567735641.6614,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  106. {"level":"info","ts":1567735641.6614866,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  107. {"level":"info","ts":1567735641.6615634,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  108. {"level":"info","ts":1567735641.6616178,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apm-es-association-controller","source":"kind source: /, Kind="}
  109. {"level":"info","ts":1567735641.661635,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apm-es-association-controller","source":"kind source: /, Kind="}
  110. {"level":"info","ts":1567735641.6617289,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  111. {"level":"info","ts":1567735641.661798,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  112. {"level":"info","ts":1567735641.6618204,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  113. {"level":"info","ts":1567735641.6618361,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  114. {"level":"info","ts":1567735641.6618774,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  115. {"level":"info","ts":1567735641.6618965,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  116. {"level":"info","ts":1567735641.661971,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  117. {"level":"info","ts":1567735641.6619945,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  118. {"level":"info","ts":1567735641.6620219,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"channel source: 0xc000341ea0"}
  119. {"level":"info","ts":1567735641.6620848,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  120. {"level":"info","ts":1567735641.6621048,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  121. {"level":"info","ts":1567735641.6621187,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  122. {"level":"info","ts":1567735641.6621327,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  123. {"level":"info","ts":1567735641.6621475,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  124. {"level":"info","ts":1567735641.6621978,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"license-controller","source":"kind source: /, Kind="}
  125. {"level":"info","ts":1567735641.662225,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"license-controller","source":"kind source: /, Kind="}
  126. {"level":"info","ts":1567735641.6622636,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"trial-controller","source":"kind source: /, Kind="}
  127. {"level":"info","ts":1567735641.6622765,"logger":"manager","msg":"Setting up webhooks"}
  128. {"level":"info","ts":1567735641.6751645,"logger":"manager","msg":"Starting the manager","uuid":"0efbabf6-d04b-11e9-909b-eea7a42f1800","namespace":"elastic-system","version":"0.9.0","build_hash":"8280d41","build_date":"2019-07-29T14:26:01Z","build_snapshot":"false"}
  129. {"level":"info","ts":1567735641.7754798,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"apm-es-association-controller"}
  130. {"level":"info","ts":1567735641.7755926,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"elasticsearch-controller"}
  131. {"level":"info","ts":1567735641.7756221,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"apmserver-controller"}
  132. {"level":"info","ts":1567735641.775633,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"kibana-controller"}
  133. {"level":"info","ts":1567735641.7754889,"logger":"kubebuilder.webhook","msg":"installing webhook configuration in cluster"}
  134. {"level":"info","ts":1567735641.775665,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"license-controller"}
  135. {"level":"info","ts":1567735641.7756948,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"trial-controller"}
  136. {"level":"info","ts":1567735641.775511,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"kibana-association-controller"}
  137. {"level":"info","ts":1567735641.8756967,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"apm-es-association-controller","worker count":1}
  138. {"level":"info","ts":1567735641.8756971,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"apmserver-controller","worker count":1}
  139. {"level":"info","ts":1567735641.8758216,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"kibana-association-controller","worker count":1}
  140. {"level":"info","ts":1567735641.8758419,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"elasticsearch-controller","worker count":1}
  141. {"level":"info","ts":1567735641.8758595,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"kibana-controller","worker count":1}
  142. {"level":"info","ts":1567735641.8758829,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"license-controller","worker count":1}
  143. {"level":"info","ts":1567735641.8759003,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"trial-controller","worker count":1}
  144. {"level":"info","ts":1567735641.8914566,"logger":"kubebuilder.webhook","msg":"starting the webhook server."}
  145. {"level":"info","ts":1567735904.745883,"logger":"license-controller","msg":"Start reconcile iteration","iteration":1,"namespace":"default","es_name":"quickstart"}
  146. {"level":"info","ts":1567735904.7459126,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":1,"namespace":"default","es_name":"quickstart"}
  147. {"level":"info","ts":1567735904.7461405,"logger":"license-controller","msg":"Re-queuing new license check","namespace":"default","es_name":"quickstart","RequeueAfter":3600}
  148. {"level":"info","ts":1567735904.746168,"logger":"license-controller","msg":"End reconcile iteration","iteration":1,"took":0.000286165,"namespace":"default","es_name":"quickstart"}
  149. {"level":"info","ts":1567735934.749632,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":1,"took":30.003719457,"namespace":"default","es_ame":"quickstart"}
  150. {"level":"error","ts":1567735934.7496924,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  151. {"level":"info","ts":1567735935.7499976,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":2,"namespace":"default","es_name":"quickstart"}
  152. {"level":"info","ts":1567735965.752078,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":2,"took":30.002081337,"namespace":"default","es_ame":"quickstart"}
  153. {"level":"error","ts":1567735965.752134,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  154. {"level":"info","ts":1567735966.7524374,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":3,"namespace":"default","es_name":"quickstart"}
  155. {"level":"info","ts":1567735996.75466,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":3,"took":30.002224374,"namespace":"default","es_ame":"quickstart"}
  156. {"level":"error","ts":1567735996.7547152,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  157. {"level":"info","ts":1567735997.7550013,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":4,"namespace":"default","es_name":"quickstart"}
  158. {"level":"info","ts":1567736027.7602708,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":4,"took":30.005271551,"namespace":"default","es_ame":"quickstart"}
  159. {"level":"error","ts":1567736027.7603307,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  160. {"level":"info","ts":1567736028.7605803,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":5,"namespace":"default","es_name":"quickstart"}
  161. {"level":"info","ts":1567736058.762554,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":5,"took":30.001978937,"namespace":"default","es_ame":"quickstart"}
  162. {"level":"error","ts":1567736058.7626107,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  163. {"level":"info","ts":1567736059.7629008,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":6,"namespace":"default","es_name":"quickstart"}
  164. {"level":"info","ts":1567736089.765073,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":6,"took":30.002174628,"namespace":"default","es_ame":"quickstart"}
  165. {"level":"error","ts":1567736089.7651317,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  166. {"level":"info","ts":1567736090.7654142,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":7,"namespace":"default","es_name":"quickstart"}
  167. {"level":"info","ts":1567736120.7675877,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":7,"took":30.002175649,"namespace":"default","es_ame":"quickstart"}
  168. {"level":"error","ts":1567736120.767645,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  169. {"level":"info","ts":1567736121.7679367,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":8,"namespace":"default","es_name":"quickstart"}
  170. {"level":"info","ts":1567736151.7701957,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":8,"took":30.00226105,"namespace":"default","es_ame":"quickstart"}
  171. {"level":"error","ts":1567736151.7702549,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  172. {"level":"info","ts":1567736152.7705572,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":9,"namespace":"default","es_name":"quickstart"}
  173. {"level":"info","ts":1567736182.7727845,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":9,"took":30.002230022,"namespace":"default","es_ame":"quickstart"}
  174. {"level":"error","ts":1567736182.7728431,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  175. {"level":"info","ts":1567736184.053079,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":10,"namespace":"default","es_name":"quickstart"}
  176. {"level":"info","ts":1567736214.0554526,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":10,"took":30.002375031,"namespace":"default","es_ame":"quickstart"}
  177. {"level":"error","ts":1567736214.0555081,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  178. {"level":"info","ts":1567736216.615703,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":11,"namespace":"default","es_name":"quickstart"}
  179.  
  180. ===================================================================
  181. DEBUGGED logs
  182. ===================================================================
  183. 2019-09-06T02:20:54.120Z INFO manager Setting up client for manager
  184. 2019-09-06T02:20:54.127Z INFO manager Setting up manager
  185. 2019-09-06T02:20:54.127Z INFO manager Exposing Prometheus metrics on /metrics {"port": 8080}
  186. 2019-09-06T02:20:54.169Z INFO manager Setting up scheme
  187. 2019-09-06T02:20:54.173Z INFO manager Setting up controllers {"roles": ["all"]}
  188. 2019-09-06T02:20:54.173Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  189. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  190. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  191. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  192. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  193. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apm-es-association-controller", "source": "kind source: /, Kind="}
  194. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apm-es-association-controller", "source": "kind source: /, Kind="}
  195. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  196. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  197. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  198. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  199. 2019-09-06T02:20:54.175Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  200. 2019-09-06T02:20:54.175Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  201. 2019-09-06T02:20:54.175Z DEBUG dynamic-enqueue-request Added new handler registration {"current_registrations": {"-owner":{"OwnerType":{"metadata":{"creationTimestamp":null},"spec":{"http":{"service":{"metadata":{"creationTimestamp":null},"spec":{}},"tls":{"certificate":{}}},"updateStrategy":{}},"status":{"zenDiscovery":{}}},"IsController":true}}}
  202. 2019-09-06T02:20:54.177Z DEBUG dynamic-enqueue-request Added new handler registration {"current_registrations": {"-owner":{"OwnerType":{"metadata":{"creationTimestamp":null},"spec":{"http":{"service":{"metadata":{"creationTimestamp":null},"spec":{}},"tls":{"certificate":{}}},"updateStrategy":{}},"status":{"zenDiscovery":{}}},"IsController":true},"pods-expectations":{}}}
  203. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  204. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  205. 2019-09-06T02:20:54.177Z DEBUG dynamic-enqueue-request Added new handler registration {"current_registrations": {"-owner":{"OwnerType":{"metadata":{"creationTimestamp":null},"spec":{"http":{"service":{"metadata":{"creationTimestamp":null},"spec":{}},"tls":{"certificate":{}}},"updateStrategy":{}},"status":{"zenDiscovery":{}}},"IsController":true}}}
  206. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "channel source: 0xc0002f2190"}
  207. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  208. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  209. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  210. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  211. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  212. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "license-controller", "source": "kind source: /, Kind="}
  213. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "license-controller", "source": "kind source: /, Kind="}
  214. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "trial-controller", "source": "kind source: /, Kind="}
  215. 2019-09-06T02:20:54.177Z INFO manager Setting up webhooks
  216. 2019-09-06T02:20:54.190Z INFO manager Starting the manager {"uuid": "0efbabf6-d04b-11e9-909b-eea7a42f1800", "namespace": "elastic-system", "version": "0.9.0", "build_hash": "8280d41", "build_date": "2019-07-29T14:26:01Z", "build_snapshot": "false"}
  217. 2019-09-06T02:20:54.290Z INFO kubebuilder.webhook installing webhook configuration in cluster
  218. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "elasticsearch-controller"}
  219. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "apmserver-controller"}
  220. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "apm-es-association-controller"}
  221. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "kibana-association-controller"}
  222. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "license-controller"}
  223. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "kibana-controller"}
  224. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "trial-controller"}
  225. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "elasticsearch-controller", "worker count": 1}
  226. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "apm-es-association-controller", "worker count": 1}
  227. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "kibana-association-controller", "worker count": 1}
  228. 2019-09-06T02:20:54.391Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 1, "namespace": "default", "es_name": "quickstart"}
  229. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "apmserver-controller", "worker count": 1}
  230. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "trial-controller", "worker count": 1}
  231. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "license-controller", "worker count": 1}
  232. 2019-09-06T02:20:54.391Z INFO license-controller Start reconcile iteration {"iteration": 1, "namespace": "default", "es_name": "quickstart"}
  233. 2019-09-06T02:20:54.391Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  234. 2019-09-06T02:20:54.391Z INFO license-controller End reconcile iteration {"iteration": 1, "took": "125.411µs", "namespace": "default", "es_name": "quickstart"}
  235. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "kibana-controller", "worker count": 1}
  236. 2019-09-06T02:20:54.391Z DEBUG annotation updating controller version annotation {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  237. 2019-09-06T02:20:54.400Z INFO license-controller Start reconcile iteration {"iteration": 2, "namespace": "default", "es_name": "quickstart"}
  238. 2019-09-06T02:20:54.400Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  239. 2019-09-06T02:20:54.400Z INFO license-controller End reconcile iteration {"iteration": 2, "took": "83.978µs", "namespace": "default", "es_name": "quickstart"}
  240. 2019-09-06T02:20:54.401Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:,APIVersion:,}"}
  241. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "expectations.finalizers.elasticsearch.k8s.elastic.co", "namespace": "default", "name": "quickstart"}
  242. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "observer.finalizers.elasticsearch.k8s.elastic.co", "namespace": "default", "name": "quickstart"}
  243. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "secure-settings.finalizers.elasticsearch.k8s.elastic.co", "namespace": "default", "name": "quickstart"}
  244. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "dynamic-watches.finalizers.k8s.elastic.co/http-certificates", "namespace": "default", "name": "quickstart"}
  245. 2019-09-06T02:20:54.404Z INFO license-controller Start reconcile iteration {"iteration": 3, "namespace": "default", "es_name": "quickstart"}
  246. 2019-09-06T02:20:54.404Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  247. 2019-09-06T02:20:54.404Z INFO license-controller End reconcile iteration {"iteration": 3, "took": "85.508µs", "namespace": "default", "es_name": "quickstart"}
  248. 2019-09-06T02:20:54.408Z INFO kubebuilder.webhook starting the webhook server.
  249. 2019-09-06T02:20:54.505Z INFO generic-reconciler Creating resource {"kind": "ConfigMap", "namespace": "default", "name": "quickstart-es-scripts"}
  250. 2019-09-06T02:20:54.511Z INFO generic-reconciler Creating resource {"kind": "Service", "namespace": "default", "name": "quickstart-es-http"}
  251. 2019-09-06T02:20:54.518Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  252. 2019-09-06T02:20:54.643Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  253. 2019-09-06T02:21:24.648Z INFO elasticsearch-controller Updating status {"iteration": 1, "namespace": "default", "es_name": "quickstart"}
  254. 2019-09-06T02:21:24.651Z DEBUG elasticsearch-controller Conflict while updating status {"namespace": "default", "es_name": "quickstart"}
  255. 2019-09-06T02:21:24.651Z INFO elasticsearch-controller End reconcile iteration {"iteration": 1, "took": "30.260133697s", "namespace": "default", "es_ame": "quickstart"}
  256. 2019-09-06T02:21:24.651Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 2, "namespace": "default", "es_name": "quickstart"}
  257. 2019-09-06T02:21:24.651Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  258. 2019-09-06T02:21:24.651Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  259. 2019-09-06T02:21:24.652Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  260. 2019-09-06T02:21:24.822Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  261. 2019-09-06T02:21:54.824Z INFO elasticsearch-controller Updating status {"iteration": 2, "namespace": "default", "es_name": "quickstart"}
  262. 2019-09-06T02:21:54.828Z INFO generic-reconciler Aggregated reconciliation results complete {"result": {"Requeue":false,"RequeueAfter":0}}
  263. 2019-09-06T02:21:54.828Z INFO elasticsearch-controller End reconcile iteration {"iteration": 2, "took": "30.177159759s", "namespace": "default", "es_ame": "quickstart"}
  264. 2019-09-06T02:21:54.828Z INFO license-controller Start reconcile iteration {"iteration": 4, "namespace": "default", "es_name": "quickstart"}
  265. 2019-09-06T02:21:54.828Z ERROR kubebuilder.controller Reconciler error {"controller": "elasticsearch-controller", "request": "default/quickstart", "error": "Timeout: request did not complete within requested timeout 30s", "errorCauses": [{"error": "Timeout: request did not complete within requested timeout 30s"}]}
  266. github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error
  267. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128
  268. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
  269. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217
  270. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
  271. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158
  272. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1
  273. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
  274. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil
  275. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
  276. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until
  277. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
  278. 2019-09-06T02:21:54.828Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  279. 2019-09-06T02:21:54.828Z INFO license-controller End reconcile iteration {"iteration": 4, "took": "124.108µs", "namespace": "default", "es_name": "quickstart"}
  280. 2019-09-06T02:21:55.829Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 3, "namespace": "default", "es_name": "quickstart"}
  281. 2019-09-06T02:21:55.829Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  282. 2019-09-06T02:21:55.829Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  283. 2019-09-06T02:21:55.829Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  284. 2019-09-06T02:21:56.127Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  285. 2019-09-06T02:22:26.130Z INFO elasticsearch-controller Updating status {"iteration": 3, "namespace": "default", "es_name": "quickstart"}
  286. 2019-09-06T02:22:26.130Z INFO generic-reconciler Aggregated reconciliation results complete {"result": {"Requeue":false,"RequeueAfter":0}}
  287. 2019-09-06T02:22:26.130Z INFO elasticsearch-controller End reconcile iteration {"iteration": 3, "took": "30.301634883s", "namespace": "default", "es_ame": "quickstart"}
  288. 2019-09-06T02:22:26.130Z ERROR kubebuilder.controller Reconciler error {"controller": "elasticsearch-controller", "request": "default/quickstart", "error": "Timeout: request did not complete within requested timeout 30s", "errorCauses": [{"error": "Timeout: request did not complete within requested timeout 30s"}]}
  289. github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error
  290. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128
  291. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
  292. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217
  293. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
  294. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158
  295. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1
  296. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
  297. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil
  298. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
  299. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until
  300. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
  301. 2019-09-06T02:22:27.131Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 4, "namespace": "default", "es_name": "quickstart"}
  302. 2019-09-06T02:22:27.131Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  303. 2019-09-06T02:22:27.131Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  304. 2019-09-06T02:22:27.131Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  305. 2019-09-06T02:22:27.242Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  306. 2019-09-06T02:22:57.245Z INFO elasticsearch-controller Updating status {"iteration": 4, "namespace": "default", "es_name": "quickstart"}
  307. 2019-09-06T02:22:57.245Z INFO generic-reconciler Aggregated reconciliation results complete {"result": {"Requeue":false,"RequeueAfter":0}}
  308. 2019-09-06T02:22:57.245Z INFO elasticsearch-controller End reconcile iteration {"iteration": 4, "took": "30.114189622s", "namespace": "default", "es_ame": "quickstart"}
  309. 2019-09-06T02:22:57.245Z ERROR kubebuilder.controller Reconciler error {"controller": "elasticsearch-controller", "request": "default/quickstart", "error": "Timeout: request did not complete within requested timeout 30s", "errorCauses": [{"error": "Timeout: request did not complete within requested timeout 30s"}]}
  310. github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error
  311. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128
  312. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
  313. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217
  314. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
  315. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158
  316. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1
  317. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
  318. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil
  319. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
  320. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until
  321. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
  322. 2019-09-06T02:22:58.245Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 5, "namespace": "default", "es_name": "quickstart"}
  323. 2019-09-06T02:22:58.245Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  324. 2019-09-06T02:22:58.245Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  325. 2019-09-06T02:22:58.246Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  326. 2019-09-06T02:22:58.427Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
Advertisement
Add Comment
Please, Sign In to add comment