API tools faq
paste
shirishatideal

Untitled

shirishatideal
Sep 5th, 2019
336
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 54.90 KB | None | 0 0
raw download clone embed print report
  1. $ kubectl get all -n elastic-system
  2. NAME READY STATUS RESTARTS AGE
  3. pod/elastic-operator-0 1/1 Running 1 8m38s
  4.  
  5. NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
  6. service/elastic-webhook-service ClusterIP 10.98.37.144 <none> 443/TCP 8m36s
  7.  
  8. NAME READY AGE
  9. statefulset.apps/elastic-operator 1/1 8m39s
  10.  
  11.  
  12. $ kubectl get events -n elastic-system
  13. LAST SEEN TYPE REASON OBJECT MESSAGE
  14. 7m47s Normal Pulled pod/elastic-operator-0 Container image "docker.elastic.co/eck/eck-operator:0.9.0" already present on machine
  15. 7m47s Normal Created pod/elastic-operator-0 Created container manager
  16. 7m48s Normal Scheduled pod/elastic-operator-0 Successfully assigned elastic-system/elastic-operator-0 to ip-10-0-2-226.us-east-2.compute.internal
  17. 7m47s Normal Started pod/elastic-operator-0 Started container manager
  18. 7m49s Warning FailedCreate statefulset/elastic-operator create Pod elastic-operator-0 in StatefulSet elastic-operator failed error: pods "elastic-operator-0" is forbidden: error looking up service account elastic-system/elastic-operator: serviceaccount "elastic-operator" not found
  19. 7m48s Normal SuccessfulCreate statefulset/elastic-operator create Pod elastic-operator-0 in StatefulSet elastic-operator successful
  20.  
  21.  
  22. $ kubectl describe pods -n elastic-system
  23. Name: elastic-operator-0
  24. Namespace: elastic-system
  25. Priority: 0
  26. Node: ip-10-0-2-226.us-east-2.compute.internal/10.0.2.226
  27. Start Time: Fri, 06 Sep 2019 02:07:19 +0000
  28. Labels: control-plane=elastic-operator
  29. controller-revision-hash=elastic-operator-5fc6f94fc
  30. statefulset.kubernetes.io/pod-name=elastic-operator-0
  31. Annotations: <none>
  32. Status: Running
  33. IP: 10.244.1.10
  34. Controlled By: StatefulSet/elastic-operator
  35. Containers:
  36. manager:
  37. Container ID: docker://de9a9be55921ffd399770f8ba44aad83137a74ad3fc467e3ca50805d53217a85
  38. Image: docker.elastic.co/eck/eck-operator:0.9.0
  39. Image ID: docker-pullable://docker.elastic.co/eck/eck-operator@sha256:9f134a7647371fc4e627c592496ff1ef1c3d50d6206fa6fb3571aacdb6ade574
  40. Port: 9876/TCP
  41. Host Port: 0/TCP
  42. Args:
  43. manager
  44. --operator-roles
  45. all
  46. --enable-debug-logs=false
  47. State: Running
  48. Started: Fri, 06 Sep 2019 02:07:21 +0000
  49. Last State: Terminated
  50. Reason: Error
  51. Exit Code: 1
  52. Started: Fri, 06 Sep 2019 02:07:20 +0000
  53. Finished: Fri, 06 Sep 2019 02:07:21 +0000
  54. Ready: True
  55. Restart Count: 1
  56. Limits:
  57. cpu: 1
  58. memory: 100Mi
  59. Requests:
  60. cpu: 100m
  61. memory: 20Mi
  62. Environment:
  63. OPERATOR_NAMESPACE: elastic-system (v1:metadata.namespace)
  64. WEBHOOK_SECRET: webhook-server-secret
  65. WEBHOOK_PODS_LABEL: elastic-operator
  66. OPERATOR_IMAGE: docker.elastic.co/eck/eck-operator:0.9.0
  67. Mounts:
  68. /tmp/cert from cert (ro)
  69. /var/run/secrets/kubernetes.io/serviceaccount from elastic-operator-token-fdtd5 (ro)
  70. Conditions:
  71. Type Status
  72. Initialized True
  73. Ready True
  74. ContainersReady True
  75. PodScheduled True
  76. Volumes:
  77. cert:
  78. Type: Secret (a volume populated by a Secret)
  79. SecretName: webhook-server-secret
  80. Optional: false
  81. elastic-operator-token-fdtd5:
  82. Type: Secret (a volume populated by a Secret)
  83. SecretName: elastic-operator-token-fdtd5
  84. Optional: false
  85. QoS Class: Burstable
  86. Node-Selectors: <none>
  87. Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
  88. node.kubernetes.io/unreachable:NoExecute for 300s
  89. Events:
  90. Type Reason Age From Message
  91. ---- ------ ---- ---- -------
  92. Normal Scheduled 9m8s default-scheduler Successfully assigned elastic-system/elastic-operator-0 to ip-10-0-2-226.us-east-2.compute.internal
  93. Normal Pulled 9m7s (x2 over 9m8s) kubelet, ip-10-0-2-226.us-east-2.compute.internal Container image "docker.elastic.co/eck/eck-operator:0.9.0" already present on machine
  94. Normal Created 9m7s (x2 over 9m8s) kubelet, ip-10-0-2-226.us-east-2.compute.internal Created container manager
  95. Normal Started 9m7s (x2 over 9m8s) kubelet, ip-10-0-2-226.us-east-2.compute.internal Started container manager
  96.  
  97. $ kubectl -n elastic-system logs statefulset.apps/elastic-operator
  98. {"level":"info","ts":1567735641.6141272,"logger":"manager","msg":"Setting up client for manager"}
  99. {"level":"info","ts":1567735641.614334,"logger":"manager","msg":"Setting up manager"}
  100. {"level":"info","ts":1567735641.6143475,"logger":"manager","msg":"Exposing Prometheus metrics on /metrics","port":8080}
  101. {"level":"info","ts":1567735641.6570077,"logger":"manager","msg":"Setting up scheme"}
  102. {"level":"info","ts":1567735641.6611297,"logger":"manager","msg":"Setting up controllers","roles":["all"]}
  103. {"level":"info","ts":1567735641.6612186,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  104. {"level":"info","ts":1567735641.6613305,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  105. {"level":"info","ts":1567735641.6614,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  106. {"level":"info","ts":1567735641.6614866,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  107. {"level":"info","ts":1567735641.6615634,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apmserver-controller","source":"kind source: /, Kind="}
  108. {"level":"info","ts":1567735641.6616178,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apm-es-association-controller","source":"kind source: /, Kind="}
  109. {"level":"info","ts":1567735641.661635,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"apm-es-association-controller","source":"kind source: /, Kind="}
  110. {"level":"info","ts":1567735641.6617289,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  111. {"level":"info","ts":1567735641.661798,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  112. {"level":"info","ts":1567735641.6618204,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  113. {"level":"info","ts":1567735641.6618361,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-association-controller","source":"kind source: /, Kind="}
  114. {"level":"info","ts":1567735641.6618774,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  115. {"level":"info","ts":1567735641.6618965,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  116. {"level":"info","ts":1567735641.661971,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  117. {"level":"info","ts":1567735641.6619945,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"kind source: /, Kind="}
  118. {"level":"info","ts":1567735641.6620219,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"elasticsearch-controller","source":"channel source: 0xc000341ea0"}
  119. {"level":"info","ts":1567735641.6620848,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  120. {"level":"info","ts":1567735641.6621048,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  121. {"level":"info","ts":1567735641.6621187,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  122. {"level":"info","ts":1567735641.6621327,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  123. {"level":"info","ts":1567735641.6621475,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"kibana-controller","source":"kind source: /, Kind="}
  124. {"level":"info","ts":1567735641.6621978,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"license-controller","source":"kind source: /, Kind="}
  125. {"level":"info","ts":1567735641.662225,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"license-controller","source":"kind source: /, Kind="}
  126. {"level":"info","ts":1567735641.6622636,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"trial-controller","source":"kind source: /, Kind="}
  127. {"level":"info","ts":1567735641.6622765,"logger":"manager","msg":"Setting up webhooks"}
  128. {"level":"info","ts":1567735641.6751645,"logger":"manager","msg":"Starting the manager","uuid":"0efbabf6-d04b-11e9-909b-eea7a42f1800","namespace":"elastic-system","version":"0.9.0","build_hash":"8280d41","build_date":"2019-07-29T14:26:01Z","build_snapshot":"false"}
  129. {"level":"info","ts":1567735641.7754798,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"apm-es-association-controller"}
  130. {"level":"info","ts":1567735641.7755926,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"elasticsearch-controller"}
  131. {"level":"info","ts":1567735641.7756221,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"apmserver-controller"}
  132. {"level":"info","ts":1567735641.775633,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"kibana-controller"}
  133. {"level":"info","ts":1567735641.7754889,"logger":"kubebuilder.webhook","msg":"installing webhook configuration in cluster"}
  134. {"level":"info","ts":1567735641.775665,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"license-controller"}
  135. {"level":"info","ts":1567735641.7756948,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"trial-controller"}
  136. {"level":"info","ts":1567735641.775511,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"kibana-association-controller"}
  137. {"level":"info","ts":1567735641.8756967,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"apm-es-association-controller","worker count":1}
  138. {"level":"info","ts":1567735641.8756971,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"apmserver-controller","worker count":1}
  139. {"level":"info","ts":1567735641.8758216,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"kibana-association-controller","worker count":1}
  140. {"level":"info","ts":1567735641.8758419,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"elasticsearch-controller","worker count":1}
  141. {"level":"info","ts":1567735641.8758595,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"kibana-controller","worker count":1}
  142. {"level":"info","ts":1567735641.8758829,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"license-controller","worker count":1}
  143. {"level":"info","ts":1567735641.8759003,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"trial-controller","worker count":1}
  144. {"level":"info","ts":1567735641.8914566,"logger":"kubebuilder.webhook","msg":"starting the webhook server."}
  145. {"level":"info","ts":1567735904.745883,"logger":"license-controller","msg":"Start reconcile iteration","iteration":1,"namespace":"default","es_name":"quickstart"}
  146. {"level":"info","ts":1567735904.7459126,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":1,"namespace":"default","es_name":"quickstart"}
  147. {"level":"info","ts":1567735904.7461405,"logger":"license-controller","msg":"Re-queuing new license check","namespace":"default","es_name":"quickstart","RequeueAfter":3600}
  148. {"level":"info","ts":1567735904.746168,"logger":"license-controller","msg":"End reconcile iteration","iteration":1,"took":0.000286165,"namespace":"default","es_name":"quickstart"}
  149. {"level":"info","ts":1567735934.749632,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":1,"took":30.003719457,"namespace":"default","es_ame":"quickstart"}
  150. {"level":"error","ts":1567735934.7496924,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  151. {"level":"info","ts":1567735935.7499976,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":2,"namespace":"default","es_name":"quickstart"}
  152. {"level":"info","ts":1567735965.752078,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":2,"took":30.002081337,"namespace":"default","es_ame":"quickstart"}
  153. {"level":"error","ts":1567735965.752134,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  154. {"level":"info","ts":1567735966.7524374,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":3,"namespace":"default","es_name":"quickstart"}
  155. {"level":"info","ts":1567735996.75466,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":3,"took":30.002224374,"namespace":"default","es_ame":"quickstart"}
  156. {"level":"error","ts":1567735996.7547152,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  157. {"level":"info","ts":1567735997.7550013,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":4,"namespace":"default","es_name":"quickstart"}
  158. {"level":"info","ts":1567736027.7602708,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":4,"took":30.005271551,"namespace":"default","es_ame":"quickstart"}
  159. {"level":"error","ts":1567736027.7603307,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  160. {"level":"info","ts":1567736028.7605803,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":5,"namespace":"default","es_name":"quickstart"}
  161. {"level":"info","ts":1567736058.762554,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":5,"took":30.001978937,"namespace":"default","es_ame":"quickstart"}
  162. {"level":"error","ts":1567736058.7626107,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  163. {"level":"info","ts":1567736059.7629008,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":6,"namespace":"default","es_name":"quickstart"}
  164. {"level":"info","ts":1567736089.765073,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":6,"took":30.002174628,"namespace":"default","es_ame":"quickstart"}
  165. {"level":"error","ts":1567736089.7651317,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  166. {"level":"info","ts":1567736090.7654142,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":7,"namespace":"default","es_name":"quickstart"}
  167. {"level":"info","ts":1567736120.7675877,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":7,"took":30.002175649,"namespace":"default","es_ame":"quickstart"}
  168. {"level":"error","ts":1567736120.767645,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  169. {"level":"info","ts":1567736121.7679367,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":8,"namespace":"default","es_name":"quickstart"}
  170. {"level":"info","ts":1567736151.7701957,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":8,"took":30.00226105,"namespace":"default","es_ame":"quickstart"}
  171. {"level":"error","ts":1567736151.7702549,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  172. {"level":"info","ts":1567736152.7705572,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":9,"namespace":"default","es_name":"quickstart"}
  173. {"level":"info","ts":1567736182.7727845,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":9,"took":30.002230022,"namespace":"default","es_ame":"quickstart"}
  174. {"level":"error","ts":1567736182.7728431,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  175. {"level":"info","ts":1567736184.053079,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":10,"namespace":"default","es_name":"quickstart"}
  176. {"level":"info","ts":1567736214.0554526,"logger":"elasticsearch-controller","msg":"End reconcile iteration","iteration":10,"took":30.002375031,"namespace":"default","es_ame":"quickstart"}
  177. {"level":"error","ts":1567736214.0555081,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"elasticsearch-controller","request":"default/quickstart","error":"Timeout: request did not complete within requested timeout 30s","stacktrace":"github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217\ngithub.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
  178. {"level":"info","ts":1567736216.615703,"logger":"elasticsearch-controller","msg":"Start reconcile iteration","iteration":11,"namespace":"default","es_name":"quickstart"}
  179.  
  180. ===================================================================
  181. DEBUGGED logs
  182. ===================================================================
  183. 2019-09-06T02:20:54.120Z INFO manager Setting up client for manager
  184. 2019-09-06T02:20:54.127Z INFO manager Setting up manager
  185. 2019-09-06T02:20:54.127Z INFO manager Exposing Prometheus metrics on /metrics {"port": 8080}
  186. 2019-09-06T02:20:54.169Z INFO manager Setting up scheme
  187. 2019-09-06T02:20:54.173Z INFO manager Setting up controllers {"roles": ["all"]}
  188. 2019-09-06T02:20:54.173Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  189. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  190. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  191. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  192. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apmserver-controller", "source": "kind source: /, Kind="}
  193. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apm-es-association-controller", "source": "kind source: /, Kind="}
  194. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "apm-es-association-controller", "source": "kind source: /, Kind="}
  195. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  196. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  197. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  198. 2019-09-06T02:20:54.174Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-association-controller", "source": "kind source: /, Kind="}
  199. 2019-09-06T02:20:54.175Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  200. 2019-09-06T02:20:54.175Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  201. 2019-09-06T02:20:54.175Z DEBUG dynamic-enqueue-request Added new handler registration {"current_registrations": {"-owner":{"OwnerType":{"metadata":{"creationTimestamp":null},"spec":{"http":{"service":{"metadata":{"creationTimestamp":null},"spec":{}},"tls":{"certificate":{}}},"updateStrategy":{}},"status":{"zenDiscovery":{}}},"IsController":true}}}
  202. 2019-09-06T02:20:54.177Z DEBUG dynamic-enqueue-request Added new handler registration {"current_registrations": {"-owner":{"OwnerType":{"metadata":{"creationTimestamp":null},"spec":{"http":{"service":{"metadata":{"creationTimestamp":null},"spec":{}},"tls":{"certificate":{}}},"updateStrategy":{}},"status":{"zenDiscovery":{}}},"IsController":true},"pods-expectations":{}}}
  203. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  204. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "kind source: /, Kind="}
  205. 2019-09-06T02:20:54.177Z DEBUG dynamic-enqueue-request Added new handler registration {"current_registrations": {"-owner":{"OwnerType":{"metadata":{"creationTimestamp":null},"spec":{"http":{"service":{"metadata":{"creationTimestamp":null},"spec":{}},"tls":{"certificate":{}}},"updateStrategy":{}},"status":{"zenDiscovery":{}}},"IsController":true}}}
  206. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "elasticsearch-controller", "source": "channel source: 0xc0002f2190"}
  207. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  208. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  209. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  210. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  211. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "kibana-controller", "source": "kind source: /, Kind="}
  212. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "license-controller", "source": "kind source: /, Kind="}
  213. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "license-controller", "source": "kind source: /, Kind="}
  214. 2019-09-06T02:20:54.177Z INFO kubebuilder.controller Starting EventSource {"controller": "trial-controller", "source": "kind source: /, Kind="}
  215. 2019-09-06T02:20:54.177Z INFO manager Setting up webhooks
  216. 2019-09-06T02:20:54.190Z INFO manager Starting the manager {"uuid": "0efbabf6-d04b-11e9-909b-eea7a42f1800", "namespace": "elastic-system", "version": "0.9.0", "build_hash": "8280d41", "build_date": "2019-07-29T14:26:01Z", "build_snapshot": "false"}
  217. 2019-09-06T02:20:54.290Z INFO kubebuilder.webhook installing webhook configuration in cluster
  218. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "elasticsearch-controller"}
  219. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "apmserver-controller"}
  220. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "apm-es-association-controller"}
  221. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "kibana-association-controller"}
  222. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "license-controller"}
  223. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "kibana-controller"}
  224. 2019-09-06T02:20:54.291Z INFO kubebuilder.controller Starting Controller {"controller": "trial-controller"}
  225. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "elasticsearch-controller", "worker count": 1}
  226. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "apm-es-association-controller", "worker count": 1}
  227. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "kibana-association-controller", "worker count": 1}
  228. 2019-09-06T02:20:54.391Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 1, "namespace": "default", "es_name": "quickstart"}
  229. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "apmserver-controller", "worker count": 1}
  230. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "trial-controller", "worker count": 1}
  231. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "license-controller", "worker count": 1}
  232. 2019-09-06T02:20:54.391Z INFO license-controller Start reconcile iteration {"iteration": 1, "namespace": "default", "es_name": "quickstart"}
  233. 2019-09-06T02:20:54.391Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  234. 2019-09-06T02:20:54.391Z INFO license-controller End reconcile iteration {"iteration": 1, "took": "125.411µs", "namespace": "default", "es_name": "quickstart"}
  235. 2019-09-06T02:20:54.391Z INFO kubebuilder.controller Starting workers {"controller": "kibana-controller", "worker count": 1}
  236. 2019-09-06T02:20:54.391Z DEBUG annotation updating controller version annotation {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  237. 2019-09-06T02:20:54.400Z INFO license-controller Start reconcile iteration {"iteration": 2, "namespace": "default", "es_name": "quickstart"}
  238. 2019-09-06T02:20:54.400Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  239. 2019-09-06T02:20:54.400Z INFO license-controller End reconcile iteration {"iteration": 2, "took": "83.978µs", "namespace": "default", "es_name": "quickstart"}
  240. 2019-09-06T02:20:54.401Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:,APIVersion:,}"}
  241. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "expectations.finalizers.elasticsearch.k8s.elastic.co", "namespace": "default", "name": "quickstart"}
  242. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "observer.finalizers.elasticsearch.k8s.elastic.co", "namespace": "default", "name": "quickstart"}
  243. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "secure-settings.finalizers.elasticsearch.k8s.elastic.co", "namespace": "default", "name": "quickstart"}
  244. 2019-09-06T02:20:54.401Z INFO finalizer Registering finalizer {"finalizer_name": "dynamic-watches.finalizers.k8s.elastic.co/http-certificates", "namespace": "default", "name": "quickstart"}
  245. 2019-09-06T02:20:54.404Z INFO license-controller Start reconcile iteration {"iteration": 3, "namespace": "default", "es_name": "quickstart"}
  246. 2019-09-06T02:20:54.404Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  247. 2019-09-06T02:20:54.404Z INFO license-controller End reconcile iteration {"iteration": 3, "took": "85.508µs", "namespace": "default", "es_name": "quickstart"}
  248. 2019-09-06T02:20:54.408Z INFO kubebuilder.webhook starting the webhook server.
  249. 2019-09-06T02:20:54.505Z INFO generic-reconciler Creating resource {"kind": "ConfigMap", "namespace": "default", "name": "quickstart-es-scripts"}
  250. 2019-09-06T02:20:54.511Z INFO generic-reconciler Creating resource {"kind": "Service", "namespace": "default", "name": "quickstart-es-http"}
  251. 2019-09-06T02:20:54.518Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  252. 2019-09-06T02:20:54.643Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  253. 2019-09-06T02:21:24.648Z INFO elasticsearch-controller Updating status {"iteration": 1, "namespace": "default", "es_name": "quickstart"}
  254. 2019-09-06T02:21:24.651Z DEBUG elasticsearch-controller Conflict while updating status {"namespace": "default", "es_name": "quickstart"}
  255. 2019-09-06T02:21:24.651Z INFO elasticsearch-controller End reconcile iteration {"iteration": 1, "took": "30.260133697s", "namespace": "default", "es_ame": "quickstart"}
  256. 2019-09-06T02:21:24.651Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 2, "namespace": "default", "es_name": "quickstart"}
  257. 2019-09-06T02:21:24.651Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  258. 2019-09-06T02:21:24.651Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  259. 2019-09-06T02:21:24.652Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  260. 2019-09-06T02:21:24.822Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  261. 2019-09-06T02:21:54.824Z INFO elasticsearch-controller Updating status {"iteration": 2, "namespace": "default", "es_name": "quickstart"}
  262. 2019-09-06T02:21:54.828Z INFO generic-reconciler Aggregated reconciliation results complete {"result": {"Requeue":false,"RequeueAfter":0}}
  263. 2019-09-06T02:21:54.828Z INFO elasticsearch-controller End reconcile iteration {"iteration": 2, "took": "30.177159759s", "namespace": "default", "es_ame": "quickstart"}
  264. 2019-09-06T02:21:54.828Z INFO license-controller Start reconcile iteration {"iteration": 4, "namespace": "default", "es_name": "quickstart"}
  265. 2019-09-06T02:21:54.828Z ERROR kubebuilder.controller Reconciler error {"controller": "elasticsearch-controller", "request": "default/quickstart", "error": "Timeout: request did not complete within requested timeout 30s", "errorCauses": [{"error": "Timeout: request did not complete within requested timeout 30s"}]}
  266. github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error
  267. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128
  268. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
  269. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217
  270. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
  271. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158
  272. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1
  273. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
  274. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil
  275. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
  276. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until
  277. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
  278. 2019-09-06T02:21:54.828Z INFO license-controller Re-queuing new license check {"namespace": "default", "es_name": "quickstart", "RequeueAfter": "1h0m0s"}
  279. 2019-09-06T02:21:54.828Z INFO license-controller End reconcile iteration {"iteration": 4, "took": "124.108µs", "namespace": "default", "es_name": "quickstart"}
  280. 2019-09-06T02:21:55.829Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 3, "namespace": "default", "es_name": "quickstart"}
  281. 2019-09-06T02:21:55.829Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  282. 2019-09-06T02:21:55.829Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  283. 2019-09-06T02:21:55.829Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  284. 2019-09-06T02:21:56.127Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  285. 2019-09-06T02:22:26.130Z INFO elasticsearch-controller Updating status {"iteration": 3, "namespace": "default", "es_name": "quickstart"}
  286. 2019-09-06T02:22:26.130Z INFO generic-reconciler Aggregated reconciliation results complete {"result": {"Requeue":false,"RequeueAfter":0}}
  287. 2019-09-06T02:22:26.130Z INFO elasticsearch-controller End reconcile iteration {"iteration": 3, "took": "30.301634883s", "namespace": "default", "es_ame": "quickstart"}
  288. 2019-09-06T02:22:26.130Z ERROR kubebuilder.controller Reconciler error {"controller": "elasticsearch-controller", "request": "default/quickstart", "error": "Timeout: request did not complete within requested timeout 30s", "errorCauses": [{"error": "Timeout: request did not complete within requested timeout 30s"}]}
  289. github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error
  290. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128
  291. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
  292. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217
  293. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
  294. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158
  295. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1
  296. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
  297. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil
  298. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
  299. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until
  300. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
  301. 2019-09-06T02:22:27.131Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 4, "namespace": "default", "es_name": "quickstart"}
  302. 2019-09-06T02:22:27.131Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  303. 2019-09-06T02:22:27.131Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  304. 2019-09-06T02:22:27.131Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  305. 2019-09-06T02:22:27.242Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
  306. 2019-09-06T02:22:57.245Z INFO elasticsearch-controller Updating status {"iteration": 4, "namespace": "default", "es_name": "quickstart"}
  307. 2019-09-06T02:22:57.245Z INFO generic-reconciler Aggregated reconciliation results complete {"result": {"Requeue":false,"RequeueAfter":0}}
  308. 2019-09-06T02:22:57.245Z INFO elasticsearch-controller End reconcile iteration {"iteration": 4, "took": "30.114189622s", "namespace": "default", "es_ame": "quickstart"}
  309. 2019-09-06T02:22:57.245Z ERROR kubebuilder.controller Reconciler error {"controller": "elasticsearch-controller", "request": "default/quickstart", "error": "Timeout: request did not complete within requested timeout 30s", "errorCauses": [{"error": "Timeout: request did not complete within requested timeout 30s"}]}
  310. github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr.(*zapLogger).Error
  311. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/github.com/go-logr/zapr/zapr.go:128
  312. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
  313. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:217
  314. github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
  315. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158
  316. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1
  317. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
  318. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil
  319. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
  320. github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait.Until
  321. /go/src/github.com/elastic/cloud-on-k8s/operators/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
  322. 2019-09-06T02:22:58.245Z INFO elasticsearch-controller Start reconcile iteration {"iteration": 5, "namespace": "default", "es_name": "quickstart"}
  323. 2019-09-06T02:22:58.245Z DEBUG annotation Current controller version on resource is compatible with running controller version {"controller_version": "0.9.0", "resource_controller_version": "0.9.0", "namespace": "default", "name": "quickstart"}
  324. 2019-09-06T02:22:58.245Z DEBUG annotation Skipping controller version annotation update, version already matches {"namespace": "default", "name": "quickstart", "kind": "&TypeMeta{Kind:Elasticsearch,APIVersion:elasticsearch.k8s.elastic.co/v1alpha1,}"}
  325. 2019-09-06T02:22:58.246Z INFO certificates No internal CA certificate Secret found, creating a new one {"owner_namespace": "default", "owner_name": "quickstart", "ca_type": "http"}
  326. 2019-09-06T02:22:58.427Z INFO generic-reconciler Creating resource {"kind": "Secret", "namespace": "default", "name": "quickstart-es-http-ca-internal"}
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!