API tools faq
paste
Advertisement
Guest User

RancherLogFailedClusterCreation

a guest
Nov 25th, 2020
126
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 74.67 KB | None | 0 0
raw download clone embed print report
  1. .cattle.io/v3/namespaces/c-l2b6w/projects/p-j9fs5,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:generic-garbage-collector,client:127.0.0.1 (started: 2020-11-25 23:09:08.995633688 +0000 UTC m=+78.048531082) (total time: 2.142927787s):
  2. Trace[1214998207]: [2.142745206s] [2.142706216s] About to write a response
  3. I1125 23:09:11.139254 27 trace.go:116] Trace[1569246510]: "Get" url:/api/v1/namespaces/kube-system/pods/coredns-7944c66d8d-pbw9j,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:09.048255384 +0000 UTC m=+78.101152777) (total time: 2.090960845s):
  4. Trace[1569246510]: [2.090724082s] [2.090710672s] About to write a response
  5. I1125 23:09:11.140110 27 trace.go:116] Trace[723608578]: "Get" url:/apis/management.cattle.io/v3/namespaces/local/clusterroletemplatebindings/u-b4qkhsnliz-admin,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:generic-garbage-collector,client:127.0.0.1 (started: 2020-11-25 23:09:08.995153446 +0000 UTC m=+78.048050837) (total time: 2.144923964s):
  6. Trace[723608578]: [2.144804045s] [2.144767568s] About to write a response
  7. I1125 23:09:11.140230 27 trace.go:116] Trace[1275890467]: "Get" url:/apis/management.cattle.io/v3/namespaces/local/projects/p-ngbdk,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:generic-garbage-collector,client:127.0.0.1 (started: 2020-11-25 23:09:08.996043156 +0000 UTC m=+78.048940550) (total time: 2.144154602s):
  8. Trace[1275890467]: [2.143935954s] [2.143867968s] About to write a response
  9. I1125 23:09:11.140750 27 trace.go:116] Trace[2146934294]: "Get" url:/apis/management.cattle.io/v3/namespaces/c-l2b6w/clusterroletemplatebindings/creator-cluster-owner,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:generic-garbage-collector,client:127.0.0.1 (started: 2020-11-25 23:09:08.994372851 +0000 UTC m=+78.047270241) (total time: 2.146348577s):
  10. Trace[2146934294]: [2.146237238s] [2.146197448s] About to write a response
  11. I1125 23:09:11.141310 27 trace.go:116] Trace[433379932]: "Get" url:/apis/management.cattle.io/v3/namespaces/c-l2b6w/projects/p-6gjsq,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:generic-garbage-collector,client:127.0.0.1 (started: 2020-11-25 23:09:08.997502632 +0000 UTC m=+78.050400026) (total time: 2.143755048s):
  12. Trace[433379932]: [2.143588139s] [2.143523439s] About to write a response
  13. I1125 23:09:11.142580 27 trace.go:116] Trace[1960014830]: "Get" url:/apis/management.cattle.io/v3/namespaces/local/projects/p-ttw4b,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:generic-garbage-collector,client:127.0.0.1 (started: 2020-11-25 23:09:08.997032643 +0000 UTC m=+78.049930026) (total time: 2.145516287s):
  14. Trace[1960014830]: [2.145330864s] [2.145289079s] About to write a response
  15. 2020/11/25 23:09:11 [INFO] Starting container [rke-worker-port-listener] on host [192.168.1.137], try #1
  16. 2020-11-25 23:09:12.139052 W | etcdserver: request "header:<ID:7587850696702651161 > txn:<compare:<target:MOD key:\"/registry/leases/kube-system/kube-scheduler\" mod_revision:4637 > success:<request_put:<key:\"/registry/leases/kube-system/kube-scheduler\" value_size:407 >> failure:<request_range:<key:\"/registry/leases/kube-system/kube-scheduler\" > >>" with result "size:16" took too long (571.750316ms) to execute
  17. I1125 23:09:12.143220 27 trace.go:116] Trace[690750193]: "Create" url:/api/v1/namespaces/cattle-system/events,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:11.146211335 +0000 UTC m=+80.199108738) (total time: 996.369202ms):
  18. Trace[690750193]: [996.160454ms] [996.072528ms] Object stored in database
  19. 2020-11-25 23:09:12.144411 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/cloud-controller-manager\" " with result "range_response_count:1 size:494" took too long (987.496512ms) to execute
  20. I1125 23:09:12.145129 27 trace.go:116] Trace[1465514726]: "GuaranteedUpdate etcd3" type:*coordination.Lease (started: 2020-11-25 23:09:11.149471215 +0000 UTC m=+80.202368633) (total time: 995.622886ms):
  21. Trace[1465514726]: [995.588468ms] [994.581406ms] Transaction committed
  22. I1125 23:09:12.147442 27 trace.go:116] Trace[201523748]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:11.149197933 +0000 UTC m=+80.202095327) (total time: 998.231162ms):
  23. Trace[201523748]: [998.210186ms] [998.023397ms] Object stored in database
  24. I1125 23:09:12.146052 27 trace.go:116] Trace[1725821692]: "GuaranteedUpdate etcd3" type:*coordination.Lease (started: 2020-11-25 23:09:11.152555066 +0000 UTC m=+80.205452492) (total time: 993.465043ms):
  25. Trace[1725821692]: [993.417107ms] [992.694626ms] Transaction committed
  26. I1125 23:09:12.147791 27 trace.go:116] Trace[349401867]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:11.152354883 +0000 UTC m=+80.205252268) (total time: 995.418956ms):
  27. Trace[349401867]: [995.364249ms] [995.217978ms] Object stored in database
  28. I1125 23:09:12.147387 27 trace.go:116] Trace[471131550]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cloud-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:11.154590392 +0000 UTC m=+80.207487793) (total time: 992.778227ms):
  29. Trace[471131550]: [992.749939ms] [992.738761ms] About to write a response
  30. I1125 23:09:12.151176 27 trace.go:116] Trace[670441096]: "GuaranteedUpdate etcd3" type:*apps.Deployment (started: 2020-11-25 23:09:11.17231418 +0000 UTC m=+80.225211585) (total time: 978.834776ms):
  31. Trace[670441096]: [978.766529ms] [976.473988ms] Transaction committed
  32. I1125 23:09:12.152067 27 trace.go:116] Trace[1740716185]: "GuaranteedUpdate etcd3" type:*core.ConfigMap (started: 2020-11-25 23:09:11.168453018 +0000 UTC m=+80.221350444) (total time: 983.600348ms):
  33. Trace[1740716185]: [983.585033ms] [982.915386ms] Transaction committed
  34. I1125 23:09:12.152328 27 trace.go:116] Trace[1853579596]: "Update" url:/api/v1/namespaces/kube-system/configmaps/k3s,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:11.168218922 +0000 UTC m=+80.221116315) (total time: 984.092068ms):
  35. Trace[1853579596]: [983.93121ms] [983.7495ms] Object stored in database
  36. I1125 23:09:12.152993 27 trace.go:116] Trace[1646860384]: "GuaranteedUpdate etcd3" type:*core.Pod (started: 2020-11-25 23:09:11.171846979 +0000 UTC m=+80.224744390) (total time: 981.130235ms):
  37. Trace[1646860384]: [981.042685ms] [976.992866ms] Transaction committed
  38. I1125 23:09:12.153539 27 trace.go:116] Trace[792532157]: "Patch" url:/api/v1/namespaces/kube-system/pods/coredns-7944c66d8d-pbw9j/status,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:11.171635867 +0000 UTC m=+80.224533259) (total time: 981.678697ms):
  39. Trace[792532157]: [981.447906ms] [978.251856ms] Object stored in database
  40. I1125 23:09:12.155694 27 trace.go:116] Trace[1911531143]: "GuaranteedUpdate etcd3" type:*apps.Deployment (started: 2020-11-25 23:09:11.168438806 +0000 UTC m=+80.221336219) (total time: 987.217056ms):
  41. Trace[1911531143]: [987.171715ms] [984.636338ms] Transaction committed
  42. I1125 23:09:12.155983 27 trace.go:116] Trace[2109442338]: "Update" url:/apis/apps/v1/namespaces/cattle-system/deployments/rancher-webhook/status,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:deployment-controller,client:127.0.0.1 (started: 2020-11-25 23:09:11.1680744 +0000 UTC m=+80.220971806) (total time: 987.843727ms):
  43. Trace[2109442338]: [987.730036ms] [987.505321ms] Object stored in database
  44. I1125 23:09:12.157901 27 trace.go:116] Trace[1805178827]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (started: 2020-11-25 23:09:11.136627464 +0000 UTC m=+80.189524861) (total time: 1.021254724s):
  45. Trace[1805178827]: [1.021242306s] [994.595164ms] Transaction committed
  46. I1125 23:09:12.159232 27 trace.go:116] Trace[2018736682]: "GuaranteedUpdate etcd3" type:*core.ConfigMap (started: 2020-11-25 23:09:11.159085174 +0000 UTC m=+80.211982575) (total time: 1.000104584s):
  47. Trace[2018736682]: [1.000068588s] [998.769365ms] Transaction committed
  48. I1125 23:09:12.159693 27 trace.go:116] Trace[1063021244]: "Update" url:/api/v1/namespaces/kube-system/configmaps/cattle-controllers,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:11.158551347 +0000 UTC m=+80.211448751) (total time: 1.001122398s):
  49. Trace[1063021244]: [1.000722446s] [1.00034887s] Object stored in database
  50. I1125 23:09:12.160931 27 trace.go:116] Trace[1904887152]: "Update" url:/apis/apps/v1/namespaces/kube-system/deployments/coredns/status,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:deployment-controller,client:127.0.0.1 (started: 2020-11-25 23:09:11.171861893 +0000 UTC m=+80.224759280) (total time: 989.049778ms):
  51. Trace[1904887152]: [979.526459ms] [979.173105ms] Object stored in database
  52. 2020-11-25 23:09:12.920912 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/projectroletemplatebindings\" range_end:\"/registry/management.cattle.io/projectroletemplatebindingt\" count_only:true " with result "range_response_count:0 size:7" took too long (810.788559ms) to execute
  53. 2020-11-25 23:09:12.921771 W | etcdserver: read-only range request "key:\"/registry/validatingwebhookconfigurations\" range_end:\"/registry/validatingwebhookconfigurationt\" count_only:true " with result "range_response_count:0 size:7" took too long (1.375210269s) to execute
  54. 2020-11-25 23:09:12.922555 W | etcdserver: request "header:<ID:7587850696702651171 > txn:<compare:<target:MOD key:\"/registry/services/endpoints/kube-system/cloud-controller-manager\" mod_revision:4638 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/cloud-controller-manager\" value_size:500 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/cloud-controller-manager\" > >>" with result "size:16" took too long (630.776214ms) to execute
  55. I1125 23:09:12.926540 27 trace.go:116] Trace[293218182]: "GuaranteedUpdate etcd3" type:*discovery.EndpointSlice (started: 2020-11-25 23:09:12.170152953 +0000 UTC m=+81.223050357) (total time: 756.349609ms):
  56. Trace[293218182]: [756.299745ms] [755.265354ms] Transaction committed
  57. I1125 23:09:12.927420 27 trace.go:116] Trace[885410224]: "Update" url:/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/kube-dns-v9c2d,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:endpointslice-controller,client:127.0.0.1 (started: 2020-11-25 23:09:12.169766004 +0000 UTC m=+81.222663385) (total time: 757.617559ms):
  58. Trace[885410224]: [756.98687ms] [756.637836ms] Object stored in database
  59. I1125 23:09:12.928576 27 trace.go:116] Trace[651839940]: "GuaranteedUpdate etcd3" type:*core.Endpoints (started: 2020-11-25 23:09:12.168762332 +0000 UTC m=+81.221659743) (total time: 759.790729ms):
  60. Trace[651839940]: [759.770855ms] [759.127207ms] Transaction committed
  61. I1125 23:09:12.928863 27 trace.go:116] Trace[345132811]: "Update" url:/api/v1/namespaces/kube-system/endpoints/kube-dns,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:endpoint-controller,client:127.0.0.1 (started: 2020-11-25 23:09:12.168604421 +0000 UTC m=+81.221501789) (total time: 760.203021ms):
  62. Trace[345132811]: [760.117861ms] [759.998933ms] Object stored in database
  63. I1125 23:09:12.929215 27 trace.go:116] Trace[36659559]: "GuaranteedUpdate etcd3" type:*core.Endpoints (started: 2020-11-25 23:09:12.15399803 +0000 UTC m=+81.206895426) (total time: 775.161344ms):
  64. Trace[36659559]: [775.141443ms] [771.399725ms] Transaction committed
  65. I1125 23:09:12.929398 27 trace.go:116] Trace[1759910682]: "Update" url:/api/v1/namespaces/kube-system/endpoints/cloud-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:12.151548268 +0000 UTC m=+81.204445665) (total time: 777.824185ms):
  66. Trace[1759910682]: [777.782709ms] [775.619699ms] Object stored in database
  67. 2020-11-25 23:09:14.506187 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:275" took too long (2.338279399s) to execute
  68. 2020-11-25 23:09:14.506909 W | etcdserver: read-only range request "key:\"/registry/services/specs\" range_end:\"/registry/services/spect\" count_only:true " with result "range_response_count:0 size:7" took too long (2.347663442s) to execute
  69. 2020-11-25 23:09:14.507769 W | etcdserver: read-only range request "key:\"/registry/csidrivers\" range_end:\"/registry/csidrivert\" count_only:true " with result "range_response_count:0 size:5" took too long (2.248477689s) to execute
  70. 2020-11-25 23:09:14.508073 W | etcdserver: request "header:<ID:7587850696702651175 > txn:<compare:<target:MOD key:\"/registry/leases/kube-node-lease/local-node\" mod_revision:4636 > success:<request_put:<key:\"/registry/leases/kube-node-lease/local-node\" value_size:538 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/local-node\" > >>" with result "size:16" took too long (1.429087478s) to execute
  71. 2020-11-25 23:09:14.509705 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" limit:500 " with result "range_response_count:37 size:31779" took too long (2.053133736s) to execute
  72. 2020-11-25 23:09:14.510805 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/cloud-controller-manager\" " with result "range_response_count:1 size:494" took too long (1.577327298s) to execute
  73. 2020-11-25 23:09:14.511327 W | etcdserver: read-only range request "key:\"/registry/horizontalpodautoscalers\" range_end:\"/registry/horizontalpodautoscalert\" count_only:true " with result "range_response_count:0 size:5" took too long (1.798550409s) to execute
  74. 2020-11-25 23:09:14.514663 W | etcdserver: read-only range request "key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" limit:500 " with result "range_response_count:108 size:96114" took too long (2.054625674s) to execute
  75. 2020-11-25 23:09:14.515168 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/globalroles/\" range_end:\"/registry/management.cattle.io/globalroles0\" limit:500 " with result "range_response_count:18 size:25966" took too long (2.0561782s) to execute
  76. 2020-11-25 23:09:14.515853 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/roletemplates/\" range_end:\"/registry/management.cattle.io/roletemplates0\" limit:500 " with result "range_response_count:39 size:67347" took too long (2.056473027s) to execute
  77. 2020-11-25 23:09:14.516596 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings/\" range_end:\"/registry/clusterrolebindings0\" limit:500 " with result "range_response_count:87 size:72281" took too long (2.058507375s) to execute
  78. 2020-11-25 23:09:14.517259 W | etcdserver: read-only range request "key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" limit:500 " with result "range_response_count:108 size:96114" took too long (2.058607671s) to execute
  79. 2020-11-25 23:09:14.517728 W | etcdserver: read-only range request "key:\"/registry/pods/cattle-system/rancher-webhook-6977f86c5f-kxfxw\" " with result "range_response_count:1 size:3161" took too long (1.426218955s) to execute
  80. 2020-11-25 23:09:14.518022 W | etcdserver: read-only range request "key:\"/registry/configmaps/kube-system/k3s\" " with result "range_response_count:1 size:502" took too long (347.776344ms) to execute
  81. 2020-11-25 23:09:14.518349 W | etcdserver: read-only range request "key:\"/registry/configmaps/kube-system/cattle-controllers\" " with result "range_response_count:1 size:536" took too long (351.28392ms) to execute
  82. 2020-11-25 23:09:14.518653 W | etcdserver: read-only range request "key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" limit:500 " with result "range_response_count:77 size:59805" took too long (2.059070231s) to execute
  83. 2020-11-25 23:09:14.519239 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/kube-scheduler\" " with result "range_response_count:1 size:569" took too long (361.188476ms) to execute
  84. 2020-11-25 23:09:14.519374 W | etcdserver: read-only range request "key:\"/registry/fleet.cattle.io/clusterregistrationtokens\" range_end:\"/registry/fleet.cattle.io/clusterregistrationtokent\" count_only:true " with result "range_response_count:0 size:7" took too long (594.68529ms) to execute
  85. 2020-11-25 23:09:14.519583 W | etcdserver: read-only range request "key:\"/registry/storageclasses\" range_end:\"/registry/storageclasset\" count_only:true " with result "range_response_count:0 size:5" took too long (907.350869ms) to execute
  86. 2020-11-25 23:09:14.519703 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/kube-controller-manager\" " with result "range_response_count:1 size:587" took too long (361.368414ms) to execute
  87. 2020-11-25 23:09:14.519743 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/authconfigs\" range_end:\"/registry/management.cattle.io/authconfigt\" count_only:true " with result "range_response_count:0 size:7" took too long (989.975819ms) to execute
  88. I1125 23:09:14.521041 27 trace.go:116] Trace[609667330]: "Get" url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:12.161609762 +0000 UTC m=+81.214507145) (total time: 2.359393731s):
  89. Trace[609667330]: [2.359351148s] [2.359344876s] About to write a response
  90. I1125 23:09:14.523766 27 trace.go:116] Trace[1087830368]: "List etcd3" key:/clusterroles,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:12.454911237 +0000 UTC m=+81.507808624) (total time: 2.068823886s):
  91. Trace[1087830368]: [2.068823886s] [2.068823886s] END
  92. I1125 23:09:14.529146 27 trace.go:116] Trace[34426616]: "List etcd3" key:/management.cattle.io/globalroles,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:12.455621127 +0000 UTC m=+81.508518490) (total time: 2.073481368s):
  93. Trace[34426616]: [2.073481368s] [2.073481368s] END
  94. I1125 23:09:14.530414 27 trace.go:116] Trace[1372279856]: "Create" url:/api/v1/namespaces/cattle-system/events,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:13.082177733 +0000 UTC m=+82.135075123) (total time: 1.448204874s):
  95. Trace[1372279856]: [1.448148361s] [1.447960564s] Object stored in database
  96. I1125 23:09:14.531565 27 trace.go:116] Trace[875430054]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cloud-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:12.932919615 +0000 UTC m=+81.985816994) (total time: 1.598607405s):
  97. Trace[875430054]: [1.598550016s] [1.59854076s] About to write a response
  98. I1125 23:09:14.534567 27 trace.go:116] Trace[388902735]: "List etcd3" key:/roles,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:12.456215663 +0000 UTC m=+81.509113056) (total time: 2.078310154s):
  99. Trace[388902735]: [2.078310154s] [2.078310154s] END
  100. I1125 23:09:14.539533 27 trace.go:116] Trace[650127769]: "List" url:/apis/rbac.authorization.k8s.io/v1/roles,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:12.45619093 +0000 UTC m=+81.509088290) (total time: 2.083125747s):
  101. Trace[650127769]: [2.078400846s] [2.078389408s] Listing from storage done
  102. I1125 23:09:14.542909 27 trace.go:116] Trace[890639486]: "GuaranteedUpdate etcd3" type:*coordination.Lease (started: 2020-11-25 23:09:12.714682823 +0000 UTC m=+81.767580233) (total time: 1.828128035s):
  103. Trace[890639486]: [1.828104593s] [1.827300809s] Transaction committed
  104. I1125 23:09:14.543316 27 trace.go:116] Trace[115240279]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/local-node,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:12.714376532 +0000 UTC m=+81.767273925) (total time: 1.828891273s):
  105. Trace[115240279]: [1.828743159s] [1.828546407s] Object stored in database
  106. I1125 23:09:14.546121 27 trace.go:116] Trace[2132633739]: "List" url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:12.454848845 +0000 UTC m=+81.507746222) (total time: 2.091220725s):
  107. Trace[2132633739]: [2.068948564s] [2.068890473s] Listing from storage done
  108. I1125 23:09:14.553217 27 trace.go:116] Trace[218414337]: "List" url:/apis/management.cattle.io/v3/globalroles,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:12.45556338 +0000 UTC m=+81.508460739) (total time: 2.097592926s):
  109. Trace[218414337]: [2.07403511s] [2.073994335s] Listing from storage done
  110. I1125 23:09:14.567728 27 trace.go:116] Trace[686026465]: "List etcd3" key:/rolebindings,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:12.45461369 +0000 UTC m=+81.507511082) (total time: 2.113064307s):
  111. Trace[686026465]: [2.113064307s] [2.113064307s] END
  112. I1125 23:09:14.570061 27 trace.go:116] Trace[319430582]: "List etcd3" key:/clusterroles,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:12.454297693 +0000 UTC m=+81.507195121) (total time: 2.115721894s):
  113. Trace[319430582]: [2.115721894s] [2.115721894s] END
  114. I1125 23:09:14.577090 27 trace.go:116] Trace[616371778]: "List" url:/apis/rbac.authorization.k8s.io/v1/rolebindings,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:12.454586852 +0000 UTC m=+81.507484226) (total time: 2.122354181s):
  115. Trace[616371778]: [2.113172292s] [2.11316211s] Listing from storage done
  116. I1125 23:09:14.583224 27 trace.go:116] Trace[658695715]: "List" url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:12.45427406 +0000 UTC m=+81.507171478) (total time: 2.12887656s):
  117. Trace[658695715]: [2.115951043s] [2.11593405s] Listing from storage done
  118. I1125 23:09:14.592544 27 trace.go:116] Trace[1918355128]: "Get" url:/api/v1/namespaces/cattle-system/pods/rancher-webhook-6977f86c5f-kxfxw,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:13.087526783 +0000 UTC m=+82.140424178) (total time: 1.504972366s):
  119. Trace[1918355128]: [1.504844431s] [1.504832153s] About to write a response
  120. I1125 23:09:14.595644 27 trace.go:116] Trace[1851686604]: "List etcd3" key:/clusterrolebindings,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:12.45358462 +0000 UTC m=+81.506482016) (total time: 2.141994294s):
  121. Trace[1851686604]: [2.141994294s] [2.141994294s] END
  122. I1125 23:09:14.599980 27 trace.go:116] Trace[342293876]: "List" url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:12.453542637 +0000 UTC m=+81.506440020) (total time: 2.146390374s):
  123. Trace[342293876]: [2.142253463s] [2.142222338s] Listing from storage done
  124. I1125 23:09:14.623606 27 trace.go:116] Trace[319578278]: "List etcd3" key:/management.cattle.io/roletemplates,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:12.455913928 +0000 UTC m=+81.508811289) (total time: 2.167660219s):
  125. Trace[319578278]: [2.167660219s] [2.167660219s] END
  126. I1125 23:09:14.631125 27 trace.go:116] Trace[1113536809]: "List" url:/apis/management.cattle.io/v3/roletemplates,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:12.455880471 +0000 UTC m=+81.508777830) (total time: 2.175177306s):
  127. Trace[1113536809]: [2.168600991s] [2.168572142s] Listing from storage done
  128. 2020-11-25 23:09:15.388829 W | etcdserver: read-only range request "key:\"/registry/endpointslices/default/kubernetes\" " with result "range_response_count:1 size:471" took too long (824.420872ms) to execute
  129. 2020-11-25 23:09:15.389581 W | etcdserver: request "header:<ID:7587850696702651183 > txn:<compare:<target:MOD key:\"/registry/services/endpoints/kube-system/kube-scheduler\" mod_revision:4652 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/kube-scheduler\" value_size:490 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/kube-scheduler\" > >>" with result "size:16" took too long (431.357872ms) to execute
  130. I1125 23:09:15.391478 27 trace.go:116] Trace[1399474134]: "GuaranteedUpdate etcd3" type:*core.Endpoints (started: 2020-11-25 23:09:14.588788752 +0000 UTC m=+83.641686176) (total time: 802.637812ms):
  131. Trace[1399474134]: [802.570758ms] [801.938656ms] Transaction committed
  132. I1125 23:09:15.392009 27 trace.go:116] Trace[1863359211]: "Update" url:/api/v1/namespaces/kube-system/endpoints/kube-scheduler,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:14.588582009 +0000 UTC m=+83.641479402) (total time: 803.389129ms):
  133. Trace[1863359211]: [803.283412ms] [803.126684ms] Object stored in database
  134. I1125 23:09:15.392767 27 trace.go:116] Trace[1684926012]: "GuaranteedUpdate etcd3" type:*core.ConfigMap (started: 2020-11-25 23:09:14.617064968 +0000 UTC m=+83.669962355) (total time: 775.673809ms):
  135. Trace[1684926012]: [775.60575ms] [775.165232ms] Transaction committed
  136. I1125 23:09:15.393474 27 trace.go:116] Trace[281053761]: "Update" url:/api/v1/namespaces/kube-system/configmaps/k3s,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:14.616891514 +0000 UTC m=+83.669788877) (total time: 776.549431ms):
  137. Trace[281053761]: [776.286095ms] [776.152194ms] Object stored in database
  138. I1125 23:09:15.391478 27 trace.go:116] Trace[1262526697]: "GuaranteedUpdate etcd3" type:*core.ConfigMap (started: 2020-11-25 23:09:14.584554389 +0000 UTC m=+83.637451796) (total time: 806.89407ms):
  139. Trace[1262526697]: [806.804795ms] [806.143984ms] Transaction committed
  140. I1125 23:09:15.395034 27 trace.go:116] Trace[1857004299]: "Get" url:/apis/discovery.k8s.io/v1beta1/namespaces/default/endpointslices/kubernetes,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:14.560804701 +0000 UTC m=+83.613702216) (total time: 834.190677ms):
  141. Trace[1857004299]: [834.105125ms] [834.09456ms] About to write a response
  142. I1125 23:09:15.399633 27 trace.go:116] Trace[185914402]: "Update" url:/api/v1/namespaces/kube-system/configmaps/cattle-controllers,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:14.58428895 +0000 UTC m=+83.637186337) (total time: 815.278551ms):
  143. Trace[185914402]: [814.05983ms] [813.863675ms] Object stored in database
  144. I1125 23:09:15.406355 27 trace.go:116] Trace[339254085]: "GuaranteedUpdate etcd3" type:*core.Pod (started: 2020-11-25 23:09:14.61178767 +0000 UTC m=+83.664685069) (total time: 794.525824ms):
  145. Trace[339254085]: [794.163654ms] [791.504583ms] Transaction committed
  146. I1125 23:09:15.408453 27 trace.go:116] Trace[1839210357]: "Patch" url:/api/v1/namespaces/cattle-system/pods/rancher-webhook-6977f86c5f-kxfxw/status,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:14.611647152 +0000 UTC m=+83.664544551) (total time: 796.753651ms):
  147. Trace[1839210357]: [796.475483ms] [794.050698ms] Object stored in database
  148. 2020-11-25 23:09:16.131806 W | etcdserver: read-only range request "key:\"/registry/secrets/cattle-system/cattle-webhook-ca\" " with result "range_response_count:1 size:1172" took too long (1.335243085s) to execute
  149. 2020-11-25 23:09:16.132242 W | etcdserver: request "header:<ID:7587850696702651188 > lease_revoke:<id:694d7601a9a96ae0>" with result "size:29" took too long (179.464087ms) to execute
  150. 2020-11-25 23:09:16.132937 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/kube-controller-manager\" " with result "range_response_count:1 size:492" took too long (1.537973469s) to execute
  151. I1125 23:09:16.134660 27 trace.go:116] Trace[1396622523]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:14.591024222 +0000 UTC m=+83.643921626) (total time: 1.543545832s):
  152. Trace[1396622523]: [1.543421244s] [1.543392334s] About to write a response
  153. I1125 23:09:16.135645 27 trace.go:116] Trace[1604514866]: "GuaranteedUpdate etcd3" type:*discovery.EndpointSlice (started: 2020-11-25 23:09:15.421516305 +0000 UTC m=+84.474413718) (total time: 714.06781ms):
  154. Trace[1604514866]: [713.991454ms] [711.415957ms] Transaction committed
  155. I1125 23:09:16.139273 27 trace.go:116] Trace[2025580602]: "Update" url:/apis/discovery.k8s.io/v1beta1/namespaces/cattle-system/endpointslices/rancher-webhook-t2dlg,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:endpointslice-controller,client:127.0.0.1 (started: 2020-11-25 23:09:15.420958974 +0000 UTC m=+84.473856365) (total time: 718.251536ms):
  156. Trace[2025580602]: [718.139578ms] [717.767035ms] Object stored in database
  157. I1125 23:09:16.140217 27 trace.go:116] Trace[1399058795]: "GuaranteedUpdate etcd3" type:*core.Endpoints (started: 2020-11-25 23:09:15.418841193 +0000 UTC m=+84.471738581) (total time: 720.619569ms):
  158. Trace[1399058795]: [720.57885ms] [717.133046ms] Transaction committed
  159. I1125 23:09:16.140871 27 trace.go:116] Trace[1403237979]: "Update" url:/api/v1/namespaces/cattle-system/endpoints/rancher-webhook,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:endpoint-controller,client:127.0.0.1 (started: 2020-11-25 23:09:15.418687127 +0000 UTC m=+84.471584485) (total time: 722.145368ms):
  160. Trace[1403237979]: [721.590754ms] [721.478699ms] Object stored in database
  161. I1125 23:09:16.136469 27 trace.go:116] Trace[1684869663]: "Get" url:/api/v1/namespaces/cattle-system/secrets/cattle-webhook-ca,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:14.796146575 +0000 UTC m=+83.849043950) (total time: 1.340243481s):
  162. Trace[1684869663]: [1.339697342s] [1.33966848s] About to write a response
  163. I1125 23:09:16.136711 27 trace.go:116] Trace[1957697217]: "GuaranteedUpdate etcd3" type:*apps.ReplicaSet (started: 2020-11-25 23:09:15.425945012 +0000 UTC m=+84.478842393) (total time: 710.73968ms):
  164. Trace[1957697217]: [710.67794ms] [709.294139ms] Transaction committed
  165. I1125 23:09:16.152051 27 trace.go:116] Trace[662256462]: "Update" url:/apis/apps/v1/namespaces/cattle-system/replicasets/rancher-webhook-6977f86c5f/status,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:replicaset-controller,client:127.0.0.1 (started: 2020-11-25 23:09:15.425423381 +0000 UTC m=+84.478320765) (total time: 725.674064ms):
  166. Trace[662256462]: [725.101527ms] [724.721236ms] Object stored in database
  167. 2020-11-25 23:09:17.526460 W | etcdserver: read-only range request "key:\"/registry/validatingwebhookconfigurations\" range_end:\"/registry/validatingwebhookconfigurationt\" count_only:true " with result "range_response_count:0 size:7" took too long (1.584714819s) to execute
  168. 2020-11-25 23:09:17.526657 W | etcdserver: read-only range request "key:\"/registry/certificatesigningrequests\" range_end:\"/registry/certificatesigningrequestt\" count_only:true " with result "range_response_count:0 size:5" took too long (1.871890886s) to execute
  169. 2020-11-25 23:09:17.526802 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/kube-scheduler\" " with result "range_response_count:1 size:474" took too long (2.117046049s) to execute
  170. 2020-11-25 23:09:17.526989 W | etcdserver: request "header:<ID:7587850696702651193 > txn:<compare:<target:MOD key:\"/registry/services/endpoints/kube-system/kube-controller-manager\" mod_revision:4650 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/kube-controller-manager\" value_size:499 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/kube-controller-manager\" > >>" with result "size:16" took too long (1.032269148s) to execute
  171. I1125 23:09:17.530214 27 trace.go:116] Trace[1642202183]: "GuaranteedUpdate etcd3" type:*core.Endpoints (started: 2020-11-25 23:09:16.155870214 +0000 UTC m=+85.208767618) (total time: 1.374299594s):
  172. Trace[1642202183]: [1.37423914s] [1.373448381s] Transaction committed
  173. I1125 23:09:17.530452 27 trace.go:116] Trace[1336660161]: "Update" url:/api/v1/namespaces/kube-system/endpoints/kube-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:16.155654172 +0000 UTC m=+85.208551571) (total time: 1.374760209s):
  174. Trace[1336660161]: [1.37464708s] [1.374494833s] Object stored in database
  175. I1125 23:09:17.532956 27 trace.go:116] Trace[491336065]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:15.407913442 +0000 UTC m=+84.460810834) (total time: 2.124568165s):
  176. Trace[491336065]: [2.124495545s] [2.124461592s] About to write a response
  177. I1125 23:09:17.533922 27 trace.go:116] Trace[1523206038]: "GuaranteedUpdate etcd3" type:*apps.Deployment (started: 2020-11-25 23:09:16.156878409 +0000 UTC m=+85.209775819) (total time: 1.377010851s):
  178. Trace[1523206038]: [1.376884311s] [1.374530326s] Transaction committed
  179. I1125 23:09:17.534227 27 trace.go:116] Trace[603381899]: "Update" url:/apis/apps/v1/namespaces/cattle-system/deployments/rancher-webhook/status,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:deployment-controller,client:127.0.0.1 (started: 2020-11-25 23:09:16.15662432 +0000 UTC m=+85.209521714) (total time: 1.377549348s):
  180. Trace[603381899]: [1.377377284s] [1.377201433s] Object stored in database
  181. 2020-11-25 23:09:17.577654 W | wal: sync duration of 1.08281954s, expected less than 1s
  182. 2020-11-25 23:09:17.578386 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/projectalerts\" range_end:\"/registry/management.cattle.io/projectalertt\" count_only:true " with result "range_response_count:0 size:5" took too long (1.329233979s) to execute
  183. 2020-11-25 23:09:17.579079 W | etcdserver: read-only range request "key:\"/registry/secrets/cattle-system/cattle-webhook-tls\" " with result "range_response_count:1 size:1464" took too long (1.425189289s) to execute
  184. 2020-11-25 23:09:17.580647 W | etcdserver: read-only range request "key:\"/registry/secrets/cattle-system/\" range_end:\"/registry/secrets/cattle-system0\" limit:500 " with result "range_response_count:27 size:71336" took too long (1.42752526s) to execute
  185. I1125 23:09:17.583800 27 trace.go:116] Trace[1041241773]: "List etcd3" key:/secrets/cattle-system,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:16.149440298 +0000 UTC m=+85.202337692) (total time: 1.434276956s):
  186. Trace[1041241773]: [1.434276956s] [1.434276956s] END
  187. I1125 23:09:17.586698 27 trace.go:116] Trace[1829386826]: "Get" url:/api/v1/namespaces/cattle-system/secrets/cattle-webhook-tls,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:16.153367464 +0000 UTC m=+85.206264863) (total time: 1.433286878s):
  188. Trace[1829386826]: [1.433198057s] [1.433186727s] About to write a response
  189. I1125 23:09:17.590095 27 trace.go:116] Trace[1316707181]: "List" url:/api/v1/namespaces/cattle-system/secrets,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:16.149396638 +0000 UTC m=+85.202294031) (total time: 1.44061362s):
  190. Trace[1316707181]: [1.434432079s] [1.43440112s] Listing from storage done
  191. 2020/11/25 23:09:17 [INFO] cluster [c-l2b6w] provisioning: [network] Successfully started [rke-worker-port-listener] container on host [192.168.1.137]
  192. 2020/11/25 23:09:17 [INFO] Image [rancher/rke-tools:v0.1.66] exists on host [192.168.1.137]
  193. 2020-11-25 23:09:19.514664 W | etcdserver: read-only range request "key:\"/registry/project.cattle.io/pipelines\" range_end:\"/registry/project.cattle.io/pipelinet\" count_only:true " with result "range_response_count:0 size:7" took too long (1.984381494s) to execute
  194. 2020-11-25 23:09:19.515566 W | etcdserver: read-only range request "key:\"/registry/cronjobs\" range_end:\"/registry/cronjobt\" count_only:true " with result "range_response_count:0 size:5" took too long (1.670704353s) to execute
  195. 2020-11-25 23:09:19.516170 W | etcdserver: read-only range request "key:\"/registry/limitranges\" range_end:\"/registry/limitranget\" count_only:true " with result "range_response_count:0 size:5" took too long (1.535997055s) to execute
  196. 2020-11-25 23:09:19.516504 W | etcdserver: read-only range request "key:\"/registry/namespaces/default\" " with result "range_response_count:1 size:977" took too long (2.526221052s) to execute
  197. 2020-11-25 23:09:19.517162 W | etcdserver: read-only range request "key:\"/registry/leases\" range_end:\"/registry/leaset\" count_only:true " with result "range_response_count:0 size:7" took too long (1.375393052s) to execute
  198. 2020-11-25 23:09:19.517686 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/cloud-controller-manager\" " with result "range_response_count:1 size:589" took too long (2.948623431s) to execute
  199. 2020-11-25 23:09:19.517808 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/cisconfigs\" range_end:\"/registry/management.cattle.io/cisconfigt\" count_only:true " with result "range_response_count:0 size:7" took too long (1.299318373s) to execute
  200. 2020-11-25 23:09:19.517948 W | etcdserver: read-only range request "key:\"/registry/secrets/cattle-system/cattle-webhook-tls\" " with result "range_response_count:1 size:1464" took too long (1.80103011s) to execute
  201. 2020-11-25 23:09:19.518552 W | etcdserver: read-only range request "key:\"/registry/configmaps/kube-system/cattle-controllers\" " with result "range_response_count:1 size:536" took too long (2.11281076s) to execute
  202. 2020-11-25 23:09:19.518758 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/clustertemplaterevisions\" range_end:\"/registry/management.cattle.io/clustertemplaterevisiont\" count_only:true " with result "range_response_count:0 size:5" took too long (2.371764954s) to execute
  203. 2020-11-25 23:09:19.519104 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/kube-controller-manager\" " with result "range_response_count:1 size:492" took too long (1.971850031s) to execute
  204. 2020-11-25 23:09:19.519426 W | etcdserver: request "header:<ID:7587850696702651203 > lease_grant:<ttl:3660-second id:694d7601a9a96b42>" with result "size:42" took too long (1.101982698s) to execute
  205. 2020-11-25 23:09:19.519787 W | etcdserver: read-only range request "key:\"/registry/configmaps/kube-system/k3s\" " with result "range_response_count:1 size:502" took too long (2.110154221s) to execute
  206. I1125 23:09:19.521571 27 trace.go:116] Trace[1253212735]: "Get" url:/api/v1/namespaces/default,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:16.988114556 +0000 UTC m=+86.041011982) (total time: 2.533312828s):
  207. Trace[1253212735]: [2.533012103s] [2.532998486s] About to write a response
  208. I1125 23:09:19.522520 27 trace.go:116] Trace[807195325]: "Get" url:/api/v1/namespaces/kube-system/configmaps/k3s,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:17.404236823 +0000 UTC m=+86.457134218) (total time: 2.118248502s):
  209. Trace[807195325]: [2.118151573s] [2.118137815s] About to write a response
  210. I1125 23:09:19.524324 27 trace.go:116] Trace[96296540]: "Get" url:/api/v1/namespaces/kube-system/configmaps/cattle-controllers,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:17.401691273 +0000 UTC m=+86.454588679) (total time: 2.122559341s):
  211. Trace[96296540]: [2.122396992s] [2.122361213s] About to write a response
  212. I1125 23:09:19.527957 27 trace.go:116] Trace[424848766]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:17.543015576 +0000 UTC m=+86.595913108) (total time: 1.984914504s):
  213. Trace[424848766]: [1.984868753s] [1.984838752s] About to write a response
  214. I1125 23:09:19.528400 27 trace.go:116] Trace[1668363664]: "Get" url:/api/v1/namespaces/kube-system/endpoints/cloud-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:16.566818837 +0000 UTC m=+85.619716234) (total time: 2.961552178s):
  215. Trace[1668363664]: [2.961512983s] [2.961496737s] About to write a response
  216. I1125 23:09:19.527975 27 trace.go:116] Trace[53179948]: "Create" url:/api/v1/namespaces/cattle-system/events,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:18.41309739 +0000 UTC m=+87.465994786) (total time: 1.114812788s):
  217. Trace[53179948]: [1.114722204s] [1.114593898s] Object stored in database
  218. I1125 23:09:19.529342 27 trace.go:116] Trace[1031594408]: "Get" url:/api/v1/namespaces/cattle-system/secrets/cattle-webhook-tls,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:17.713322174 +0000 UTC m=+86.766219579) (total time: 1.815986956s):
  219. Trace[1031594408]: [1.815879074s] [1.815864197s] About to write a response
  220. 2020-11-25 23:09:20.336125 W | etcdserver: request "header:<ID:7587850696702651205 > txn:<compare:<target:MOD key:\"/registry/configmaps/kube-system/cattle-controllers\" mod_revision:4676 > success:<request_put:<key:\"/registry/configmaps/kube-system/cattle-controllers\" value_size:461 >> failure:<request_range:<key:\"/registry/configmaps/kube-system/cattle-controllers\" > >>" with result "size:16" took too long (441.980342ms) to execute
  221. 2020-11-25 23:09:20.346358 W | etcdserver: read-only range request "key:\"/registry/services/specs/default/kubernetes\" " with result "range_response_count:1 size:599" took too long (805.865517ms) to execute
  222. I1125 23:09:20.349071 27 trace.go:116] Trace[455235579]: "GuaranteedUpdate etcd3" type:*coordination.Lease (started: 2020-11-25 23:09:19.53294796 +0000 UTC m=+88.585845363) (total time: 815.964211ms):
  223. Trace[455235579]: [815.804431ms] [812.311045ms] Transaction committed
  224. I1125 23:09:20.350047 27 trace.go:116] Trace[1446416222]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:19.532009782 +0000 UTC m=+88.584907169) (total time: 817.980399ms):
  225. Trace[1446416222]: [817.499203ms] [816.62462ms] Object stored in database
  226. I1125 23:09:20.350400 27 trace.go:116] Trace[1215246372]: "GuaranteedUpdate etcd3" type:*core.ConfigMap (started: 2020-11-25 23:09:19.526753872 +0000 UTC m=+88.579651265) (total time: 823.615389ms):
  227. Trace[1215246372]: [823.577225ms] [822.766606ms] Transaction committed
  228. I1125 23:09:20.368231 27 trace.go:116] Trace[1860038906]: "Update" url:/api/v1/namespaces/kube-system/configmaps/cattle-controllers,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:19.526527282 +0000 UTC m=+88.579424682) (total time: 841.653333ms):
  229. Trace[1860038906]: [841.513959ms] [841.344333ms] Object stored in database
  230. I1125 23:09:20.352815 27 trace.go:116] Trace[1187404182]: "GuaranteedUpdate etcd3" type:*core.ConfigMap (started: 2020-11-25 23:09:19.537941588 +0000 UTC m=+88.590838990) (total time: 814.702499ms):
  231. Trace[1187404182]: [814.542285ms] [813.989155ms] Transaction committed
  232. I1125 23:09:20.371658 27 trace.go:116] Trace[754998407]: "Update" url:/api/v1/namespaces/kube-system/configmaps/k3s,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:19.53773478 +0000 UTC m=+88.590632162) (total time: 833.847385ms):
  233. Trace[754998407]: [833.726629ms] [833.565308ms] Object stored in database
  234. I1125 23:09:20.354024 27 trace.go:116] Trace[1727290746]: "Get" url:/api/v1/namespaces/default/services/kubernetes,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:19.539664979 +0000 UTC m=+88.592562366) (total time: 814.183343ms):
  235. Trace[1727290746]: [813.846669ms] [813.836768ms] About to write a response
  236. I1125 23:09:20.355539 27 trace.go:116] Trace[1233220462]: "GuaranteedUpdate etcd3" type:*core.Secret (started: 2020-11-25 23:09:19.537105105 +0000 UTC m=+88.590002520) (total time: 818.26991ms):
  237. Trace[1233220462]: [818.100367ms] [817.132656ms] Transaction committed
  238. I1125 23:09:20.372372 27 trace.go:116] Trace[867143783]: "Update" url:/api/v1/namespaces/cattle-system/secrets/cattle-webhook-tls,user-agent:webhook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.19 (started: 2020-11-25 23:09:19.53665678 +0000 UTC m=+88.589554168) (total time: 835.683487ms):
  239. Trace[867143783]: [835.542ms] [835.190131ms] Object stored in database
  240. I1125 23:09:20.392201 27 trace.go:116] Trace[1964805906]: "Call validating webhook" configuration:rancher.cattle.io,webhook:rancher.cattle.io,resource:management.cattle.io/v3, Resource=clusters,subresource:,operation:UPDATE,UID:6c2ed9ee-fa05-4cfa-b7eb-e2536d6aa396 (started: 2020-11-25 23:09:17.706909511 +0000 UTC m=+86.759806912) (total time: 2.685147458s):
  241. Trace[1964805906]: [2.685123798s] [2.685123798s] Request completed
  242. 2020-11-25 23:09:20.907956 W | wal: sync duration of 1.013882654s, expected less than 1s
  243. 2020/11/25 23:09:21 [INFO] Starting container [rke-port-checker] on host [192.168.1.137], try #1
  244. 2020-11-25 23:09:21.820825 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/kube-scheduler\" " with result "range_response_count:1 size:569" took too long (2.230951583s) to execute
  245. 2020-11-25 23:09:21.820981 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/cloud-controller-manager\" " with result "range_response_count:1 size:494" took too long (2.280185793s) to execute
  246. 2020-11-25 23:09:21.821221 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/clusterroletemplatebindings\" range_end:\"/registry/management.cattle.io/clusterroletemplatebindingt\" count_only:true " with result "range_response_count:0 size:7" took too long (1.526902921s) to execute
  247. 2020-11-25 23:09:21.821328 W | etcdserver: request "header:<ID:7587850696702651210 > txn:<compare:<target:MOD key:\"/registry/management.cattle.io/clusters/c-l2b6w\" mod_revision:4657 > success:<request_put:<key:\"/registry/management.cattle.io/clusters/c-l2b6w\" value_size:7406 >> failure:<request_range:<key:\"/registry/management.cattle.io/clusters/c-l2b6w\" > >>" with result "size:16" took too long (911.988729ms) to execute
  248. 2020-11-25 23:09:21.822155 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts\" range_end:\"/registry/serviceaccountt\" count_only:true " with result "range_response_count:0 size:7" took too long (1.669844319s) to execute
  249. I1125 23:09:21.822316 27 trace.go:116] Trace[1250208051]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cloud-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:19.540517644 +0000 UTC m=+88.593415073) (total time: 2.281753958s):
  250. Trace[1250208051]: [2.281681305s] [2.28167411s] About to write a response
  251. I1125 23:09:21.822976 27 trace.go:116] Trace[1284307339]: "Get" url:/api/v1/namespaces/kube-system/endpoints/kube-scheduler,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:19.589239428 +0000 UTC m=+88.642136882) (total time: 2.23370103s):
  252. Trace[1284307339]: [2.233673987s] [2.233605152s] About to write a response
  253. I1125 23:09:21.833850 27 trace.go:116] Trace[487178554]: "GuaranteedUpdate etcd3" type:*unstructured.Unstructured (started: 2020-11-25 23:09:17.699595831 +0000 UTC m=+86.752493224) (total time: 4.134235704s):
  254. Trace[487178554]: [2.694306465s] [2.69366551s] Transaction prepared
  255. Trace[487178554]: [4.131771927s] [1.437465462s] Transaction committed
  256. I1125 23:09:21.835197 27 trace.go:116] Trace[1386541247]: "Update" url:/apis/management.cattle.io/v3/clusters/c-l2b6w,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:17.695678584 +0000 UTC m=+86.748575964) (total time: 4.139495725s):
  257. Trace[1386541247]: [4.13872023s] [4.135035276s] Object stored in database
  258. 2020/11/25 23:09:21 [INFO] cluster [c-l2b6w] provisioning: [network] Port listener containers deployed successfully
  259. 2020-11-25 23:09:22.312029 W | wal: sync duration of 1.40301135s, expected less than 1s
  260. 2020-11-25 23:09:23.385957 W | etcdserver: read-only range request "key:\"/registry/project.cattle.io/sourcecodecredentials\" range_end:\"/registry/project.cattle.io/sourcecodecredentialt\" count_only:true " with result "range_response_count:0 size:5" took too long (2.957272773s) to execute
  261. 2020-11-25 23:09:23.386480 W | etcdserver: read-only range request "key:\"/registry/masterleases/172.17.0.2\" " with result "range_response_count:1 size:129" took too long (3.005088048s) to execute
  262. 2020-11-25 23:09:23.387025 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/fleetworkspaces\" range_end:\"/registry/management.cattle.io/fleetworkspacet\" count_only:true " with result "range_response_count:0 size:5" took too long (2.834527272s) to execute
  263. 2020-11-25 23:09:23.387605 W | etcdserver: request "header:<ID:7587850696702651212 > txn:<compare:<target:MOD key:\"/registry/services/endpoints/kube-system/cloud-controller-manager\" mod_revision:4669 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/cloud-controller-manager\" value_size:500 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/cloud-controller-manager\" > >>" with result "size:16" took too long (1.074934601s) to execute
  264. I1125 23:09:23.391740 27 trace.go:116] Trace[43187927]: "GuaranteedUpdate etcd3" type:*unstructured.Unstructured (started: 2020-11-25 23:09:21.837929424 +0000 UTC m=+90.890826822) (total time: 1.553766411s):
  265. Trace[43187927]: [1.55150184s] [1.54482245s] Transaction committed
  266. I1125 23:09:23.398063 27 trace.go:116] Trace[407791248]: "GuaranteedUpdate etcd3" type:*core.Endpoints (started: 2020-11-25 23:09:21.830335204 +0000 UTC m=+90.883232579) (total time: 1.567684493s):
  267. Trace[407791248]: [1.567643809s] [1.567202937s] Transaction committed
  268. I1125 23:09:23.399363 27 trace.go:116] Trace[947012722]: "Update" url:/api/v1/namespaces/kube-system/endpoints/cloud-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:21.83023657 +0000 UTC m=+90.883133934) (total time: 1.569057775s):
  269. Trace[947012722]: [1.568383516s] [1.568316576s] Object stored in database
  270. I1125 23:09:23.402039 27 trace.go:116] Trace[1299610219]: "Update" url:/apis/management.cattle.io/v3/clusters/c-l2b6w,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:21.836951991 +0000 UTC m=+90.889849360) (total time: 1.565041536s):
  271. Trace[1299610219]: [1.554869724s] [1.553986748s] Object stored in database
  272. 2020/11/25 23:09:23 [INFO] cluster [c-l2b6w] provisioning: [network] Running control plane -> etcd port checks
  273. 2020-11-25 23:09:24.028107 W | wal: sync duration of 1.715323261s, expected less than 1s
  274. 2020-11-25 23:09:24.993181 W | etcdserver: read-only range request "key:\"/registry/jobs/\" range_end:\"/registry/jobs0\" limit:500 " with result "range_response_count:0 size:5" took too long (3.826075547s) to execute
  275. 2020-11-25 23:09:24.993922 W | etcdserver: read-only range request "key:\"/registry/ingressclasses\" range_end:\"/registry/ingressclasset\" count_only:true " with result "range_response_count:0 size:5" took too long (3.330742383s) to execute
  276. 2020-11-25 23:09:24.994794 W | etcdserver: read-only range request "key:\"/registry/statefulsets\" range_end:\"/registry/statefulsett\" count_only:true " with result "range_response_count:0 size:5" took too long (3.390540151s) to execute
  277. 2020-11-25 23:09:24.995889 W | etcdserver: read-only range request "key:\"/registry/persistentvolumeclaims\" range_end:\"/registry/persistentvolumeclaimt\" count_only:true " with result "range_response_count:0 size:5" took too long (3.471850593s) to execute
  278. 2020-11-25 23:09:24.997575 W | etcdserver: read-only range request "key:\"/registry/namespaces\" range_end:\"/registry/namespacet\" count_only:true " with result "range_response_count:0 size:7" took too long (3.705006243s) to execute
  279. 2020-11-25 23:09:24.997639 W | etcdserver: read-only range request "key:\"/registry/project.cattle.io/apprevisions\" range_end:\"/registry/project.cattle.io/apprevisiont\" count_only:true " with result "range_response_count:0 size:5" took too long (3.272835125s) to execute
  280. 2020-11-25 23:09:24.997685 W | etcdserver: read-only range request "key:\"/registry/namespaces/kube-system\" " with result "range_response_count:1 size:985" took too long (2.909923298s) to execute
  281. 2020-11-25 23:09:24.997737 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/kube-scheduler\" " with result "range_response_count:1 size:473" took too long (3.164208932s) to execute
  282. 2020-11-25 23:09:24.997836 W | etcdserver: request "header:<ID:7587850696702651215 > txn:<compare:<target:MOD key:\"/registry/events/cattle-system/helm-operation-bthns.164ae2f5c524b0e8\" mod_revision:0 > success:<request_put:<key:\"/registry/events/cattle-system/helm-operation-bthns.164ae2f5c524b0e8\" value_size:666 lease:7587850696702651202 >> failure:<>>" with result "size:16" took too long (968.373802ms) to execute
  283. 2020-11-25 23:09:24.999663 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/clusters\" range_end:\"/registry/management.cattle.io/clustert\" count_only:true " with result "range_response_count:0 size:7" took too long (1.48824765s) to execute
  284. 2020-11-25 23:09:25.000440 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/cloud-controller-manager\" " with result "range_response_count:1 size:494" took too long (1.5953089s) to execute
  285. 2020-11-25 23:09:25.000709 W | etcdserver: read-only range request "key:\"/registry/fleet.cattle.io/clusterregistrations\" range_end:\"/registry/fleet.cattle.io/clusterregistrationt\" count_only:true " with result "range_response_count:0 size:5" took too long (2.034918279s) to execute
  286. 2020-11-25 23:09:25.001380 W | etcdserver: read-only range request "key:\"/registry/project.cattle.io/sourcecoderepositories\" range_end:\"/registry/project.cattle.io/sourcecoderepositoriet\" count_only:true " with result "range_response_count:0 size:5" took too long (2.043497172s) to execute
  287. 2020-11-25 23:09:25.001931 W | etcdserver: read-only range request "key:\"/registry/project.cattle.io/pipelineexecutions\" range_end:\"/registry/project.cattle.io/pipelineexecutiont\" count_only:true " with result "range_response_count:0 size:5" took too long (2.143819552s) to execute
  288. 2020-11-25 23:09:25.002456 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/globaldnses\" range_end:\"/registry/management.cattle.io/globaldnset\" count_only:true " with result "range_response_count:0 size:5" took too long (2.209661448s) to execute
  289. 2020-11-25 23:09:25.003014 W | etcdserver: read-only range request "key:\"/registry/configmaps/kube-system/k3s\" " with result "range_response_count:1 size:502" took too long (2.620032768s) to execute
  290. 2020-11-25 23:09:25.003578 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/kube-controller-manager\" " with result "range_response_count:1 size:587" took too long (2.630725934s) to execute
  291. 2020-11-25 23:09:25.004059 W | etcdserver: read-only range request "key:\"/registry/configmaps/kube-system/cattle-controllers\" " with result "range_response_count:1 size:536" took too long (2.631865376s) to execute
  292. I1125 23:09:25.005551 27 trace.go:116] Trace[472690960]: "Get" url:/api/v1/namespaces/kube-system/endpoints/kube-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:22.372417231 +0000 UTC m=+91.425314629) (total time: 2.633020139s):
  293. Trace[472690960]: [2.632909318s] [2.632847296s] About to write a response
  294. I1125 23:09:25.006748 27 trace.go:116] Trace[1824808115]: "Get" url:/api/v1/namespaces/kube-system/configmaps/cattle-controllers,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:22.37126131 +0000 UTC m=+91.424158702) (total time: 2.635449339s):
  295. Trace[1824808115]: [2.635348363s] [2.635317519s] About to write a response
  296. I1125 23:09:25.009120 27 trace.go:116] Trace[1413680836]: "Get" url:/api/v1/namespaces/kube-system/configmaps/k3s,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:22.38238488 +0000 UTC m=+91.435282262) (total time: 2.626656876s):
  297. Trace[1413680836]: [2.626475591s] [2.626462879s] About to write a response
  298. I1125 23:09:25.011080 27 trace.go:116] Trace[1334914357]: "List etcd3" key:/jobs,resourceVersion:,limit:500,continue: (started: 2020-11-25 23:09:21.166438144 +0000 UTC m=+90.219335568) (total time: 3.844586251s):
  299. Trace[1334914357]: [3.844586251s] [3.844586251s] END
  300. I1125 23:09:25.011848 27 trace.go:116] Trace[1817924930]: "List" url:/apis/batch/v1/jobs,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/system:serviceaccount:kube-system:cronjob-controller,client:127.0.0.1 (started: 2020-11-25 23:09:21.166364393 +0000 UTC m=+90.219261794) (total time: 3.845269233s):
  301. Trace[1817924930]: [3.845026119s] [3.844974449s] Listing from storage done
  302. I1125 23:09:25.015769 27 trace.go:116] Trace[1171655967]: "Get" url:/api/v1/namespaces/kube-system,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:22.086517495 +0000 UTC m=+91.139414922) (total time: 2.929006366s):
  303. Trace[1171655967]: [2.928649298s] [2.928618734s] About to write a response
  304. I1125 23:09:25.022717 27 trace.go:116] Trace[1350940972]: "GuaranteedUpdate etcd3" type:*unstructured.Unstructured (started: 2020-11-25 23:09:23.406411641 +0000 UTC m=+92.459309023) (total time: 1.616264896s):
  305. Trace[1350940972]: [1.606756054s] [1.597598822s] Transaction committed
  306. I1125 23:09:25.042997 27 trace.go:116] Trace[389902764]: "Update" url:/apis/management.cattle.io/v3/clusters/c-l2b6w,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:23.404629436 +0000 UTC m=+92.457526830) (total time: 1.63828708s):
  307. Trace[389902764]: [1.635663189s] [1.634098218s] Object stored in database
  308. I1125 23:09:25.024063 27 trace.go:116] Trace[107347940]: "Create" url:/api/v1/namespaces/cattle-system/events,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531,client:127.0.0.1 (started: 2020-11-25 23:09:22.316832683 +0000 UTC m=+91.369730079) (total time: 2.707186435s):
  309. Trace[107347940]: [2.707092556s] [2.7067548s] Object stored in database
  310. I1125 23:09:25.030624 27 trace.go:116] Trace[901693219]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:21.832101913 +0000 UTC m=+90.884999280) (total time: 3.19844754s):
  311. Trace[901693219]: [3.198345731s] [3.198332115s] About to write a response
  312. I1125 23:09:25.030902 27 trace.go:116] Trace[1401285670]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cloud-controller-manager,user-agent:k3s/v1.18.8+k3s1 (linux/amd64) kubernetes/6b59531/leader-election,client:127.0.0.1 (started: 2020-11-25 23:09:23.404633327 +0000 UTC m=+92.457530735) (total time: 1.626183446s):
  313. Trace[1401285670]: [1.626112772s] [1.626100836s] About to write a response
  314. 2020-11-25 23:09:26.006693 W | wal: sync duration of 1.010111331s, expected less than 1s
  315. I1125 23:09:26.042727 27 trace.go:116] Trace[280850469]: "List" url:/api/v1/componentstatuses,user-agent:rancher/v0.0.0 (linux/amd64) kubernetes/$Format,client:127.0.0.1 (started: 2020-11-25 23:09:25.020402147 +0000 UTC m=+94.073299535) (total time: 1.02227417s):
  316. Trace[280850469]: [1.022130292s] [1.022116462s] Listing from storage done
  317. E1125 23:09:26.565579 27 leaderelection.go:356] Failed to update lock: Put https://127.0.0.1:6444/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cloud-controller-manager: context deadline exceeded
  318. I1125 23:09:26.565842 27 leaderelection.go:277] failed to renew lease kube-system/cloud-controller-manager: timed out waiting for the condition
  319. F1125 23:09:26.565939 27 controllermanager.go:213] leaderelection lost
  320. I1125 23:09:26.565718 27 trace.go:116] Trace[896607469]: "GuaranteedUpdate etcd3" type:*coordination.Lease (started: 2020-11-25 23:09:25.082260053 +0000 UTC m=+94.135157432) (total time: 1.483430438s):
  321. Trace[896607469]: [1.483430438s] [1.483010899s] END
  322. I1125 23:09:26.749367 27 event.go:278] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"cloud-controller-manager", UID:"64e98ae9-a7f4-4ca4-9403-3d053620c459", APIVersion:"v1", ResourceVersion:"4691", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' 23b14d418844_2b04e8a0-0959-4058-8826-f67892a508a7 stopped leading
  323. 2020-11-25 23:09:27.060043 W | etcdserver: read-only range request "key:\"/registry/ingress\" range_end:\"/registry/ingrest\" count_only:true " with result "range_response_count:0 size:5" took too long (2.187986227s) to execute
  324. 2020-11-25 23:09:27.060451 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/catalogs\" range_end:\"/registry/management.cattle.io/catalogt\" count_only:true " with result "range_response_count:0 size:7" took too long (2.117151828s) to execute
  325. 2020-11-25 23:09:27.060648 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/userattributes\" range_end:\"/registry/management.cattle.io/userattributet\" count_only:true " with result "range_response_count:0 size:7" took too long (2.9763381s) to execute
  326. 2020-11-25 23:09:27.061392 W | etcdserver: request "header:<ID:7587850696702651222 > txn:<compare:<target:MOD key:\"/registry/masterleases/172.17.0.2\" mod_revision:4664 > success:<request_put:<key:\"/registry/masterleases/172.17.0.2\" value_size:65 lease:7587850696702651216 >> failure:<request_range:<key:\"/registry/masterleases/172.17.0.2\" > >>" with result "size:16" took too long (1.053827119s) to execute
  327. E1125 23:09:27.076096 8 leaderelection.go:357] Failed to update lock: Put "https://127.0.0.1:6443/api/v1/namespaces/kube-system/configmaps/cattle-controllers?timeout=15m0s": EOF
  328. 2020/11/25 23:09:27 [ERROR] Failed to install system chart rancher-operator: pod cattle-system/helm-operation-bthns failed, watch closed
  329. 2020/11/25 23:09:27 [ERROR] [updateClusterHealth] Failed to update cluster [local]: Put "https://127.0.0.1:6443/apis/management.cattle.io/v3/clusters/local": EOF
  330. 2020-11-25 23:09:27.098162 W | etcdserver: read-only range request "key:\"/registry/fleet.cattle.io/clustergroups\" range_end:\"/registry/fleet.cattle.io/clustergroupt\" count_only:true " with result "error:context canceled" took too long (749.891719ms) to execute
  331. WARNING: 2020/11/25 23:09:27 grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
  332. 2020-11-25 23:09:27.107277 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/podsecuritypolicytemplateprojectbindings\" range_end:\"/registry/management.cattle.io/podsecuritypolicytemplateprojectbindingt\" count_only:true " with result "error:context canceled" took too long (1.031097351s) to execute
  333. WARNING: 2020/11/25 23:09:27 grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
  334. 2020-11-25 23:09:27.112541 W | etcdserver: read-only range request "key:\"/registry/management.cattle.io/roletemplates\" range_end:\"/registry/management.cattle.io/roletemplatet\" count_only:true " with result "error:context canceled" took too long (2.037242471s) to execute
  335. WARNING: 2020/11/25 23:09:27 grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
  336. WARNING: 2020/11/25 23:09:27 grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
  337. 2020-11-25 23:09:27.125135 W | etcdserver: read-only range request "key:\"/registry/leases/kube-system/kube-controller-manager\" " with result "error:context canceled" took too long (2.036122105s) to execute
  338. WARNING: 2020/11/25 23:09:27 grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
  339. 2020-11-25 23:09:27.125601 W | etcdserver: read-only range request "key:\"/registry/cronjobs/\" range_end:\"/registry/cronjobs0\" limit:500 " with result "error:context canceled" took too long (2.049132901s) to execute
  340. WARNING: 2020/11/25 23:09:27 grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
  341. W1125 23:09:27.129649 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  342. W1125 23:09:27.129702 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  343. W1125 23:09:27.130559 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  344. W1125 23:09:27.130679 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  345. W1125 23:09:27.130755 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  346. W1125 23:09:27.130939 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  347. W1125 23:09:27.131101 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  348. W1125 23:09:27.131187 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  349. W1125 23:09:27.131556 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  350. W1125 23:09:27.131642 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  351. W1125 23:09:27.131723 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  352. W1125 23:09:27.131861 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  353. W1125 23:09:27.132142 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  354. W1125 23:09:27.132368 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  355. W1125 23:09:27.132452 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  356. W1125 23:09:27.132651 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  357. W1125 23:09:27.132895 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  358. W1125 23:09:27.132994 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  359. W1125 23:09:27.133988 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  360. W1125 23:09:27.134249 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  361. W1125 23:09:27.134503 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  362. W1125 23:09:27.139019 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  363. W1125 23:09:27.139880 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  364. W1125 23:09:27.140013 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  365. W1125 23:09:27.140094 8 reflector.go:425] pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: watch of *summary.SummarizedObject ended with: very short watch: pkg/mod/github.com/rancher/client-go@v1.19.0-rancher.1/tools/cache/reflector.go:157: Unexpected watch close - watch lasted less than a second and no items received
  366. 2020/11/25 23:09:27 [FATAL] k3s exited with: exit status 255
  367. hako@ranchervm:~$
  368.  
  369.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!