API tools faq
paste
drpaneas

kubeadm ubuntu

drpaneas
May 8th, 2018
99
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 147.48 KB | None | 0 0
raw download clone embed print report
  1. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ sudo apt-get update
  2. [sudo] password for panos:
  3. Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease
  4. Hit:2 http://de.archive.ubuntu.com/ubuntu bionic InRelease
  5. Hit:3 http://de.archive.ubuntu.com/ubuntu bionic-updates InRelease
  6. Hit:4 http://de.archive.ubuntu.com/ubuntu bionic-backports InRelease
  7. Reading package lists... Done
  8.  
  9. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ sudo apt-get install -y docker.io
  10. Reading package lists... Done
  11. Building dependency tree
  12. Reading state information... Done
  13. The following additional packages will be installed:
  14. bridge-utils cgroupfs-mount git git-man liberror-perl ubuntu-fan
  15. Suggested packages:
  16. aufs-tools btrfs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk gitweb git-cvs git-mediawiki git-svn
  17. The following NEW packages will be installed:
  18. bridge-utils cgroupfs-mount docker.io git git-man liberror-perl ubuntu-fan
  19. 0 upgraded, 7 newly installed, 0 to remove and 12 not upgraded.
  20. Need to get 34,9 MB of archives.
  21. After this operation, 171 MB of additional disk space will be used.
  22. Get:1 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 bridge-utils amd64 1.5-15ubuntu1 [30,1 kB]
  23. Get:2 http://de.archive.ubuntu.com/ubuntu bionic/universe amd64 cgroupfs-mount all 1.4 [6.320 B]
  24. Get:3 http://de.archive.ubuntu.com/ubuntu bionic/universe amd64 docker.io amd64 17.12.1-0ubuntu1 [30,1 MB]
  25. Get:4 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 liberror-perl all 0.17025-1 [22,8 kB]
  26. Get:5 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 git-man all 1:2.17.0-1ubuntu1 [803 kB]
  27. Get:6 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 git amd64 1:2.17.0-1ubuntu1 [3.894 kB]
  28. Get:7 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 ubuntu-fan all 0.12.10 [34,7 kB]
  29. Fetched 34,9 MB in 25s (1.381 kB/s)
  30. Preconfiguring packages ...
  31. Selecting previously unselected package bridge-utils.
  32. (Reading database ... 128414 files and directories currently installed.)
  33. Preparing to unpack .../0-bridge-utils_1.5-15ubuntu1_amd64.deb ...
  34. Unpacking bridge-utils (1.5-15ubuntu1) ...
  35. Selecting previously unselected package cgroupfs-mount.
  36. Preparing to unpack .../1-cgroupfs-mount_1.4_all.deb ...
  37. Unpacking cgroupfs-mount (1.4) ...
  38. Selecting previously unselected package docker.io.
  39. Preparing to unpack .../2-docker.io_17.12.1-0ubuntu1_amd64.deb ...
  40. Unpacking docker.io (17.12.1-0ubuntu1) ...
  41. Selecting previously unselected package liberror-perl.
  42. Preparing to unpack .../3-liberror-perl_0.17025-1_all.deb ...
  43. Unpacking liberror-perl (0.17025-1) ...
  44. Selecting previously unselected package git-man.
  45. Preparing to unpack .../4-git-man_1%3a2.17.0-1ubuntu1_all.deb ...
  46. Unpacking git-man (1:2.17.0-1ubuntu1) ...
  47. Selecting previously unselected package git.
  48. Preparing to unpack .../5-git_1%3a2.17.0-1ubuntu1_amd64.deb ...
  49. Unpacking git (1:2.17.0-1ubuntu1) ...
  50. Selecting previously unselected package ubuntu-fan.
  51. Preparing to unpack .../6-ubuntu-fan_0.12.10_all.deb ...
  52. Unpacking ubuntu-fan (0.12.10) ...
  53. Setting up git-man (1:2.17.0-1ubuntu1) ...
  54. Setting up docker.io (17.12.1-0ubuntu1) ...
  55. Adding group `docker' (GID 127) ...
  56. Done.
  57. Created symlink /etc/systemd/system/sockets.target.wants/docker.socket → /lib/systemd/system/docker.socket.
  58. Processing triggers for ureadahead (0.100.0-20) ...
  59. Setting up liberror-perl (0.17025-1) ...
  60. Setting up cgroupfs-mount (1.4) ...
  61. Setting up bridge-utils (1.5-15ubuntu1) ...
  62. Setting up ubuntu-fan (0.12.10) ...
  63. Created symlink /etc/systemd/system/multi-user.target.wants/ubuntu-fan.service → /lib/systemd/system/ubuntu-fan.service.
  64. Processing triggers for systemd (237-3ubuntu10) ...
  65. Processing triggers for man-db (2.8.3-2) ...
  66. Setting up git (1:2.17.0-1ubuntu1) ...
  67. Processing triggers for ureadahead (0.100.0-20) ...
  68.  
  69.  
  70.  
  71. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ systemctl start docker
  72. ==== AUTHENTICATING FOR org.freedesktop.systemd1.manage-units ===
  73. Authentication is required to start 'docker.service'.
  74. Authenticating as: Panos,,, (panos)
  75. Password:
  76. ==== AUTHENTICATION COMPLETE ===
  77. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ systemctl status docker
  78. ● docker.service - Docker Application Container Engine
  79. Loaded: loaded (/lib/systemd/system/docker.service; disabled; vendor preset: enabled)
  80. Active: active (running) since Tue 2018-05-08 17:20:32 CEST; 48s ago
  81. Docs: https://docs.docker.com
  82. Main PID: 5400 (dockerd)
  83. Tasks: 21
  84. CGroup: /system.slice/docker.service
  85. ├─5400 /usr/bin/dockerd -H fd://
  86. └─5418 docker-containerd --config /var/run/docker/containerd/containerd.toml
  87.  
  88. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.336551366+02:00" level=warning msg="Your kernel does not support swap memory limit"
  89. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.336597117+02:00" level=warning msg="Your kernel does not support cgroup rt period"
  90. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.336606189+02:00" level=warning msg="Your kernel does not support cgroup rt runtime"
  91. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.337159615+02:00" level=info msg="Loading containers: start."
  92. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.646171596+02:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option -
  93. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.877731708+02:00" level=info msg="Loading containers: done."
  94. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:32.042898957+02:00" level=info msg="Docker daemon" commit=7390fc6 graphdriver(s)=overlay2 version=17.12.1-ce
  95. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:32.042986232+02:00" level=info msg="Daemon has completed initialization"
  96. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:32.062648407+02:00" level=info msg="API listen on /var/run/docker.sock"
  97. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Started Docker Application Container Engine.
  98.  
  99.  
  100. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ systemctl start docker
  101. ==== AUTHENTICATING FOR org.freedesktop.systemd1.manage-units ===
  102. Authentication is required to start 'docker.service'.
  103. Authenticating as: Panos,,, (panos)
  104. Password:
  105. ==== AUTHENTICATION COMPLETE ===
  106. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ systemctl status docker
  107. ● docker.service - Docker Application Container Engine
  108. Loaded: loaded (/lib/systemd/system/docker.service; disabled; vendor preset: enabled)
  109. Active: active (running) since Tue 2018-05-08 17:20:32 CEST; 48s ago
  110. Docs: https://docs.docker.com
  111. Main PID: 5400 (dockerd)
  112. Tasks: 21
  113. CGroup: /system.slice/docker.service
  114. ├─5400 /usr/bin/dockerd -H fd://
  115. └─5418 docker-containerd --config /var/run/docker/containerd/containerd.toml
  116.  
  117. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.336551366+02:00" level=warning msg="Your kernel does not support swap memory limit"
  118. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.336597117+02:00" level=warning msg="Your kernel does not support cgroup rt period"
  119. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.336606189+02:00" level=warning msg="Your kernel does not support cgroup rt runtime"
  120. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.337159615+02:00" level=info msg="Loading containers: start."
  121. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.646171596+02:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option -
  122. Mai 08 17:20:31 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:31.877731708+02:00" level=info msg="Loading containers: done."
  123. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:32.042898957+02:00" level=info msg="Docker daemon" commit=7390fc6 graphdriver(s)=overlay2 version=17.12.1-ce
  124. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:32.042986232+02:00" level=info msg="Daemon has completed initialization"
  125. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 dockerd[5400]: time="2018-05-08T17:20:32.062648407+02:00" level=info msg="API listen on /var/run/docker.sock"
  126. Mai 08 17:20:32 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Started Docker Application Container Engine.
  127.  
  128.  
  129. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ sudo docker ps
  130. CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
  131.  
  132.  
  133. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ sudo docker info | grep -i cgroup
  134. WARNING: No swap limit support
  135. Cgroup Driver: cgroupfs
  136.  
  137. This is because we have swap enabled...
  138.  
  139. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ swapon --summary
  140. Filename Type Size Used Priority
  141. /swapfile file 1942896 0 -2
  142.  
  143.  
  144. Disable swap:
  145. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ sudo swapoff -a
  146. panos@panos-Standard-PC-i440FX-PIIX-1996:~$ sudo swapon --summary
  147.  
  148. sudo -i
  149.  
  150. root@panos-Standard-PC-i440FX-PIIX-1996:~# apt-get update && apt-get install -y apt-transport-https curl
  151. Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease
  152. Hit:2 http://de.archive.ubuntu.com/ubuntu bionic InRelease
  153. Hit:3 http://de.archive.ubuntu.com/ubuntu bionic-updates InRelease
  154. Hit:4 http://de.archive.ubuntu.com/ubuntu bionic-backports InRelease
  155. Reading package lists... Done
  156. Reading package lists... Done
  157. Building dependency tree
  158. Reading state information... Done
  159. The following additional packages will be installed:
  160. libcurl4
  161. The following NEW packages will be installed:
  162. apt-transport-https curl libcurl4
  163. 0 upgraded, 3 newly installed, 0 to remove and 12 not upgraded.
  164. Need to get 375 kB of archives.
  165. After this operation, 1.188 kB of additional disk space will be used.
  166. Get:1 http://de.archive.ubuntu.com/ubuntu bionic/universe amd64 apt-transport-https all 1.6.1 [1.692 B]
  167. Get:2 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 libcurl4 amd64 7.58.0-2ubuntu3 [214 kB]
  168. Get:3 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 curl amd64 7.58.0-2ubuntu3 [159 kB]
  169. Fetched 375 kB in 0s (2.385 kB/s)
  170. Selecting previously unselected package apt-transport-https.
  171. (Reading database ... 129573 files and directories currently installed.)
  172. Preparing to unpack .../apt-transport-https_1.6.1_all.deb ...
  173. Unpacking apt-transport-https (1.6.1) ...
  174. Selecting previously unselected package libcurl4:amd64.
  175. Preparing to unpack .../libcurl4_7.58.0-2ubuntu3_amd64.deb ...
  176. Unpacking libcurl4:amd64 (7.58.0-2ubuntu3) ...
  177. Selecting previously unselected package curl.
  178. Preparing to unpack .../curl_7.58.0-2ubuntu3_amd64.deb ...
  179. Unpacking curl (7.58.0-2ubuntu3) ...
  180. Setting up apt-transport-https (1.6.1) ...
  181. Setting up libcurl4:amd64 (7.58.0-2ubuntu3) ...
  182. Processing triggers for libc-bin (2.27-3ubuntu1) ...
  183. Processing triggers for man-db (2.8.3-2) ...
  184. Setting up curl (7.58.0-2ubuntu3) ...
  185.  
  186.  
  187. root@panos-Standard-PC-i440FX-PIIX-1996:~# curl -s https://packages.cloud.google.com/apt/doc/apt-key.gpg | apt-key add -
  188. OK
  189. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat <<EOF >/etc/apt/sources.list.d/kubernetes.list
  190. > deb http://apt.kubernetes.io/ kubernetes-xenial main
  191. > EOF
  192.  
  193.  
  194. root@panos-Standard-PC-i440FX-PIIX-1996:~# apt-get update
  195. Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease
  196. Hit:2 http://de.archive.ubuntu.com/ubuntu bionic InRelease
  197. Hit:3 http://de.archive.ubuntu.com/ubuntu bionic-updates InRelease
  198. Hit:4 http://de.archive.ubuntu.com/ubuntu bionic-backports InRelease
  199. Get:5 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [8.993 B]
  200. Get:6 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 Packages [15,9 kB]
  201. Fetched 24,9 kB in 2s (14,5 kB/s)
  202. Reading package lists... Done
  203.  
  204.  
  205. root@panos-Standard-PC-i440FX-PIIX-1996:~# apt-get install -y kubelet kubeadm kubectl
  206. Reading package lists... Done
  207. Building dependency tree
  208. Reading state information... Done
  209. The following additional packages will be installed:
  210. ebtables ethtool kubernetes-cni socat
  211. The following NEW packages will be installed:
  212. ebtables ethtool kubeadm kubectl kubelet kubernetes-cni socat
  213. 0 upgraded, 7 newly installed, 0 to remove and 12 not upgraded.
  214. Need to get 57,1 MB of archives.
  215. After this operation, 411 MB of additional disk space will be used.
  216. Get:1 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 ebtables amd64 2.0.10.4-3.5ubuntu2 [80,0 kB]
  217. Get:2 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 ethtool amd64 1:4.15-0ubuntu1 [114 kB]
  218. Get:3 http://de.archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB]
  219. Get:4 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubernetes-cni amd64 0.6.0-00 [5.910 kB]
  220. Get:5 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubelet amd64 1.10.2-00 [21,1 MB]
  221. Get:6 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubectl amd64 1.10.2-00 [8.909 kB]
  222. Get:7 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubeadm amd64 1.10.2-00 [20,7 MB]
  223. Fetched 57,1 MB in 8s (7.423 kB/s)
  224. Selecting previously unselected package ebtables.
  225. (Reading database ... 129590 files and directories currently installed.)
  226. Preparing to unpack .../0-ebtables_2.0.10.4-3.5ubuntu2_amd64.deb ...
  227. Unpacking ebtables (2.0.10.4-3.5ubuntu2) ...
  228. Selecting previously unselected package ethtool.
  229. Preparing to unpack .../1-ethtool_1%3a4.15-0ubuntu1_amd64.deb ...
  230. Unpacking ethtool (1:4.15-0ubuntu1) ...
  231. Selecting previously unselected package kubernetes-cni.
  232. Preparing to unpack .../2-kubernetes-cni_0.6.0-00_amd64.deb ...
  233. Unpacking kubernetes-cni (0.6.0-00) ...
  234. Selecting previously unselected package socat.
  235. Preparing to unpack .../3-socat_1.7.3.2-2ubuntu2_amd64.deb ...
  236. Unpacking socat (1.7.3.2-2ubuntu2) ...
  237. Selecting previously unselected package kubelet.
  238. Preparing to unpack .../4-kubelet_1.10.2-00_amd64.deb ...
  239. Unpacking kubelet (1.10.2-00) ...
  240. Selecting previously unselected package kubectl.
  241. Preparing to unpack .../5-kubectl_1.10.2-00_amd64.deb ...
  242. Unpacking kubectl (1.10.2-00) ...
  243. Selecting previously unselected package kubeadm.
  244. Preparing to unpack .../6-kubeadm_1.10.2-00_amd64.deb ...
  245. Unpacking kubeadm (1.10.2-00) ...
  246. Setting up kubernetes-cni (0.6.0-00) ...
  247. Processing triggers for ureadahead (0.100.0-20) ...
  248. Setting up socat (1.7.3.2-2ubuntu2) ...
  249. Processing triggers for systemd (237-3ubuntu10) ...
  250. Setting up ebtables (2.0.10.4-3.5ubuntu2) ...
  251. Created symlink /etc/systemd/system/multi-user.target.wants/ebtables.service → /lib/systemd/system/ebtables.service.
  252. update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
  253. Setting up kubectl (1.10.2-00) ...
  254. Processing triggers for man-db (2.8.3-2) ...
  255. Setting up ethtool (1:4.15-0ubuntu1) ...
  256. Setting up kubelet (1.10.2-00) ...
  257. Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /lib/systemd/system/kubelet.service.
  258. Setting up kubeadm (1.10.2-00) ...
  259. Processing triggers for ureadahead (0.100.0-20) ...
  260. Processing triggers for systemd (237-3ubuntu10) ...
  261.  
  262.  
  263. The kubelet is now restarting every few seconds, as it waits in a crashloop for kubeadm to tell it what to do.
  264. For example:
  265.  
  266. journalctl -u kubelet -f
  267.  
  268. Mai 08 17:30:13 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
  269. Mai 08 17:30:13 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 7.
  270. Mai 08 17:30:13 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
  271. Mai 08 17:30:13 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Started kubelet: The Kubernetes Node Agent.
  272. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  273. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: Flag --allow-privileged has been deprecated, will be removed in a future version
  274. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  275. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  276. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  277. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  278. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
  279. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: I0508 17:30:14.058379 11437 feature_gate.go:226] feature gates: &{{} map[]}
  280. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 kubelet[11437]: F0508 17:30:14.059264 11437 server.go:218] unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory
  281. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
  282. Mai 08 17:30:14 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Failed with result 'exit-code'.
  283.  
  284.  
  285. root@panos-Standard-PC-i440FX-PIIX-1996:~# docker info | grep -i cgroup
  286. Cgroup Driver: cgroupfs
  287. WARNING: No swap limit support
  288.  
  289.  
  290. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
  291. [Service]
  292. Environment="KUBELET_KUBECONFIG_ARGS=--bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf"
  293. Environment="KUBELET_SYSTEM_PODS_ARGS=--pod-manifest-path=/etc/kubernetes/manifests --allow-privileged=true"
  294. Environment="KUBELET_NETWORK_ARGS=--network-plugin=cni --cni-conf-dir=/etc/cni/net.d --cni-bin-dir=/opt/cni/bin"
  295. Environment="KUBELET_DNS_ARGS=--cluster-dns=10.96.0.10 --cluster-domain=cluster.local"
  296. Environment="KUBELET_AUTHZ_ARGS=--authorization-mode=Webhook --client-ca-file=/etc/kubernetes/pki/ca.crt"
  297. Environment="KUBELET_CADVISOR_ARGS=--cadvisor-port=0"
  298. Environment="KUBELET_CERTIFICATE_ARGS=--rotate-certificates=true --cert-dir=/var/lib/kubelet/pki"
  299. ExecStart=
  300. ExecStart=/usr/bin/kubelet $KUBELET_KUBECONFIG_ARGS $KUBELET_SYSTEM_PODS_ARGS $KUBELET_NETWORK_ARGS $KUBELET_DNS_ARGS $KUBELET_AUTHZ_ARGS $KUBELET_CADVISOR_ARGS $KUBELET_CERTIFICATE_ARGS $KUBELET_EXTRA_ARGS
  301.  
  302.  
  303. RELEASE="$(curl -sSL https://dl.k8s.io/release/stable.txt)"
  304. Upstream kubeadm.conf can be found at: https://raw.githubusercontent.com/kubernetes/kubernetes/${RELEASE}/build/debs/10-kubeadm.conf"
  305.  
  306. In thi case: https://raw.githubusercontent.com/kubernetes/kubernetes/v1.10.2/build/debs/10-kubeadm.conf
  307.  
  308. [Service]
  309. Environment="KUBELET_KUBECONFIG_ARGS=--bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf"
  310. Environment="KUBELET_SYSTEM_PODS_ARGS=--pod-manifest-path=/etc/kubernetes/manifests --allow-privileged=true"
  311. Environment="KUBELET_NETWORK_ARGS=--network-plugin=cni --cni-conf-dir=/etc/cni/net.d --cni-bin-dir=/opt/cni/bin"
  312. Environment="KUBELET_DNS_ARGS=--cluster-dns=10.96.0.10 --cluster-domain=cluster.local"
  313. Environment="KUBELET_AUTHZ_ARGS=--authorization-mode=Webhook --client-ca-file=/etc/kubernetes/pki/ca.crt"
  314. # Value should match Docker daemon settings.
  315. # Defaults are "cgroupfs" for Debian/Ubuntu/OpenSUSE and "systemd" for Fedora/CentOS/RHEL
  316. Environment="KUBELET_CGROUP_ARGS=--cgroup-driver=cgroupfs"
  317. Environment="KUBELET_CADVISOR_ARGS=--cadvisor-port=0"
  318. Environment="KUBELET_CERTIFICATE_ARGS=--rotate-certificates=true"
  319. ExecStart=
  320. ExecStart=/usr/bin/kubelet $KUBELET_KUBECONFIG_ARGS $KUBELET_SYSTEM_PODS_ARGS $KUBELET_NETWORK_ARGS $KUBELET_DNS_ARGS $KUBELET_AUTHZ_ARGS $KUBELET_CGROUP_ARGS $KUBELET_CADVISOR_ARGS $KUBELET_CERTIFICATE_ARGS $KUBELET_EXTRA_ARGS
  321.  
  322. Looking at those, I modified the kubeadm from Ubuntu by adding:
  323. Environment="KUBELET_CGROUP_ARGS=--cgroup-driver=cgroupfs"
  324. and also $KUBELET_CGROUP_ARGS to the ExecStart
  325.  
  326. So the final looks like this:
  327.  
  328. [Service]
  329. Environment="KUBELET_KUBECONFIG_ARGS=--bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf"
  330. Environment="KUBELET_SYSTEM_PODS_ARGS=--pod-manifest-path=/etc/kubernetes/manifests --allow-privileged=true"
  331. Environment="KUBELET_NETWORK_ARGS=--network-plugin=cni --cni-conf-dir=/etc/cni/net.d --cni-bin-dir=/opt/cni/bin"
  332. Environment="KUBELET_DNS_ARGS=--cluster-dns=10.96.0.10 --cluster-domain=cluster.local"
  333. Environment="KUBELET_AUTHZ_ARGS=--authorization-mode=Webhook --client-ca-file=/etc/kubernetes/pki/ca.crt"
  334. # Value should match Docker daemon settings
  335. Environment="KUBELET_CGROUP_ARGS=--cgroup-driver=cgroupfs"
  336. Environment="KUBELET_CADVISOR_ARGS=--cadvisor-port=0"
  337. Environment="KUBELET_CERTIFICATE_ARGS=--rotate-certificates=true --cert-dir=/var/lib/kubelet/pki"
  338. ExecStart=
  339. ExecStart=/usr/bin/kubelet $KUBELET_KUBECONFIG_ARGS $KUBELET_SYSTEM_PODS_ARGS $KUBELET_NETWORK_ARGS $KUBELET_DNS_ARGS $KUBELET_AUTHZ_ARGS $KUBELET_CGROUP_ARGS $KUBELET_CADVISOR_ARGS $KUBELET_CERTIFICATE_ARGS $KUBELET_EXTRA_ARGS
  340.  
  341. One thing that exists in Ubuntu's kubeadm.conf is the location of the certs: see '--cert-dir=/var/lib/kubelet/pki"'
  342.  
  343. root@panos-Standard-PC-i440FX-PIIX-1996:~# ls -l /var/lib/kubelet/pki
  344. total 8
  345. -rw-r--r-- 1 root root 2339 Mai 8 17:29 kubelet.crt
  346. -rw------- 1 root root 1679 Mai 8 17:29 kubelet.key
  347.  
  348. root@panos-Standard-PC-i440FX-PIIX-1996:~# systemctl daemon-reload
  349. root@panos-Standard-PC-i440FX-PIIX-1996:~# systemctl restart kubelet
  350.  
  351. Then I see this at the logs of kubelet:
  352.  
  353. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
  354. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 97.
  355. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
  356. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Started kubelet: The Kubernetes Node Agent.
  357. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  358. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --allow-privileged has been deprecated, will be removed in a future version
  359. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  360. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  361. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  362. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  363. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  364. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
  365. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: I0508 17:45:36.796967 14323 feature_gate.go:226] feature gates: &{{} map[]}
  366. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14323]: F0508 17:45:36.797813 14323 server.go:218] unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory
  367. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
  368. Mai 08 17:45:36 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Failed with result 'exit-code'.
  369.  
  370.  
  371. kubeadm init
  372. [init] Using Kubernetes version: v1.10.2
  373. [init] Using Authorization modes: [Node RBAC]
  374. [preflight] Running pre-flight checks.
  375. [WARNING SystemVerification]: docker version is greater than the most recently validated version. Docker version: 17.12.1-ce. Max validated version: 17.03
  376. [WARNING Service-Docker]: docker service is not enabled, please run 'systemctl enable docker.service'
  377. [WARNING FileExisting-crictl]: crictl not found in system path
  378. Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl
  379. [certificates] Generated ca certificate and key.
  380. [certificates] Generated apiserver certificate and key.
  381. [certificates] apiserver serving cert is signed for DNS names [panos-standard-pc-i440fx-piix-1996 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 10.160.65.27]
  382. [certificates] Generated apiserver-kubelet-client certificate and key.
  383. [certificates] Generated etcd/ca certificate and key.
  384. [certificates] Generated etcd/server certificate and key.
  385. [certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1]
  386. [certificates] Generated etcd/peer certificate and key.
  387. [certificates] etcd/peer serving cert is signed for DNS names [panos-standard-pc-i440fx-piix-1996] and IPs [10.160.65.27]
  388. [certificates] Generated etcd/healthcheck-client certificate and key.
  389. [certificates] Generated apiserver-etcd-client certificate and key.
  390. [certificates] Generated sa key and public key.
  391. [certificates] Generated front-proxy-ca certificate and key.
  392. [certificates] Generated front-proxy-client certificate and key.
  393. [certificates] Valid certificates and keys now exist in "/etc/kubernetes/pki"
  394. [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf"
  395. [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf"
  396. [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf"
  397. [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf"
  398. [controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml"
  399. [controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
  400. [controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml"
  401. [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml"
  402. [init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests".
  403. [init] This might take a minute or longer if the control plane images have to be pulled.
  404. [apiclient] All control plane components are healthy after 42.001068 seconds
  405. [uploadconfig] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
  406. [markmaster] Will mark node panos-standard-pc-i440fx-piix-1996 as master by adding a label and a taint
  407. [markmaster] Master panos-standard-pc-i440fx-piix-1996 tainted and labelled with key/value: node-role.kubernetes.io/master=""
  408. [bootstraptoken] Using token: hpgsjt.r1ufhobhlps5yp3f
  409. [bootstraptoken] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
  410. [bootstraptoken] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
  411. [bootstraptoken] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
  412. [bootstraptoken] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
  413. [addons] Applied essential addon: kube-dns
  414. [addons] Applied essential addon: kube-proxy
  415.  
  416. Your Kubernetes master has initialized successfully!
  417.  
  418. To start using your cluster, you need to run the following as a regular user:
  419.  
  420. mkdir -p $HOME/.kube
  421. sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  422. sudo chown $(id -u):$(id -g) $HOME/.kube/config
  423.  
  424. You should now deploy a pod network to the cluster.
  425. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
  426. https://kubernetes.io/docs/concepts/cluster-administration/addons/
  427.  
  428. You can now join any number of machines by running the following on each node
  429. as root:
  430.  
  431. kubeadm join 10.160.65.27:6443 --token hpgsjt.r1ufhobhlps5yp3f --discovery-token-ca-cert-hash sha256:86e3f3c9912a3a56515fe64c86f7b070f5a1dc2b72be4db7b7fcb565f2c54936
  432.  
  433.  
  434.  
  435. During this, these are the logs from kubelet:
  436.  
  437. PAME
  438.  
  439. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
  440. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 109.
  441. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
  442. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 systemd[1]: Started kubelet: The Kubernetes Node Agent.
  443. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  444. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --allow-privileged has been deprecated, will be removed in a future version
  445. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  446. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  447. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  448. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  449. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
  450. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
  451. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.792928 14845 feature_gate.go:226] feature gates: &{{} map[]}
  452. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.803426 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  453. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.809080 14845 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
  454. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.809109 14845 server.go:376] Version: v1.10.2
  455. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.809140 14845 feature_gate.go:226] feature gates: &{{} map[]}
  456. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.809205 14845 plugins.go:89] No cloud provider specified.
  457. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.839799 14845 certificate_manager.go:299] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://10.160.65.27:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  458. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.843728 14845 server.go:613] --cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /
  459. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.844025 14845 container_manager_linux.go:242] container manager verified user specified cgroup-root exists: /
  460. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.844114 14845 container_manager_linux.go:247] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} ExperimentalQOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true}
  461. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.844726 14845 container_manager_linux.go:266] Creating device plugin manager: true
  462. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.844858 14845 state_mem.go:36] [cpumanager] initializing new in-memory state store
  463. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.844983 14845 state_file.go:82] [cpumanager] state file: created new state file "/var/lib/kubelet/cpu_manager_state"
  464. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.845301 14845 kubelet.go:272] Adding pod path: /etc/kubernetes/manifests
  465. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.845384 14845 kubelet.go:297] Watching apiserver
  466. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.869962 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  467. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.870057 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  468. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.870126 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  469. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.871918 14845 kubelet_network.go:139] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
  470. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.871938 14845 kubelet.go:556] Hairpin mode set to "hairpin-veth"
  471. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.871972 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  472. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.871987 14845 client.go:75] Connecting to docker on unix:///var/run/docker.sock
  473. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.871996 14845 client.go:104] Start docker client with request timeout=2m0s
  474. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.873003 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  475. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.875669 14845 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
  476. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.875695 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  477. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.875710 14845 docker_service.go:244] Docker cri networking managed by cni
  478. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.885371 14845 docker_service.go:249] Docker Info: &{ID:VQHB:HLB4:WMMV:7TOU:TOGO:EZPY:LYGE:5R7A:YW6G:6VVF:6K3B:CZIV Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:21 OomKillDisable:true NGoroutines:34 SystemTime:2018-05-08T17:47:39.876540466+02:00 LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.15.0-20-generic OperatingSystem:Ubuntu 18.04 LTS OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc420236a80 NCPU:2 MemTotal:4136452096 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:panos-Standard-PC-i440FX-PIIX-1996 Labels:[] ExperimentalBuild:false ServerVersion:17.12.1-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9b55aab90508bd389d7654c4baf173a981477d55 Expected:9b55aab90508bd389d7654c4baf173a981477d55} RuncCommit:{ID:9f9c96235cc97674e935002fc3d78361b696a69e Expected:9f9c96235cc97674e935002fc3d78361b696a69e} InitCommit:{ID:v0.13.0 Expected:949e6facb77383876aeff8a6944dde66b3089574} SecurityOptions:[name=apparmor name=seccomp,profile=default]}
  479. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.885494 14845 docker_service.go:262] Setting cgroupDriver to cgroupfs
  480. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.896352 14845 remote_runtime.go:43] Connecting to runtime service unix:///var/run/dockershim.sock
  481. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.923233 14845 kuberuntime_manager.go:186] Container runtime docker initialized, version: 17.12.1-ce, apiVersion: 1.35.0
  482. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.923675 14845 probe.go:215] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
  483. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.923996 14845 csi_plugin.go:61] kubernetes.io/csi: plugin initializing...
  484. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.936961 14845 kubelet.go:1277] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data for container /
  485. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.937266 14845 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
  486. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.937281 14845 status_manager.go:140] Starting to sync pod status with apiserver
  487. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.937288 14845 kubelet.go:1777] Starting kubelet main sync loop.
  488. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.937296 14845 kubelet.go:1794] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
  489. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.937371 14845 server.go:129] Starting to listen on 0.0.0.0:10250
  490. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.937763 14845 server.go:299] Adding debug handlers to kubelet server.
  491. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.938627 14845 volume_manager.go:247] Starting Kubelet Volume Manager
  492. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.942772 14845 event.go:209] Unable to write event: 'Post https://10.160.65.27:6443/api/v1/namespaces/default/events: dial tcp 10.160.65.27:6443: getsockopt: connection refused' (may retry after sleeping)
  493. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.943300 14845 dns.go:180] CheckLimitsForResolvConf: Resolv.conf file '/etc/resolv.conf' contains search line consisting of more than 3 domains!
  494. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.943440 14845 server.go:944] Started kubelet
  495. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:39.943551 14845 desired_state_of_world_populator.go:129] Desired state populator starts to run
  496. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:39.944187 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  497. Mai 08 17:47:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:39.947245 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  498. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.037611 14845 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
  499. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.039597 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  500. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.043237 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  501. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:40.043861 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  502. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.238551 14845 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
  503. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.244412 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  504. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.249570 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  505. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:40.250954 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  506. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.638795 14845 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
  507. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.651203 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  508. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:40.653161 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  509. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:40.653605 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  510. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:40.870348 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  511. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:40.871528 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  512. Mai 08 17:47:40 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:40.872648 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  513. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:41.438980 14845 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
  514. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:41.453914 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  515. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:41.457643 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  516. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:41.458214 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  517. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:41.871717 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  518. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:41.871917 14845 certificate_manager.go:299] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://10.160.65.27:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  519. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:41.873554 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  520. Mai 08 17:47:41 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:41.873694 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  521. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:42.090916 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  522. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:42.092342 14845 cpu_manager.go:155] [cpumanager] starting with none policy
  523. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:42.092422 14845 cpu_manager.go:156] [cpumanager] reconciling every 10s
  524. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:42.092474 14845 policy_none.go:42] [cpumanager] none policy: Start
  525. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: Starting Device Plugin manager
  526. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:42.113736 14845 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "panos-standard-pc-i440fx-piix-1996" not found
  527. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:42.872724 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  528. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:42.876393 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  529. Mai 08 17:47:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:42.877332 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  530. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.039848 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  531. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.048536 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/2a231b6575471532c8aa31ab88e9bde9-kubeconfig") pod "kube-scheduler-panos-standard-pc-i440fx-piix-1996" (UID: "2a231b6575471532c8aa31ab88e9bde9")
  532. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.058790 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  533. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.066902 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  534. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:43.067197 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  535. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.070912 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  536. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.071736 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  537. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:43.075266 14845 status_manager.go:461] Failed to get status for pod "kube-scheduler-panos-standard-pc-i440fx-piix-1996_kube-system(2a231b6575471532c8aa31ab88e9bde9)": Get https://10.160.65.27:6443/api/v1/namespaces/kube-system/pods/kube-scheduler-panos-standard-pc-i440fx-piix-1996: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  538. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.082766 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  539. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.083180 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  540. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:43.086398 14845 status_manager.go:461] Failed to get status for pod "etcd-panos-standard-pc-i440fx-piix-1996_kube-system(a0e5fe0c1680fba5b6285fb12f05a962)": Get https://10.160.65.27:6443/api/v1/namespaces/kube-system/pods/etcd-panos-standard-pc-i440fx-piix-1996: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  541. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.094744 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  542. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.095199 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  543. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:43.097931 14845 status_manager.go:461] Failed to get status for pod "kube-apiserver-panos-standard-pc-i440fx-piix-1996_kube-system(040c9273db872453d591f48d84364ed3)": Get https://10.160.65.27:6443/api/v1/namespaces/kube-system/pods/kube-apiserver-panos-standard-pc-i440fx-piix-1996: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  544. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.104193 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  545. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:43.109304 14845 status_manager.go:461] Failed to get status for pod "kube-controller-manager-panos-standard-pc-i440fx-piix-1996_kube-system(8c3a818387f40cc7440b2226fa50c39a)": Get https://10.160.65.27:6443/api/v1/namespaces/kube-system/pods/kube-controller-manager-panos-standard-pc-i440fx-piix-1996: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  546. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.150958 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-certs" (UniqueName: "kubernetes.io/host-path/a0e5fe0c1680fba5b6285fb12f05a962-etcd-certs") pod "etcd-panos-standard-pc-i440fx-piix-1996" (UID: "a0e5fe0c1680fba5b6285fb12f05a962")
  547. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.153803 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/040c9273db872453d591f48d84364ed3-k8s-certs") pod "kube-apiserver-panos-standard-pc-i440fx-piix-1996" (UID: "040c9273db872453d591f48d84364ed3")
  548. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.154525 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/8c3a818387f40cc7440b2226fa50c39a-ca-certs") pod "kube-controller-manager-panos-standard-pc-i440fx-piix-1996" (UID: "8c3a818387f40cc7440b2226fa50c39a")
  549. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.154638 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-data" (UniqueName: "kubernetes.io/host-path/a0e5fe0c1680fba5b6285fb12f05a962-etcd-data") pod "etcd-panos-standard-pc-i440fx-piix-1996" (UID: "a0e5fe0c1680fba5b6285fb12f05a962")
  550. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.155084 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs-etc-pki" (UniqueName: "kubernetes.io/host-path/040c9273db872453d591f48d84364ed3-ca-certs-etc-pki") pod "kube-apiserver-panos-standard-pc-i440fx-piix-1996" (UID: "040c9273db872453d591f48d84364ed3")
  551. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.155190 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/040c9273db872453d591f48d84364ed3-ca-certs") pod "kube-apiserver-panos-standard-pc-i440fx-piix-1996" (UID: "040c9273db872453d591f48d84364ed3")
  552. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.155493 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/8c3a818387f40cc7440b2226fa50c39a-k8s-certs") pod "kube-controller-manager-panos-standard-pc-i440fx-piix-1996" (UID: "8c3a818387f40cc7440b2226fa50c39a")
  553. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.156076 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/8c3a818387f40cc7440b2226fa50c39a-kubeconfig") pod "kube-controller-manager-panos-standard-pc-i440fx-piix-1996" (UID: "8c3a818387f40cc7440b2226fa50c39a")
  554. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:43.156556 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs-etc-pki" (UniqueName: "kubernetes.io/host-path/8c3a818387f40cc7440b2226fa50c39a-ca-certs-etc-pki") pod "kube-controller-manager-panos-standard-pc-i440fx-piix-1996" (UID: "8c3a818387f40cc7440b2226fa50c39a")
  555. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:43.873654 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  556. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:43.877216 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  557. Mai 08 17:47:43 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:43.878198 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  558. Mai 08 17:47:44 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:44.875352 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  559. Mai 08 17:47:44 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:44.879388 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  560. Mai 08 17:47:44 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:44.880239 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  561. Mai 08 17:47:45 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:45.875679 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  562. Mai 08 17:47:45 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:45.880240 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  563. Mai 08 17:47:45 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:45.881422 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  564. Mai 08 17:47:45 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:45.970600 14845 certificate_manager.go:299] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://10.160.65.27:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  565. Mai 08 17:47:46 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:46.267891 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  566. Mai 08 17:47:46 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:46.273575 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  567. Mai 08 17:47:46 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:46.274600 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  568. Mai 08 17:47:46 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:46.876328 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  569. Mai 08 17:47:46 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:46.881047 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  570. Mai 08 17:47:46 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:46.881988 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  571. Mai 08 17:47:47 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:47.119154 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  572. Mai 08 17:47:47 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:47.119273 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  573. Mai 08 17:47:47 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:47.876634 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  574. Mai 08 17:47:47 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:47.888663 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  575. Mai 08 17:47:47 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:47.888868 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  576. Mai 08 17:47:48 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:48.733999 14845 event.go:209] Unable to write event: 'Post https://10.160.65.27:6443/api/v1/namespaces/default/events: dial tcp 10.160.65.27:6443: getsockopt: connection refused' (may retry after sleeping)
  577. Mai 08 17:47:48 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:48.877159 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  578. Mai 08 17:47:48 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:48.889190 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  579. Mai 08 17:47:48 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:48.898526 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  580. Mai 08 17:47:49 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:49.877538 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  581. Mai 08 17:47:49 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:49.889545 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  582. Mai 08 17:47:49 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:49.898847 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  583. Mai 08 17:47:50 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:50.877890 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  584. Mai 08 17:47:50 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:50.889874 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  585. Mai 08 17:47:50 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:50.899139 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  586. Mai 08 17:47:51 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:51.878205 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  587. Mai 08 17:47:51 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:51.890206 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  588. Mai 08 17:47:51 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:51.899428 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  589. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:52.113978 14845 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "panos-standard-pc-i440fx-piix-1996" not found
  590. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:52.119827 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  591. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:52.119889 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  592. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:52.674823 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  593. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:52.676164 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  594. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:52.676335 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  595. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:52.878715 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  596. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:52.890594 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  597. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:52.900924 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  598. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:52.993127 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  599. Mai 08 17:47:52 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:52.994576 14845 status_manager.go:461] Failed to get status for pod "kube-scheduler-panos-standard-pc-i440fx-piix-1996_kube-system(2a231b6575471532c8aa31ab88e9bde9)": Get https://10.160.65.27:6443/api/v1/namespaces/kube-system/pods/kube-scheduler-panos-standard-pc-i440fx-piix-1996: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  600. Mai 08 17:47:53 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:53.880265 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  601. Mai 08 17:47:53 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:53.891917 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  602. Mai 08 17:47:53 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:53.902049 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  603. Mai 08 17:47:54 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:54.016836 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  604. Mai 08 17:47:54 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:54.145669 14845 certificate_manager.go:299] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://10.160.65.27:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  605. Mai 08 17:47:54 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:54.880950 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  606. Mai 08 17:47:54 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:54.893420 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  607. Mai 08 17:47:54 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:54.902982 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  608. Mai 08 17:47:55 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:55.882380 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  609. Mai 08 17:47:55 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:55.894925 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  610. Mai 08 17:47:55 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:55.904405 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  611. Mai 08 17:47:56 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:56.884208 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  612. Mai 08 17:47:56 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:56.895650 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  613. Mai 08 17:47:56 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:56.905017 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  614. Mai 08 17:47:57 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:47:57.123197 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  615. Mai 08 17:47:57 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:57.124275 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  616. Mai 08 17:47:57 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:57.884504 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  617. Mai 08 17:47:57 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:57.895907 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  618. Mai 08 17:47:57 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:57.905250 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  619. Mai 08 17:47:58 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:58.734352 14845 event.go:209] Unable to write event: 'Post https://10.160.65.27:6443/api/v1/namespaces/default/events: dial tcp 10.160.65.27:6443: getsockopt: connection refused' (may retry after sleeping)
  620. Mai 08 17:47:58 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:58.884929 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  621. Mai 08 17:47:58 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:58.896225 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  622. Mai 08 17:47:58 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:58.905595 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  623. Mai 08 17:47:59 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:59.676782 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  624. Mai 08 17:47:59 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:47:59.680154 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  625. Mai 08 17:47:59 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:59.680745 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  626. Mai 08 17:47:59 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:59.886945 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  627. Mai 08 17:47:59 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:59.899089 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  628. Mai 08 17:47:59 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:47:59.909588 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  629. Mai 08 17:48:00 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:00.889067 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  630. Mai 08 17:48:00 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:00.900456 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  631. Mai 08 17:48:00 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:00.911925 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  632. Mai 08 17:48:01 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:01.252613 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  633. Mai 08 17:48:01 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:01.265229 14845 status_manager.go:461] Failed to get status for pod "kube-controller-manager-panos-standard-pc-i440fx-piix-1996_kube-system(8c3a818387f40cc7440b2226fa50c39a)": Get https://10.160.65.27:6443/api/v1/namespaces/kube-system/pods/kube-controller-manager-panos-standard-pc-i440fx-piix-1996: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  634. Mai 08 17:48:01 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:01.890538 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  635. Mai 08 17:48:01 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:01.902107 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  636. Mai 08 17:48:01 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:01.914476 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  637. Mai 08 17:48:02 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:02.114541 14845 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "panos-standard-pc-i440fx-piix-1996" not found
  638. Mai 08 17:48:02 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:02.125824 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  639. Mai 08 17:48:02 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:02.126203 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  640. Mai 08 17:48:02 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:02.257640 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  641. Mai 08 17:48:02 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:02.892569 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  642. Mai 08 17:48:02 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:02.903395 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  643. Mai 08 17:48:02 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:02.915305 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  644. Mai 08 17:48:03 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:03.892978 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  645. Mai 08 17:48:03 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:03.904590 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  646. Mai 08 17:48:03 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:03.915813 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  647. Mai 08 17:48:04 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:04.893335 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  648. Mai 08 17:48:04 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:04.904927 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  649. Mai 08 17:48:04 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:04.916182 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  650. Mai 08 17:48:05 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:05.894533 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  651. Mai 08 17:48:05 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:05.905273 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  652. Mai 08 17:48:05 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:05.916509 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  653. Mai 08 17:48:06 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:06.680854 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  654. Mai 08 17:48:06 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:06.682138 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  655. Mai 08 17:48:06 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:06.682336 14845 kubelet_node_status.go:106] Unable to register node "panos-standard-pc-i440fx-piix-1996" with API server: Post https://10.160.65.27:6443/api/v1/nodes: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  656. Mai 08 17:48:06 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:06.894954 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://10.160.65.27:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  657. Mai 08 17:48:06 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:06.909479 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://10.160.65.27:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  658. Mai 08 17:48:06 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:06.916915 14845 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://10.160.65.27:6443/api/v1/nodes?fieldSelector=metadata.name%3Dpanos-standard-pc-i440fx-piix-1996&limit=500&resourceVersion=0: dial tcp 10.160.65.27:6443: getsockopt: connection refused
  659. Mai 08 17:48:07 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:07.127071 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  660. Mai 08 17:48:07 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:07.127155 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  661. Mai 08 17:48:08 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:08.362245 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  662. Mai 08 17:48:09 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:09.365567 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  663. Mai 08 17:48:09 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:09.943567 14845 dns.go:180] CheckLimitsForResolvConf: Resolv.conf file '/etc/resolv.conf' contains search line consisting of more than 3 domains!
  664. Mai 08 17:48:12 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:12.115287 14845 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "panos-standard-pc-i440fx-piix-1996" not found
  665. Mai 08 17:48:12 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:12.127756 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  666. Mai 08 17:48:12 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:12.127834 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  667. Mai 08 17:48:13 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:13.683675 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  668. Mai 08 17:48:13 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:13.685056 14845 kubelet_node_status.go:82] Attempting to register node panos-standard-pc-i440fx-piix-1996
  669. Mai 08 17:48:17 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:17.128473 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  670. Mai 08 17:48:17 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:17.128879 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  671. Mai 08 17:48:17 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:17.405434 14845 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
  672. Mai 08 17:48:17 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:17.791368 14845 reconciler.go:154] Reconciler: start to sync state
  673. Mai 08 17:48:17 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:17.832197 14845 kubelet_node_status.go:85] Successfully registered node panos-standard-pc-i440fx-piix-1996
  674. Mai 08 17:48:17 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:17.853964 14845 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"panos-standard-pc-i440fx-piix-1996.152cb5fa30c23fb1", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"panos-standard-pc-i440fx-piix-1996", UID:"panos-standard-pc-i440fx-piix-1996", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"Starting", Message:"Starting kubelet.", Source:v1.EventSource{Component:"kubelet", Host:"panos-standard-pc-i440fx-piix-1996"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbeb48f86f7cdf1b1, ext:215058150, loc:(*time.Location)(0x5b9f020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbeb48f86f7cdf1b1, ext:215058150, loc:(*time.Location)(0x5b9f020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
  675. Mai 08 17:48:22 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:22.129658 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  676. Mai 08 17:48:22 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:22.130063 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  677. Mai 08 17:48:26 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:26.615763 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy" (UniqueName: "kubernetes.io/configmap/3f21239b-52d7-11e8-868c-525400c272f8-kube-proxy") pod "kube-proxy-bmqdk" (UID: "3f21239b-52d7-11e8-868c-525400c272f8")
  678. Mai 08 17:48:26 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:26.616137 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy-token-vd2b5" (UniqueName: "kubernetes.io/secret/3f21239b-52d7-11e8-868c-525400c272f8-kube-proxy-token-vd2b5") pod "kube-proxy-bmqdk" (UID: "3f21239b-52d7-11e8-868c-525400c272f8")
  679. Mai 08 17:48:26 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:26.616278 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "xtables-lock" (UniqueName: "kubernetes.io/host-path/3f21239b-52d7-11e8-868c-525400c272f8-xtables-lock") pod "kube-proxy-bmqdk" (UID: "3f21239b-52d7-11e8-868c-525400c272f8")
  680. Mai 08 17:48:26 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:26.616381 14845 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-modules" (UniqueName: "kubernetes.io/host-path/3f21239b-52d7-11e8-868c-525400c272f8-lib-modules") pod "kube-proxy-bmqdk" (UID: "3f21239b-52d7-11e8-868c-525400c272f8")
  681. Mai 08 17:48:26 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:26.744983 14845 helpers.go:135] readString: Failed to read "/sys/fs/cgroup/memory/system.slice/run-ra96892997d3748f796925e814921e7ad.scope/memory.soft_limit_in_bytes": read /sys/fs/cgroup/memory/system.slice/run-ra96892997d3748f796925e814921e7ad.scope/memory.soft_limit_in_bytes: no such device
  682. Mai 08 17:48:27 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:27.134103 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  683. Mai 08 17:48:27 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:27.134202 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  684. Mai 08 17:48:29 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: I0508 17:48:29.815498 14845 transport.go:121] certificate rotation detected, shutting down client connections to start using new credentials
  685. Mai 08 17:48:32 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:32.144489 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  686. Mai 08 17:48:32 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:32.144639 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  687. Mai 08 17:48:33 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:33.637467 14845 remote_runtime.go:278] ContainerStatus "b9a8c80b73cb77945fe40e2f1b689a9e35df2dc419e22899eea75d4cf1c5890e" from runtime service failed: rpc error: code = Unknown desc = Error: No such container: b9a8c80b73cb77945fe40e2f1b689a9e35df2dc419e22899eea75d4cf1c5890e
  688. Mai 08 17:48:33 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:33.637497 14845 kuberuntime_container.go:385] ContainerStatus for b9a8c80b73cb77945fe40e2f1b689a9e35df2dc419e22899eea75d4cf1c5890e error: rpc error: code = Unknown desc = Error: No such container: b9a8c80b73cb77945fe40e2f1b689a9e35df2dc419e22899eea75d4cf1c5890e
  689. Mai 08 17:48:33 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:33.637506 14845 kuberuntime_manager.go:873] getPodContainerStatuses for pod "kube-proxy-bmqdk_kube-system(3f21239b-52d7-11e8-868c-525400c272f8)" failed: rpc error: code = Unknown desc = Error: No such container: b9a8c80b73cb77945fe40e2f1b689a9e35df2dc419e22899eea75d4cf1c5890e
  690. Mai 08 17:48:33 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:33.637520 14845 generic.go:241] PLEG: Ignoring events for pod kube-proxy-bmqdk/kube-system: rpc error: code = Unknown desc = Error: No such container: b9a8c80b73cb77945fe40e2f1b689a9e35df2dc419e22899eea75d4cf1c5890e
  691. Mai 08 17:48:37 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:37.146641 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  692. Mai 08 17:48:37 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:37.148530 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  693. Mai 08 17:48:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:39.943674 14845 dns.go:180] CheckLimitsForResolvConf: Resolv.conf file '/etc/resolv.conf' contains search line consisting of more than 3 domains!
  694.  
  695.  
  696.  
  697. Then it keeps looping with this:
  698.  
  699. Mai 08 17:48:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: W0508 17:48:42.149374 14845 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
  700. Mai 08 17:48:42 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:48:42.149478 14845 kubelet.go:2125] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
  701.  
  702. Setup Networkplugin WeaveNet:
  703.  
  704. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /proc/sys/net/bridge/bridge-nf-call-iptables
  705. 1
  706.  
  707. root@panos-Standard-PC-i440FX-PIIX-1996:~# mkdir -p $HOME/.kube
  708. root@panos-Standard-PC-i440FX-PIIX-1996:~# sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  709. root@panos-Standard-PC-i440FX-PIIX-1996:~# sudo chown $(id -u):$(id -g) $HOME/.kube/config
  710. root@panos-Standard-PC-i440FX-PIIX-1996:~# export KUBECONFIG=/etc/kubernetes/admin.conf
  711.  
  712.  
  713. export kubever=$(kubectl version | base64 | tr -d '\n')
  714.  
  715. root@panos-Standard-PC-i440FX-PIIX-1996:~# kubectl apply -f "https://cloud.weave.works/k8s/net?k8s-version=$kubever"
  716. serviceaccount "weave-net" created
  717. clusterrole.rbac.authorization.k8s.io "weave-net" created
  718. clusterrolebinding.rbac.authorization.k8s.io "weave-net" created
  719. role.rbac.authorization.k8s.io "weave-net" created
  720. rolebinding.rbac.authorization.k8s.io "weave-net" created
  721. daemonset.extensions "weave-net" created
  722.  
  723.  
  724. After ~5 minutes (takes some time)
  725. root@panos-Standard-PC-i440FX-PIIX-1996:~# kubectl get pods --all-namespaces
  726. NAMESPACE NAME READY STATUS RESTARTS AGE
  727. kube-system etcd-panos-standard-pc-i440fx-piix-1996 1/1 Running 0 11m
  728. kube-system kube-apiserver-panos-standard-pc-i440fx-piix-1996 1/1 Running 0 10m
  729. kube-system kube-controller-manager-panos-standard-pc-i440fx-piix-1996 1/1 Running 0 10m
  730. kube-system kube-dns-86f4d74b45-ctb4b 2/3 Running 0 10m
  731. kube-system kube-proxy-bmqdk 1/1 Running 0 10m
  732. kube-system kube-scheduler-panos-standard-pc-i440fx-piix-1996 1/1 Running 0 10m
  733. kube-system weave-net-rphts 2/2 Running 0 1m
  734.  
  735. kubelet logs complain only for one thing now:
  736.  
  737. Mai 08 17:59:39 panos-Standard-PC-i440FX-PIIX-1996 kubelet[14845]: E0508 17:59:39.982878 14845 dns.go:180] CheckLimitsForResolvConf: Resolv.conf file '/etc/resolv.conf' contains search line consisting of more than 3 domains!
  738.  
  739. This is because my /etc/resolv has:
  740.  
  741. nameserver 127.0.0.53
  742. search suse.de arch.suse.de nue.suse.com openvpn.suse.de suse.cz
  743.  
  744. Fixing that:
  745.  
  746. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/resolv.conf
  747. # This file is managed by man:systemd-resolved(8). Do not edit.
  748. #
  749. # This is a dynamic resolv.conf file for connecting local clients to the
  750. # internal DNS stub resolver of systemd-resolved. This file lists all
  751. # configured search domains.
  752. #
  753. # Run "systemd-resolve --status" to see details about the uplink DNS servers
  754. # currently in use.
  755. #
  756. # Third party programs must not access this file directly, but only through the
  757. # symlink at /etc/resolv.conf. To manage man:resolv.conf(5) in a different way,
  758. # replace this symlink by a static file or a different symlink.
  759. #
  760. # See man:systemd-resolved.service(8) for details about the supported modes of
  761. # operation for /etc/resolv.conf.
  762.  
  763. nameserver 127.0.0.53
  764. search suse.de nue.suse.com
  765.  
  766. Kubelet complains no more. Zero logging problem in Kubelet.
  767.  
  768.  
  769.  
  770.  
  771.  
  772. =======
  773. =======
  774.  
  775. Some yaml and conf files:
  776.  
  777. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/admin.conf
  778. apiVersion: v1
  779. clusters:
  780. - cluster:
  781. certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRFNE1EVXdPREUxTkRjek5Wb1hEVEk0TURVd05URTFORGN6TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBSjFaClE5SEhJc2piRWtCU0xQWDE2RWdjTTNVWnoxTnNxNTUzNkF1L1JTcFBpOEZPUG82di9ZeE1CQ3BpbUdsVmkwVDYKTmJqd2JiYmppY3U3RHZFRWs3VVpyZUIrc3R4Rnk4OThTenJmNnhTNlgwY3cyclRZakQ4djNnTk1HRHByMXV6cAoyYzNBUkFyOFhMd1dKZ3k4QndwQ2NLeTV3OUs3OUxUOTN0cWMwR0VxVWNqQ21OYklraTRsam5tNGZNRCtFK3A4CmY0a0tpRVdLUjZjZjVlZ0x3bDF1N1pSdkJkbGV5alhDV0F4M0hERGFEUFQ0c3Iyc0U1UVIzR0JvdjRYYXBRbGUKdlJ6eUl5SjR6Qnh4OGUxaS92dVg5Vk4veVlmd2hTYTl6R0RkTnJUMS9QRWJqM0Yybk4wVjU4RVFlV3F2QWgxdApOQVpKZE5GeWMrR3h4VHhCR0JjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBUzRrdWgrZzJKY2FNa2pMMUQ4YlpIUXl6Q2cKT0RZRW02VUJWSXl3dmFiblM2ZGlGUWdoeTFaWk9UTjVZNGtXVjRGN3VBYzVWYVoraTNKUnl3YUdkb1pWeFVULwpKZUlFMnRZTVRWa2E0L1NpbDhYcVphVXk3U2lwQStnNXFPL0tXdXpEZXVDY1pKbzRwbDlTNmxOeWdmY2dRVnVCClJwSTQ0N0R3U3FpSGtKemZhQ3huRVJhMnBGb2lmUU8xN1N0U3JhWmVEQzBmb3RJOTJtQ3l4UHFZbHBKb2pja3AKWk5pc3N1LzdGM2M0d0gvOUFXblZ0MlI0THkvaFJZMTlaUEFJVXAxOElyQmhQQVIvRzMxV0c3Ty8zRDVsMFdrSQpaT2ZlOWZHOHpuTVNWdEVNU1NBNnF2Y2FzWjF1dmFock1vWENzcmxMYmJISGU3bnVBbGsraWI0K0k5MD0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
  782. server: https://10.160.65.27:6443
  783. name: kubernetes
  784. contexts:
  785. - context:
  786. cluster: kubernetes
  787. user: kubernetes-admin
  788. name: kubernetes-admin@kubernetes
  789. current-context: kubernetes-admin@kubernetes
  790. kind: Config
  791. preferences: {}
  792. users:
  793. - name: kubernetes-admin
  794. user:
  795. client-certificate-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM4akNDQWRxZ0F3SUJBZ0lJSk5Tckc1a2JJRjR3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB4T0RBMU1EZ3hOVFEzTXpWYUZ3MHhPVEExTURneE5UUTNNemRhTURReApGekFWQmdOVkJBb1REbk41YzNSbGJUcHRZWE4wWlhKek1Sa3dGd1lEVlFRREV4QnJkV0psY201bGRHVnpMV0ZrCmJXbHVNSUlCSWpBTkJna3Foa2lHOXcwQkFRRUZBQU9DQVE4QU1JSUJDZ0tDQVFFQXdnYldBWjYrdXhtRXNjbE4KZTM2dHAraWduSlhsZXFnN3dvNWxhc0FVOFVjUjR6MndoMm00WWlHSEt2QmZiQ29ZUEIyQmpIeUV3RFNqbENidApIVEVDdUk5eEkraU1RSTc1Q2ZWUWdkZUh6Wnk3azN1MlFaZnRxWkxMN0x1UHBKVndyN3I2M2ZWZ3lvRnc1ODlmCkg5azNEZzNCS2MvVDlWaEY3VUgxNUEvT3JzczRMY3EvejRpZzhqekJ0SUZUSk9wTlc3aG9lZ3NzY25Ga2wxRlUKQkVReDJXcnFibGMxUDQwTUxvV0tPT1lDYURMN1NmaVpDK3A4blFmU09kVWRuZzBCVndjczRQck0zSERKd2hlSwoyRzhZTmwxbUhJK210SjNiV2hCTGM2S1Z3ai9LVDBIMndlbFZaWXJ5SSt3Uk5sTnFEQmhXTWtQTXlRUkc3enkvCmJMcjJSd0lEQVFBQm95Y3dKVEFPQmdOVkhROEJBZjhFQkFNQ0JhQXdFd1lEVlIwbEJBd3dDZ1lJS3dZQkJRVUgKQXdJd0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFHanhoQ2I4R2dhRytyWkluMkN2ckhDT3dtOEl4aEpnRHdYeAozcVh4eGJtTjVTWk5ucHpFYVZ0WE83TjE3NG9MRHE4NmJPMzRiTWl0dE9xZXpQOEN5RjZHOVB2TEdBTWhEZ1hxCmllMUhjMGQ5U3BoQklIVXk3VTUwZGN2b1lsdW5lUy9lVCs4U2JjNXJ3UC9LNlRZYURsVldpU0l1ZlJQb25JWUsKTThzVDVKU2RFQXJ3NE0vcnUrdzhwMmtPMUpBY21jcVd3M1hWSTRpYU5VTUc1aVo4cTlOT2J2UmZldWFlakYwcQoxOFhKTXRjOGl4dWl0QzY0YTZiSi95MTlCdnAxZElWeXYwMHl4VG54VURHZmhOYmdHUFVOR3JjQWVEa2RUbzNDCitDVVVCT3JRTkZJMi80QXV3dG82cHNjVzRQVTN5SmxMR01sby8rWDEzTUlBMEQ0R2g4UT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
  796. client-key-data: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFb3dJQkFBS0NBUUVBd2diV0FaNit1eG1Fc2NsTmUzNnRwK2lnbkpYbGVxZzd3bzVsYXNBVThVY1I0ejJ3CmgybTRZaUdIS3ZCZmJDb1lQQjJCakh5RXdEU2psQ2J0SFRFQ3VJOXhJK2lNUUk3NUNmVlFnZGVIelp5N2szdTIKUVpmdHFaTEw3THVQcEpWd3I3cjYzZlZneW9GdzU4OWZIOWszRGczQktjL1Q5VmhGN1VIMTVBL09yc3M0TGNxLwp6NGlnOGp6QnRJRlRKT3BOVzdob2Vnc3NjbkZrbDFGVUJFUXgyV3JxYmxjMVA0ME1Mb1dLT09ZQ2FETDdTZmlaCkMrcDhuUWZTT2RVZG5nMEJWd2NzNFByTTNIREp3aGVLMkc4WU5sMW1ISSttdEozYldoQkxjNktWd2ovS1QwSDIKd2VsVlpZcnlJK3dSTmxOcURCaFdNa1BNeVFSRzd6eS9iTHIyUndJREFRQUJBb0lCQVFDZ2x3M2NDMnJyNndRVQpMbnd1QWJ4enBDd0RUbUhBTXF3N3JLWXVROHRScERRZTlEays2dmJNYWRtNVpYaGxTellCMDU0ZERCYklDd2wxCkh2N1VVWE5pRkg5ZGJDVmhiYlNjVkdtTS9qb05xWExyYjlKNjJlZkFtWnFsVnR4ZUtiNDZCTFdNcm9LdE9aT2MKbWR1dXZaYyt6NDJZTU1iTFk0T0ZDem9jeUNTV01IV0I5OG9lSVFTckNrenZVQVlDRGVzMGNiZzRNZkJFbkk5WQovTmJGZE9TN3M2WXRUK1UvMG4rb0NJb29YK29SMHk3ZUppd1RobWx3d0g4WTZ3WS9OUDlFS2xMRmUzRUN1NXpsClRmMnRpZVpGNkFYMWZBazdrUG92aUxHUjdCTnZ3ZEFxYjloVVl1blBxRVdrMW4zMmlCeTlhbm4yTUMrazFaWXIKU0l3a2V5MEpBb0dCQU5BS25tSmxhQjVpSnV2MisvdzFhMU8yZ2E3TnNiYVFLdERWaXlIdlZPZ1FRTzg5M2RGdAptNWc1YXRXWlFkUDJKdXdVZHZERkxIdFQ1K3M2RFBFZmpER0twQk1aaE5Bb1NaYlFXWUM1eC9QMElrYUFPT0Z6CnpPVDhDMlVhYTJvTTFzU3lZWHVwWElyaU54cGNveDNXUnV0eHBNeGpxRTBKRzNLQ1dzMTJCVjdEQW9HQkFPN0IKSmRlV3RpU1BPekNkdld1QXRMMFFhYlQ2VFAxSGRBVitqdU9QMytnT1piVUQ1eUUvaEY1cmVsd0xMTVEzSnJkegorQXBQc0NZU3lnNG5xQXdnY0Fia29oVXdIOUlpQ3piUFdoTm84ZENERmNBWVVnQWNxeWtLK2ErT2o4MGlveUl1CitVaHVVakZhWGRaZDV3emRlQ0JSdnhGRWo2NmpSNmR1SVVBbG1Kb3RBb0dBQkhOVnRCRXJTd3NhZmczSWtqcXEKVXg0aVpCVHVhbE5uTnhSNlozMXhPWTJ2ZGU3QzRnb1FQQTl1WTZkbHF4MG05QUgwRVc2R1p4VUNieHZNenhPMwpzZytmTnZGaXova3NxZGRITXVQR2pVZDV2RHhkK3lTNUMyVUE4V2JCU1lHQXpyQnFPWFVFRDh5TEZUdEtHZ2ROCmVSZnpTSlFSTTZTd082RGlSR2J6OG5VQ2dZQUNFcWs2Y3ZPSDQ3cDIxSmZGYkN1bGpKUHVYMUgxelA0RDRqSnAKWldGalNXUzJxcDhDR2VRVFVjbVJMUU9wZkhVWW1LZ3Bwc0Yzd3lmLzhYWXpETUVNUGtYdCt5bjdrQklhMnJnRQpmUi9FV0s4Q3FQTmxUdHBwazgvUkoySzJQRHZBV3pvTTEvQmN2MVViUEZ0Nk1CNFA0Y1hQNTVGN3lhMGdsZ014CjVHR3J6UUtCZ0V0QkpjbVVFNlg4aEttekZsTk5rWElOVDIxZE1ucFhYMnBGQlUwQVlpQ2RucEhMUE1XblMvNHoKc1hOVVFkQmJ1SXAyeDFVblYvbk9YWUV6VDRhUXplOTRHVTJMYmpIMmVzRXRtdDdMUHJlbXpiWnVkblJJcXA3dQoyNnJsdWpXNVB3bHdoNnR0UDkzeUJURXlPdUpBM0l3YlVldTBvdFp3UFBHUk4veTY1a1UvCi0tLS0tRU5EIFJTQSBQUklWQVRFIEtFWS0tLS0tCg==
  797. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/kubelet.conf
  798. apiVersion: v1
  799. clusters:
  800. - cluster:
  801. certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRFNE1EVXdPREUxTkRjek5Wb1hEVEk0TURVd05URTFORGN6TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBSjFaClE5SEhJc2piRWtCU0xQWDE2RWdjTTNVWnoxTnNxNTUzNkF1L1JTcFBpOEZPUG82di9ZeE1CQ3BpbUdsVmkwVDYKTmJqd2JiYmppY3U3RHZFRWs3VVpyZUIrc3R4Rnk4OThTenJmNnhTNlgwY3cyclRZakQ4djNnTk1HRHByMXV6cAoyYzNBUkFyOFhMd1dKZ3k4QndwQ2NLeTV3OUs3OUxUOTN0cWMwR0VxVWNqQ21OYklraTRsam5tNGZNRCtFK3A4CmY0a0tpRVdLUjZjZjVlZ0x3bDF1N1pSdkJkbGV5alhDV0F4M0hERGFEUFQ0c3Iyc0U1UVIzR0JvdjRYYXBRbGUKdlJ6eUl5SjR6Qnh4OGUxaS92dVg5Vk4veVlmd2hTYTl6R0RkTnJUMS9QRWJqM0Yybk4wVjU4RVFlV3F2QWgxdApOQVpKZE5GeWMrR3h4VHhCR0JjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBUzRrdWgrZzJKY2FNa2pMMUQ4YlpIUXl6Q2cKT0RZRW02VUJWSXl3dmFiblM2ZGlGUWdoeTFaWk9UTjVZNGtXVjRGN3VBYzVWYVoraTNKUnl3YUdkb1pWeFVULwpKZUlFMnRZTVRWa2E0L1NpbDhYcVphVXk3U2lwQStnNXFPL0tXdXpEZXVDY1pKbzRwbDlTNmxOeWdmY2dRVnVCClJwSTQ0N0R3U3FpSGtKemZhQ3huRVJhMnBGb2lmUU8xN1N0U3JhWmVEQzBmb3RJOTJtQ3l4UHFZbHBKb2pja3AKWk5pc3N1LzdGM2M0d0gvOUFXblZ0MlI0THkvaFJZMTlaUEFJVXAxOElyQmhQQVIvRzMxV0c3Ty8zRDVsMFdrSQpaT2ZlOWZHOHpuTVNWdEVNU1NBNnF2Y2FzWjF1dmFock1vWENzcmxMYmJISGU3bnVBbGsraWI0K0k5MD0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
  802. server: https://10.160.65.27:6443
  803. name: kubernetes
  804. contexts:
  805. - context:
  806. cluster: kubernetes
  807. user: system:node:panos-standard-pc-i440fx-piix-1996
  808. name: system:node:panos-standard-pc-i440fx-piix-1996@kubernetes
  809. current-context: system:node:panos-standard-pc-i440fx-piix-1996@kubernetes
  810. kind: Config
  811. preferences: {}
  812. users:
  813. - name: system:node:panos-standard-pc-i440fx-piix-1996
  814. user:
  815. client-certificate-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUREakNDQWZhZ0F3SUJBZ0lJT0ttS2FaeWhIS1F3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB4T0RBMU1EZ3hOVFEzTXpWYUZ3MHhPVEExTURneE5UUTNNemRhTUZBeApGVEFUQmdOVkJBb1RESE41YzNSbGJUcHViMlJsY3pFM01EVUdBMVVFQXhNdWMzbHpkR1Z0T201dlpHVTZjR0Z1CmIzTXRjM1JoYm1SaGNtUXRjR010YVRRME1HWjRMWEJwYVhndE1UazVOakNDQVNJd0RRWUpLb1pJaHZjTkFRRUIKQlFBRGdnRVBBRENDQVFvQ2dnRUJBUEcvWVNyZzRWa0FXSmhKK0dUSDc0ek1nRzZxcHlScHl1VG1ocUpodUxCbApMYXROeDkxSm9EUTN6cWdqWTVGV3RuU3NWSlY1Q3JnYnF3RWVQNThMU21WZnhORDNqcnU3NUxhNmtSeGl4aUloClo0emgwemMrSld5QW5tK3BMQTJtblgxamh1ZUtJMjJyd0lIZXE4VG1pc201cEVWS1oxd1JIQXkzUWxQMWNiZysKa090cFBlWHpDN0ZjY2ZDMkxUYkovT2NGcVlqODB5dEo0UVp3TVo0R2tZa00weERYZnJpMUxkY1dGM0cxVElOWgpxT2pMRnU5R2QrN291cjRuNndrQ21Na1h1ZU5Tdlh1SHhCNGFiWE9RTFRTbVN0UGpRdnA0WDh1ZDlidlZqRW1SCnFiUXdlcHZZSEdzMkJMZVpyN3YxemU3MkYvZE8wTGoxaFpmZnMwUVZUQnNDQXdFQUFhTW5NQ1V3RGdZRFZSMFAKQVFIL0JBUURBZ1dnTUJNR0ExVWRKUVFNTUFvR0NDc0dBUVVGQndNQ01BMEdDU3FHU0liM0RRRUJDd1VBQTRJQgpBUUEyQjRvdGtCdHpudHZwMUNvQkRkM24xZkRPbXRqTVZIR1lRS1g1ejlLelVsNHloMzdmVXhtNVF4TTZ4YlJQCjNnVTNNc0wyZ3lSUHphZnJhNW5FS3IrOGdpRDBoTlBpOFVBdlFpckRobnBZRWVqbEdTcTV4L09ZdGZ2VnVKQjYKd3hMeUtEM3E2eVl3WWNoVG9iNlF5STNhT1BycERxUDY3VFRndERldFlxMms0MlJ1UGt0SFhIVEdRMU1EdFQveAp3QzRTMEUwL3dpZ2Y5ZndVeDZxVkI1M2lVZ1NTZENVNE1JMFFLUDlSbC8rNkx6TkgyQzZ3dlZ6N2pjL3FsZkUxCnh2WGtoSEdXYW0rYnZwYjg5Y1o0V0Z0QVQxZGZNa1RzenVnRHRuNmhQSi9yMDdiQTg2VXRBbUJEQm5xclM1bEsKc0F5OFlldUlnNmFlYnRqOGhHYzN2ak9vCi0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K
  816. client-key-data: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFcFFJQkFBS0NBUUVBOGI5aEt1RGhXUUJZbUVuNFpNZnZqTXlBYnFxbkpHbks1T2FHb21HNHNHVXRxMDNICjNVbWdORGZPcUNOamtWYTJkS3hVbFhrS3VCdXJBUjQvbnd0S1pWL0UwUGVPdTd2a3RycVJIR0xHSWlGbmpPSFQKTno0bGJJQ2ViNmtzRGFhZGZXT0c1NG9qYmF2QWdkNnJ4T2FLeWJta1JVcG5YQkVjRExkQ1UvVnh1RDZRNjJrOQo1Zk1Mc1Z4eDhMWXROc244NXdXcGlQelRLMG5oQm5BeG5nYVJpUXpURU5kK3VMVXQxeFlYY2JWTWcxbW82TXNXCjcwWjM3dWk2dmlmckNRS1l5UmU1NDFLOWU0ZkVIaHB0YzVBdE5LWkswK05DK25oZnk1MzF1OVdNU1pHcHREQjYKbTlnY2F6WUV0NW12dS9YTjd2WVg5MDdRdVBXRmw5K3pSQlZNR3dJREFRQUJBb0lCQVFDcFJKZUVybkViSUdMbwpQdUx0cmhETlJXT29HVlZ1NmFSbklnS2pNRWxoT1hjQXV6VjJmRmJ3T1NNNkY0MWY5cGRLbWwrZlNXRjRCK2QwCm9QbHJJenkwUHBwUXR3WDU3VlgzbkNwKzlhcEZ1NTRGeHhsZFZPWmZVcStjLzVjWTk5RE9PeUg2Zlg3UkM3Ri8KUGFxSDgrUzUyb0pyQWUzZFNSMmF5Ylpua3pSTkRDV0FadEZlL3hjQmdKRTdSWFdSYlFoUi9YdzJ1ZU5od0V6bQpsdGtEYVE3YTdQL3p3dWlZNGdDcnZPaE10OXJza3VVeG1oRkZ4MHNScWVPUld1K3AyOFFPbXVrY3pSZ0JXNnlFCnIxVDNzNVlWaTRkQXV5RXk1c3ptNXVOai84NGhNSjVVaVNld3ZyRTh6eGdDZ0s2dUR5Z1hCZEhIMjhyNENySHAKTjA1aEQxb0JBb0dCQVBUSjhxZ2FxY0xnYUdIQi9TVkFqeW50Y2VuSzBRQWNFcEk0aG9icnBqZ0lBWWxOVHJZWgpvVy9Za2xIMTZDWG12V3JvOHFRVnJob3BaLzFDUGpSeHpQdWxHdWdNQXduRFpndi83YmU5QncxNHVrdGl4SXFyClc5RnVJTWNYRkxCa3RjUUJWa3N6cW9MNmF1SHdYdzdHbXpQQlJhZnJmcVBObzZBOUZianVHTXJ0QW9HQkFQelIKeGh0THV1RkZOOHdDcmd3ZVlmU0szSUd1MzZEclVBcGtZclRua0hMVStPM1NLRGxLd1hyTEhUQXZrbC9rZWpsVgpMdFpKa2RoMGhBTjl0TjE3UzluMVpqR1RLN1ArNVI5NjJidVFwQzZ0ejBZUmEwdUMxcE9rOXp2TEhoL251T2ppCkhtYklYWnhTY1diZ0ZaUXpmZE56RG5ndWpKYlp0RFN2aVFyN0lhb25Bb0dBY2wyanRHeDRvZWFzZmZmZktMZG4KNjhQVzg4N2hKTGI0Nmoza2hFYTJxdmo2bHNaNm50T012QytuOVFqNXhETndqZkYxNDdtSlZRbkJYdTdERjBlUAo2SVl6OHZRaHV6OENmMXE4R3BzREg0VW5MSzloZWhRaldzNmtHOEFwMTF2R0hHUXZpQVVFaGhzdk1vNVdLeFlaClR1M2VlRnlyRnlhdGF1RC9OQjV4a09VQ2dZRUF2aGdJNmlzMTkvM3dwMC80aUJvc014QmFIcFJiaDRhSFoxajEKc3VwT2ZWbFBWcHBuTGpUY1o3VGpYSURZZ1l1c3J3RXl0Mk1YNjNZb2NPdUxHK0dDTmY5RGVORWMwams5RkQ5dQpDWThITkNYeUxOQWFLZXZWNWF2clRhVTdJR2crYTdUaGdRejAvZjRyVUZ2N1BiUzl6a2k3djNmWXMvQTdoRVhjCk9FcDlsSThDZ1lFQXRSZjZvQTh4RFRYbC9ybGZ2ZU5BbVF0cUswZzFzNVV4b1VST040Z09GTFJ3TFg1cHBkR0MKaVpnUktlQ0RzbmRtdUI4UENMTWV0dlpUNTdUb0ROM1U5UUh4TW56YkJMaUN2cHJZZDh6MjJNcytNbTNVQm5oMQozZlJQYTJaS0ppcFl4cUxyY1dsVmdMLzRKWkl1Yi9sWWxFN2U2N0tPVmk1NzE3eEhXaGxzbktvPQotLS0tLUVORCBSU0EgUFJJVkFURSBLRVktLS0tLQo=
  817. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/controller-manager.conf
  818. apiVersion: v1
  819. clusters:
  820. - cluster:
  821. certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRFNE1EVXdPREUxTkRjek5Wb1hEVEk0TURVd05URTFORGN6TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBSjFaClE5SEhJc2piRWtCU0xQWDE2RWdjTTNVWnoxTnNxNTUzNkF1L1JTcFBpOEZPUG82di9ZeE1CQ3BpbUdsVmkwVDYKTmJqd2JiYmppY3U3RHZFRWs3VVpyZUIrc3R4Rnk4OThTenJmNnhTNlgwY3cyclRZakQ4djNnTk1HRHByMXV6cAoyYzNBUkFyOFhMd1dKZ3k4QndwQ2NLeTV3OUs3OUxUOTN0cWMwR0VxVWNqQ21OYklraTRsam5tNGZNRCtFK3A4CmY0a0tpRVdLUjZjZjVlZ0x3bDF1N1pSdkJkbGV5alhDV0F4M0hERGFEUFQ0c3Iyc0U1UVIzR0JvdjRYYXBRbGUKdlJ6eUl5SjR6Qnh4OGUxaS92dVg5Vk4veVlmd2hTYTl6R0RkTnJUMS9QRWJqM0Yybk4wVjU4RVFlV3F2QWgxdApOQVpKZE5GeWMrR3h4VHhCR0JjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBUzRrdWgrZzJKY2FNa2pMMUQ4YlpIUXl6Q2cKT0RZRW02VUJWSXl3dmFiblM2ZGlGUWdoeTFaWk9UTjVZNGtXVjRGN3VBYzVWYVoraTNKUnl3YUdkb1pWeFVULwpKZUlFMnRZTVRWa2E0L1NpbDhYcVphVXk3U2lwQStnNXFPL0tXdXpEZXVDY1pKbzRwbDlTNmxOeWdmY2dRVnVCClJwSTQ0N0R3U3FpSGtKemZhQ3huRVJhMnBGb2lmUU8xN1N0U3JhWmVEQzBmb3RJOTJtQ3l4UHFZbHBKb2pja3AKWk5pc3N1LzdGM2M0d0gvOUFXblZ0MlI0THkvaFJZMTlaUEFJVXAxOElyQmhQQVIvRzMxV0c3Ty8zRDVsMFdrSQpaT2ZlOWZHOHpuTVNWdEVNU1NBNnF2Y2FzWjF1dmFock1vWENzcmxMYmJISGU3bnVBbGsraWI0K0k5MD0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
  822. server: https://10.160.65.27:6443
  823. name: kubernetes
  824. contexts:
  825. - context:
  826. cluster: kubernetes
  827. user: system:kube-controller-manager
  828. name: system:kube-controller-manager@kubernetes
  829. current-context: system:kube-controller-manager@kubernetes
  830. kind: Config
  831. preferences: {}
  832. users:
  833. - name: system:kube-controller-manager
  834. user:
  835. client-certificate-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lJWW1WMkZEQy9TWXN3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB4T0RBMU1EZ3hOVFEzTXpWYUZ3MHhPVEExTURneE5UUTNNemhhTUNreApKekFsQmdOVkJBTVRIbk41YzNSbGJUcHJkV0psTFdOdmJuUnliMnhzWlhJdGJXRnVZV2RsY2pDQ0FTSXdEUVlKCktvWklodmNOQVFFQkJRQURnZ0VQQURDQ0FRb0NnZ0VCQUx5SzhFcGZGMktseDQyOHE1dG56RjM1YXBSS01mT2kKVWczMC9WZWJmWWhSVCs1U1YrSCswa3NvYUUwVEplUGF0TU5mTkhDdERkR2RuRUcweWZYUFpyaC9rbDIrUitUUQo1S2pPdFRiY1Ztc3ZJU1Z4aklYRER6aThkVTJzZFp2bEF6RWdBTFZFQ3prOEVIZjk5WjRkakt6Wm9TNDJiYUxFCjlLZENhVlJTclFRajlaU3M0WVcza2U2citMZ015Zm5oZWdHdTVya1dpbFdYZ0tFa2VZYSszMWVvSzY2aVQyTVUKN2dZZVIyVktnMng5SzViVVdudTlFRUphcmUzOGNlZDFKM3hEOW95Y0JOQUJ6NzJpZDVYeDM2akt2TldxYkFDcAp5TkpHOHQ5cVpXcnJuUWQ2V3ZmMjFtN1Z4amNsZWg3T2llQk1Lc2lVS091Zlo2NDdHMkF2S2QwQ0F3RUFBYU1uCk1DVXdEZ1lEVlIwUEFRSC9CQVFEQWdXZ01CTUdBMVVkSlFRTU1Bb0dDQ3NHQVFVRkJ3TUNNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZUJqZHpxWDd5dXRyR0ZNQkdmaXNubE5Kb2FlZ2hkT3A0R3dxZFdBK1VLZk9KWE9kRQpHTEZSaGFkS2ZvelJvM21yRDhDUzJsR25HSW5VNTBMZ3VyOHZQVU0xUlJtc1pZNDhSTUR2RDRRSUszZjFiR2hYCm1PTDlxazJQd0FDZ0t5OFVmbkJpZnB0aWdSTEVJODYrRWF4ZWFyU25EUWE5alBBSlloekIzeGRnTFFNQysyclIKeW1FUGhaOWhQRHRnVi91TWZSTTZZV3R0Qk5rb01NczZuMFBub0xzeEhBOVBXY3RWOHFuZU14dkhSVzZCdlpiMQpmc3o2Rmx5cjA3a2d0ZmZlZWNHQU1JM2hEQlpTTTRqbW5HSWo4MGoyUjJTcDg4STNnMEZONGY4TWgrUlhNLzZrCllTSmhUZnRwb2ZaVjFGS0pDeThGZXh2bHFLeS9yTm42dis3SgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
  836. client-key-data: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFcEFJQkFBS0NBUUVBdklyd1NsOFhZcVhIamJ5cm0yZk1YZmxxbEVveDg2SlNEZlQ5VjV0OWlGRlA3bEpYCjRmN1NTeWhvVFJNbDQ5cTB3MTgwY0swTjBaMmNRYlRKOWM5bXVIK1NYYjVINU5Ea3FNNjFOdHhXYXk4aEpYR00KaGNNUE9MeDFUYXgxbStVRE1TQUF0VVFMT1R3UWQvMzFuaDJNck5taExqWnRvc1QwcDBKcFZGS3RCQ1AxbEt6aApoYmVSN3F2NHVBekorZUY2QWE3bXVSYUtWWmVBb1NSNWhyN2ZWNmdycnFKUFl4VHVCaDVIWlVxRGJIMHJsdFJhCmU3MFFRbHF0N2Z4eDUzVW5mRVAyakp3RTBBSFB2YUozbGZIZnFNcTgxYXBzQUtuSTBrYnkzMnBsYXV1ZEIzcGEKOS9iV2J0WEdOeVY2SHM2SjRFd3F5SlFvNjU5bnJqc2JZQzhwM1FJREFRQUJBb0lCQUhpcjBCazVmVVVrNTNCKwoxYktVSDRmeDcxWFRtdDdjLy9sdzJJaXV1d3g1UmxnNUdZaEtTSnZUMDlXb3NMS0Jzdm5zUUNyeGg0dW1mWERNClhncFdZTjhxdnlvQ2RBOHQ1M3RuT1RKUW1Ycm1ZaWVONGl0bWFhS2RjOUp2MDZJZ1ZBZW4vT3dIRGN2bTluOWwKNmtMMWxLaTRiV0dmY2xJZ0RwblNkb21DbEx1MWtrZFBKVGZYYmxBVEpwbTk4c2pJV0Q2ZXkvR284OU1qRndSegpyaWczUUlFcW5ieSsyc0hlK0FZNmNVL2ExUWt5UHN1MW41dzZyTkgvaUFBSzVtOGxla1NHbzFpUFArY25FTk1wCmhqS2diR1hCQVg0bVNZdTR4STYxbWQyOGVZd3JOYUEybUR6VmxPcFpGczdueWxxaWliQjl4cEE3bnJYdDRHdjEKWmhoQ2hwMENnWUVBNnZJYTJwUENhMDRuVVk0UnRheUdYMFMzRklrTC9iTE5NamZ2WkZvc21DYkRDYWNvMzduKwpCNUV6NS9ha2NBV25JSi9lZUFxc2YwYjJrSEdhdVdLZ1BXOUM4NnhXc2N3MkFCZlV0SERwQmZKU2t0TVY5UExXCmx1SUF6ZStxNzlvcFozZU1Vd2pISEswTUtycnVSaXRVN3ViTFRiSitGYy9UWFJTSms2c3czTE1DZ1lFQXpYQk4KTjFIR1BaSjBHTTZKOE1WVGg3bElEUGlmMzhlWDM5WGZBVkNZcFQwOXUrNmhid1YycVJtSGJJV1hBNENyVzF6aAp3cDdNOHNhclVsTDZYektqMlEyanBxRnd4VFc5TXp1Um5OMUJ2UTZZK3N0bTZBTTFwUU1XMitwWUxidU13N1hCCm0rTGZCNzBHNkVIK1Jzb0Z4U3FEL1BhaENoakwrTjJKdjdsN1J5OENnWUVBZ2J0R0VNUGVheG93bzl2cTg0SmMKZ0dhVklZVzdWVTlSOXhUajMybmJqZmg1WWU4bnBzSXcvMFN5Z0xlMGZSYmgvaVhJMWtndWorbERaT2NXSkovTgpFNTlJUFAxQXNkU3RUTWZiNy9jWTlPdWxwT1ZpRG11NUNuK3BLZzNaT2JBaGhMeUNnNmNwS3pCeXMzV2M5S29nCnIvcEk4SkpMQlFoSkVmQ3hOeFVrV2ZrQ2dZQTJGNk85TlNMbGczSmVOY1BNU2FpOHkrUlV4Z0lTZ2hOVE5KVUwKVzVWVnJOSmNjWERBTXNnVHJrMGlIZXF0V1d2RkdxZTIvdWtuNDNlb3JZQ1BJRjVVQUd0ZXJKTnMyY0YvZytmTApUZGJKV05hZThuK2VCM3BRZ0llOFQrLzMyckl0dGVYTWplZjd1YUhmOWNCbUV6dUJ0cmdhR3pZNzJsdWFvM3BwCnFRVDBzUUtCZ1FEWnFtVFpxV0EybTRPdTZxUlIyak82ai9jQjZlMVN5MTlOZll6Z1hxRTdrbGdZRHo2K3RWTlgKbVR4OGtWbkI1amdHQm52VnhHaEFUQjFtQURIM0Nsb0VmM0lXeFkzNzN0cGxCSVFFNDVLS2IyNmVjVHhXUUdnUgorWWNRemtTWGZWRURhb2dPUzVYeTF2cWlnQlNUYzQ0bVU5TXpnaEF4b2cwcDNZTllKb254cmc9PQotLS0tLUVORCBSU0EgUFJJVkFURSBLRVktLS0tLQo=
  837. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/scheduler.conf
  838. apiVersion: v1
  839. clusters:
  840. - cluster:
  841. certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRFNE1EVXdPREUxTkRjek5Wb1hEVEk0TURVd05URTFORGN6TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBSjFaClE5SEhJc2piRWtCU0xQWDE2RWdjTTNVWnoxTnNxNTUzNkF1L1JTcFBpOEZPUG82di9ZeE1CQ3BpbUdsVmkwVDYKTmJqd2JiYmppY3U3RHZFRWs3VVpyZUIrc3R4Rnk4OThTenJmNnhTNlgwY3cyclRZakQ4djNnTk1HRHByMXV6cAoyYzNBUkFyOFhMd1dKZ3k4QndwQ2NLeTV3OUs3OUxUOTN0cWMwR0VxVWNqQ21OYklraTRsam5tNGZNRCtFK3A4CmY0a0tpRVdLUjZjZjVlZ0x3bDF1N1pSdkJkbGV5alhDV0F4M0hERGFEUFQ0c3Iyc0U1UVIzR0JvdjRYYXBRbGUKdlJ6eUl5SjR6Qnh4OGUxaS92dVg5Vk4veVlmd2hTYTl6R0RkTnJUMS9QRWJqM0Yybk4wVjU4RVFlV3F2QWgxdApOQVpKZE5GeWMrR3h4VHhCR0JjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBUzRrdWgrZzJKY2FNa2pMMUQ4YlpIUXl6Q2cKT0RZRW02VUJWSXl3dmFiblM2ZGlGUWdoeTFaWk9UTjVZNGtXVjRGN3VBYzVWYVoraTNKUnl3YUdkb1pWeFVULwpKZUlFMnRZTVRWa2E0L1NpbDhYcVphVXk3U2lwQStnNXFPL0tXdXpEZXVDY1pKbzRwbDlTNmxOeWdmY2dRVnVCClJwSTQ0N0R3U3FpSGtKemZhQ3huRVJhMnBGb2lmUU8xN1N0U3JhWmVEQzBmb3RJOTJtQ3l4UHFZbHBKb2pja3AKWk5pc3N1LzdGM2M0d0gvOUFXblZ0MlI0THkvaFJZMTlaUEFJVXAxOElyQmhQQVIvRzMxV0c3Ty8zRDVsMFdrSQpaT2ZlOWZHOHpuTVNWdEVNU1NBNnF2Y2FzWjF1dmFock1vWENzcmxMYmJISGU3bnVBbGsraWI0K0k5MD0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
  842. server: https://10.160.65.27:6443
  843. name: kubernetes
  844. contexts:
  845. - context:
  846. cluster: kubernetes
  847. user: system:kube-scheduler
  848. name: system:kube-scheduler@kubernetes
  849. current-context: system:kube-scheduler@kubernetes
  850. kind: Config
  851. preferences: {}
  852. users:
  853. - name: system:kube-scheduler
  854. user:
  855. client-certificate-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMzakNDQWNhZ0F3SUJBZ0lJUmc2b0lLUjJzT013RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB4T0RBMU1EZ3hOVFEzTXpWYUZ3MHhPVEExTURneE5UUTNNemhhTUNBeApIakFjQmdOVkJBTVRGWE41YzNSbGJUcHJkV0psTFhOamFHVmtkV3hsY2pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCCkJRQURnZ0VQQURDQ0FRb0NnZ0VCQUxiS21NZ3pXWTFBbDVvNmw4ZU1rS1NGanYxUm9WdmNrbDV6emtQZXlSTGoKeldOMDVWTTJRVi9NVVYwWCtOb2l1bVlKUzhTOW50TmdCK0xMWXV4TCtJV2U3djZFY2t4TGowQ3BDNFZhUGlOOAplZ3BpMnFmczdnV0hoTFd6ZXZrMWNqME1JN1dMTFgzRlYrWC9LTDJ1SnIyek1YWDh0MHd0anA3Zkdsd2MxYWF3CnVHeG1KM2F5cEdUT2kxT0tRUHUvakMvMytjMXBZdG5meUlRbmpkUkplOWdabWRTQnNJWUFqVldmdC9tY3llcTQKN1d4WDVrcXU0bmx6Sk8wa1JUb2ZlR3NmZUpnSE53VS9MWUprR0EvdWFwNnJrd3lObEFMenRDN2tIeG5QQTNudgpTVVJoTSsvZFhScy84RURwWWd2ZnpmamFmS3hJaE5oVzNOYTltc1B5UGcwQ0F3RUFBYU1uTUNVd0RnWURWUjBQCkFRSC9CQVFEQWdXZ01CTUdBMVVkSlFRTU1Bb0dDQ3NHQVFVRkJ3TUNNQTBHQ1NxR1NJYjNEUUVCQ3dVQUE0SUIKQVFBVFNvQVZJOW1sV3g0Ujc1MDNnLy9QTFdySGJOWkdBdG9DUVkrT0V0WGJodTRRamVFZEZnS1E0NkNaMi83VwpOcmlSZVZZR1ZRSUdhR0Vib3ZBRWlwYjdEa0NMbnpJK0tVbk1mVlY2OTUyZDVGQTVQeGxzVW5xN3hGVUIvV3NqClhSdmhUajVTaStSMEFncnRxS0c1N1BqL0QwZFU3UkI5c2xVbW40M2JQaDJObXJBZHBHb0NmKzBxc1JpM1VtcXIKNG55L05GcXZnY1h5UitDUTZoWGV0OG9ESDU4K3NLb0xRdTdaRDBISTlTWTlKZmlpdHJNTkVPdUUrZU4wSjQybwp5Yzk1N1krN1dUT3RvbU8vUGl6LzZlZHBPRkx4WEx1OXh6V1FsVklYUXh5bHdVRzVpMDJmcXhEV0FjQzVWdG5rCkRwZ0tJTWc4czlSejRYalhoZkV5dzUvUAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
  856. client-key-data: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFcEFJQkFBS0NBUUVBdHNxWXlETlpqVUNYbWpxWHg0eVFwSVdPL1ZHaFc5eVNYblBPUTk3SkV1UE5ZM1RsClV6WkJYOHhSWFJmNDJpSzZaZ2xMeEwyZTAyQUg0c3RpN0V2NGhaN3Uvb1J5VEV1UFFLa0xoVm8rSTN4NkNtTGEKcCt6dUJZZUV0Yk42K1RWeVBRd2p0WXN0ZmNWWDVmOG92YTRtdmJNeGRmeTNUQzJPbnQ4YVhCelZwckM0YkdZbgpkcktrWk02TFU0cEErNytNTC9mNXpXbGkyZC9JaENlTjFFbDcyQm1aMUlHd2hnQ05WWiszK1p6SjZyanRiRmZtClNxN2llWE1rN1NSRk9oOTRheDk0bUFjM0JUOHRnbVFZRCs1cW5xdVRESTJVQXZPMEx1UWZHYzhEZWU5SlJHRXoKNzkxZEd6L3dRT2xpQzkvTitOcDhyRWlFMkZiYzFyMmF3L0krRFFJREFRQUJBb0lCQUh2YlpaRHFNbmppMXBiYgpzdksweldHZFdobE4wYTlFRXkzSy9HM0NySzZQQ3lHa0dLdThyS2x6OFlISjk0WWZWL3hCdWtSeVZBZFlINS9PClBwWnNsOVk2cmlocHFHVUlJZVluWlRZVHd0MGF3RHIvWnJlNGRFUHM0c0NYLy9DVEJYaFdISEFzQVVRaWp2KzYKV0duR2NsdkI2dmJPcVlrRnFZai9GWVpxeDE0dFpXaDZlQlJGU1RCWCtNK0VzT0lMbXA5blIzdWt4UFZRNFcreQo1dGM5RUVMK3R3eFBCdyt4L2Z3dXhuM3VBeCswTEJaeXpOeHhkNnlhVXhLRkE3aUFZNnRNcEVtQWE4bUFTb3pQClplS3JveG5Bd2F6UjdVVHFuNzlVZDlCZG1LZnFObUEwRDU4S2hmNU4vcjJ3Wi9IRlFyRjlEa2tZSEd6YURVTUMKZHRmMmUrRUNnWUVBMVB1YURNaGs5NzlhbldJeEVZTVU4bVhNdWNQeUxwL3NKazE5Tm1naVMrdTBnbG95aTEwTgpoNnZSTXBEVldCRkpZd1hyZkg1b1dUUVdNMlM3enkxRHlYTDFIT2I4UHlFK3NyNkFSeGh3RXIrd1A5ZHRlVmFyCmpqdkVGNTl1Z1VQamw5ZFBPRTR6bExpOUpRUU1WNnNGUFp3TkE0dXBhSWlld3h2NUhzRmVGd2tDZ1lFQTI3WHUKSHBMYTFmY1ZFVjdwa0YvVm1OSTVGNXZGUHNPWUp3NDVGUDVEa0pDdEdESy80dVo1ZEdUSG11enBsdlFnRXNJcApDYUNRZ3BzN0NWWTY4TUNTTnhSWG9FOVJsSlJ6d05xT3dIWXE0QTFQRjNsNTBQNUZMbWd5VTNjdnlMQjJrbVExCkIweUoyMVc2OUhKZk92eVJMNmNZaFhnWVhaZkZkbmxtd1NQSVMrVUNnWUVBeHgycU9nVW5rQTlQMGcrNHZCeUcKZXMvOWhEYlN0aEJCSU5ZVkY4Wm5PZjlVdFFGS2U4dzFGLy9rQnBndFBMWjhtNTB2T1NhY3U3amNnSlBPbWJSQgp5WlkxM2gxOCtqQkVnNnRpRmhXY3dZcUFaazhyUStOcFpBSXdJNzJqL0NuU0gyVGw1VWdISlNWSmY4KzNFa2NMCkVUeFJWbDA5dGtMejJvak9jSmhyTkxFQ2dZQkVyQVNWUWNsc2Z5SHluL3ZZeUZ0MnZKNWpwcWhzQ2E2UTVuMG8KOXFBZm0xaSs2MzNXYWJza2lpdHBYUXRWeDFBUERPak92WVR0alo5U044V01ZbVJSR3VhWWtMSXJBb3Q3aDlSKwppM0N6UHZXdG5LWmFrRjhITmtJa25HZ3ZEaGpCZ05paVEyWURURFIzR3hodzAyaDl3SGlGbnhmZWlRV0xGajdyCnQwZHZrUUtCZ1FDYVpXSzh4dUpFTUpBK3pubnUwMTVlNGVtZVc3NlV2NlNoaHJHRm9teXRpN0JIMlcyay8vNmkKMzEzS054R1BTUnNxcjdEQVdsZllwVzF2dXBBdUFGaHczdkgvcllKWUpEQ2l1OENGdDBoRFhQS2tBNStyU0J3dQphUE42bUJoZFVmRW5QVE9SRFRBLy96MTl0VmVkRGxuYm10bGlvSlZFQ3lXOWJkdEJFS2Q5Q3c9PQotLS0tLUVORCBSU0EgUFJJVkFURSBLRVktLS0tLQo=
  857. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/kube-apiserver.yaml
  858. apiVersion: v1
  859. kind: Pod
  860. metadata:
  861. annotations:
  862. scheduler.alpha.kubernetes.io/critical-pod: ""
  863. creationTimestamp: null
  864. labels:
  865. component: kube-apiserver
  866. tier: control-plane
  867. name: kube-apiserver
  868. namespace: kube-system
  869. spec:
  870. containers:
  871. - command:
  872. - kube-apiserver
  873. - --enable-bootstrap-token-auth=true
  874. - --requestheader-allowed-names=front-proxy-client
  875. - --client-ca-file=/etc/kubernetes/pki/ca.crt
  876. - --tls-cert-file=/etc/kubernetes/pki/apiserver.crt
  877. - --kubelet-client-key=/etc/kubernetes/pki/apiserver-kubelet-client.key
  878. - --insecure-port=0
  879. - --admission-control=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota
  880. - --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname
  881. - --requestheader-group-headers=X-Remote-Group
  882. - --service-cluster-ip-range=10.96.0.0/12
  883. - --service-account-key-file=/etc/kubernetes/pki/sa.pub
  884. - --kubelet-client-certificate=/etc/kubernetes/pki/apiserver-kubelet-client.crt
  885. - --proxy-client-cert-file=/etc/kubernetes/pki/front-proxy-client.crt
  886. - --tls-private-key-file=/etc/kubernetes/pki/apiserver.key
  887. - --secure-port=6443
  888. - --requestheader-client-ca-file=/etc/kubernetes/pki/front-proxy-ca.crt
  889. - --proxy-client-key-file=/etc/kubernetes/pki/front-proxy-client.key
  890. - --allow-privileged=true
  891. - --requestheader-username-headers=X-Remote-User
  892. - --requestheader-extra-headers-prefix=X-Remote-Extra-
  893. - --advertise-address=10.160.65.27
  894. - --authorization-mode=Node,RBAC
  895. - --etcd-servers=https://127.0.0.1:2379
  896. - --etcd-cafile=/etc/kubernetes/pki/etcd/ca.crt
  897. - --etcd-certfile=/etc/kubernetes/pki/apiserver-etcd-client.crt
  898. - --etcd-keyfile=/etc/kubernetes/pki/apiserver-etcd-client.key
  899. image: k8s.gcr.io/kube-apiserver-amd64:v1.10.2
  900. livenessProbe:
  901. failureThreshold: 8
  902. httpGet:
  903. host: 10.160.65.27
  904. path: /healthz
  905. port: 6443
  906. scheme: HTTPS
  907. initialDelaySeconds: 15
  908. timeoutSeconds: 15
  909. name: kube-apiserver
  910. resources:
  911. requests:
  912. cpu: 250m
  913. volumeMounts:
  914. - mountPath: /etc/ssl/certs
  915. name: ca-certs
  916. readOnly: true
  917. - mountPath: /etc/pki
  918. name: ca-certs-etc-pki
  919. readOnly: true
  920. - mountPath: /etc/kubernetes/pki
  921. name: k8s-certs
  922. readOnly: true
  923. hostNetwork: true
  924. volumes:
  925. - hostPath:
  926. path: /etc/pki
  927. type: DirectoryOrCreate
  928. name: ca-certs-etc-pki
  929. - hostPath:
  930. path: /etc/kubernetes/pki
  931. type: DirectoryOrCreate
  932. name: k8s-certs
  933. - hostPath:
  934. path: /etc/ssl/certs
  935. type: DirectoryOrCreate
  936. name: ca-certs
  937. status: {}
  938. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/kube-controller-manager.yaml
  939. apiVersion: v1
  940. kind: Pod
  941. metadata:
  942. annotations:
  943. scheduler.alpha.kubernetes.io/critical-pod: ""
  944. creationTimestamp: null
  945. labels:
  946. component: kube-controller-manager
  947. tier: control-plane
  948. name: kube-controller-manager
  949. namespace: kube-system
  950. spec:
  951. containers:
  952. - command:
  953. - kube-controller-manager
  954. - --use-service-account-credentials=true
  955. - --kubeconfig=/etc/kubernetes/controller-manager.conf
  956. - --root-ca-file=/etc/kubernetes/pki/ca.crt
  957. - --service-account-private-key-file=/etc/kubernetes/pki/sa.key
  958. - --cluster-signing-key-file=/etc/kubernetes/pki/ca.key
  959. - --address=127.0.0.1
  960. - --leader-elect=true
  961. - --controllers=*,bootstrapsigner,tokencleaner
  962. - --cluster-signing-cert-file=/etc/kubernetes/pki/ca.crt
  963. image: k8s.gcr.io/kube-controller-manager-amd64:v1.10.2
  964. livenessProbe:
  965. failureThreshold: 8
  966. httpGet:
  967. host: 127.0.0.1
  968. path: /healthz
  969. port: 10252
  970. scheme: HTTP
  971. initialDelaySeconds: 15
  972. timeoutSeconds: 15
  973. name: kube-controller-manager
  974. resources:
  975. requests:
  976. cpu: 200m
  977. volumeMounts:
  978. - mountPath: /etc/kubernetes/pki
  979. name: k8s-certs
  980. readOnly: true
  981. - mountPath: /etc/ssl/certs
  982. name: ca-certs
  983. readOnly: true
  984. - mountPath: /etc/kubernetes/controller-manager.conf
  985. name: kubeconfig
  986. readOnly: true
  987. - mountPath: /etc/pki
  988. name: ca-certs-etc-pki
  989. readOnly: true
  990. hostNetwork: true
  991. volumes:
  992. - hostPath:
  993. path: /etc/kubernetes/pki
  994. type: DirectoryOrCreate
  995. name: k8s-certs
  996. - hostPath:
  997. path: /etc/ssl/certs
  998. type: DirectoryOrCreate
  999. name: ca-certs
  1000. - hostPath:
  1001. path: /etc/kubernetes/controller-manager.conf
  1002. type: FileOrCreate
  1003. name: kubeconfig
  1004. - hostPath:
  1005. path: /etc/pki
  1006. type: DirectoryOrCreate
  1007. name: ca-certs-etc-pki
  1008. status: {}
  1009. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/kube-scheduler.yaml
  1010. apiVersion: v1
  1011. kind: Pod
  1012. metadata:
  1013. annotations:
  1014. scheduler.alpha.kubernetes.io/critical-pod: ""
  1015. creationTimestamp: null
  1016. labels:
  1017. component: kube-scheduler
  1018. tier: control-plane
  1019. name: kube-scheduler
  1020. namespace: kube-system
  1021. spec:
  1022. containers:
  1023. - command:
  1024. - kube-scheduler
  1025. - --leader-elect=true
  1026. - --kubeconfig=/etc/kubernetes/scheduler.conf
  1027. - --address=127.0.0.1
  1028. image: k8s.gcr.io/kube-scheduler-amd64:v1.10.2
  1029. livenessProbe:
  1030. failureThreshold: 8
  1031. httpGet:
  1032. host: 127.0.0.1
  1033. path: /healthz
  1034. port: 10251
  1035. scheme: HTTP
  1036. initialDelaySeconds: 15
  1037. timeoutSeconds: 15
  1038. name: kube-scheduler
  1039. resources:
  1040. requests:
  1041. cpu: 100m
  1042. volumeMounts:
  1043. - mountPath: /etc/kubernetes/scheduler.conf
  1044. name: kubeconfig
  1045. readOnly: true
  1046. hostNetwork: true
  1047. volumes:
  1048. - hostPath:
  1049. path: /etc/kubernetes/scheduler.conf
  1050. type: FileOrCreate
  1051. name: kubeconfig
  1052. status: {}
  1053. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/etcd.yaml
  1054. apiVersion: v1
  1055. kind: Pod
  1056. metadata:
  1057. annotations:
  1058. scheduler.alpha.kubernetes.io/critical-pod: ""
  1059. creationTimestamp: null
  1060. labels:
  1061. component: etcd
  1062. tier: control-plane
  1063. name: etcd
  1064. namespace: kube-system
  1065. spec:
  1066. containers:
  1067. - command:
  1068. - etcd
  1069. - --advertise-client-urls=https://127.0.0.1:2379
  1070. - --peer-client-cert-auth=true
  1071. - --cert-file=/etc/kubernetes/pki/etcd/server.crt
  1072. - --peer-key-file=/etc/kubernetes/pki/etcd/peer.key
  1073. - --listen-client-urls=https://127.0.0.1:2379
  1074. - --data-dir=/var/lib/etcd
  1075. - --key-file=/etc/kubernetes/pki/etcd/server.key
  1076. - --trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt
  1077. - --peer-cert-file=/etc/kubernetes/pki/etcd/peer.crt
  1078. - --peer-trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt
  1079. - --client-cert-auth=true
  1080. image: k8s.gcr.io/etcd-amd64:3.1.12
  1081. livenessProbe:
  1082. exec:
  1083. command:
  1084. - /bin/sh
  1085. - -ec
  1086. - ETCDCTL_API=3 etcdctl --endpoints=127.0.0.1:2379 --cacert=/etc/kubernetes/pki/etcd/ca.crt
  1087. --cert=/etc/kubernetes/pki/etcd/healthcheck-client.crt --key=/etc/kubernetes/pki/etcd/healthcheck-client.key
  1088. get foo
  1089. failureThreshold: 8
  1090. initialDelaySeconds: 15
  1091. timeoutSeconds: 15
  1092. name: etcd
  1093. resources: {}
  1094. volumeMounts:
  1095. - mountPath: /var/lib/etcd
  1096. name: etcd-data
  1097. - mountPath: /etc/kubernetes/pki/etcd
  1098. name: etcd-certs
  1099. hostNetwork: true
  1100. volumes:
  1101. - hostPath:
  1102. path: /var/lib/etcd
  1103. type: DirectoryOrCreate
  1104. name: etcd-data
  1105. - hostPath:
  1106. path: /etc/kubernetes/pki/etcd
  1107. type: DirectoryOrCreate
  1108. name: etcd-certs
  1109. status: {}
  1110. root@panos-Standard-PC-i440FX-PIIX-1996:~# ls -l etc/kubernetes/manifests
  1111. ls: cannot access 'etc/kubernetes/manifests': No such file or directory
  1112. root@panos-Standard-PC-i440FX-PIIX-1996:~# ls -l /etc/kubernetes/manifests
  1113. total 16
  1114. -rw------- 1 root root 1640 Mai 8 17:47 etcd.yaml
  1115. -rw------- 1 root root 2765 Mai 8 17:47 kube-apiserver.yaml
  1116. -rw------- 1 root root 1891 Mai 8 17:47 kube-controller-manager.yaml
  1117. -rw------- 1 root root 978 Mai 8 17:47 kube-scheduler.yaml
  1118. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat etcd.yaml kube-apiserver.yaml kube-controller-manager.yaml kube-scheduler.yaml
  1119. cat: etcd.yaml: No such file or directory
  1120. cat: kube-apiserver.yaml: No such file or directory
  1121. cat: kube-controller-manager.yaml: No such file or directory
  1122. cat: kube-scheduler.yaml: No such file or directory
  1123. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/etcd.yaml
  1124. apiVersion: v1
  1125. kind: Pod
  1126. metadata:
  1127. annotations:
  1128. scheduler.alpha.kubernetes.io/critical-pod: ""
  1129. creationTimestamp: null
  1130. labels:
  1131. component: etcd
  1132. tier: control-plane
  1133. name: etcd
  1134. namespace: kube-system
  1135. spec:
  1136. containers:
  1137. - command:
  1138. - etcd
  1139. - --advertise-client-urls=https://127.0.0.1:2379
  1140. - --peer-client-cert-auth=true
  1141. - --cert-file=/etc/kubernetes/pki/etcd/server.crt
  1142. - --peer-key-file=/etc/kubernetes/pki/etcd/peer.key
  1143. - --listen-client-urls=https://127.0.0.1:2379
  1144. - --data-dir=/var/lib/etcd
  1145. - --key-file=/etc/kubernetes/pki/etcd/server.key
  1146. - --trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt
  1147. - --peer-cert-file=/etc/kubernetes/pki/etcd/peer.crt
  1148. - --peer-trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt
  1149. - --client-cert-auth=true
  1150. image: k8s.gcr.io/etcd-amd64:3.1.12
  1151. livenessProbe:
  1152. exec:
  1153. command:
  1154. - /bin/sh
  1155. - -ec
  1156. - ETCDCTL_API=3 etcdctl --endpoints=127.0.0.1:2379 --cacert=/etc/kubernetes/pki/etcd/ca.crt
  1157. --cert=/etc/kubernetes/pki/etcd/healthcheck-client.crt --key=/etc/kubernetes/pki/etcd/healthcheck-client.key
  1158. get foo
  1159. failureThreshold: 8
  1160. initialDelaySeconds: 15
  1161. timeoutSeconds: 15
  1162. name: etcd
  1163. resources: {}
  1164. volumeMounts:
  1165. - mountPath: /var/lib/etcd
  1166. name: etcd-data
  1167. - mountPath: /etc/kubernetes/pki/etcd
  1168. name: etcd-certs
  1169. hostNetwork: true
  1170. volumes:
  1171. - hostPath:
  1172. path: /var/lib/etcd
  1173. type: DirectoryOrCreate
  1174. name: etcd-data
  1175. - hostPath:
  1176. path: /etc/kubernetes/pki/etcd
  1177. type: DirectoryOrCreate
  1178. name: etcd-certs
  1179. status: {}
  1180. root@panos-Standard-PC-i440FX-PIIX-1996:~# ls -l /etc/kubernetes/manifests
  1181. total 16
  1182. -rw------- 1 root root 1640 Mai 8 17:47 etcd.yaml
  1183. -rw------- 1 root root 2765 Mai 8 17:47 kube-apiserver.yaml
  1184. -rw------- 1 root root 1891 Mai 8 17:47 kube-controller-manager.yaml
  1185. -rw------- 1 root root 978 Mai 8 17:47 kube-scheduler.yaml
  1186. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/kube-apiserver.yaml
  1187. apiVersion: v1
  1188. kind: Pod
  1189. metadata:
  1190. annotations:
  1191. scheduler.alpha.kubernetes.io/critical-pod: ""
  1192. creationTimestamp: null
  1193. labels:
  1194. component: kube-apiserver
  1195. tier: control-plane
  1196. name: kube-apiserver
  1197. namespace: kube-system
  1198. spec:
  1199. containers:
  1200. - command:
  1201. - kube-apiserver
  1202. - --enable-bootstrap-token-auth=true
  1203. - --requestheader-allowed-names=front-proxy-client
  1204. - --client-ca-file=/etc/kubernetes/pki/ca.crt
  1205. - --tls-cert-file=/etc/kubernetes/pki/apiserver.crt
  1206. - --kubelet-client-key=/etc/kubernetes/pki/apiserver-kubelet-client.key
  1207. - --insecure-port=0
  1208. - --admission-control=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota
  1209. - --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname
  1210. - --requestheader-group-headers=X-Remote-Group
  1211. - --service-cluster-ip-range=10.96.0.0/12
  1212. - --service-account-key-file=/etc/kubernetes/pki/sa.pub
  1213. - --kubelet-client-certificate=/etc/kubernetes/pki/apiserver-kubelet-client.crt
  1214. - --proxy-client-cert-file=/etc/kubernetes/pki/front-proxy-client.crt
  1215. - --tls-private-key-file=/etc/kubernetes/pki/apiserver.key
  1216. - --secure-port=6443
  1217. - --requestheader-client-ca-file=/etc/kubernetes/pki/front-proxy-ca.crt
  1218. - --proxy-client-key-file=/etc/kubernetes/pki/front-proxy-client.key
  1219. - --allow-privileged=true
  1220. - --requestheader-username-headers=X-Remote-User
  1221. - --requestheader-extra-headers-prefix=X-Remote-Extra-
  1222. - --advertise-address=10.160.65.27
  1223. - --authorization-mode=Node,RBAC
  1224. - --etcd-servers=https://127.0.0.1:2379
  1225. - --etcd-cafile=/etc/kubernetes/pki/etcd/ca.crt
  1226. - --etcd-certfile=/etc/kubernetes/pki/apiserver-etcd-client.crt
  1227. - --etcd-keyfile=/etc/kubernetes/pki/apiserver-etcd-client.key
  1228. image: k8s.gcr.io/kube-apiserver-amd64:v1.10.2
  1229. livenessProbe:
  1230. failureThreshold: 8
  1231. httpGet:
  1232. host: 10.160.65.27
  1233. path: /healthz
  1234. port: 6443
  1235. scheme: HTTPS
  1236. initialDelaySeconds: 15
  1237. timeoutSeconds: 15
  1238. name: kube-apiserver
  1239. resources:
  1240. requests:
  1241. cpu: 250m
  1242. volumeMounts:
  1243. - mountPath: /etc/ssl/certs
  1244. name: ca-certs
  1245. readOnly: true
  1246. - mountPath: /etc/pki
  1247. name: ca-certs-etc-pki
  1248. readOnly: true
  1249. - mountPath: /etc/kubernetes/pki
  1250. name: k8s-certs
  1251. readOnly: true
  1252. hostNetwork: true
  1253. volumes:
  1254. - hostPath:
  1255. path: /etc/pki
  1256. type: DirectoryOrCreate
  1257. name: ca-certs-etc-pki
  1258. - hostPath:
  1259. path: /etc/kubernetes/pki
  1260. type: DirectoryOrCreate
  1261. name: k8s-certs
  1262. - hostPath:
  1263. path: /etc/ssl/certs
  1264. type: DirectoryOrCreate
  1265. name: ca-certs
  1266. status: {}
  1267. root@panos-Standard-PC-i440FX-PIIX-1996:~# ls -l /etc/kubernetes/manifests
  1268. total 16
  1269. -rw------- 1 root root 1640 Mai 8 17:47 etcd.yaml
  1270. -rw------- 1 root root 2765 Mai 8 17:47 kube-apiserver.yaml
  1271. -rw------- 1 root root 1891 Mai 8 17:47 kube-controller-manager.yaml
  1272. -rw------- 1 root root 978 Mai 8 17:47 kube-scheduler.yaml
  1273. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/kube-controller-manager.yaml
  1274. apiVersion: v1
  1275. kind: Pod
  1276. metadata:
  1277. annotations:
  1278. scheduler.alpha.kubernetes.io/critical-pod: ""
  1279. creationTimestamp: null
  1280. labels:
  1281. component: kube-controller-manager
  1282. tier: control-plane
  1283. name: kube-controller-manager
  1284. namespace: kube-system
  1285. spec:
  1286. containers:
  1287. - command:
  1288. - kube-controller-manager
  1289. - --use-service-account-credentials=true
  1290. - --kubeconfig=/etc/kubernetes/controller-manager.conf
  1291. - --root-ca-file=/etc/kubernetes/pki/ca.crt
  1292. - --service-account-private-key-file=/etc/kubernetes/pki/sa.key
  1293. - --cluster-signing-key-file=/etc/kubernetes/pki/ca.key
  1294. - --address=127.0.0.1
  1295. - --leader-elect=true
  1296. - --controllers=*,bootstrapsigner,tokencleaner
  1297. - --cluster-signing-cert-file=/etc/kubernetes/pki/ca.crt
  1298. image: k8s.gcr.io/kube-controller-manager-amd64:v1.10.2
  1299. livenessProbe:
  1300. failureThreshold: 8
  1301. httpGet:
  1302. host: 127.0.0.1
  1303. path: /healthz
  1304. port: 10252
  1305. scheme: HTTP
  1306. initialDelaySeconds: 15
  1307. timeoutSeconds: 15
  1308. name: kube-controller-manager
  1309. resources:
  1310. requests:
  1311. cpu: 200m
  1312. volumeMounts:
  1313. - mountPath: /etc/kubernetes/pki
  1314. name: k8s-certs
  1315. readOnly: true
  1316. - mountPath: /etc/ssl/certs
  1317. name: ca-certs
  1318. readOnly: true
  1319. - mountPath: /etc/kubernetes/controller-manager.conf
  1320. name: kubeconfig
  1321. readOnly: true
  1322. - mountPath: /etc/pki
  1323. name: ca-certs-etc-pki
  1324. readOnly: true
  1325. hostNetwork: true
  1326. volumes:
  1327. - hostPath:
  1328. path: /etc/kubernetes/pki
  1329. type: DirectoryOrCreate
  1330. name: k8s-certs
  1331. - hostPath:
  1332. path: /etc/ssl/certs
  1333. type: DirectoryOrCreate
  1334. name: ca-certs
  1335. - hostPath:
  1336. path: /etc/kubernetes/controller-manager.conf
  1337. type: FileOrCreate
  1338. name: kubeconfig
  1339. - hostPath:
  1340. path: /etc/pki
  1341. type: DirectoryOrCreate
  1342. name: ca-certs-etc-pki
  1343. status: {}
  1344. root@panos-Standard-PC-i440FX-PIIX-1996:~# ls -l /etc/kubernetes/manifests
  1345. total 16
  1346. -rw------- 1 root root 1640 Mai 8 17:47 etcd.yaml
  1347. -rw------- 1 root root 2765 Mai 8 17:47 kube-apiserver.yaml
  1348. -rw------- 1 root root 1891 Mai 8 17:47 kube-controller-manager.yaml
  1349. -rw------- 1 root root 978 Mai 8 17:47 kube-scheduler.yaml
  1350. root@panos-Standard-PC-i440FX-PIIX-1996:~# cat /etc/kubernetes/manifests/kube-scheduler.yaml
  1351. apiVersion: v1
  1352. kind: Pod
  1353. metadata:
  1354. annotations:
  1355. scheduler.alpha.kubernetes.io/critical-pod: ""
  1356. creationTimestamp: null
  1357. labels:
  1358. component: kube-scheduler
  1359. tier: control-plane
  1360. name: kube-scheduler
  1361. namespace: kube-system
  1362. spec:
  1363. containers:
  1364. - command:
  1365. - kube-scheduler
  1366. - --leader-elect=true
  1367. - --kubeconfig=/etc/kubernetes/scheduler.conf
  1368. - --address=127.0.0.1
  1369. image: k8s.gcr.io/kube-scheduler-amd64:v1.10.2
  1370. livenessProbe:
  1371. failureThreshold: 8
  1372. httpGet:
  1373. host: 127.0.0.1
  1374. path: /healthz
  1375. port: 10251
  1376. scheme: HTTP
  1377. initialDelaySeconds: 15
  1378. timeoutSeconds: 15
  1379. name: kube-scheduler
  1380. resources:
  1381. requests:
  1382. cpu: 100m
  1383. volumeMounts:
  1384. - mountPath: /etc/kubernetes/scheduler.conf
  1385. name: kubeconfig
  1386. readOnly: true
  1387. hostNetwork: true
  1388. volumes:
  1389. - hostPath:
  1390. path: /etc/kubernetes/scheduler.conf
  1391. type: FileOrCreate
  1392. name: kubeconfig
  1393. status: {}
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!