Apr 18 09:49:22 kms-mediator dockerd[25059]: time="2019-04-18T09:49:22.467787577Z" level=info msg="memberlist: Suspect e7b284330420 has failed, no acks received"
Apr 18 09:49:23 kms-mediator dockerd[25059]: time="2019-04-18T09:49:23.267884494Z" level=warning msg="memberlist: Refuting a suspect message (from: e7b284330420)"
Apr 18 09:49:25 kms-mediator dockerd[25059]: time="2019-04-18T09:49:25.467471174Z" level=warning msg="memberlist: Was able to connect to e7b284330420 but other probes failed, network may be misconfigured"
Apr 18 09:49:25 kms-mediator dockerd[25059]: time="2019-04-18T09:49:25.728220236Z" level=info msg="memberlist: Marking e7b284330420 as failed, suspect timeout reached (0 peer confirmations)"
Apr 18 09:49:25 kms-mediator dockerd[25059]: time="2019-04-18T09:49:25.728834806Z" level=info msg="Node e7b284330420/142.93.61.181, left gossip cluster"
Apr 18 09:49:25 kms-mediator dockerd[25059]: time="2019-04-18T09:49:25.729191439Z" level=info msg="Node e7b284330420 change state NodeActive --> NodeFailed"
Apr 18 09:49:25 kms-mediator dockerd[25059]: time="2019-04-18T09:49:25.731386994Z" level=info msg="Node e7b284330420/142.93.61.181, added to failed nodes list"
Apr 18 09:49:25 kms-mediator kernel: [3376954.372918] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:25 kms-mediator kernel: [3376954.481196] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:25 kms-mediator kernel: [3376954.550956] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:25 kms-mediator kernel: [3376954.622775] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:26 kms-mediator kernel: [3376954.694568] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:26 kms-mediator dockerd[25059]: time="2019-04-18T09:49:26.468973653Z" level=error msg="node: e7b284330420 is unknown to memberlist"
Apr 18 09:49:26 kms-mediator dockerd[25059]: time="2019-04-18T09:49:26.665523578Z" level=info msg="Node e7b284330420/142.93.61.181, joined gossip cluster"
Apr 18 09:49:26 kms-mediator dockerd[25059]: time="2019-04-18T09:49:26.666218716Z" level=info msg="Node e7b284330420 change state NodeFailed --> NodeActive"
Apr 18 09:49:28 kms-mediator dockerd[25059]: time="2019-04-18T09:49:28.467625225Z" level=info msg="memberlist: Suspect e7b284330420 has failed, no acks received"
Apr 18 09:49:30 kms-mediator dockerd[25059]: time="2019-04-18T09:49:30.468476025Z" level=info msg="memberlist: Suspect 3af987f41544 has failed, no acks received"
Apr 18 09:49:32 kms-mediator dockerd[25059]: time="2019-04-18T09:49:32.468450928Z" level=info msg="memberlist: Marking e7b284330420 as failed, suspect timeout reached (0 peer confirmations)"
Apr 18 09:49:32 kms-mediator dockerd[25059]: time="2019-04-18T09:49:32.469189666Z" level=info msg="Node e7b284330420/142.93.61.181, left gossip cluster"
Apr 18 09:49:32 kms-mediator dockerd[25059]: time="2019-04-18T09:49:32.469470452Z" level=info msg="Node e7b284330420 change state NodeActive --> NodeFailed"
Apr 18 09:49:32 kms-mediator dockerd[25059]: time="2019-04-18T09:49:32.470109864Z" level=info msg="Node e7b284330420/142.93.61.181, added to failed nodes list"
Apr 18 09:49:33 kms-mediator dockerd[25059]: time="2019-04-18T09:49:33.469522967Z" level=info msg="memberlist: Suspect e7b284330420 has failed, no acks received"
Apr 18 09:49:33 kms-mediator dockerd[25059]: time="2019-04-18T09:49:33.667422538Z" level=warning msg="NetworkDB stats kms-mediator(4adb11869318) - healthscore:3 (connectivity issues)"
Apr 18 09:49:34 kms-mediator dockerd[25059]: time="2019-04-18T09:49:34.469674875Z" level=info msg="memberlist: Marking 3af987f41544 as failed, suspect timeout reached (0 peer confirmations)"
Apr 18 09:49:34 kms-mediator dockerd[25059]: time="2019-04-18T09:49:34.470319061Z" level=info msg="Node 3af987f41544/134.209.118.8, left gossip cluster"
Apr 18 09:49:34 kms-mediator dockerd[25059]: time="2019-04-18T09:49:34.470637570Z" level=info msg="Node 3af987f41544 change state NodeActive --> NodeFailed"
Apr 18 09:49:34 kms-mediator dockerd[25059]: time="2019-04-18T09:49:34.472656043Z" level=info msg="Node 3af987f41544/134.209.118.8, added to failed nodes list"
Apr 18 09:49:34 kms-mediator kernel: [3376963.113830] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:34 kms-mediator kernel: [3376963.226682] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:34 kms-mediator kernel: [3376963.308286] IPVS: __ip_vs_del_service: enter
Apr 18 09:49:36 kms-mediator dockerd[25059]: time="2019-04-18T09:49:36.869239471Z" level=warning msg="bulk sync to node e7b284330420 failed: failed to send a TCP message during bulk sync: dial tcp 142.93.61.181:7946: i/o timeout"
Apr 18 09:49:38 kms-mediator dockerd[25059]: time="2019-04-18T09:49:38.467811908Z" level=info msg="memberlist: Suspect 3af987f41544 has failed, no acks received"
Apr 18 09:49:41 kms-mediator dockerd[25059]: time="2019-04-18T09:49:41.192632861Z" level=warning msg="failed to deactivate service binding for container registry.1.xsbeeiivmethu6y39sla2rhm4" error="No such container: registry.1.xsbeeiivmethu6y39sla2rhm4" module=node/agent node.id=0ipcceidwwiwvbtt17gzm85qh
Apr 18 09:49:43 kms-mediator dockerd[25059]: time="2019-04-18T09:49:43.871978135Z" level=warning msg="memberlist: Refuting a suspect message (from: 4adb11869318)"
Apr 18 09:49:43 kms-mediator dockerd[25059]: time="2019-04-18T09:49:43.872527373Z" level=info msg="Node 3af987f41544/134.209.118.8, joined gossip cluster"
Apr 18 09:49:43 kms-mediator dockerd[25059]: time="2019-04-18T09:49:43.872804716Z" level=info msg="Node 3af987f41544 change state NodeFailed --> NodeActive"
Apr 18 09:49:50 kms-mediator dockerd[25059]: time="2019-04-18T09:49:50.467724250Z" level=warning msg="memberlist: Was able to connect to 3af987f41544 but other probes failed, network may be misconfigured"
Apr 18 09:49:54 kms-mediator dockerd[25059]: time="2019-04-18T09:49:54.268218780Z" level=warning msg="bulk sync to node 3af987f41544 failed: failed to send a TCP message during bulk sync: dial tcp 134.209.118.8:7946: i/o timeout"
Apr 18 09:49:56 kms-mediator dockerd[25059]: time="2019-04-18T09:49:56.467677675Z" level=warning msg="memberlist: Was able to connect to 3af987f41544 but other probes failed, network may be misconfigured"
Apr 18 09:49:58 kms-mediator systemd-udevd[27120]: Could not generate persistent MAC address for vethbd080e0: No such file or directory
Apr 18 09:49:58 kms-mediator kernel: [3376987.439119] veth6: renamed from veth749d935
Apr 18 09:49:58 kms-mediator kernel: [3376987.439403] device veth6 entered promiscuous mode
Apr 18 09:49:58 kms-mediator systemd-udevd[27132]: Could not generate persistent MAC address for veth168e384: No such file or directory
Apr 18 09:49:58 kms-mediator kernel: [3376987.443324] device veth12a1589 entered promiscuous mode
Apr 18 09:49:58 kms-mediator kernel: [3376987.443389] IPv6: ADDRCONF(NETDEV_UP): veth12a1589: link is not ready
Apr 18 09:49:58 kms-mediator kernel: [3376987.443393] docker_gwbridge: port 5(veth12a1589) entered forwarding state
Apr 18 09:49:58 kms-mediator kernel: [3376987.443405] docker_gwbridge: port 5(veth12a1589) entered forwarding state
Apr 18 09:49:58 kms-mediator systemd-udevd[27135]: Could not generate persistent MAC address for veth12a1589: No such file or directory
Apr 18 09:49:58 kms-mediator containerd[1449]: time="2019-04-18T09:49:58.823363801Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/8196bb6167b12c8099c5804c752b5dc37a5d72955979f78e36ed928d8bcb0859/shim.sock" debug=false pid=27142
Apr 18 09:49:58 kms-mediator kernel: [3376987.546195] IPVS: Creating netns size=2192 id=259
Apr 18 09:49:59 kms-mediator kernel: [3376987.859396] eth0: renamed from vethbd080e0
Apr 18 09:49:59 kms-mediator kernel: [3376987.859641] docker_gwbridge: port 5(veth12a1589) entered disabled state
Apr 18 09:49:59 kms-mediator kernel: [3376987.859679] br0: port 4(veth6) entered forwarding state
Apr 18 09:49:59 kms-mediator kernel: [3376987.859692] br0: port 4(veth6) entered forwarding state
Apr 18 09:49:59 kms-mediator kernel: [3376987.955523] eth1: renamed from veth168e384
Apr 18 09:49:59 kms-mediator kernel: [3376987.955779] IPv6: ADDRCONF(NETDEV_CHANGE): veth12a1589: link becomes ready
Apr 18 09:49:59 kms-mediator kernel: [3376987.955811] docker_gwbridge: port 5(veth12a1589) entered forwarding state
Apr 18 09:49:59 kms-mediator kernel: [3376987.955819] docker_gwbridge: port 5(veth12a1589) entered forwarding state
Apr 18 09:49:59 kms-mediator dockerd[25059]: time="2019-04-18T09:49:59.852392328Z" level=info msg="worker gctoo2ifeyh7q36gndsvj8wzw was successfully registered" method="(*Dispatcher).register"
Apr 18 09:50:00 kms-mediator dockerd[25059]: time="2019-04-18T09:50:00.159227736Z" level=info msg="worker mb6891ny99kiw0spipbfdt73x was successfully registered" method="(*Dispatcher).register"
Apr 18 09:50:01 kms-mediator dockerd[25059]: time="2019-04-18T09:50:01.275724633Z" level=error msg="node: e7b284330420 is unknown to memberlist"
Apr 18 09:50:01 kms-mediator dockerd[25059]: time="2019-04-18T09:50:01.466315575Z" level=info msg="Node e7b284330420/142.93.61.181, joined gossip cluster"
Apr 18 09:50:01 kms-mediator dockerd[25059]: time="2019-04-18T09:50:01.467024727Z" level=info msg="Node e7b284330420 change state NodeFailed --> NodeActive"
Apr 18 09:50:01 kms-mediator dockerd[25059]: time="2019-04-18T09:50:01.468190934Z" level=warning msg="memberlist: Was able to connect to 3af987f41544 but other probes failed, network may be misconfigured"
Apr 18 09:50:04 kms-mediator dockerd[25059]: time="2019-04-18T09:50:04.468612334Z" level=warning msg="memberlist: Was able to connect to 3af987f41544 but other probes failed, network may be misconfigured"
Apr 18 09:50:14 kms-mediator kernel: [3377002.874676] br0: port 4(veth6) entered forwarding state
Apr 18 09:50:14 kms-mediator kernel: [3377003.002697] docker_gwbridge: port 5(veth12a1589) entered forwarding state
Apr 18 09:50:31 kms-mediator dockerd[25059]: time="2019-04-18T09:50:31.668648717Z" level=error msg="Bulk sync to node e7b284330420 timed out"
Apr 18 09:50:43 kms-mediator dockerd[25059]: time="2019-04-18T09:50:43.469005548Z" level=error msg="Bulk sync to node 3af987f41544 timed out"