Hossy923

20220628-DEBUG Logs after Consul Docker Container restart

Jun 28th, 2022 (edited)
121
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 44.21 KB | None | 0 0
  1. 2022-06-28T18:40:30.901063334Z ==> Found address '192.168.11.144' for interface 'eth0', setting bind option...
  2. 2022-06-28T18:40:30.976442703Z WARNING: LAN keyring exists but -encrypt given, using keyring
  3. 2022-06-28T18:40:30.976495665Z WARNING: WAN keyring exists but -encrypt given, using keyring
  4. 2022-06-28T18:40:30.976500862Z bootstrap_expect > 0: expecting 3 servers
  5. 2022-06-28T18:40:30.976514612Z ==> Starting Consul agent...
  6. 2022-06-28T18:40:31.016450016Z ==> Consul agent running!
  7. 2022-06-28T18:40:31.016489153Z Version: 'v1.2.0'
  8. 2022-06-28T18:40:31.016493448Z Node ID: '9e519d4e-9707-7449-a13b-bf17718a839e'
  9. 2022-06-28T18:40:31.016496616Z Node name: 'dc1-144.dc1.company.corp'
  10. 2022-06-28T18:40:31.016499501Z Datacenter: 'dc1' (Segment: '<all>')
  11. 2022-06-28T18:40:31.016502574Z Server: true (Bootstrap: false)
  12. 2022-06-28T18:40:31.016505485Z Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
  13. 2022-06-28T18:40:31.016508445Z Cluster Addr: 192.168.11.144 (LAN: 8301, WAN: 8302)
  14. 2022-06-28T18:40:31.016511341Z Encrypt: Gossip: true, TLS-Outgoing: false, TLS-Incoming: false
  15. 2022-06-28T18:40:31.016514170Z
  16. 2022-06-28T18:40:31.016516859Z ==> Log data will now stream in as it occurs:
  17. 2022-06-28T18:40:31.016519743Z
  18. 2022-06-28T18:40:31.016522502Z 2022/06/28 13:40:30 [WARN] agent: Node name "dc1-144.dc1.company.corp" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
  19. 2022-06-28T18:40:31.016528151Z 2022/06/28 13:40:30 [INFO] raft: Initial configuration (index=0): []
  20. 2022-06-28T18:40:31.016531010Z 2022/06/28 13:40:30 [INFO] serf: EventMemberJoin: dc1-144.dc1.company.corp.dc1 192.168.11.144
  21. 2022-06-28T18:40:31.016534016Z 2022/06/28 13:40:30 [INFO] serf: EventMemberJoin: dc1-144.dc1.company.corp 192.168.11.144
  22. 2022-06-28T18:40:31.016536841Z 2022/06/28 13:40:30 [INFO] raft: Node at 192.168.11.144:8300 [Follower] entering Follower state (Leader: "")
  23. 2022-06-28T18:40:31.016539896Z 2022/06/28 13:40:30 [INFO] consul: Handled member-join event for server "dc1-144.dc1.company.corp.dc1" in area "wan"
  24. 2022-06-28T18:40:31.016543039Z 2022/06/28 13:40:30 [INFO] serf: Attempting re-join to previously known node: dc1-121.dc1.company.corp.dc1: 192.168.11.121:8302
  25. 2022-06-28T18:40:31.016546085Z 2022/06/28 13:40:30 [INFO] consul: Adding LAN server dc1-144.dc1.company.corp (Addr: tcp/192.168.11.144:8300) (DC: dc1)
  26. 2022-06-28T18:40:31.016548969Z 2022/06/28 13:40:30 [INFO] serf: Attempting re-join to previously known node: dc1-28.dc1.company.corp: 192.168.11.28:8301
  27. 2022-06-28T18:40:31.016551859Z 2022/06/28 13:40:30 [DEBUG] agent/proxy: managed Connect proxy manager started
  28. 2022-06-28T18:40:31.016554684Z 2022/06/28 13:40:30 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.121:8302
  29. 2022-06-28T18:40:31.016557608Z 2022/06/28 13:40:30 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.28:8301
  30. 2022-06-28T18:40:31.016571955Z 2022/06/28 13:40:30 [DEBUG] memberlist: Failed to join 192.168.11.28: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  31. 2022-06-28T18:40:31.016575617Z 2022/06/28 13:40:30 [INFO] serf: Attempting re-join to previously known node: dc1-127.dc1.company.corp: 192.168.11.127:8301
  32. 2022-06-28T18:40:31.016578623Z 2022/06/28 13:40:30 [INFO] serf: EventMemberJoin: dc1-127.dc1.company.corp.dc1 192.168.11.127
  33. 2022-06-28T18:40:31.016581475Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-28.dc1.company.corp.dc1 192.168.11.28
  34. 2022-06-28T18:40:31.016584338Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-146.dc1.company.corp.dc1 192.168.11.146
  35. 2022-06-28T18:40:31.016587236Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-120.dc1.company.corp.dc1 192.168.11.120
  36. 2022-06-28T18:40:31.016590433Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-consul01.dc1 192.168.11.37
  37. 2022-06-28T18:40:31.016593405Z 2022/06/28 13:40:31 [WARN] memberlist: Refuting an alive message
  38. 2022-06-28T18:40:31.016596181Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: localhost.localdomain.dc1 192.168.11.116
  39. 2022-06-28T18:40:31.016599111Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-27.dc1.company.corp.dc1 192.168.11.27
  40. 2022-06-28T18:40:31.016601966Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-145.dc1.company.corp.dc1 192.168.11.145
  41. 2022-06-28T18:40:31.016604810Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-136.dc1.company.corp.dc1 192.168.11.136
  42. 2022-06-28T18:40:31.016607671Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-143.dc1.company.corp.dc1 192.168.11.143
  43. 2022-06-28T18:40:31.016610604Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-142.dc1.company.corp.dc1 192.168.11.142
  44. 2022-06-28T18:40:31.016613404Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-121.dc1.company.corp.dc1 192.168.11.121
  45. 2022-06-28T18:40:31.016616257Z 2022/06/28 13:40:31 [INFO] serf: Re-joined to previously known node: dc1-121.dc1.company.corp.dc1: 192.168.11.121:8302
  46. 2022-06-28T18:40:31.016619200Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-127.dc1.company.corp.dc1" in area "wan"
  47. 2022-06-28T18:40:31.016648170Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-28.dc1.company.corp.dc1" in area "wan"
  48. 2022-06-28T18:40:31.016652553Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-146.dc1.company.corp.dc1" in area "wan"
  49. 2022-06-28T18:40:31.016656404Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-120.dc1.company.corp.dc1" in area "wan"
  50. 2022-06-28T18:40:31.016659459Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-consul01.dc1" in area "wan"
  51. 2022-06-28T18:40:31.016662619Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "localhost.localdomain.dc1" in area "wan"
  52. 2022-06-28T18:40:31.016674817Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-27.dc1.company.corp.dc1" in area "wan"
  53. 2022-06-28T18:40:31.016678878Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-145.dc1.company.corp.dc1" in area "wan"
  54. 2022-06-28T18:40:31.016681979Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-136.dc1.company.corp.dc1" in area "wan"
  55. 2022-06-28T18:40:31.016685038Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-143.dc1.company.corp.dc1" in area "wan"
  56. 2022-06-28T18:40:31.016688021Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-142.dc1.company.corp.dc1" in area "wan"
  57. 2022-06-28T18:40:31.016691086Z 2022/06/28 13:40:31 [INFO] consul: Handled member-join event for server "dc1-121.dc1.company.corp.dc1" in area "wan"
  58. 2022-06-28T18:40:31.016694045Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.127:8301
  59. 2022-06-28T18:40:31.016696880Z 2022/06/28 13:40:31 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
  60. 2022-06-28T18:40:31.016699674Z 2022/06/28 13:40:31 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
  61. 2022-06-28T18:40:31.016702634Z 2022/06/28 13:40:31 [INFO] agent: Started HTTP server on 0.0.0.0:8500 (tcp)
  62. 2022-06-28T18:40:31.016705433Z 2022/06/28 13:40:31 [INFO] agent: started state syncer
  63. 2022-06-28T18:40:31.016708214Z 2022/06/28 13:40:31 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer triton
  64. 2022-06-28T18:40:31.016711142Z 2022/06/28 13:40:31 [INFO] agent: Joining LAN cluster...
  65. 2022-06-28T18:40:31.016714036Z 2022/06/28 13:40:31 [INFO] agent: (LAN) joining: [consul.discovery.rancher.internal]
  66. 2022-06-28T18:40:31.017528377Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.127: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  67. 2022-06-28T18:40:31.017543216Z 2022/06/28 13:40:31 [INFO] serf: Attempting re-join to previously known node: dc1-145.dc1.company.corp: 192.168.11.145:8301
  68. 2022-06-28T18:40:31.031533515Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.145:8301
  69. 2022-06-28T18:40:31.031560497Z 2022/06/28 13:40:31 [WARN] memberlist: Refuting a suspect message (from: dc1-127.dc1.company.corp)
  70. 2022-06-28T18:40:31.031564904Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.145: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  71. 2022-06-28T18:40:31.031568429Z 2022/06/28 13:40:31 [INFO] serf: Attempting re-join to previously known node: dc1-142.dc1.company.corp: 192.168.11.142:8301
  72. 2022-06-28T18:40:31.031571735Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.142:8301
  73. 2022-06-28T18:40:31.031577394Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.121:8301
  74. 2022-06-28T18:40:31.031591710Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.142: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  75. 2022-06-28T18:40:31.031595351Z 2022/06/28 13:40:31 [INFO] serf: Attempting re-join to previously known node: dc1-svcapi02: 192.168.11.54:8301
  76. 2022-06-28T18:40:31.031598321Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-consul01 192.168.11.37
  77. 2022-06-28T18:40:31.031601193Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-27.dc1.company.corp 192.168.11.27
  78. 2022-06-28T18:40:31.031604185Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-127.dc1.company.corp 192.168.11.127
  79. 2022-06-28T18:40:31.031607037Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-28.dc1.company.corp 192.168.11.28
  80. 2022-06-28T18:40:31.031610020Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-121.dc1.company.corp 192.168.11.121
  81. 2022-06-28T18:40:31.031612902Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-120.dc1.company.corp 192.168.11.120
  82. 2022-06-28T18:40:31.031615824Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-146.dc1.company.corp 192.168.11.146
  83. 2022-06-28T18:40:31.031618677Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-143.dc1.company.corp 192.168.11.143
  84. 2022-06-28T18:40:31.031621660Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-svcapi02 192.168.11.54
  85. 2022-06-28T18:40:31.031625096Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-136.dc1.company.corp 192.168.11.136
  86. 2022-06-28T18:40:31.031628119Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: localhost.localdomain 192.168.11.116
  87. 2022-06-28T18:40:31.031631041Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-svcapi01 192.168.11.53
  88. 2022-06-28T18:40:31.031633882Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-142.dc1.company.corp 192.168.11.142
  89. 2022-06-28T18:40:31.032425037Z 2022/06/28 13:40:31 [INFO] serf: EventMemberJoin: dc1-145.dc1.company.corp 192.168.11.145
  90. 2022-06-28T18:40:31.036431584Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.54:8301
  91. 2022-06-28T18:40:31.036448066Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-consul01 (Addr: tcp/192.168.11.37:8300) (DC: dc1)
  92. 2022-06-28T18:40:31.044191257Z 2022/06/28 13:40:31 [INFO] serf: Re-joined to previously known node: dc1-svcapi02: 192.168.11.54:8301
  93. 2022-06-28T18:40:31.044230782Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.27:8301
  94. 2022-06-28T18:40:31.054519556Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.120:8301
  95. 2022-06-28T18:40:31.054562217Z 2022/06/28 13:40:31 [INFO] consul: Existing Raft peers reported by dc1-127.dc1.company.corp, disabling bootstrap mode
  96. 2022-06-28T18:40:31.054567332Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-27.dc1.company.corp (Addr: tcp/192.168.11.27:8300) (DC: dc1)
  97. 2022-06-28T18:40:31.054587582Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-127.dc1.company.corp (Addr: tcp/192.168.11.127:8300) (DC: dc1)
  98. 2022-06-28T18:40:31.054591132Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-28.dc1.company.corp (Addr: tcp/192.168.11.28:8300) (DC: dc1)
  99. 2022-06-28T18:40:31.054594076Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-121.dc1.company.corp (Addr: tcp/192.168.11.121:8300) (DC: dc1)
  100. 2022-06-28T18:40:31.054597078Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-120.dc1.company.corp (Addr: tcp/192.168.11.120:8300) (DC: dc1)
  101. 2022-06-28T18:40:31.054600000Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-146.dc1.company.corp (Addr: tcp/192.168.11.146:8300) (DC: dc1)
  102. 2022-06-28T18:40:31.054603047Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-143.dc1.company.corp (Addr: tcp/192.168.11.143:8300) (DC: dc1)
  103. 2022-06-28T18:40:31.054605971Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-136.dc1.company.corp (Addr: tcp/192.168.11.136:8300) (DC: dc1)
  104. 2022-06-28T18:40:31.054609057Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server localhost.localdomain (Addr: tcp/192.168.11.116:8300) (DC: dc1)
  105. 2022-06-28T18:40:31.054612577Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-142.dc1.company.corp (Addr: tcp/192.168.11.142:8300) (DC: dc1)
  106. 2022-06-28T18:40:31.054615577Z 2022/06/28 13:40:31 [INFO] consul: Adding LAN server dc1-145.dc1.company.corp (Addr: tcp/192.168.11.145:8300) (DC: dc1)
  107. 2022-06-28T18:40:31.058451508Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.146:8301
  108. 2022-06-28T18:40:31.081436779Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.146: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  109. 2022-06-28T18:40:31.090466579Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.143:8301
  110. 2022-06-28T18:40:31.100447227Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.127:8301
  111. 2022-06-28T18:40:31.112465148Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.127: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  112. 2022-06-28T18:40:31.112506303Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.145:8301
  113. 2022-06-28T18:40:31.118443568Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.145: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  114. 2022-06-28T18:40:31.142466147Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.28:8301
  115. 2022-06-28T18:40:31.146441616Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.28: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  116. 2022-06-28T18:40:31.149455092Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.142:8301
  117. 2022-06-28T18:40:31.152420984Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.142: Member 'dc1-116.dc1.company.corp' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'localhost.localdomain'
  118. 2022-06-28T18:40:31.155415129Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.136:8301
  119. 2022-06-28T18:40:31.157477980Z 2022/06/28 13:40:31 [DEBUG] memberlist: Failed to join 192.168.11.136: Member 'localhost.localdomain' has conflicting node ID '9123397d-1058-471b-4977-70daa1afac2e' with member 'dc1-116.dc1.company.corp'
  120. 2022-06-28T18:40:31.160420018Z 2022/06/28 13:40:31 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.116:8301
  121. 2022-06-28T18:40:31.172481885Z 2022/06/28 13:40:31 [INFO] agent: (LAN) joined: 5 Err: <nil>
  122. 2022-06-28T18:40:31.172518628Z 2022/06/28 13:40:31 [DEBUG] agent: systemd notify failed: No socket
  123. 2022-06-28T18:40:31.172523494Z 2022/06/28 13:40:31 [INFO] agent: Join LAN completed. Synced with 5 initial agents
  124. 2022-06-28T18:40:31.293291821Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  125. 2022-06-28T18:40:31.588968040Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  126. 2022-06-28T18:40:31.600833483Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  127. 2022-06-28T18:40:31.602938530Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  128. 2022-06-28T18:40:31.624026212Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  129. 2022-06-28T18:40:31.677556678Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  130. 2022-06-28T18:40:31.763422088Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  131. 2022-06-28T18:40:31.803222571Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  132. 2022-06-28T18:40:31.859469799Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  133. 2022-06-28T18:40:31.958285689Z 2022/06/28 13:40:31 [DEBUG] serf: messageJoinType: dc1-144.dc1.company.corp
  134. 2022-06-28T18:40:32.590485248Z 2022/06/28 13:40:32 [DEBUG] serf: messageJoinType: localhost.localdomain
  135. 2022-06-28T18:40:32.789138575Z 2022/06/28 13:40:32 [DEBUG] serf: messageJoinType: localhost.localdomain
  136. 2022-06-28T18:40:32.891880710Z 2022/06/28 13:40:32 [DEBUG] serf: messageJoinType: localhost.localdomain
  137. 2022-06-28T18:40:32.893572492Z 2022/06/28 13:40:32 [DEBUG] serf: messageJoinType: localhost.localdomain
  138. 2022-06-28T18:40:32.999476465Z 2022/06/28 13:40:32 [DEBUG] serf: messageJoinType: localhost.localdomain
  139. 2022-06-28T18:40:38.090497345Z 2022/06/28 13:40:38 [ERR] agent: failed to sync remote state: No cluster leader
  140. 2022-06-28T18:40:38.646409147Z 2022/06/28 13:40:38 [WARN] raft: no known peers, aborting election
  141. 2022-06-28T18:40:39.177486091Z 2022/06/28 13:40:39 [DEBUG] memberlist: Stream connection from=192.168.11.37:44032
  142. 2022-06-28T18:40:39.553505164Z 2022/06/28 13:40:39 [DEBUG] memberlist: Stream connection from=192.168.11.120:32784
  143. 2022-06-28T18:40:43.488716064Z 2022/06/28 13:40:43 [DEBUG] memberlist: Failed ping: dc1-143.dc1.company.corp (timeout reached)
  144. 2022-06-28T18:40:43.988354780Z 2022/06/28 13:40:43 [INFO] memberlist: Suspect dc1-143.dc1.company.corp has failed, no acks received
  145. 2022-06-28T18:40:43.990340588Z 2022/06/28 13:40:43 [DEBUG] memberlist: Failed ping: dc1-143.dc1.company.corp.dc1 (timeout reached)
  146. 2022-06-28T18:40:44.888619542Z 2022/06/28 13:40:44 [INFO] memberlist: Marking dc1-143.dc1.company.corp as failed, suspect timeout reached (2 peer confirmations)
  147. 2022-06-28T18:40:44.888659703Z 2022/06/28 13:40:44 [INFO] serf: EventMemberFailed: dc1-143.dc1.company.corp 192.168.11.143
  148. 2022-06-28T18:40:44.889464041Z 2022/06/28 13:40:44 [INFO] consul: Removing LAN server dc1-143.dc1.company.corp (Addr: tcp/192.168.11.143:8300) (DC: dc1)
  149. 2022-06-28T18:40:45.989925616Z 2022/06/28 13:40:45 [INFO] memberlist: Suspect dc1-143.dc1.company.corp.dc1 has failed, no acks received
  150. 2022-06-28T18:40:47.847474878Z 2022/06/28 13:40:47 [DEBUG] memberlist: Stream connection from=192.168.11.143:35264
  151. 2022-06-28T18:40:47.847509309Z 2022/06/28 13:40:47 [INFO] serf: EventMemberJoin: dc1-143.dc1.company.corp 192.168.11.143
  152. 2022-06-28T18:40:47.847514254Z 2022/06/28 13:40:47 [INFO] consul: Adding LAN server dc1-143.dc1.company.corp (Addr: tcp/192.168.11.143:8300) (DC: dc1)
  153. 2022-06-28T18:40:48.202890696Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  154. 2022-06-28T18:40:48.202935834Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  155. 2022-06-28T18:40:48.291444910Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  156. 2022-06-28T18:40:48.291470012Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  157. 2022-06-28T18:40:48.294957872Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  158. 2022-06-28T18:40:48.391285284Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  159. 2022-06-28T18:40:48.469349626Z 2022/06/28 13:40:48 [INFO] serf: EventMemberUpdate: dc1-143.dc1.company.corp.dc1
  160. 2022-06-28T18:40:48.477315140Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  161. 2022-06-28T18:40:48.493994322Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  162. 2022-06-28T18:40:48.591993290Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  163. 2022-06-28T18:40:48.678398463Z 2022/06/28 13:40:48 [DEBUG] serf: messageJoinType: dc1-143.dc1.company.corp
  164. 2022-06-28T18:40:49.133887514Z ==> Newer Consul version available: 1.12.2 (currently running: 1.2.0)
  165. 2022-06-28T18:40:53.831487189Z 2022/06/28 13:40:53 [ERR] agent: Coordinate update error: No cluster leader
  166. 2022-06-28T18:41:00.639513203Z 2022/06/28 13:41:00 [DEBUG] memberlist: Stream connection from=192.168.11.54:57908
  167. 2022-06-28T18:41:02.468466751Z 2022/06/28 13:41:02 [INFO] memberlist: Marking dc1-136.dc1.company.corp as failed, suspect timeout reached (2 peer confirmations)
  168. 2022-06-28T18:41:02.468499107Z 2022/06/28 13:41:02 [INFO] serf: EventMemberFailed: dc1-136.dc1.company.corp 192.168.11.136
  169. 2022-06-28T18:41:02.468504174Z 2022/06/28 13:41:02 [INFO] consul: Removing LAN server dc1-136.dc1.company.corp (Addr: tcp/192.168.11.136:8300) (DC: dc1)
  170. 2022-06-28T18:41:03.342481760Z 2022/06/28 13:41:03 [DEBUG] memberlist: Stream connection from=192.168.11.136:38952
  171. 2022-06-28T18:41:03.369461592Z 2022/06/28 13:41:03 [DEBUG] memberlist: Stream connection from=192.168.11.136:56028
  172. 2022-06-28T18:41:03.375440247Z 2022/06/28 13:41:03 [INFO] serf: EventMemberJoin: dc1-136.dc1.company.corp 192.168.11.136
  173. 2022-06-28T18:41:03.375465395Z 2022/06/28 13:41:03 [INFO] consul: Adding LAN server dc1-136.dc1.company.corp (Addr: tcp/192.168.11.136:8300) (DC: dc1)
  174. 2022-06-28T18:41:03.850507256Z 2022/06/28 13:41:03 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  175. 2022-06-28T18:41:03.888465328Z 2022/06/28 13:41:03 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  176. 2022-06-28T18:41:03.895563074Z 2022/06/28 13:41:03 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  177. 2022-06-28T18:41:03.955225782Z 2022/06/28 13:41:03 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  178. 2022-06-28T18:41:03.984875911Z 2022/06/28 13:41:03 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  179. 2022-06-28T18:41:03.992338582Z 2022/06/28 13:41:03 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  180. 2022-06-28T18:41:04.184422496Z 2022/06/28 13:41:04 [INFO] serf: EventMemberUpdate: dc1-136.dc1.company.corp.dc1
  181. 2022-06-28T18:41:04.292473318Z 2022/06/28 13:41:04 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  182. 2022-06-28T18:41:04.292511228Z 2022/06/28 13:41:04 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  183. 2022-06-28T18:41:04.292515628Z 2022/06/28 13:41:04 [DEBUG] serf: messageJoinType: dc1-136.dc1.company.corp
  184. 2022-06-28T18:41:07.805471653Z 2022/06/28 13:41:07 [DEBUG] serf: messageUserEventType: consul:new-leader
  185. 2022-06-28T18:41:07.805505313Z 2022/06/28 13:41:07 [INFO] consul: New leader elected: dc1-142.dc1.company.corp
  186. 2022-06-28T18:41:07.990320964Z 2022/06/28 13:41:07 [DEBUG] serf: messageUserEventType: consul:new-leader
  187. 2022-06-28T18:41:08.048735232Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  188. 2022-06-28T18:41:08.145437240Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  189. 2022-06-28T18:41:08.189433612Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  190. 2022-06-28T18:41:08.230441454Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  191. 2022-06-28T18:41:08.350272849Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  192. 2022-06-28T18:41:08.388566496Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  193. 2022-06-28T18:41:08.408973847Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  194. 2022-06-28T18:41:08.593426784Z 2022/06/28 13:41:08 [DEBUG] serf: messageUserEventType: consul:new-leader
  195. 2022-06-28T18:41:13.883712868Z 2022/06/28 13:41:13 [ERR] agent: failed to sync remote state: No cluster leader
  196. 2022-06-28T18:41:18.047154450Z 2022/06/28 13:41:18 [INFO] memberlist: Marking dc1-145.dc1.company.corp as failed, suspect timeout reached (2 peer confirmations)
  197. 2022-06-28T18:41:18.047225852Z 2022/06/28 13:41:18 [INFO] serf: EventMemberFailed: dc1-145.dc1.company.corp 192.168.11.145
  198. 2022-06-28T18:41:18.047231252Z 2022/06/28 13:41:18 [INFO] consul: Removing LAN server dc1-145.dc1.company.corp (Addr: tcp/192.168.11.145:8300) (DC: dc1)
  199. 2022-06-28T18:41:18.621428548Z 2022/06/28 13:41:18 [DEBUG] memberlist: Stream connection from=192.168.11.145:50216
  200. 2022-06-28T18:41:18.625511311Z 2022/06/28 13:41:18 [INFO] serf: EventMemberUpdate: dc1-145.dc1.company.corp.dc1
  201. 2022-06-28T18:41:18.668427010Z 2022/06/28 13:41:18 [DEBUG] memberlist: Stream connection from=192.168.11.145:35736
  202. 2022-06-28T18:41:18.668455594Z 2022/06/28 13:41:18 [INFO] serf: EventMemberJoin: dc1-145.dc1.company.corp 192.168.11.145
  203. 2022-06-28T18:41:18.668460135Z 2022/06/28 13:41:18 [INFO] consul: Adding LAN server dc1-145.dc1.company.corp (Addr: tcp/192.168.11.145:8300) (DC: dc1)
  204. 2022-06-28T18:41:18.898769808Z 2022/06/28 13:41:18 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  205. 2022-06-28T18:41:18.999508268Z 2022/06/28 13:41:18 [DEBUG] memberlist: Failed ping: dc1-145.dc1.company.corp.dc1 (timeout reached)
  206. 2022-06-28T18:41:19.087055657Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  207. 2022-06-28T18:41:19.092081720Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  208. 2022-06-28T18:41:19.183865177Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  209. 2022-06-28T18:41:19.193059261Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp.dc1
  210. 2022-06-28T18:41:19.248197758Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  211. 2022-06-28T18:41:19.248257994Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  212. 2022-06-28T18:41:19.291211585Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  213. 2022-06-28T18:41:19.311709525Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  214. 2022-06-28T18:41:19.411441669Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  215. 2022-06-28T18:41:19.584756200Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp
  216. 2022-06-28T18:41:19.896227915Z 2022/06/28 13:41:19 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp.dc1
  217. 2022-06-28T18:41:20.047948099Z 2022/06/28 13:41:20 [DEBUG] memberlist: Stream connection from=192.168.11.116:33634
  218. 2022-06-28T18:41:20.197427290Z 2022/06/28 13:41:20 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp.dc1
  219. 2022-06-28T18:41:20.278318597Z 2022/06/28 13:41:20 [DEBUG] serf: messageJoinType: dc1-145.dc1.company.corp.dc1
  220. 2022-06-28T18:41:21.276911025Z 2022/06/28 13:41:21 [ERR] agent: Coordinate update error: No cluster leader
  221. 2022-06-28T18:41:21.435478519Z 2022/06/28 13:41:21 [ERR] agent: failed to sync remote state: No cluster leader
  222. 2022-06-28T18:41:24.572774852Z 2022/06/28 13:41:24 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.54:8301
  223. 2022-06-28T18:41:28.488325697Z 2022/06/28 13:41:28 [DEBUG] memberlist: Failed ping: dc1-142.dc1.company.corp (timeout reached)
  224. 2022-06-28T18:41:28.991454392Z 2022/06/28 13:41:28 [INFO] memberlist: Suspect dc1-142.dc1.company.corp has failed, no acks received
  225. 2022-06-28T18:41:33.109485352Z 2022/06/28 13:41:33 [INFO] memberlist: Marking dc1-142.dc1.company.corp as failed, suspect timeout reached (2 peer confirmations)
  226. 2022-06-28T18:41:33.109524336Z 2022/06/28 13:41:33 [INFO] serf: EventMemberFailed: dc1-142.dc1.company.corp 192.168.11.142
  227. 2022-06-28T18:41:33.109529994Z 2022/06/28 13:41:33 [INFO] consul: Removing LAN server dc1-142.dc1.company.corp (Addr: tcp/192.168.11.142:8300) (DC: dc1)
  228. 2022-06-28T18:41:34.412005462Z 2022/06/28 13:41:34 [DEBUG] memberlist: Stream connection from=192.168.11.142:37418
  229. 2022-06-28T18:41:34.414596564Z 2022/06/28 13:41:34 [INFO] serf: EventMemberJoin: dc1-142.dc1.company.corp 192.168.11.142
  230. 2022-06-28T18:41:34.414646230Z 2022/06/28 13:41:34 [INFO] consul: Adding LAN server dc1-142.dc1.company.corp (Addr: tcp/192.168.11.142:8300) (DC: dc1)
  231. 2022-06-28T18:41:34.790334717Z 2022/06/28 13:41:34 [INFO] serf: EventMemberUpdate: dc1-142.dc1.company.corp.dc1
  232. 2022-06-28T18:41:34.958466544Z 2022/06/28 13:41:34 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp
  233. 2022-06-28T18:41:34.982464360Z 2022/06/28 13:41:34 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp
  234. 2022-06-28T18:41:34.982501846Z 2022/06/28 13:41:34 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp
  235. 2022-06-28T18:41:34.994454641Z 2022/06/28 13:41:34 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp
  236. 2022-06-28T18:41:35.030417555Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp
  237. 2022-06-28T18:41:35.183063913Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp
  238. 2022-06-28T18:41:35.202973640Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp
  239. 2022-06-28T18:41:35.386480669Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp.dc1
  240. 2022-06-28T18:41:35.397458973Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp.dc1
  241. 2022-06-28T18:41:35.567912499Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp.dc1
  242. 2022-06-28T18:41:35.755467294Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp.dc1
  243. 2022-06-28T18:41:35.801477121Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp.dc1
  244. 2022-06-28T18:41:35.991831443Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp.dc1
  245. 2022-06-28T18:41:36.000162127Z 2022/06/28 13:41:35 [DEBUG] serf: messageJoinType: dc1-142.dc1.company.corp.dc1
  246. 2022-06-28T18:41:39.582510785Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  247. 2022-06-28T18:41:39.582540833Z 2022/06/28 13:41:39 [INFO] consul: New leader elected: dc1-120.dc1.company.corp
  248. 2022-06-28T18:41:39.691028042Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  249. 2022-06-28T18:41:39.691142912Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  250. 2022-06-28T18:41:39.753483269Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  251. 2022-06-28T18:41:39.765419953Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  252. 2022-06-28T18:41:39.769405413Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  253. 2022-06-28T18:41:39.885777189Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  254. 2022-06-28T18:41:39.964902619Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  255. 2022-06-28T18:41:39.989169874Z 2022/06/28 13:41:39 [DEBUG] serf: messageUserEventType: consul:new-leader
  256. 2022-06-28T18:41:40.025876876Z 2022/06/28 13:41:40 [DEBUG] serf: messageUserEventType: consul:new-leader
  257. 2022-06-28T18:41:40.092074095Z 2022/06/28 13:41:40 [DEBUG] serf: messageUserEventType: consul:new-leader
  258. 2022-06-28T18:41:40.257481723Z 2022/06/28 13:41:40 [DEBUG] serf: messageUserEventType: consul:new-leader
  259. 2022-06-28T18:41:40.295464741Z 2022/06/28 13:41:40 [DEBUG] serf: messageUserEventType: consul:new-leader
  260. 2022-06-28T18:41:44.068037325Z 2022/06/28 13:41:44 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.27:8302
  261. 2022-06-28T18:41:47.889819559Z 2022/06/28 13:41:47 [ERR] agent: failed to sync remote state: No cluster leader
  262. 2022-06-28T18:41:48.488755129Z 2022/06/28 13:41:48 [DEBUG] memberlist: Failed ping: dc1-120.dc1.company.corp (timeout reached)
  263. 2022-06-28T18:41:48.992454693Z 2022/06/28 13:41:48 [INFO] memberlist: Suspect dc1-120.dc1.company.corp has failed, no acks received
  264. 2022-06-28T18:41:49.223939830Z 2022/06/28 13:41:49 [INFO] serf: EventMemberFailed: dc1-120.dc1.company.corp 192.168.11.120
  265. 2022-06-28T18:41:49.224156001Z 2022/06/28 13:41:49 [INFO] consul: Removing LAN server dc1-120.dc1.company.corp (Addr: tcp/192.168.11.120:8300) (DC: dc1)
  266. 2022-06-28T18:41:51.147386320Z 2022/06/28 13:41:51 [DEBUG] memberlist: Stream connection from=192.168.11.120:34816
  267. 2022-06-28T18:41:51.148298671Z 2022/06/28 13:41:51 [ERR] memberlist: Conflicting address for localhost.localdomain. Mine: 192.168.11.116:8301 Theirs: 192.168.11.120:8301
  268. 2022-06-28T18:41:51.148312611Z 2022/06/28 13:41:51 [WARN] serf: Name conflict for 'localhost.localdomain' both 192.168.11.116:8301 and 192.168.11.120:8301 are claiming
  269. 2022-06-28T18:41:51.182674494Z 2022/06/28 13:41:51 [DEBUG] memberlist: Stream connection from=192.168.11.120:34862
  270. 2022-06-28T18:41:51.182718333Z 2022/06/28 13:41:51 [ERR] memberlist: Conflicting address for localhost.localdomain. Mine: 192.168.11.116:8301 Theirs: 192.168.11.120:8301
  271. 2022-06-28T18:41:51.182723414Z 2022/06/28 13:41:51 [WARN] serf: Name conflict for 'localhost.localdomain' both 192.168.11.116:8301 and 192.168.11.120:8301 are claiming
  272. 2022-06-28T18:41:53.870604308Z 2022/06/28 13:41:53 [ERR] agent: Coordinate update error: No cluster leader
  273. 2022-06-28T18:41:54.086428335Z 2022/06/28 13:41:54 [DEBUG] serf: messageUserEventType: consul:new-leader
  274. 2022-06-28T18:41:54.086509782Z 2022/06/28 13:41:54 [INFO] consul: New leader elected: dc1-143.dc1.company.corp
  275. 2022-06-28T18:41:54.143430211Z 2022/06/28 13:41:54 [DEBUG] serf: messageUserEventType: consul:new-leader
  276. 2022-06-28T18:41:54.185476697Z 2022/06/28 13:41:54 [DEBUG] serf: messageUserEventType: consul:new-leader
  277. 2022-06-28T18:41:54.287514126Z 2022/06/28 13:41:54 [DEBUG] serf: messageUserEventType: consul:new-leader
  278. 2022-06-28T18:41:54.290510107Z 2022/06/28 13:41:54 [DEBUG] serf: messageUserEventType: consul:new-leader
  279. 2022-06-28T18:41:54.382559757Z 2022/06/28 13:41:54 [DEBUG] serf: messageUserEventType: consul:new-leader
  280. 2022-06-28T18:41:54.490676721Z 2022/06/28 13:41:54 [DEBUG] serf: messageUserEventType: consul:new-leader
  281. 2022-06-28T18:41:54.588436560Z 2022/06/28 13:41:54 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.136:8301
  282. 2022-06-28T18:41:55.910798486Z 2022/06/28 13:41:55 [DEBUG] memberlist: Stream connection from=192.168.11.27:58104
  283. 2022-06-28T18:42:00.997483283Z 2022/06/28 13:42:00 [DEBUG] serf: forgoing reconnect for random throttling
  284. 2022-06-28T18:42:02.354768669Z 2022/06/28 13:42:02 [ERR] agent: failed to sync remote state: No cluster leader
  285. 2022-06-28T18:42:04.186432840Z 2022/06/28 13:42:04 [DEBUG] serf: messageLeaveType: dc1-120.dc1.company.corp
  286. 2022-06-28T18:42:04.186462816Z 2022/06/28 13:42:04 [INFO] serf: EventMemberLeave (forced): dc1-120.dc1.company.corp 192.168.11.120
  287. 2022-06-28T18:42:04.186467499Z 2022/06/28 13:42:04 [INFO] consul: Removing LAN server dc1-120.dc1.company.corp (Addr: tcp/192.168.11.120:8300) (DC: dc1)
  288. 2022-06-28T18:42:04.297439189Z 2022/06/28 13:42:04 [DEBUG] serf: messageLeaveType: dc1-120.dc1.company.corp
  289. 2022-06-28T18:42:04.355838837Z 2022/06/28 13:42:04 [DEBUG] serf: messageLeaveType: dc1-120.dc1.company.corp
  290. 2022-06-28T18:42:04.485156096Z 2022/06/28 13:42:04 [DEBUG] serf: messageLeaveType: dc1-120.dc1.company.corp
  291. 2022-06-28T18:42:04.491741381Z 2022/06/28 13:42:04 [DEBUG] serf: messageLeaveType: dc1-120.dc1.company.corp
  292. 2022-06-28T18:42:04.892961571Z 2022/06/28 13:42:04 [INFO] serf: EventMemberFailed: dc1-27.dc1.company.corp 192.168.11.27
  293. 2022-06-28T18:42:04.893459938Z 2022/06/28 13:42:04 [INFO] consul: Removing LAN server dc1-27.dc1.company.corp (Addr: tcp/192.168.11.27:8300) (DC: dc1)
  294. 2022-06-28T18:42:05.283526256Z 2022/06/28 13:42:05 [DEBUG] memberlist: Stream connection from=192.168.11.27:59178
  295. 2022-06-28T18:42:05.285679483Z 2022/06/28 13:42:05 [INFO] serf: EventMemberUpdate: dc1-27.dc1.company.corp.dc1
  296. 2022-06-28T18:42:05.361535982Z 2022/06/28 13:42:05 [DEBUG] memberlist: Stream connection from=192.168.11.27:58428
  297. 2022-06-28T18:42:05.361583593Z 2022/06/28 13:42:05 [INFO] serf: EventMemberJoin: dc1-27.dc1.company.corp 192.168.11.27
  298. 2022-06-28T18:42:05.361588601Z 2022/06/28 13:42:05 [INFO] consul: Adding LAN server dc1-27.dc1.company.corp (Addr: tcp/192.168.11.27:8300) (DC: dc1)
  299. 2022-06-28T18:42:05.564033974Z 2022/06/28 13:42:05 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp
  300. 2022-06-28T18:42:05.648136852Z 2022/06/28 13:42:05 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp
  301. 2022-06-28T18:42:05.652778301Z 2022/06/28 13:42:05 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp
  302. 2022-06-28T18:42:05.699185469Z 2022/06/28 13:42:05 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp
  303. 2022-06-28T18:42:05.762779460Z 2022/06/28 13:42:05 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp
  304. 2022-06-28T18:42:05.942622415Z 2022/06/28 13:42:05 [ERR] memberlist: Conflicting address for localhost.localdomain. Mine: 192.168.11.116:8301 Theirs: 192.168.11.120:8301
  305. 2022-06-28T18:42:05.942663120Z 2022/06/28 13:42:05 [WARN] serf: Name conflict for 'localhost.localdomain' both 192.168.11.116:8301 and 192.168.11.120:8301 are claiming
  306. 2022-06-28T18:42:05.954945732Z 2022/06/28 13:42:05 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp
  307. 2022-06-28T18:42:06.256484161Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  308. 2022-06-28T18:42:06.256531486Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  309. 2022-06-28T18:42:06.336472567Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  310. 2022-06-28T18:42:06.358148608Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  311. 2022-06-28T18:42:06.522442018Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  312. 2022-06-28T18:42:06.555475363Z 2022/06/28 13:42:06 [DEBUG] serf: messageLeaveType: dc1-120.dc1.company.corp
  313. 2022-06-28T18:42:06.555529037Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp
  314. 2022-06-28T18:42:06.555533799Z 2022/06/28 13:42:06 [DEBUG] serf: messageUserEventType: consul:new-leader
  315. 2022-06-28T18:42:06.559443271Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  316. 2022-06-28T18:42:06.641534429Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  317. 2022-06-28T18:42:06.740956100Z 2022/06/28 13:42:06 [DEBUG] serf: messageUserEventType: consul:new-leader
  318. 2022-06-28T18:42:06.746279203Z 2022/06/28 13:42:06 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  319. 2022-06-28T18:42:06.945602660Z 2022/06/28 13:42:06 [DEBUG] serf: messageUserEventType: consul:new-leader
  320. 2022-06-28T18:42:07.001448868Z 2022/06/28 13:42:07 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  321. 2022-06-28T18:42:07.058036727Z 2022/06/28 13:42:07 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  322. 2022-06-28T18:42:07.143014968Z 2022/06/28 13:42:07 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  323. 2022-06-28T18:42:07.251164141Z 2022/06/28 13:42:07 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  324. 2022-06-28T18:42:07.251203988Z 2022/06/28 13:42:07 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  325. 2022-06-28T18:42:08.250486540Z 2022/06/28 13:42:08 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  326. 2022-06-28T18:42:08.250532463Z 2022/06/28 13:42:08 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  327. 2022-06-28T18:42:08.250537935Z 2022/06/28 13:42:08 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  328. 2022-06-28T18:42:08.250540948Z 2022/06/28 13:42:08 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  329. 2022-06-28T18:42:08.250544003Z 2022/06/28 13:42:08 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  330. 2022-06-28T18:42:08.250546922Z 2022/06/28 13:42:08 [DEBUG] serf: messageJoinType: dc1-27.dc1.company.corp.dc1
  331. 2022-06-28T18:42:08.994436089Z 2022/06/28 13:42:08 [DEBUG] memberlist: Failed ping: dc1-120.dc1.company.corp.dc1 (timeout reached)
  332. 2022-06-28T18:42:08.999408923Z 2022/06/28 13:42:08 [ERR] memberlist: Failed fallback ping: EOF
  333. 2022-06-28T18:42:10.992563618Z 2022/06/28 13:42:10 [INFO] memberlist: Suspect dc1-120.dc1.company.corp.dc1 has failed, no acks received
  334. 2022-06-28T18:42:16.421743189Z 2022/06/28 13:42:16 [ERR] http: Request GET /v1/operator/raft/configuration, error: No cluster leader from=127.0.0.1:51352
  335. 2022-06-28T18:42:16.424432693Z 2022/06/28 13:42:16 [DEBUG] http: Request GET /v1/operator/raft/configuration (7.224894532s) from=127.0.0.1:51352
  336. 2022-06-28T18:42:17.652407320Z 2022/06/28 13:42:17 [ERR] agent: Coordinate update error: No cluster leader
  337. 2022-06-28T18:42:21.221151769Z 2022/06/28 13:42:21 [DEBUG] memberlist: Stream connection from=192.168.11.120:39136
  338. 2022-06-28T18:42:21.222990367Z 2022/06/28 13:42:21 [ERR] memberlist: Conflicting address for localhost.localdomain. Mine: 192.168.11.116:8301 Theirs: 192.168.11.120:8301
  339. 2022-06-28T18:42:21.223008462Z 2022/06/28 13:42:21 [WARN] serf: Name conflict for 'localhost.localdomain' both 192.168.11.116:8301 and 192.168.11.120:8301 are claiming
  340. 2022-06-28T18:42:21.491843553Z 2022/06/28 13:42:21 [DEBUG] serf: messageJoinType: localhost.localdomain
  341. 2022-06-28T18:42:21.583268822Z 2022/06/28 13:42:21 [DEBUG] serf: messageJoinType: localhost.localdomain
  342. 2022-06-28T18:42:21.583975290Z 2022/06/28 13:42:21 [DEBUG] serf: messageJoinType: localhost.localdomain
  343. 2022-06-28T18:42:21.691790816Z 2022/06/28 13:42:21 [DEBUG] serf: messageJoinType: localhost.localdomain
  344. 2022-06-28T18:42:21.761007978Z 2022/06/28 13:42:21 [DEBUG] serf: messageJoinType: localhost.localdomain
  345. 2022-06-28T18:42:21.784250443Z 2022/06/28 13:42:21 [DEBUG] serf: messageJoinType: localhost.localdomain
  346. 2022-06-28T18:42:21.984689739Z 2022/06/28 13:42:21 [DEBUG] serf: messageJoinType: localhost.localdomain
  347. 2022-06-28T18:42:24.590564917Z 2022/06/28 13:42:24 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.145:8301
  348. 2022-06-28T18:42:27.139987373Z 2022/06/28 13:42:27 [ERR] consul.acl: Failed to get policy from ACL datacenter: No cluster leader
  349. 2022-06-28T18:42:27.142585602Z 2022/06/28 13:42:27 [DEBUG] http: Request GET /v1/operator/raft/configuration?stale= (7.272322493s) from=127.0.0.1:51474
  350. 2022-06-28T18:42:30.990380626Z 2022/06/28 13:42:30 [DEBUG] manager: Rebalanced 13 servers, next active server is dc1-28.dc1.company.corp.dc1 (Addr: tcp/192.168.11.28:8300) (DC: dc1)
  351. 2022-06-28T18:42:32.058027519Z 2022/06/28 13:42:32 [INFO] serf: EventMemberFailed: dc1-120.dc1.company.corp.dc1 192.168.11.120
  352. 2022-06-28T18:42:32.058063878Z 2022/06/28 13:42:32 [INFO] consul: Handled member-failed event for server "dc1-120.dc1.company.corp.dc1" in area "wan"
  353. 2022-06-28T18:42:34.026158385Z 2022/06/28 13:42:34 [ERR] agent: failed to sync remote state: No cluster leader
  354. 2022-06-28T18:42:44.070518976Z 2022/06/28 13:42:44 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.143:8302
  355. 2022-06-28T18:42:53.023256413Z 2022/06/28 13:42:53 [ERR] agent: Coordinate update error: No cluster leader
  356. 2022-06-28T18:42:54.595167647Z 2022/06/28 13:42:54 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.11.136:8301
  357. 2022-06-28T18:43:00.997451537Z 2022/06/28 13:43:00 [DEBUG] serf: forgoing reconnect for random throttling
  358. 2022-06-28T18:43:06.345929993Z 2022/06/28 13:43:06 [ERR] agent: failed to sync remote state: No cluster leader
Advertisement
Add Comment
Please, Sign In to add comment