Advertisement
cetex

Untitled

Mar 5th, 2015
348
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 12.18 KB | None | 0 0
  1. 2015/03/05 20:52:19 [INFO] consul: removing server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
  2. 2015/03/05 20:52:20 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
  3. 2015/03/05 20:52:21 [ERR] yamux: Failed to write body: use of closed network connection
  4. 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: rpc error: unexpected EOF
  5. 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: rpc error: No cluster leader
  6. 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: rpc error: No cluster leader
  7. 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: rpc error: No cluster leader
  8. 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: rpc error: No cluster leader
  9. 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: rpc error: No cluster leader
  10. 2015/03/05 20:52:22 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
  11. 2015/03/05 20:52:22 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: rpc error: No cluster leader
  12. 2015/03/05 20:52:22 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: rpc error: No cluster leader
  13. 2015/03/05 20:52:22 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: rpc error: No cluster leader
  14. 2015/03/05 20:52:23 [WARN] raft: Heartbeat timeout reached, starting election
  15. 2015/03/05 20:52:23 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  16. 2015/03/05 20:52:23 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
  17. 2015/03/05 20:52:23 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: No cluster leader
  18. 2015/03/05 20:52:23 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: No cluster leader
  19. 2015/03/05 20:52:23 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: No cluster leader
  20. 2015/03/05 20:52:23 [INFO] consul: New leader elected: s8.r1.age
  21. 2015/03/05 20:52:28 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
  22. 2015/03/05 20:52:30 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
  23. 2015/03/05 20:52:31 [WARN] raft: Heartbeat timeout reached, starting election
  24. 2015/03/05 20:52:31 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  25. 2015/03/05 20:52:31 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
  26. 2015/03/05 20:52:32 [WARN] raft: Heartbeat timeout reached, starting election
  27. 2015/03/05 20:52:32 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  28. 2015/03/05 20:52:32 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.1:8300: dial tcp 10.255.255.1:8300: no route to host
  29. 2015/03/05 20:52:32 [INFO] consul: New leader elected: s3.r1.age
  30. 2015/03/05 20:52:33 [INFO] serf: EventMemberJoin: s3.r1.age 10.255.255.2
  31. 2015/03/05 20:52:33 [INFO] consul: adding server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
  32. 2015/03/05 20:52:33 [INFO] raft: Duplicate RequestVote for same term: 711
  33. 2015/03/05 20:52:34 [WARN] raft: Election timeout reached, restarting election
  34. 2015/03/05 20:52:34 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  35. 2015/03/05 20:52:34 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.1:8300: dial tcp 10.255.255.1:8300: no route to host
  36. 2015/03/05 20:52:34 [INFO] raft: Duplicate RequestVote for same term: 712
  37. 2015/03/05 20:52:35 [WARN] raft: Election timeout reached, restarting election
  38. 2015/03/05 20:52:35 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  39. 2015/03/05 20:52:35 [INFO] raft: Election won. Tally: 2
  40. 2015/03/05 20:52:35 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
  41. 2015/03/05 20:52:35 [INFO] consul: cluster leadership acquired
  42. 2015/03/05 20:52:35 [INFO] consul: New leader elected: s2.r1.age
  43. 2015/03/05 20:52:35 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
  44. 2015/03/05 20:52:35 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
  45. 2015/03/05 20:52:35 [INFO] consul: member 's3.r1.age' joined, marking health alive
  46. 2015/03/05 20:52:41 [WARN] raft: Failed to contact 10.255.255.2:8300 in 500.253234ms
  47. 2015/03/05 20:52:42 [WARN] raft: Failed to contact 10.255.255.2:8300 in 991.224078ms
  48. 2015/03/05 20:52:42 [WARN] raft: Failed to contact 10.255.255.2:8300 in 1.45461354s
  49. 2015/03/05 20:52:43 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.3:8300
  50. 2015/03/05 20:52:44 [INFO] serf: EventMemberFailed: s8.r1.age 10.255.255.1
  51. 2015/03/05 20:52:44 [INFO] consul: removing server s8.r1.age (Addr: 10.255.255.1:8300) (DC: dc1)
  52. 2015/03/05 20:52:44 [INFO] consul: member 's8.r1.age' failed, marking health critical
  53. 2015/03/05 20:52:44 [INFO] memberlist: Suspect s3.r1.age has failed, no acks received
  54. 2015/03/05 20:52:44 [ERR] raft: peer 10.255.255.2:8300 has newer term, stopping replication
  55. 2015/03/05 20:52:44 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
  56. 2015/03/05 20:52:44 [INFO] raft: aborting pipeline replication to peer 10.255.255.2:8300
  57. 2015/03/05 20:52:44 [INFO] consul: cluster leadership lost 2015/03/05 20:52:44 [INFO] raft: aborting pipeline replication to peer 10.255.255.1:8300
  58.  
  59. 2015/03/05 20:52:45 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since our last index is greater (6564, 6563)
  60. 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: No cluster leader
  61. 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: No cluster leader
  62. 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: No cluster leader
  63. 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: No cluster leader
  64. 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: No cluster leader
  65. 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: No cluster leader
  66. 2015/03/05 20:52:46 [WARN] raft: Heartbeat timeout reached, starting election
  67. 2015/03/05 20:52:46 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  68. 2015/03/05 20:52:46 [INFO] raft: Election won. Tally: 2
  69. 2015/03/05 20:52:46 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
  70. 2015/03/05 20:52:46 [INFO] consul: cluster leadership acquired
  71. 2015/03/05 20:52:46 [INFO] consul: New leader elected: s2.r1.age
  72. 2015/03/05 20:52:46 [WARN] raft: AppendEntries to 10.255.255.2:8300 rejected, sending older logs (next: 6564)
  73. 2015/03/05 20:52:46 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
  74. 2015/03/05 20:52:46 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
  75. 2015/03/05 20:52:47 [ERR] yamux: Failed to write header: write tcp 185.25.45.75:36367: connection reset by peer
  76. 2015/03/05 20:52:49 [WARN] raft: Failed to contact 10.255.255.2:8300 in 500.214106ms
  77. 2015/03/05 20:52:49 [WARN] raft: Failed to contact 10.255.255.1:8300 in 500.314202ms
  78. 2015/03/05 20:52:49 [WARN] raft: Failed to contact 10.255.255.2:8300 in 747.354923ms
  79. 2015/03/05 20:52:49 [WARN] raft: Failed to contact quorum of nodes, stepping down
  80. 2015/03/05 20:52:49 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
  81. 2015/03/05 20:52:49 [INFO] consul: cluster leadership lost
  82. 2015/03/05 20:52:49 [INFO] raft: aborting pipeline replication to peer 10.255.255.1:8300
  83. 2015/03/05 20:52:49 [INFO] raft: aborting pipeline replication to peer 10.255.255.2:8300
  84. 2015/03/05 20:52:50 [WARN] raft: Heartbeat timeout reached, starting election
  85. 2015/03/05 20:52:50 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  86. 2015/03/05 20:52:50 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.1:8300: dial tcp 10.255.255.1:8300: no route to host
  87. 2015/03/05 20:52:51 [INFO] raft: Duplicate RequestVote for same term: 717
  88. 2015/03/05 20:52:51 [INFO] raft: Duplicate RequestVote for same term: 717
  89. 2015/03/05 20:52:52 [ERR] http: Request /v1/kv/Services/zookeeper/Enabled?dc=dc1&token=, error: No cluster leader
  90. 2015/03/05 20:52:52 [INFO] memberlist: Marking s3.r1.age as failed, suspect timeout reached
  91. 2015/03/05 20:52:52 [INFO] serf: EventMemberFailed: s3.r1.age 10.255.255.2
  92. 2015/03/05 20:52:52 [INFO] consul: removing server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
  93. 2015/03/05 20:52:52 [WARN] raft: Election timeout reached, restarting election
  94. 2015/03/05 20:52:52 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  95. 2015/03/05 20:52:52 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.2:8300: dial tcp 10.255.255.2:8300: no route to host
  96. 2015/03/05 20:52:52 [INFO] raft: Election won. Tally: 2
  97. 2015/03/05 20:52:52 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
  98. 2015/03/05 20:52:52 [INFO] consul: cluster leadership acquired
  99. 2015/03/05 20:52:52 [INFO] consul: New leader elected: s2.r1.age
  100. 2015/03/05 20:52:52 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
  101. 2015/03/05 20:52:52 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
  102. 2015/03/05 20:52:52 [INFO] consul: member 's3.r1.age' failed, marking health critical
  103. 2015/03/05 20:52:53 [INFO] serf: EventMemberJoin: s3.r1.age 10.255.255.2
  104. 2015/03/05 20:52:53 [INFO] consul: adding server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
  105. 2015/03/05 20:52:53 [INFO] consul: member 's3.r1.age' joined, marking health alive
  106. 2015/03/05 20:52:56 [WARN] raft: Failed to contact 10.255.255.1:8300 in 500.216486ms
  107. 2015/03/05 20:52:57 [WARN] raft: Failed to contact 10.255.255.1:8300 in 962.116727ms
  108. 2015/03/05 20:52:57 [WARN] raft: Failed to contact 10.255.255.1:8300 in 1.408549765s
  109. 2015/03/05 20:52:58 [WARN] raft: Rejecting vote from 10.255.255.1:8300 since we have a leader: 10.255.255.3:8300
  110. 2015/03/05 20:52:59 [ERR] raft: peer 10.255.255.1:8300 has newer term, stopping replication
  111. 2015/03/05 20:52:59 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
  112. 2015/03/05 20:52:59 [INFO] raft: aborting pipeline replication to peer 10.255.255.1:8300
  113. 2015/03/05 20:52:59 [INFO] consul: cluster leadership lost
  114. 2015/03/05 20:52:59 [INFO] raft: aborting pipeline replication to peer 10.255.255.2:8300
  115. 2015/03/05 20:52:59 [WARN] raft: Rejecting vote from 10.255.255.1:8300 since our last index is greater (6585, 6584)
  116. 2015/03/05 20:53:00 [WARN] raft: Heartbeat timeout reached, starting election
  117. 2015/03/05 20:53:00 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
  118. 2015/03/05 20:53:01 [INFO] raft: Election won. Tally: 2
  119. 2015/03/05 20:53:01 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
  120. 2015/03/05 20:53:01 [INFO] consul: cluster leadership acquired
  121. 2015/03/05 20:53:01 [INFO] consul: New leader elected: s2.r1.age
  122. 2015/03/05 20:53:01 [WARN] raft: AppendEntries to 10.255.255.1:8300 rejected, sending older logs (next: 6585)
  123. 2015/03/05 20:53:01 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
  124. 2015/03/05 20:53:01 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
  125. 2015/03/05 20:53:01 [INFO] serf: EventMemberJoin: s8.r1.age 10.255.255.1
  126. 2015/03/05 20:53:01 [INFO] consul: adding server s8.r1.age (Addr: 10.255.255.1:8300) (DC: dc1)
  127. 2015/03/05 20:53:01 [INFO] consul: member 's8.r1.age' joined, marking health alive
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement