Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2015/03/05 20:52:19 [INFO] consul: removing server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
- 2015/03/05 20:52:20 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
- 2015/03/05 20:52:21 [ERR] yamux: Failed to write body: use of closed network connection
- 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: rpc error: unexpected EOF
- 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:21 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:22 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
- 2015/03/05 20:52:22 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:22 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:22 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: rpc error: No cluster leader
- 2015/03/05 20:52:23 [WARN] raft: Heartbeat timeout reached, starting election
- 2015/03/05 20:52:23 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:23 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
- 2015/03/05 20:52:23 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:23 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:23 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:23 [INFO] consul: New leader elected: s8.r1.age
- 2015/03/05 20:52:28 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
- 2015/03/05 20:52:30 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.1:8300
- 2015/03/05 20:52:31 [WARN] raft: Heartbeat timeout reached, starting election
- 2015/03/05 20:52:31 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:31 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
- 2015/03/05 20:52:32 [WARN] raft: Heartbeat timeout reached, starting election
- 2015/03/05 20:52:32 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:32 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.1:8300: dial tcp 10.255.255.1:8300: no route to host
- 2015/03/05 20:52:32 [INFO] consul: New leader elected: s3.r1.age
- 2015/03/05 20:52:33 [INFO] serf: EventMemberJoin: s3.r1.age 10.255.255.2
- 2015/03/05 20:52:33 [INFO] consul: adding server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
- 2015/03/05 20:52:33 [INFO] raft: Duplicate RequestVote for same term: 711
- 2015/03/05 20:52:34 [WARN] raft: Election timeout reached, restarting election
- 2015/03/05 20:52:34 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:34 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.1:8300: dial tcp 10.255.255.1:8300: no route to host
- 2015/03/05 20:52:34 [INFO] raft: Duplicate RequestVote for same term: 712
- 2015/03/05 20:52:35 [WARN] raft: Election timeout reached, restarting election
- 2015/03/05 20:52:35 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:35 [INFO] raft: Election won. Tally: 2
- 2015/03/05 20:52:35 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
- 2015/03/05 20:52:35 [INFO] consul: cluster leadership acquired
- 2015/03/05 20:52:35 [INFO] consul: New leader elected: s2.r1.age
- 2015/03/05 20:52:35 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
- 2015/03/05 20:52:35 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
- 2015/03/05 20:52:35 [INFO] consul: member 's3.r1.age' joined, marking health alive
- 2015/03/05 20:52:41 [WARN] raft: Failed to contact 10.255.255.2:8300 in 500.253234ms
- 2015/03/05 20:52:42 [WARN] raft: Failed to contact 10.255.255.2:8300 in 991.224078ms
- 2015/03/05 20:52:42 [WARN] raft: Failed to contact 10.255.255.2:8300 in 1.45461354s
- 2015/03/05 20:52:43 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since we have a leader: 10.255.255.3:8300
- 2015/03/05 20:52:44 [INFO] serf: EventMemberFailed: s8.r1.age 10.255.255.1
- 2015/03/05 20:52:44 [INFO] consul: removing server s8.r1.age (Addr: 10.255.255.1:8300) (DC: dc1)
- 2015/03/05 20:52:44 [INFO] consul: member 's8.r1.age' failed, marking health critical
- 2015/03/05 20:52:44 [INFO] memberlist: Suspect s3.r1.age has failed, no acks received
- 2015/03/05 20:52:44 [ERR] raft: peer 10.255.255.2:8300 has newer term, stopping replication
- 2015/03/05 20:52:44 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
- 2015/03/05 20:52:44 [INFO] raft: aborting pipeline replication to peer 10.255.255.2:8300
- 2015/03/05 20:52:44 [INFO] consul: cluster leadership lost 2015/03/05 20:52:44 [INFO] raft: aborting pipeline replication to peer 10.255.255.1:8300
- 2015/03/05 20:52:45 [WARN] raft: Rejecting vote from 10.255.255.2:8300 since our last index is greater (6564, 6563)
- 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/docker-repo?index=5359&recurse=&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/zookeeper?index=6540&recurse=&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:46 [ERR] http: Request /v1/kv/Services/?index=6540&keys=&separator=%2F&wait=10000ms, error: No cluster leader
- 2015/03/05 20:52:46 [WARN] raft: Heartbeat timeout reached, starting election
- 2015/03/05 20:52:46 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:46 [INFO] raft: Election won. Tally: 2
- 2015/03/05 20:52:46 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
- 2015/03/05 20:52:46 [INFO] consul: cluster leadership acquired
- 2015/03/05 20:52:46 [INFO] consul: New leader elected: s2.r1.age
- 2015/03/05 20:52:46 [WARN] raft: AppendEntries to 10.255.255.2:8300 rejected, sending older logs (next: 6564)
- 2015/03/05 20:52:46 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
- 2015/03/05 20:52:46 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
- 2015/03/05 20:52:47 [ERR] yamux: Failed to write header: write tcp 185.25.45.75:36367: connection reset by peer
- 2015/03/05 20:52:49 [WARN] raft: Failed to contact 10.255.255.2:8300 in 500.214106ms
- 2015/03/05 20:52:49 [WARN] raft: Failed to contact 10.255.255.1:8300 in 500.314202ms
- 2015/03/05 20:52:49 [WARN] raft: Failed to contact 10.255.255.2:8300 in 747.354923ms
- 2015/03/05 20:52:49 [WARN] raft: Failed to contact quorum of nodes, stepping down
- 2015/03/05 20:52:49 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
- 2015/03/05 20:52:49 [INFO] consul: cluster leadership lost
- 2015/03/05 20:52:49 [INFO] raft: aborting pipeline replication to peer 10.255.255.1:8300
- 2015/03/05 20:52:49 [INFO] raft: aborting pipeline replication to peer 10.255.255.2:8300
- 2015/03/05 20:52:50 [WARN] raft: Heartbeat timeout reached, starting election
- 2015/03/05 20:52:50 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:50 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.1:8300: dial tcp 10.255.255.1:8300: no route to host
- 2015/03/05 20:52:51 [INFO] raft: Duplicate RequestVote for same term: 717
- 2015/03/05 20:52:51 [INFO] raft: Duplicate RequestVote for same term: 717
- 2015/03/05 20:52:52 [ERR] http: Request /v1/kv/Services/zookeeper/Enabled?dc=dc1&token=, error: No cluster leader
- 2015/03/05 20:52:52 [INFO] memberlist: Marking s3.r1.age as failed, suspect timeout reached
- 2015/03/05 20:52:52 [INFO] serf: EventMemberFailed: s3.r1.age 10.255.255.2
- 2015/03/05 20:52:52 [INFO] consul: removing server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
- 2015/03/05 20:52:52 [WARN] raft: Election timeout reached, restarting election
- 2015/03/05 20:52:52 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:52:52 [ERR] raft: Failed to make RequestVote RPC to 10.255.255.2:8300: dial tcp 10.255.255.2:8300: no route to host
- 2015/03/05 20:52:52 [INFO] raft: Election won. Tally: 2
- 2015/03/05 20:52:52 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
- 2015/03/05 20:52:52 [INFO] consul: cluster leadership acquired
- 2015/03/05 20:52:52 [INFO] consul: New leader elected: s2.r1.age
- 2015/03/05 20:52:52 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
- 2015/03/05 20:52:52 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
- 2015/03/05 20:52:52 [INFO] consul: member 's3.r1.age' failed, marking health critical
- 2015/03/05 20:52:53 [INFO] serf: EventMemberJoin: s3.r1.age 10.255.255.2
- 2015/03/05 20:52:53 [INFO] consul: adding server s3.r1.age (Addr: 10.255.255.2:8300) (DC: dc1)
- 2015/03/05 20:52:53 [INFO] consul: member 's3.r1.age' joined, marking health alive
- 2015/03/05 20:52:56 [WARN] raft: Failed to contact 10.255.255.1:8300 in 500.216486ms
- 2015/03/05 20:52:57 [WARN] raft: Failed to contact 10.255.255.1:8300 in 962.116727ms
- 2015/03/05 20:52:57 [WARN] raft: Failed to contact 10.255.255.1:8300 in 1.408549765s
- 2015/03/05 20:52:58 [WARN] raft: Rejecting vote from 10.255.255.1:8300 since we have a leader: 10.255.255.3:8300
- 2015/03/05 20:52:59 [ERR] raft: peer 10.255.255.1:8300 has newer term, stopping replication
- 2015/03/05 20:52:59 [INFO] raft: Node at 10.255.255.3:8300 [Follower] entering Follower state
- 2015/03/05 20:52:59 [INFO] raft: aborting pipeline replication to peer 10.255.255.1:8300
- 2015/03/05 20:52:59 [INFO] consul: cluster leadership lost
- 2015/03/05 20:52:59 [INFO] raft: aborting pipeline replication to peer 10.255.255.2:8300
- 2015/03/05 20:52:59 [WARN] raft: Rejecting vote from 10.255.255.1:8300 since our last index is greater (6585, 6584)
- 2015/03/05 20:53:00 [WARN] raft: Heartbeat timeout reached, starting election
- 2015/03/05 20:53:00 [INFO] raft: Node at 10.255.255.3:8300 [Candidate] entering Candidate state
- 2015/03/05 20:53:01 [INFO] raft: Election won. Tally: 2
- 2015/03/05 20:53:01 [INFO] raft: Node at 10.255.255.3:8300 [Leader] entering Leader state
- 2015/03/05 20:53:01 [INFO] consul: cluster leadership acquired
- 2015/03/05 20:53:01 [INFO] consul: New leader elected: s2.r1.age
- 2015/03/05 20:53:01 [WARN] raft: AppendEntries to 10.255.255.1:8300 rejected, sending older logs (next: 6585)
- 2015/03/05 20:53:01 [INFO] raft: pipelining replication to peer 10.255.255.2:8300
- 2015/03/05 20:53:01 [INFO] raft: pipelining replication to peer 10.255.255.1:8300
- 2015/03/05 20:53:01 [INFO] serf: EventMemberJoin: s8.r1.age 10.255.255.1
- 2015/03/05 20:53:01 [INFO] consul: adding server s8.r1.age (Addr: 10.255.255.1:8300) (DC: dc1)
- 2015/03/05 20:53:01 [INFO] consul: member 's8.r1.age' joined, marking health alive
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement