API tools faq
paste
Advertisement
ronniepg

masternode01.log

ronniepg
Feb 10th, 2023
48
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 28.42 KB | Software | 0 0
raw download clone embed print report
  1. 2023-02-10T08:51:32,952 worker][T#2] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [32413ms] ago, timed out [22409ms] ago, action [internal:coordination/fault_detection/leader_check], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993804]
  2. 2023-02-10T08:51:32,957 worker][T#2] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [21409ms] ago, timed out [11405ms] ago, action [internal:coordination/fault_detection/leader_check], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993806]
  3. 2023-02-10T08:51:32,957 worker][T#2] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [10404ms] ago, timed out [400ms] ago, action [internal:coordination/fault_detection/leader_check], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993807]
  4. 2023-02-10T08:51:42,650 eneric][T#3] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  5. 2023-02-10T08:51:52,651 eneric][T#3] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  6. 2023-02-10T08:52:02,651 eneric][T#3] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  7. 2023-02-10T08:52:12,652 eneric][T#1] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  8. 2023-02-10T08:52:14,551 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [14809ms] ago, timed out [11806ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993905]
  9. 2023-02-10T08:52:14,551 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [10005ms] ago, timed out [7004ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993920]
  10. 2023-02-10T08:52:22,653 eneric][T#3] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  11. 2023-02-10T08:52:32,653 eneric][T#2] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  12. 2023-02-10T08:52:42,654 eneric][T#3] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  13. 2023-02-10T08:52:44,073 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [25419ms] ago, timed out [22417ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993964]
  14. 2023-02-10T08:52:44,073 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [19412ms] ago, timed out [16408ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993978]
  15. 2023-02-10T08:52:44,073 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [22417ms] ago, timed out [19412ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993971]
  16. 2023-02-10T08:52:44,073 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [13407ms] ago, timed out [10405ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993992]
  17. 2023-02-10T08:52:44,073 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [7404ms] ago, timed out [4402ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15994007]
  18. 2023-02-10T08:52:44,073 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [10405ms] ago, timed out [7404ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15994000]
  19. 2023-02-10T08:52:44,073 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [4402ms] ago, timed out [1401ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15994014]
  20. 2023-02-10T08:52:44,079 worker][T#3] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [16408ms] ago, timed out [13407ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993988]
  21. 2023-02-10T08:52:44,229 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [36624ms] ago, timed out [33622ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993933]
  22. 2023-02-10T08:52:44,229 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [28620ms] ago, timed out [25619ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993954]
  23. 2023-02-10T08:52:44,229 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [33622ms] ago, timed out [30621ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15993940]
  24. 2023-02-10T08:52:52,655 eneric][T#1] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  25.  
  26. 2023-02-10T08:52:52,655 eneric][T#1] [W] u.coo.ClusterFormationFailureHelper - [UID=] - master not discovered or elected yet, an election requires at least 2 nodes with ids from [VeWJEcurTOOQ0qAOoHfppQ, aLlNr3otQIqjrGfcJgr1PA, TyestOnKSi22HxoORZfhLw], have discovered [{masternode01.example.com}{TyestOnKSi2
  27. 2HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true},
  28. {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}] which is a quorum; discovery will continue using [xxx.xxx.xxx.251:9041, xxx.xxx.xxx.252:9041] from hosts providers and [{masternode02.
  29. example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_
  30. indexing_pressure_enabled=true}, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 2, last-accepted version 19173 in term 2
  31. 2023-02-10T08:52:54,756 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [12006ms] ago, timed out [9005ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}
  32. {masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15994018]
  33. 2023-02-10T08:52:54,790 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [9205ms] ago, timed out [6203ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{
  34. masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15994025]
  35. 2023-02-10T08:52:54,790 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [6203ms] ago, timed out [3202ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{
  36. masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15994032]
  37. 2023-02-10T08:52:54,790 worker][T#1] [W] org.ope.tra.TransportService - [UID=] - Received response for a request that has timed out, sent [3202ms] ago, timed out [200ms] ago, action [internal:discovery/request_peers], node [{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{q
  38. osmasterpm02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true}], id [15994039]
  39. 2023-02-10T08:52:55,048 teTask][T#1] [W] org.ope.clu.ser.MasterService - [UID=] - failing [elected-as-master ([2] nodes joined)[{masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true} e
  40. lect leader, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_]]: failed to commit cluster state version [19174]
  41. org.opensearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 3 while handling publication
  42. at org.opensearch.cluster.coordination.Coordinator.publish(Coordinator.java:1257) ~[opensearch-1.2.4.jar:1.2.4]
  43. at org.opensearch.cluster.service.MasterService.publish(MasterService.java:303) [opensearch-1.2.4.jar:1.2.4]
  44. at org.opensearch.cluster.service.MasterService.runTasks(MasterService.java:285) [opensearch-1.2.4.jar:1.2.4]
  45. at org.opensearch.cluster.service.MasterService.access$000(MasterService.java:86) [opensearch-1.2.4.jar:1.2.4]
  46. at org.opensearch.cluster.service.MasterService$Batcher.run(MasterService.java:173) [opensearch-1.2.4.jar:1.2.4]
  47. at org.opensearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:175) [opensearch-1.2.4.jar:1.2.4]
  48. at org.opensearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:213) [opensearch-1.2.4.jar:1.2.4]
  49. at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [opensearch-1.2.4.jar:1.2.4]
  50. at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:275) [opensearch-1.2.4.jar:1.2.4]
  51. at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:238) [opensearch-1.2.4.jar:1.2.4]
  52. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  53. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  54. at java.lang.Thread.run(Thread.java:887) [?:?]
  55. 2023-02-10T08:52:55,283 teTask][T#1] [W] org.ope.clu.ser.MasterService - [UID=] - failing [elected-as-master ([2] nodes joined)[{masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true} e
  56. lect leader, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], node-join[{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfp
  57. pQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true} join existing leader, {masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_en
  58. abled=true} join existing leader]]: failed to commit cluster state version [19174]
  59. org.opensearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 7 while handling publication
  60. at org.opensearch.cluster.coordination.Coordinator.publish(Coordinator.java:1257) ~[opensearch-1.2.4.jar:1.2.4]
  61. at org.opensearch.cluster.service.MasterService.publish(MasterService.java:303) [opensearch-1.2.4.jar:1.2.4]
  62. at org.opensearch.cluster.service.MasterService.runTasks(MasterService.java:285) [opensearch-1.2.4.jar:1.2.4]
  63. at org.opensearch.cluster.service.MasterService.access$000(MasterService.java:86) [opensearch-1.2.4.jar:1.2.4]
  64. at org.opensearch.cluster.service.MasterService$Batcher.run(MasterService.java:173) [opensearch-1.2.4.jar:1.2.4]
  65. at org.opensearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:175) [opensearch-1.2.4.jar:1.2.4]
  66. at org.opensearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:213) [opensearch-1.2.4.jar:1.2.4]
  67. at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [opensearch-1.2.4.jar:1.2.4]
  68. at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:275) [opensearch-1.2.4.jar:1.2.4]
  69. at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:238) [opensearch-1.2.4.jar:1.2.4]
  70. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  71. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  72. at java.lang.Thread.run(Thread.java:887) [?:?]
  73. 2023-02-10T08:52:55,495 teTask][T#1] [W] org.ope.clu.ser.MasterService - [UID=] - failing [elected-as-master ([2] nodes joined)[{masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true} elect leader, {masternode01.example.com}{TyestOnKSi22HxoORZfhLw}{cWB0_1xCTry1OIeSvtbLMQ}{masternode01.example.com}{xxx.xxx.xxx.250:9041}{m}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], node-join[{masternode02.example.com}{VeWJEcurTOOQ0qAOoHfppQ}{BcrkMr6aT9i9NWhZOu7dng}{masternode02.example.com}{xxx.xxx.xxx.251:9041}{m}{shard_indexing_pressure_enabled=true} join existing leader, {masternode03.example.com}{aLlNr3otQIqjrGfcJgr1PA}{Vt7e2b1XQ_afLPLGeq7OPg}{masternode03.example.com}{xxx.xxx.xxx.252:9041}{m}{shard_indexing_pressure_enabled=true} join existing leader]]: failed to commit cluster state version [19174]
  74. org.opensearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 10 while handling publication
  75. at org.opensearch.cluster.coordination.Coordinator.publish(Coordinator.java:1257) ~[opensearch-1.2.4.jar:1.2.4]
  76. at org.opensearch.cluster.service.MasterService.publish(MasterService.java:303) [opensearch-1.2.4.jar:1.2.4]
  77. at org.opensearch.cluster.service.MasterService.runTasks(MasterService.java:285) [opensearch-1.2.4.jar:1.2.4]
  78. at org.opensearch.cluster.service.MasterService.access$000(MasterService.java:86) [opensearch-1.2.4.jar:1.2.4]
  79. at org.opensearch.cluster.service.MasterService$Batcher.run(MasterService.java:173) [opensearch-1.2.4.jar:1.2.4]
  80. at org.opensearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:175) [opensearch-1.2.4.jar:1.2.4]
  81. at org.opensearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:213) [opensearch-1.2.4.jar:1.2.4]
  82. at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [opensearch-1.2.4.jar:1.2.4]
  83. at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:275) [opensearch-1.2.4.jar:1.2.4]
  84. at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:238) [opensearch-1.2.4.jar:1.2.4]
  85. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  86. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  87. at java.lang.Thread.run(Thread.java:887) [?:?]
  88.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!