API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Dec 17th, 2018
151
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 83.39 KB | None | 0 0
raw download clone embed print report
  1. 2018-12-17 13:04:34 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  2. 2018-12-17 13:04:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":149,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  3. 2018-12-17 13:04:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.948114ms {"request-id":149,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  4. 2018-12-17 13:04:48 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  5. 2018-12-17 13:04:53 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  6. 2018-12-17 13:04:53 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  7. 2018-12-17 13:04:53 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  8. 2018-12-17 13:04:53 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  9. 2018-12-17 13:05:05 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  10. 2018-12-17 13:05:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  11. 2018-12-17 13:05:23 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  12. 2018-12-17 13:05:24 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  13. 2018-12-17 13:05:28 DEBUG juju.state.presence presence.go:375 watcher "03326505-4f0a-426a-8ab0-7542eda7286f" decided to prune "presence.beings" and "presence.pings"
  14. 2018-12-17 13:05:28 DEBUG juju.state.presence pruner.go:96 pruned "presence.pings" for "03326505-4f0a-426a-8ab0-7542eda7286f" of 6 old pings in 38.069538ms
  15. 2018-12-17 13:05:28 DEBUG juju.state.presence pruner.go:150 pruned "presence.beings" for "03326505-4f0a-426a-8ab0-7542eda7286f" of 0 sequence keys (evaluated 2) from 1 keys in 1.184689ms
  16. 2018-12-17 13:05:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  17. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  18. desired voting members: (maxId: 3)
  19. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  20. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  21. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  22. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  23. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  24. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  25. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  26. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:334 assessed
  27. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  28. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  29. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  30. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  31. 2018-12-17 13:05:31 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  32. 0: true
  33. 5: false
  34. 6: false
  35. 2018-12-17 13:05:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":151,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  36. 2018-12-17 13:05:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 2.028762ms {"request-id":151,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  37. 2018-12-17 13:05:38 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  38. 2018-12-17 13:05:54 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  39. 2018-12-17 13:05:57 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  40. 2018-12-17 13:06:18 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  41. 2018-12-17 13:06:23 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  42. 2018-12-17 13:06:24 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  43. 2018-12-17 13:06:24 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  44. 2018-12-17 13:06:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  45. 2018-12-17 13:06:30 DEBUG juju.worker.pubsub remoteserver.go:221 open api to machine-0: [172.17.0.1:17070]
  46. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper publish.go:39 API host ports have not changed
  47. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  48. desired voting members: (maxId: 3)
  49. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  50. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  51. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  52. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  53. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  54. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  55. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  56. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:334 assessed
  57. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  58. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  59. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  60. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  61. 2018-12-17 13:06:31 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  62. 6: false
  63. 0: true
  64. 5: false
  65. 2018-12-17 13:06:35 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  66. 2018-12-17 13:06:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":153,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  67. 2018-12-17 13:06:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.821421ms {"request-id":153,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  68. 2018-12-17 13:06:50 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  69. 2018-12-17 13:06:55 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  70. 2018-12-17 13:06:55 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  71. 2018-12-17 13:06:55 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  72. 2018-12-17 13:07:24 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  73. 2018-12-17 13:07:25 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  74. 2018-12-17 13:07:27 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  75. 2018-12-17 13:07:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  76. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  77. desired voting members: (maxId: 3)
  78. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  79. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  80. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  81. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  82. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  83. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  84. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  85. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:334 assessed
  86. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  87. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  88. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  89. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  90. 2018-12-17 13:07:31 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  91. 0: true
  92. 5: false
  93. 6: false
  94. 2018-12-17 13:07:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":155,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  95. 2018-12-17 13:07:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.622935ms {"request-id":155,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  96. 2018-12-17 13:07:40 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  97. 2018-12-17 13:07:47 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  98. 2018-12-17 13:07:55 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  99. 2018-12-17 13:07:55 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  100. 2018-12-17 13:08:05 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  101. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 5m3.393082256s {"request-id":79,"response":"'body redacted'"} NotifyWatcher["2"].Next
  102. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 5m3.393308838s {"request-id":77,"response":"'body redacted'"} NotifyWatcher["3"].Next
  103. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":86,"type":"NotifyWatcher","version":1,"id":"3","request":"Next","params":"'params redacted'"}
  104. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":87,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  105. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":88,"type":"NotifyWatcher","version":1,"id":"2","request":"Next","params":"'params redacted'"}
  106. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":89,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  107. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 1.385634ms {"request-id":89,"response":"'body redacted'"} LifeFlag[""].Life
  108. 2018-12-17 13:08:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 1.610274ms {"request-id":87,"response":"'body redacted'"} LifeFlag[""].Life
  109. 2018-12-17 13:08:18 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  110. 2018-12-17 13:08:25 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  111. 2018-12-17 13:08:26 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  112. 2018-12-17 13:08:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  113. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  114. desired voting members: (maxId: 3)
  115. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  116. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  117. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  118. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  119. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  120. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  121. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  122. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  123. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  124. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  125. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  126. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  127. 2018-12-17 13:08:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  128. 0: true
  129. 5: false
  130. 6: false
  131. 2018-12-17 13:08:36 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  132. 2018-12-17 13:08:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":157,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  133. 2018-12-17 13:08:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.82703ms {"request-id":157,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  134. 2018-12-17 13:08:50 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  135. 2018-12-17 13:08:54 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  136. 2018-12-17 13:08:56 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  137. 2018-12-17 13:08:56 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  138. 2018-12-17 13:08:56 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  139. 2018-12-17 13:09:21 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  140. 2018-12-17 13:09:26 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  141. 2018-12-17 13:09:26 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  142. 2018-12-17 13:09:27 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  143. 2018-12-17 13:09:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  144. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper publish.go:39 API host ports have not changed
  145. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  146. desired voting members: (maxId: 3)
  147. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  148. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  149. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  150. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  151. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  152. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  153. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  154. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  155. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  156. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  157. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  158. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  159. 2018-12-17 13:09:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  160. 6: false
  161. 0: true
  162. 5: false
  163. 2018-12-17 13:09:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":159,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  164. 2018-12-17 13:09:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.367975ms {"request-id":159,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  165. 2018-12-17 13:09:41 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  166. 2018-12-17 13:09:57 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  167. 2018-12-17 13:09:58 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  168. 2018-12-17 13:10:18 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  169. 2018-12-17 13:10:25 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  170. 2018-12-17 13:10:26 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  171. 2018-12-17 13:10:27 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  172. 2018-12-17 13:10:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  173. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper publish.go:39 API host ports have not changed
  174. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  175. desired voting members: (maxId: 3)
  176. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  177. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  178. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  179. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  180. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  181. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  182. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  183. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  184. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  185. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  186. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  187. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  188. 2018-12-17 13:10:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  189. 0: true
  190. 5: false
  191. 6: false
  192. 2018-12-17 13:10:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":161,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  193. 2018-12-17 13:10:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.328066ms {"request-id":161,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  194. 2018-12-17 13:10:37 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  195. 2018-12-17 13:10:49 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  196. 2018-12-17 13:10:58 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  197. 2018-12-17 13:10:58 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  198. 2018-12-17 13:10:58 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  199. 2018-12-17 13:11:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  200. 2018-12-17 13:11:24 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  201. 2018-12-17 13:11:28 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  202. 2018-12-17 13:11:28 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  203. 2018-12-17 13:11:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  204. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper publish.go:39 API host ports have not changed
  205. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  206. desired voting members: (maxId: 3)
  207. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  208. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  209. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  210. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  211. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  212. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  213. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  214. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  215. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  216. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  217. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  218. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  219. 2018-12-17 13:11:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  220. 6: false
  221. 0: true
  222. 5: false
  223. 2018-12-17 13:11:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":163,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  224. 2018-12-17 13:11:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.706353ms {"request-id":163,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  225. 2018-12-17 13:11:40 DEBUG juju.worker.pubsub remoteserver.go:221 open api to machine-0: [172.17.0.1:17070]
  226. 2018-12-17 13:11:43 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  227. 2018-12-17 13:11:55 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  228. 2018-12-17 13:11:58 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  229. 2018-12-17 13:12:06 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  230. 2018-12-17 13:12:17 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  231. 2018-12-17 13:12:26 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  232. 2018-12-17 13:12:28 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  233. 2018-12-17 13:12:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  234. 2018-12-17 13:12:29 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  235. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  236. desired voting members: (maxId: 3)
  237. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  238. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  239. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  240. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  241. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  242. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  243. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  244. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  245. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  246. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  247. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  248. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  249. 2018-12-17 13:12:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  250. 5: false
  251. 6: false
  252. 0: true
  253. 2018-12-17 13:12:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":165,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  254. 2018-12-17 13:12:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.327818ms {"request-id":165,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  255. 2018-12-17 13:12:37 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  256. 2018-12-17 13:12:49 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  257. 2018-12-17 13:12:59 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  258. 2018-12-17 13:12:59 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  259. 2018-12-17 13:12:59 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  260. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 4m58.493115518s {"request-id":88,"response":"'body redacted'"} NotifyWatcher["2"].Next
  261. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 4m58.493420147s {"request-id":86,"response":"'body redacted'"} NotifyWatcher["3"].Next
  262. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":95,"type":"NotifyWatcher","version":1,"id":"3","request":"Next","params":"'params redacted'"}
  263. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":96,"type":"NotifyWatcher","version":1,"id":"2","request":"Next","params":"'params redacted'"}
  264. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":97,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  265. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":98,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  266. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 906.438µs {"request-id":97,"response":"'body redacted'"} LifeFlag[""].Life
  267. 2018-12-17 13:13:13 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 1.411085ms {"request-id":98,"response":"'body redacted'"} LifeFlag[""].Life
  268. 2018-12-17 13:13:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  269. 2018-12-17 13:13:25 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  270. 2018-12-17 13:13:28 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  271. 2018-12-17 13:13:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  272. 2018-12-17 13:13:29 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  273. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  274. desired voting members: (maxId: 3)
  275. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  276. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  277. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  278. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  279. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  280. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  281. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  282. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  283. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  284. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  285. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  286. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  287. 2018-12-17 13:13:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  288. 0: true
  289. 5: false
  290. 6: false
  291. 2018-12-17 13:13:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":167,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  292. 2018-12-17 13:13:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.202484ms {"request-id":167,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  293. 2018-12-17 13:13:44 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  294. 2018-12-17 13:13:56 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  295. 2018-12-17 13:13:59 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  296. 2018-12-17 13:14:00 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  297. 2018-12-17 13:14:17 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  298. 2018-12-17 13:14:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  299. 2018-12-17 13:14:29 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  300. 2018-12-17 13:14:30 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  301. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  302. desired voting members: (maxId: 3)
  303. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  304. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  305. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  306. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  307. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  308. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  309. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  310. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  311. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  312. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  313. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  314. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  315. 2018-12-17 13:14:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  316. 5: false
  317. 6: false
  318. 0: true
  319. 2018-12-17 13:14:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":169,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  320. 2018-12-17 13:14:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.899058ms {"request-id":169,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  321. 2018-12-17 13:14:38 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  322. 2018-12-17 13:14:49 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  323. 2018-12-17 13:14:56 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  324. 2018-12-17 13:15:01 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  325. 2018-12-17 13:15:01 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  326. 2018-12-17 13:15:01 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  327. 2018-12-17 13:15:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  328. 2018-12-17 13:15:27 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  329. 2018-12-17 13:15:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  330. 2018-12-17 13:15:29 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  331. 2018-12-17 13:15:31 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  332. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  333. desired voting members: (maxId: 3)
  334. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  335. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  336. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  337. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  338. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  339. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  340. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  341. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  342. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  343. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  344. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  345. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  346. 2018-12-17 13:15:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  347. 0: true
  348. 5: false
  349. 6: false
  350. 2018-12-17 13:15:34 DEBUG juju.state.presence presence.go:375 watcher "301f3e82-a292-40c5-8a2e-947953ffe9ee" decided to prune "presence.beings" and "presence.pings"
  351. 2018-12-17 13:15:34 DEBUG juju.state.presence pruner.go:96 pruned "presence.pings" for "301f3e82-a292-40c5-8a2e-947953ffe9ee" of 6 old pings in 31.999641ms
  352. 2018-12-17 13:15:34 DEBUG juju.state.presence pruner.go:150 pruned "presence.beings" for "301f3e82-a292-40c5-8a2e-947953ffe9ee" of 0 sequence keys (evaluated 10) from 3 keys in 1.507765ms
  353. 2018-12-17 13:15:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":171,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  354. 2018-12-17 13:15:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.612856ms {"request-id":171,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  355. 2018-12-17 13:15:46 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  356. 2018-12-17 13:16:01 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  357. 2018-12-17 13:16:01 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  358. 2018-12-17 13:16:17 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  359. 2018-12-17 13:16:26 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  360. 2018-12-17 13:16:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  361. 2018-12-17 13:16:31 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  362. 2018-12-17 13:16:32 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  363. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  364. desired voting members: (maxId: 3)
  365. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  366. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  367. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  368. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  369. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  370. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  371. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  372. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  373. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  374. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  375. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  376. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  377. 2018-12-17 13:16:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  378. 0: true
  379. 5: false
  380. 6: false
  381. 2018-12-17 13:16:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":173,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  382. 2018-12-17 13:16:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.381595ms {"request-id":173,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  383. 2018-12-17 13:16:37 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  384. 2018-12-17 13:16:48 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  385. 2018-12-17 13:16:50 DEBUG juju.worker.pubsub remoteserver.go:221 open api to machine-0: [172.17.0.1:17070]
  386. 2018-12-17 13:16:57 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  387. 2018-12-17 13:17:02 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  388. 2018-12-17 13:17:02 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  389. 2018-12-17 13:17:02 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  390. 2018-12-17 13:17:08 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  391. 2018-12-17 13:17:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  392. 2018-12-17 13:17:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  393. 2018-12-17 13:17:32 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  394. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  395. desired voting members: (maxId: 3)
  396. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  397. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  398. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  399. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  400. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  401. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  402. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  403. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  404. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  405. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  406. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  407. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  408. 2018-12-17 13:17:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  409. 0: true
  410. 5: false
  411. 6: false
  412. 2018-12-17 13:17:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":175,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  413. 2018-12-17 13:17:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.562007ms {"request-id":175,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  414. 2018-12-17 13:17:47 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  415. 2018-12-17 13:17:56 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  416. 2018-12-17 13:18:00 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  417. 2018-12-17 13:18:03 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  418. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 5m1.489355194s {"request-id":96,"response":"'body redacted'"} NotifyWatcher["2"].Next
  419. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 5m1.489522425s {"request-id":95,"response":"'body redacted'"} NotifyWatcher["3"].Next
  420. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":104,"type":"NotifyWatcher","version":1,"id":"3","request":"Next","params":"'params redacted'"}
  421. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":105,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  422. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":106,"type":"NotifyWatcher","version":1,"id":"2","request":"Next","params":"'params redacted'"}
  423. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":107,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  424. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 776.398µs {"request-id":107,"response":"'body redacted'"} LifeFlag[""].Life
  425. 2018-12-17 13:18:14 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 1.335266ms {"request-id":105,"response":"'body redacted'"} LifeFlag[""].Life
  426. 2018-12-17 13:18:17 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  427. 2018-12-17 13:18:27 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  428. 2018-12-17 13:18:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  429. 2018-12-17 13:18:32 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  430. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  431. desired voting members: (maxId: 3)
  432. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  433. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  434. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  435. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  436. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  437. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  438. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  439. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  440. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  441. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  442. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  443. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  444. 2018-12-17 13:18:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  445. 5: false
  446. 6: false
  447. 0: true
  448. 2018-12-17 13:18:33 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  449. 2018-12-17 13:18:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":177,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  450. 2018-12-17 13:18:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.5658ms {"request-id":177,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  451. 2018-12-17 13:18:39 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  452. 2018-12-17 13:18:48 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  453. 2018-12-17 13:18:58 DEBUG juju.state.presence presence.go:375 watcher "03326505-4f0a-426a-8ab0-7542eda7286f" decided to prune "presence.beings" and "presence.pings"
  454. 2018-12-17 13:18:58 DEBUG juju.state.presence pruner.go:96 pruned "presence.pings" for "03326505-4f0a-426a-8ab0-7542eda7286f" of 4 old pings in 7.923494ms
  455. 2018-12-17 13:18:58 DEBUG juju.state.presence pruner.go:150 pruned "presence.beings" for "03326505-4f0a-426a-8ab0-7542eda7286f" of 0 sequence keys (evaluated 2) from 1 keys in 1.324788ms
  456. 2018-12-17 13:19:04 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  457. 2018-12-17 13:19:04 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  458. 2018-12-17 13:19:04 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  459. 2018-12-17 13:19:19 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  460. 2018-12-17 13:19:26 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  461. 2018-12-17 13:19:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  462. 2018-12-17 13:19:30 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  463. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  464. desired voting members: (maxId: 3)
  465. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  466. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  467. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  468. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  469. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  470. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  471. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  472. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  473. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  474. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  475. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  476. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  477. 2018-12-17 13:19:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  478. 0: true
  479. 5: false
  480. 6: false
  481. 2018-12-17 13:19:34 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  482. 2018-12-17 13:19:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":179,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  483. 2018-12-17 13:19:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.386507ms {"request-id":179,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  484. 2018-12-17 13:19:49 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  485. 2018-12-17 13:19:49 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  486. 2018-12-17 13:19:57 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  487. 2018-12-17 13:20:04 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  488. 2018-12-17 13:20:09 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  489. 2018-12-17 13:20:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  490. 2018-12-17 13:20:28 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  491. 2018-12-17 13:20:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  492. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  493. desired voting members: (maxId: 3)
  494. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  495. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  496. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  497. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  498. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  499. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  500. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  501. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:334 assessed
  502. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  503. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  504. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  505. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  506. 2018-12-17 13:20:32 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  507. 0: true
  508. 5: false
  509. 6: false
  510. 2018-12-17 13:20:34 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  511. 2018-12-17 13:20:35 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  512. 2018-12-17 13:20:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":181,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  513. 2018-12-17 13:20:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.9933ms {"request-id":181,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  514. 2018-12-17 13:21:00 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  515. 2018-12-17 13:21:05 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  516. 2018-12-17 13:21:05 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  517. 2018-12-17 13:21:05 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  518. 2018-12-17 13:21:17 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  519. 2018-12-17 13:21:28 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  520. 2018-12-17 13:21:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  521. 2018-12-17 13:21:31 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  522. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper publish.go:39 API host ports have not changed
  523. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  524. desired voting members: (maxId: 3)
  525. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  526. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  527. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  528. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  529. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  530. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  531. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  532. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:334 assessed
  533. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  534. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  535. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  536. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  537. 2018-12-17 13:21:33 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  538. 6: false
  539. 0: true
  540. 5: false
  541. 2018-12-17 13:21:35 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  542. 2018-12-17 13:21:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":183,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  543. 2018-12-17 13:21:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.586785ms {"request-id":183,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  544. 2018-12-17 13:21:49 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  545. 2018-12-17 13:21:50 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  546. 2018-12-17 13:22:00 DEBUG juju.worker.pubsub remoteserver.go:221 open api to machine-0: [172.17.0.1:17070]
  547. 2018-12-17 13:22:06 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  548. 2018-12-17 13:22:09 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  549. 2018-12-17 13:22:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  550. 2018-12-17 13:22:27 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  551. 2018-12-17 13:22:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  552. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  553. desired voting members: (maxId: 3)
  554. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  555. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  556. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  557. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  558. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  559. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  560. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  561. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:334 assessed
  562. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  563. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  564. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  565. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  566. 2018-12-17 13:22:33 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  567. 0: true
  568. 5: false
  569. 6: false
  570. 2018-12-17 13:22:35 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  571. 2018-12-17 13:22:36 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  572. 2018-12-17 13:22:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":185,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  573. 2018-12-17 13:22:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.701283ms {"request-id":185,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  574. 2018-12-17 13:22:59 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  575. 2018-12-17 13:23:01 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  576. 2018-12-17 13:23:07 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  577. 2018-12-17 13:23:07 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  578. 2018-12-17 13:23:07 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  579. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 5m1.638657318s {"request-id":104,"response":"'body redacted'"} NotifyWatcher["3"].Next
  580. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 5m1.638533366s {"request-id":106,"response":"'body redacted'"} NotifyWatcher["2"].Next
  581. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":113,"type":"NotifyWatcher","version":1,"id":"2","request":"Next","params":"'params redacted'"}
  582. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":114,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  583. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":115,"type":"NotifyWatcher","version":1,"id":"3","request":"Next","params":"'params redacted'"}
  584. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:178 <- [4] machine-5 {"request-id":116,"type":"LifeFlag","version":1,"request":"Life","params":"'params redacted'"}
  585. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 944.777µs {"request-id":116,"response":"'body redacted'"} LifeFlag[""].Life
  586. 2018-12-17 13:23:16 DEBUG juju.apiserver request_notifier.go:195 -> [4] machine-5 1.509263ms {"request-id":114,"response":"'body redacted'"} LifeFlag[""].Life
  587. 2018-12-17 13:23:17 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  588. 2018-12-17 13:23:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  589. 2018-12-17 13:23:32 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  590. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper publish.go:39 API host ports have not changed
  591. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  592. desired voting members: (maxId: 3)
  593. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  594. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  595. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  596. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  597. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  598. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  599. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  600. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:334 assessed
  601. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  602. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  603. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  604. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  605. 2018-12-17 13:23:33 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  606. 6: false
  607. 0: true
  608. 5: false
  609. 2018-12-17 13:23:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":187,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  610. 2018-12-17 13:23:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.737615ms {"request-id":187,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  611. 2018-12-17 13:23:37 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  612. 2018-12-17 13:23:48 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  613. 2018-12-17 13:23:52 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  614. 2018-12-17 13:23:58 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  615. 2018-12-17 13:24:07 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  616. 2018-12-17 13:24:09 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  617. 2018-12-17 13:24:19 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  618. 2018-12-17 13:24:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  619. 2018-12-17 13:24:29 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  620. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper publish.go:39 API host ports have not changed
  621. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  622. desired voting members: (maxId: 3)
  623. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  624. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  625. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  626. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  627. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  628. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  629. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  630. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:334 assessed
  631. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  632. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  633. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  634. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  635. 2018-12-17 13:24:33 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  636. 5: false
  637. 6: false
  638. 0: true
  639. 2018-12-17 13:24:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":189,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  640. 2018-12-17 13:24:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.704255ms {"request-id":189,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  641. 2018-12-17 13:24:37 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  642. 2018-12-17 13:24:38 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  643. 2018-12-17 13:24:50 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  644. 2018-12-17 13:25:02 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  645. 2018-12-17 13:25:08 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  646. 2018-12-17 13:25:08 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  647. 2018-12-17 13:25:08 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  648. 2018-12-17 13:25:28 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  649. 2018-12-17 13:25:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  650. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  651. desired voting members: (maxId: 3)
  652. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  653. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  654. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  655. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  656. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  657. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  658. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  659. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:334 assessed
  660. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  661. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  662. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  663. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  664. 2018-12-17 13:25:33 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  665. 6: false
  666. 0: true
  667. 5: false
  668. 2018-12-17 13:25:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":191,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  669. 2018-12-17 13:25:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.17303ms {"request-id":191,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  670. 2018-12-17 13:25:38 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  671. 2018-12-17 13:25:39 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  672. 2018-12-17 13:25:47 DEBUG juju.apiserver request_notifier.go:113 [8] API connection from 10.100.1.200:36648
  673. 2018-12-17 13:25:47 DEBUG juju.apiserver request_notifier.go:178 <- [8] {"request-id":1,"type":"Admin","version":3,"request":"Login","params":"'params redacted'"}
  674. 2018-12-17 13:25:47 DEBUG juju.apiserver admin.go:405 model login: user admin has "superuser" for controller; "admin" for model 03326505-4f0a-426a-8ab0-7542eda7286f
  675. 2018-12-17 13:25:47 DEBUG juju.apiserver admin.go:340 model login: user-admin for 03326505-4f0a-426a-8ab0-7542eda7286f
  676. 2018-12-17 13:25:47 DEBUG juju.apiserver request_notifier.go:195 -> [8] 30.644981ms {"request-id":1,"response":"'body redacted'"} Admin[""].Login
  677. 2018-12-17 13:25:47 DEBUG juju.apiserver request_notifier.go:178 <- [8] user-admin {"request-id":2,"type":"Client","version":2,"request":"FullStatus","params":"'params redacted'"}
  678. 2018-12-17 13:25:47 DEBUG juju.apiserver request_notifier.go:195 -> [8] user-admin 184.804541ms {"request-id":2,"response":"'body redacted'"} Client[""].FullStatus
  679. 2018-12-17 13:25:47 DEBUG juju.apiserver request_notifier.go:134 [8] user-admin API connection terminated after 266.96152ms
  680. 2018-12-17 13:25:48 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  681. 2018-12-17 13:25:53 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  682. 2018-12-17 13:25:59 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  683. 2018-12-17 13:26:09 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  684. 2018-12-17 13:26:20 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  685. 2018-12-17 13:26:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  686. 2018-12-17 13:26:31 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  687. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  688. desired voting members: (maxId: 3)
  689. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  690. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  691. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  692. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  693. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  694. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  695. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  696. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:334 assessed
  697. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  698. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  699. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  700. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  701. 2018-12-17 13:26:33 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  702. 0: true
  703. 5: false
  704. 6: false
  705. 2018-12-17 13:26:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":193,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  706. 2018-12-17 13:26:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.94724ms {"request-id":193,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  707. 2018-12-17 13:26:38 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  708. 2018-12-17 13:26:39 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  709. 2018-12-17 13:26:59 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  710. 2018-12-17 13:27:02 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  711. 2018-12-17 13:27:10 DEBUG juju.mongo open.go:174 dialled mongodb server at "127.0.0.1:37017"
  712. 2018-12-17 13:27:10 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.221:37017"
  713. 2018-12-17 13:27:10 DEBUG juju.mongo open.go:174 dialled mongodb server at "10.100.1.220:37017"
  714. 2018-12-17 13:27:10 DEBUG juju.worker.pubsub remoteserver.go:221 open api to machine-0: [172.17.0.1:17070]
  715. 2018-12-17 13:27:18 DEBUG juju.worker.lease manager.go:309 [033265] no leases to expire
  716. 2018-12-17 13:27:28 DEBUG juju.worker.lease manager.go:309 [301f3e] no leases to expire
  717. 2018-12-17 13:27:33 DEBUG juju.worker.lease manager.go:309 [a63de4] no leases to expire
  718. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:187 calculating desired peer group
  719. desired voting members: (maxId: 3)
  720. &peergrouper.machine{id: "0", wantsVote: true, addresses: [public:10.100.1.200 local-cloud:172.17.0.1 local-machine:127.0.0.1 local-machine:::1]}: rs_id=1, rs_addr=172.17.0.1:37017
  721. &peergrouper.machine{id: "5", wantsVote: true, addresses: [public:10.100.1.221 local-machine:127.0.0.1 local-machine:::1]}: rs_id=2, rs_addr=10.100.1.221:37017
  722. &peergrouper.machine{id: "6", wantsVote: true, addresses: [public:10.100.1.220 local-machine:127.0.0.1 local-machine:::1]}: rs_id=3, rs_addr=10.100.1.220:37017
  723. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:298 assessing possible peer group changes:
  724. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:306 machine "0" is already voting
  725. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:313 machine "5" exists but is not ready (status: STARTUP, healthy: true)
  726. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:313 machine "6" exists but is not ready (status: STARTUP, healthy: true)
  727. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:334 assessed
  728. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:372 number of voters is odd
  729. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:521 machine "0" selected address "172.17.0.1:37017" by scope from [10.100.1.200:37017 172.17.0.1:37017 127.0.0.1:37017 [::1]:37017]
  730. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:521 machine "5" selected address "10.100.1.221:37017" by scope from [10.100.1.221:37017 127.0.0.1:37017 [::1]:37017]
  731. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper desired.go:521 machine "6" selected address "10.100.1.220:37017" by scope from [10.100.1.220:37017 127.0.0.1:37017 [::1]:37017]
  732. 2018-12-17 13:27:33 DEBUG juju.worker.peergrouper worker.go:532 no change in desired peer group, voting:
  733. 6: false
  734. 0: true
  735. 5: false
  736. 2018-12-17 13:27:36 DEBUG juju.apiserver request_notifier.go:178 <- [5] machine-5 {"request-id":195,"type":"Resumer","version":2,"request":"ResumeTransactions","params":"'params redacted'"}
  737. 2018-12-17 13:27:36 DEBUG juju.apiserver request_notifier.go:195 -> [5] machine-5 1.749598ms {"request-id":195,"response":"'body redacted'"} Resumer[""].ResumeTransactions
  738. 2018-12-17 13:27:40 WARNING juju.mongo open.go:160 mongodb connection failed, will retry: dial tcp 172.17.0.1:37017: i/o timeout
  739. ubuntu@juju-ctrl-ha-2:/var/log/juju$
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!