API tools faq
paste
Guest User

Redis slave log

a guest
Apr 18th, 2019
234
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 26.95 KB | None | 0 0
raw download clone embed print report
  1. 1376:M 21 Aug 02:09:28.990 # Server started, Redis version 3.2.0
  2. 1376:M 21 Aug 02:09:28.990 * DB loaded from disk: 0.000 seconds
  3. 1376:M 21 Aug 02:09:28.990 * The server is now ready to accept connections on port 6379
  4. 1376:S 21 Aug 02:09:28.991 # Cluster state changed: ok
  5. 1376:S 21 Aug 02:09:29.994 * Connecting to MASTER 10.10.52.43:6379
  6. 1376:S 21 Aug 02:09:29.994 * MASTER <-> SLAVE sync started
  7. 1376:S 21 Aug 02:09:29.995 * Non blocking connect for SYNC fired the event.
  8. 1376:S 21 Aug 02:09:29.995 * Master replied to PING, replication can continue...
  9. 1376:S 21 Aug 02:09:29.996 * Partial resynchronization not possible (no cached master)
  10. 1376:S 21 Aug 02:09:29.997 * Full resync from master: 3562692ee0767bce2b912209853f304928082cfd:6401174
  11. 1376:S 21 Aug 02:09:30.035 * MASTER <-> SLAVE sync: receiving 96 bytes from master
  12. 1376:S 21 Aug 02:09:30.036 * MASTER <-> SLAVE sync: Flushing old data
  13. 1376:S 21 Aug 02:09:30.036 * MASTER <-> SLAVE sync: Loading DB in memory
  14. 1376:S 21 Aug 02:09:30.036 * MASTER <-> SLAVE sync: Finished with success
  15. 1376:M 21 Aug 02:09:47.414 # Connection with master lost.
  16. 1376:M 21 Aug 02:09:47.414 * Caching the disconnected master state.
  17. 1376:M 21 Aug 02:09:47.414 * Discarding previously cached master state.
  18. 1376:M 21 Aug 02:09:47.415 # Cluster state changed: fail
  19. 1376:S 21 Aug 02:09:56.453 # Cluster state changed: ok
  20. 1376:S 21 Aug 02:09:57.091 * Connecting to MASTER 10.10.52.43:6379
  21. 1376:S 21 Aug 02:09:57.092 * MASTER <-> SLAVE sync started
  22. 1376:S 21 Aug 02:09:57.092 * Non blocking connect for SYNC fired the event.
  23. 1376:S 21 Aug 02:09:57.093 * Master replied to PING, replication can continue...
  24. 1376:S 21 Aug 02:09:57.093 * Partial resynchronization not possible (no cached master)
  25. 1376:S 21 Aug 02:09:57.094 * Full resync from master: 3562692ee0767bce2b912209853f304928082cfd:6401216
  26. 1376:S 21 Aug 02:09:57.191 * MASTER <-> SLAVE sync: receiving 96 bytes from master
  27. 1376:S 21 Aug 02:09:57.191 * MASTER <-> SLAVE sync: Flushing old data
  28. 1376:S 21 Aug 02:09:57.191 * MASTER <-> SLAVE sync: Loading DB in memory
  29. 1376:S 21 Aug 02:09:57.192 * MASTER <-> SLAVE sync: Finished with success
  30. 1376:S 10 Oct 05:42:01.300 # Manual failover user request accepted.
  31. 1376:S 10 Oct 05:42:01.374 # Received replication offset for paused master manual failover: 321902312855
  32. 1376:S 10 Oct 05:42:01.421 # All master replication stream processed, manual failover can start.
  33. 1376:S 10 Oct 05:42:01.421 # Start of election delayed for 0 milliseconds (rank #0, offset 321902312855).
  34. 1376:S 10 Oct 05:42:01.522 # Starting a failover election for epoch 42.
  35. 1376:S 10 Oct 05:42:01.524 # Currently unable to failover: Waiting for votes, but majority still not reached.
  36. 1376:S 10 Oct 05:42:01.525 # Failover election won: I'm the new master.
  37. 1376:S 10 Oct 05:42:01.525 # configEpoch set to 42 after successful failover
  38. 1376:M 10 Oct 05:42:01.525 # Connection with master lost.
  39. 1376:M 10 Oct 05:42:01.525 * Caching the disconnected master state.
  40. 1376:M 10 Oct 05:42:01.525 * Discarding previously cached master state.
  41. 1376:M 10 Oct 05:42:02.076 * Slave 10.10.52.43:6379 asks for synchronization
  42. 1376:M 10 Oct 05:42:02.076 * Full resync requested by slave 10.10.52.43:6379
  43. 1376:M 10 Oct 05:42:02.076 * Starting BGSAVE for SYNC with target: disk
  44. 1376:M 10 Oct 05:42:02.137 * Background saving started by pid 6750
  45. 6750:C 10 Oct 05:42:02.855 * DB saved on disk
  46. 6750:C 10 Oct 05:42:02.871 * RDB: 13 MB of memory used by copy-on-write
  47. 1376:M 10 Oct 05:42:02.956 * Background saving terminated with success
  48. 1376:M 10 Oct 05:42:03.081 * Synchronization with slave 10.10.52.43:6379 succeeded
  49. 1376:M 12 Oct 05:42:35.717 # Manual failover requested by slave 19538764e5cde1014f1fd35afbf1af3a217de7b4.
  50. 1376:M 12 Oct 05:42:35.908 # Failover auth granted to 19538764e5cde1014f1fd35afbf1af3a217de7b4 for epoch 43
  51. 1376:M 12 Oct 05:42:35.909 # Connection with slave 10.10.52.43:6379 lost.
  52. 1376:M 12 Oct 05:42:35.928 # Configuration change detected. Reconfiguring myself as a replica of 19538764e5cde1014f1fd35afbf1af3a217de7b4
  53. 1376:S 12 Oct 05:42:36.587 * Connecting to MASTER 10.10.52.43:6379
  54. 1376:S 12 Oct 05:42:36.587 * MASTER <-> SLAVE sync started
  55. 1376:S 12 Oct 05:42:36.588 * Non blocking connect for SYNC fired the event.
  56. 1376:S 12 Oct 05:42:36.588 * Master replied to PING, replication can continue...
  57. 1376:S 12 Oct 05:42:36.590 * Partial resynchronization not possible (no cached master)
  58. 1376:S 12 Oct 05:42:36.601 * Full resync from master: 3562692ee0767bce2b912209853f304928082cfd:576601433570
  59. 1376:S 12 Oct 05:42:36.907 * MASTER <-> SLAVE sync: receiving 13594316 bytes from master
  60. 1376:S 12 Oct 05:42:37.191 * MASTER <-> SLAVE sync: Flushing old data
  61. 1376:S 12 Oct 05:42:37.306 * MASTER <-> SLAVE sync: Loading DB in memory
  62. 1376:S 12 Oct 05:42:37.698 * MASTER <-> SLAVE sync: Finished with success
  63. 1376:S 07 Nov 14:20:59.951 # Connection with master lost.
  64. 1376:S 07 Nov 14:20:59.951 * Caching the disconnected master state.
  65. 1376:S 07 Nov 14:21:00.406 * Connecting to MASTER 10.10.52.43:6379
  66. 1376:S 07 Nov 14:21:00.406 * MASTER <-> SLAVE sync started
  67. 1376:S 07 Nov 14:21:00.407 * Non blocking connect for SYNC fired the event.
  68. 1376:S 07 Nov 14:21:00.408 * Master replied to PING, replication can continue...
  69. 1376:S 07 Nov 14:21:00.410 * Trying a partial resynchronization (request 3562692ee0767bce2b912209853f304928082cfd:3173357575792).
  70. 1376:S 07 Nov 14:21:00.440 * Full resync from master: 3562692ee0767bce2b912209853f304928082cfd:3173694744310
  71. 1376:S 07 Nov 14:21:00.440 * Discarding previously cached master state.
  72. 1376:S 07 Nov 14:21:04.583 * MASTER <-> SLAVE sync: receiving 177804439 bytes from master
  73. 1376:S 07 Nov 14:21:09.469 * MASTER <-> SLAVE sync: Flushing old data
  74. 1376:S 07 Nov 14:21:09.876 * MASTER <-> SLAVE sync: Loading DB in memory
  75. 1376:S 07 Nov 14:21:23.335 * MASTER <-> SLAVE sync: Finished with success
  76. 1376:S 16 Nov 07:04:14.557 # Connection with master lost.
  77. 1376:S 16 Nov 07:04:14.558 * Caching the disconnected master state.
  78. 1376:S 16 Nov 07:04:14.646 * Connecting to MASTER 10.10.52.43:6379
  79. 1376:S 16 Nov 07:04:14.646 * MASTER <-> SLAVE sync started
  80. 1376:S 16 Nov 07:04:14.647 * Non blocking connect for SYNC fired the event.
  81. 1376:S 16 Nov 07:04:14.647 * Master replied to PING, replication can continue...
  82. 1376:S 16 Nov 07:04:14.648 * Trying a partial resynchronization (request 3562692ee0767bce2b912209853f304928082cfd:4004098412371).
  83. 1376:S 16 Nov 07:04:14.668 * Full resync from master: 3562692ee0767bce2b912209853f304928082cfd:4004375797466
  84. 1376:S 16 Nov 07:04:14.668 * Discarding previously cached master state.
  85. 1376:S 16 Nov 07:04:15.870 * MASTER <-> SLAVE sync: receiving 51649815 bytes from master
  86. 1376:S 16 Nov 07:04:16.880 * MASTER <-> SLAVE sync: Flushing old data
  87. 1376:S 16 Nov 07:04:17.008 * MASTER <-> SLAVE sync: Loading DB in memory
  88. 1376:S 16 Nov 07:04:20.442 * MASTER <-> SLAVE sync: Finished with success
  89. 1376:S 15 Dec 18:51:21.628 * FAIL message received from 0060ee610b3a52bf88a0202aff0ce63039354578 about 6adb459bc1cda0ae002109140d04015c531c6910
  90. 1376:S 15 Dec 18:51:46.153 * Clear FAIL state for node 6adb459bc1cda0ae002109140d04015c531c6910: slave is reachable again.
  91. 1376:S 24 Dec 02:08:41.244 * FAIL message received from d190c341144350bf9dbad67841104ed75ccbdcdc about 6adb459bc1cda0ae002109140d04015c531c6910
  92. 1376:S 24 Dec 02:08:44.639 * Clear FAIL state for node 6adb459bc1cda0ae002109140d04015c531c6910: slave is reachable again.
  93. 1376:S 12 Jan 23:52:21.017 * FAIL message received from d190c341144350bf9dbad67841104ed75ccbdcdc about a0f14e54f18e1a04c448cd09e851459863e929b0
  94. 1376:S 12 Jan 23:54:05.378 * Clear FAIL state for node a0f14e54f18e1a04c448cd09e851459863e929b0: slave is reachable again.
  95. 1376:S 12 Jan 23:54:49.058 * FAIL message received from b702bbcddb6a39e2deb8567804fa5d4468fbe5cc about a0f14e54f18e1a04c448cd09e851459863e929b0
  96. 1376:S 12 Jan 23:54:50.153 * Clear FAIL state for node a0f14e54f18e1a04c448cd09e851459863e929b0: slave is reachable again.
  97. 1376:S 13 Jan 00:24:34.708 * FAIL message received from 19538764e5cde1014f1fd35afbf1af3a217de7b4 about a0f14e54f18e1a04c448cd09e851459863e929b0
  98. 1376:S 13 Jan 00:24:50.197 * Clear FAIL state for node a0f14e54f18e1a04c448cd09e851459863e929b0: slave is reachable again.
  99. 1376:S 16 Jan 10:55:31.479 * FAIL message received from d190c341144350bf9dbad67841104ed75ccbdcdc about a0f14e54f18e1a04c448cd09e851459863e929b0
  100. 1376:S 16 Jan 10:56:13.758 * Clear FAIL state for node a0f14e54f18e1a04c448cd09e851459863e929b0: slave is reachable again.
  101. 1376:S 24 Jan 13:47:53.526 * FAIL message received from 19538764e5cde1014f1fd35afbf1af3a217de7b4 about a0f14e54f18e1a04c448cd09e851459863e929b0
  102. 1376:S 24 Jan 13:48:22.862 * Clear FAIL state for node a0f14e54f18e1a04c448cd09e851459863e929b0: slave is reachable again.
  103. 1376:S 01 Feb 10:08:57.547 # Connection with master lost.
  104. 1376:S 01 Feb 10:08:57.547 * Caching the disconnected master state.
  105. 1376:S 01 Feb 10:08:57.630 * Connecting to MASTER 10.10.52.43:6379
  106. 1376:S 01 Feb 10:08:57.630 * MASTER <-> SLAVE sync started
  107. 1376:S 01 Feb 10:08:57.631 * Non blocking connect for SYNC fired the event.
  108. 1376:S 01 Feb 10:08:57.635 * Master replied to PING, replication can continue...
  109. 1376:S 01 Feb 10:08:57.637 * Trying a partial resynchronization (request 3562692ee0767bce2b912209853f304928082cfd:11537554625819).
  110. 1376:S 01 Feb 10:08:57.668 * Full resync from master: 3562692ee0767bce2b912209853f304928082cfd:11537891498664
  111. 1376:S 01 Feb 10:08:57.668 * Discarding previously cached master state.
  112. 1376:S 01 Feb 10:09:02.008 * MASTER <-> SLAVE sync: receiving 228484379 bytes from master
  113. 1376:S 01 Feb 10:09:06.238 * MASTER <-> SLAVE sync: Flushing old data
  114. 1376:S 01 Feb 10:09:07.279 * MASTER <-> SLAVE sync: Loading DB in memory
  115. 1376:S 01 Feb 10:09:17.840 * MASTER <-> SLAVE sync: Finished with success
  116. 1376:S 07 Feb 05:57:00.087 * FAIL message received from d190c341144350bf9dbad67841104ed75ccbdcdc about 1833427e42afa74273aa33696ed7e5f80f40e244
  117. 1376:S 07 Feb 05:57:19.503 * Clear FAIL state for node 1833427e42afa74273aa33696ed7e5f80f40e244: slave is reachable again.
  118. 1376:S 05 Apr 14:11:01.812 # Connection with master lost.
  119. 1376:S 05 Apr 14:11:01.812 * Caching the disconnected master state.
  120. 1376:S 05 Apr 14:11:02.773 * Connecting to MASTER 10.10.52.43:6379
  121. 1376:S 05 Apr 14:11:02.773 * MASTER <-> SLAVE sync started
  122. 1376:S 05 Apr 14:11:02.774 * Non blocking connect for SYNC fired the event.
  123. 1376:S 05 Apr 14:11:02.798 * Master replied to PING, replication can continue...
  124. 1376:S 05 Apr 14:11:02.807 * Trying a partial resynchronization (request 3562692ee0767bce2b912209853f304928082cfd:18218967128947).
  125. 1376:S 05 Apr 14:11:02.838 * Full resync from master: 3562692ee0767bce2b912209853f304928082cfd:18219370240232
  126. 1376:S 05 Apr 14:11:02.838 * Discarding previously cached master state.
  127. 1376:S 05 Apr 14:11:07.808 * MASTER <-> SLAVE sync: receiving 254053454 bytes from master
  128. 1376:S 05 Apr 14:11:12.349 * MASTER <-> SLAVE sync: Flushing old data
  129. 1376:S 05 Apr 14:11:12.915 * MASTER <-> SLAVE sync: Loading DB in memory
  130. 1376:S 05 Apr 14:11:29.525 * MASTER <-> SLAVE sync: Finished with success
  131. 1376:S 05 Apr 22:45:33.117 # Manual failover user request accepted.
  132. 1376:S 05 Apr 22:45:33.139 # Received replication offset for paused master manual failover: 18260883455508
  133. 1376:S 05 Apr 22:45:33.166 # All master replication stream processed, manual failover can start.
  134. 1376:S 05 Apr 22:45:33.166 # Start of election delayed for 0 milliseconds (rank #0, offset 18260883455508).
  135. 1376:S 05 Apr 22:45:33.267 # Starting a failover election for epoch 57.
  136. 1376:S 05 Apr 22:45:33.273 # Currently unable to failover: Waiting for votes, but majority still not reached.
  137. 1376:S 05 Apr 22:45:33.273 # Failover election won: I'm the new master.
  138. 1376:S 05 Apr 22:45:33.273 # configEpoch set to 57 after successful failover
  139. 1376:M 05 Apr 22:45:33.274 # Connection with master lost.
  140. 1376:M 05 Apr 22:45:33.274 * Caching the disconnected master state.
  141. 1376:M 05 Apr 22:45:33.276 * Discarding previously cached master state.
  142. 1376:M 05 Apr 22:45:33.945 * Slave 10.10.52.43:6379 asks for synchronization
  143. 1376:M 05 Apr 22:45:33.945 * Full resync requested by slave 10.10.52.43:6379
  144. 1376:M 05 Apr 22:45:33.945 * Starting BGSAVE for SYNC with target: disk
  145. 1376:M 05 Apr 22:45:34.089 * Background saving started by pid 641
  146. 641:C 05 Apr 22:45:39.152 * DB saved on disk
  147. 641:C 05 Apr 22:45:39.196 * RDB: 78 MB of memory used by copy-on-write
  148. 1376:M 05 Apr 22:45:39.332 * Background saving terminated with success
  149. 1376:M 05 Apr 22:45:40.001 * Synchronization with slave 10.10.52.43:6379 succeeded
  150. 1376:M 05 Apr 23:07:39.736 # Connection with slave 10.10.52.43:6379 lost.
  151. 1376:M 06 Apr 00:07:40.722 * Replication backlog freed after 3600 seconds without connected slaves.
  152. 1376:M 06 Apr 01:32:38.912 # Failover auth granted to 0060ee610b3a52bf88a0202aff0ce63039354578 for epoch 58
  153. 1376:M 06 Apr 01:36:28.266 # Failover auth granted to b702bbcddb6a39e2deb8567804fa5d4468fbe5cc for epoch 59
  154. 1376:M 06 Apr 01:39:56.976 # Failover auth granted to d190c341144350bf9dbad67841104ed75ccbdcdc for epoch 60
  155. 1376:M 06 Apr 01:42:05.411 * Slave 10.10.52.43:6379 asks for synchronization
  156. 1376:M 06 Apr 01:42:05.411 * Full resync requested by slave 10.10.52.43:6379
  157. 1376:M 06 Apr 01:42:05.411 * Starting BGSAVE for SYNC with target: disk
  158. 1376:M 06 Apr 01:42:05.472 * Background saving started by pid 773
  159. 1376:M 06 Apr 01:42:06.416 # Connection with slave 10.10.52.43:6379 lost.
  160. 773:C 06 Apr 01:42:09.709 * DB saved on disk
  161. 773:C 06 Apr 01:42:09.753 * RDB: 70 MB of memory used by copy-on-write
  162. 1376:M 06 Apr 01:42:09.884 * Background saving terminated with success
  163. 1376:M 06 Apr 01:42:20.963 * Slave 10.10.52.43:6379 asks for synchronization
  164. 1376:M 06 Apr 01:42:20.963 * Full resync requested by slave 10.10.52.43:6379
  165. 1376:M 06 Apr 01:42:20.963 * Starting BGSAVE for SYNC with target: disk
  166. 1376:M 06 Apr 01:42:21.016 * Background saving started by pid 820
  167. 820:C 06 Apr 01:42:25.812 * DB saved on disk
  168. 820:C 06 Apr 01:42:25.843 * RDB: 72 MB of memory used by copy-on-write
  169. 1376:M 06 Apr 01:42:25.915 * Background saving terminated with success
  170. 1376:M 06 Apr 01:42:26.551 * Synchronization with slave 10.10.52.43:6379 succeeded
  171. 1376:M 06 Apr 01:43:46.224 # Connection with slave 10.10.52.43:6379 lost.
  172. 1376:M 06 Apr 01:44:30.884 * Slave 10.10.52.43:6379 asks for synchronization
  173. 1376:M 06 Apr 01:44:30.884 * Full resync requested by slave 10.10.52.43:6379
  174. 1376:M 06 Apr 01:44:30.884 * Starting BGSAVE for SYNC with target: disk
  175. 1376:M 06 Apr 01:44:30.976 * Background saving started by pid 1274
  176. 1274:C 06 Apr 01:44:35.670 * DB saved on disk
  177. 1274:C 06 Apr 01:44:35.712 * RDB: 65 MB of memory used by copy-on-write
  178. 1376:M 06 Apr 01:44:35.873 * Background saving terminated with success
  179. 1376:M 06 Apr 01:44:36.523 * Synchronization with slave 10.10.52.43:6379 succeeded
  180. 1376:M 06 Apr 01:44:50.121 # Manual failover requested by slave 19538764e5cde1014f1fd35afbf1af3a217de7b4.
  181. 1376:M 06 Apr 01:44:50.296 # Failover auth granted to 19538764e5cde1014f1fd35afbf1af3a217de7b4 for epoch 61
  182. 1376:M 06 Apr 01:44:50.296 # Connection with slave 10.10.52.43:6379 lost.
  183. 1376:M 06 Apr 01:44:50.328 # Configuration change detected. Reconfiguring myself as a replica of 19538764e5cde1014f1fd35afbf1af3a217de7b4
  184. 1376:S 06 Apr 01:44:50.961 * Connecting to MASTER 10.10.52.43:6379
  185. 1376:S 06 Apr 01:44:50.961 * MASTER <-> SLAVE sync started
  186. 1376:S 06 Apr 01:44:50.962 * Non blocking connect for SYNC fired the event.
  187. 1376:S 06 Apr 01:44:50.962 * Master replied to PING, replication can continue...
  188. 1376:S 06 Apr 01:44:50.963 * Partial resynchronization not possible (no cached master)
  189. 1376:S 06 Apr 01:44:50.966 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:18261214905923
  190. 1376:S 06 Apr 01:44:52.102 * MASTER <-> SLAVE sync: receiving 72724482 bytes from master
  191. 1376:S 06 Apr 01:44:53.521 * MASTER <-> SLAVE sync: Flushing old data
  192. 1376:S 06 Apr 01:44:53.947 * MASTER <-> SLAVE sync: Loading DB in memory
  193. 1376:S 06 Apr 01:44:58.655 * MASTER <-> SLAVE sync: Finished with success
  194. 1376:S 09 Apr 21:41:24.395 * FAIL message received from b702bbcddb6a39e2deb8567804fa5d4468fbe5cc about 19538764e5cde1014f1fd35afbf1af3a217de7b4
  195. 1376:S 09 Apr 21:41:24.395 # Cluster state changed: fail
  196. 1376:S 09 Apr 21:41:24.428 # Start of election delayed for 993 milliseconds (rank #0, offset 18604034765863).
  197. 1376:S 09 Apr 21:41:25.438 # Starting a failover election for epoch 62.
  198. 1376:S 09 Apr 21:41:25.445 # Failover election won: I'm the new master.
  199. 1376:S 09 Apr 21:41:25.445 # configEpoch set to 62 after successful failover
  200. 1376:M 09 Apr 21:41:25.445 # Connection with master lost.
  201. 1376:M 09 Apr 21:41:25.445 * Caching the disconnected master state.
  202. 1376:M 09 Apr 21:41:25.447 * Discarding previously cached master state.
  203. 1376:M 09 Apr 21:41:25.448 # Cluster state changed: ok
  204. 1376:M 09 Apr 21:41:55.235 * Clear FAIL state for node 19538764e5cde1014f1fd35afbf1af3a217de7b4: master without slots is reachable again.
  205. 1376:M 09 Apr 21:41:57.649 * Slave 10.10.52.43:6379 asks for synchronization
  206. 1376:M 09 Apr 21:41:57.650 * Full resync requested by slave 10.10.52.43:6379
  207. 1376:M 09 Apr 21:41:57.650 * Starting BGSAVE for SYNC with target: disk
  208. 1376:M 09 Apr 21:41:57.692 * Background saving started by pid 14563
  209. 14563:C 09 Apr 21:42:01.662 * DB saved on disk
  210. 14563:C 09 Apr 21:42:01.709 * RDB: 93 MB of memory used by copy-on-write
  211. 1376:M 09 Apr 21:42:01.878 * Background saving terminated with success
  212. 1376:M 09 Apr 21:42:04.210 * Synchronization with slave 10.10.52.43:6379 succeeded
  213. 1376:M 10 Apr 01:13:28.219 * FAIL message received from 0060ee610b3a52bf88a0202aff0ce63039354578 about b702bbcddb6a39e2deb8567804fa5d4468fbe5cc
  214. 1376:M 10 Apr 01:13:28.220 # Cluster state changed: fail
  215. 1376:M 10 Apr 01:13:29.308 # Failover auth granted to 1833427e42afa74273aa33696ed7e5f80f40e244 for epoch 63
  216. 1376:M 10 Apr 01:13:29.325 # Cluster state changed: ok
  217. 1376:M 10 Apr 01:13:32.407 * Clear FAIL state for node b702bbcddb6a39e2deb8567804fa5d4468fbe5cc: master without slots is reachable again.
  218. 1376:M 10 Apr 02:55:55.271 * FAIL message received from 0060ee610b3a52bf88a0202aff0ce63039354578 about b702bbcddb6a39e2deb8567804fa5d4468fbe5cc
  219. 1376:M 10 Apr 02:56:16.656 * Clear FAIL state for node b702bbcddb6a39e2deb8567804fa5d4468fbe5cc: slave is reachable again.
  220. 1376:M 12 Apr 00:34:05.870 * FAIL message received from d190c341144350bf9dbad67841104ed75ccbdcdc about 19538764e5cde1014f1fd35afbf1af3a217de7b4
  221. 1376:M 12 Apr 00:34:28.389 * Clear FAIL state for node 19538764e5cde1014f1fd35afbf1af3a217de7b4: slave is reachable again.
  222. 1376:M 12 Apr 22:55:40.556 * FAIL message received from d190c341144350bf9dbad67841104ed75ccbdcdc about b702bbcddb6a39e2deb8567804fa5d4468fbe5cc
  223. 1376:M 12 Apr 22:56:07.297 * Clear FAIL state for node b702bbcddb6a39e2deb8567804fa5d4468fbe5cc: slave is reachable again.
  224. 1376:M 12 Apr 23:42:52.385 * Marking node d190c341144350bf9dbad67841104ed75ccbdcdc as failing (quorum reached).
  225. 1376:M 12 Apr 23:42:52.386 # Cluster state changed: fail
  226. 1376:M 12 Apr 23:42:53.176 # Failover auth granted to a0f14e54f18e1a04c448cd09e851459863e929b0 for epoch 64
  227. 1376:M 12 Apr 23:42:53.183 # Cluster state changed: ok
  228. 1376:M 12 Apr 23:43:17.942 * Clear FAIL state for node d190c341144350bf9dbad67841104ed75ccbdcdc: master without slots is reachable again.
  229. 1376:M 13 Apr 08:21:21.640 * Marking node 19538764e5cde1014f1fd35afbf1af3a217de7b4 as failing (quorum reached).
  230. 1376:M 13 Apr 08:21:44.830 * Clear FAIL state for node 19538764e5cde1014f1fd35afbf1af3a217de7b4: slave is reachable again.
  231. 1376:M 13 Apr 22:06:33.584 * FAIL message received from 0060ee610b3a52bf88a0202aff0ce63039354578 about b702bbcddb6a39e2deb8567804fa5d4468fbe5cc
  232. 1376:M 13 Apr 22:06:37.875 * Clear FAIL state for node b702bbcddb6a39e2deb8567804fa5d4468fbe5cc: slave is reachable again.
  233. 1376:M 14 Apr 03:05:17.988 * Marking node d190c341144350bf9dbad67841104ed75ccbdcdc as failing (quorum reached).
  234. 1376:M 14 Apr 03:05:44.480 * Clear FAIL state for node d190c341144350bf9dbad67841104ed75ccbdcdc: slave is reachable again.
  235. 1376:M 14 Apr 20:50:24.332 * FAIL message received from a0f14e54f18e1a04c448cd09e851459863e929b0 about d190c341144350bf9dbad67841104ed75ccbdcdc
  236. 1376:M 14 Apr 20:50:31.069 * Clear FAIL state for node d190c341144350bf9dbad67841104ed75ccbdcdc: slave is reachable again.
  237. 1376:M 15 Apr 04:36:21.709 * FAIL message received from 1833427e42afa74273aa33696ed7e5f80f40e244 about b702bbcddb6a39e2deb8567804fa5d4468fbe5cc
  238. 1376:M 15 Apr 04:36:33.031 * Clear FAIL state for node b702bbcddb6a39e2deb8567804fa5d4468fbe5cc: slave is reachable again.
  239. 1376:M 15 Apr 13:12:18.420 # Failover auth granted to d190c341144350bf9dbad67841104ed75ccbdcdc for epoch 65
  240. 1376:M 16 Apr 20:20:50.049 * FAIL message received from d190c341144350bf9dbad67841104ed75ccbdcdc about 6adb459bc1cda0ae002109140d04015c531c6910
  241. 1376:M 16 Apr 20:21:04.789 * Clear FAIL state for node 6adb459bc1cda0ae002109140d04015c531c6910: slave is reachable again.
  242. 1376:M 18 Apr 14:41:57.445 # Manual failover requested by slave 19538764e5cde1014f1fd35afbf1af3a217de7b4.
  243. 1376:M 18 Apr 14:42:02.484 # Manual failover timed out.
  244. 1376:M 18 Apr 14:43:14.752 # Manual failover requested by slave 19538764e5cde1014f1fd35afbf1af3a217de7b4.
  245. 1376:M 18 Apr 14:43:14.994 # Failover auth granted to 19538764e5cde1014f1fd35afbf1af3a217de7b4 for epoch 66
  246. 1376:M 18 Apr 14:43:15.023 # Configuration change detected. Reconfiguring myself as a replica of 19538764e5cde1014f1fd35afbf1af3a217de7b4
  247. 1376:S 18 Apr 14:43:15.028 # Connection with slave client id #1429979 lost.
  248. 1376:S 18 Apr 14:43:18.204 * Connecting to MASTER 10.10.52.43:6379
  249. 1376:S 18 Apr 14:43:18.205 * MASTER <-> SLAVE sync started
  250. 1376:S 18 Apr 14:43:18.699 * Non blocking connect for SYNC fired the event.
  251. 1376:S 18 Apr 14:43:18.737 * Master replied to PING, replication can continue...
  252. 1376:S 18 Apr 14:43:20.315 * Partial resynchronization not possible (no cached master)
  253. 1376:S 18 Apr 14:43:21.424 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19629367318918
  254. 1376:S 18 Apr 14:43:25.397 * MASTER <-> SLAVE sync: receiving 210871171 bytes from master
  255. 1376:S 18 Apr 14:47:21.431 # I/O error trying to sync with MASTER: connection lost
  256. 1376:S 18 Apr 14:47:30.345 * Connecting to MASTER 10.10.52.43:6379
  257. 1376:S 18 Apr 14:47:30.345 * MASTER <-> SLAVE sync started
  258. 1376:S 18 Apr 14:47:31.451 * Non blocking connect for SYNC fired the event.
  259. 1376:S 18 Apr 14:47:31.583 * Master replied to PING, replication can continue...
  260. 1376:S 18 Apr 14:47:33.884 * Partial resynchronization not possible (no cached master)
  261. 1376:S 18 Apr 14:47:35.180 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19629558430526
  262. 1376:S 18 Apr 14:47:44.991 * MASTER <-> SLAVE sync: receiving 211821517 bytes from master
  263. 1376:S 18 Apr 14:51:39.763 # I/O error trying to sync with MASTER: connection lost
  264. 1376:S 18 Apr 14:51:42.016 * Connecting to MASTER 10.10.52.43:6379
  265. 1376:S 18 Apr 14:51:42.016 * MASTER <-> SLAVE sync started
  266. 1376:S 18 Apr 14:51:42.907 * Non blocking connect for SYNC fired the event.
  267. 1376:S 18 Apr 14:51:43.018 * Master replied to PING, replication can continue...
  268. 1376:S 18 Apr 14:51:44.629 * Partial resynchronization not possible (no cached master)
  269. 1376:S 18 Apr 14:51:45.736 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19629779849506
  270. 1376:S 18 Apr 14:51:52.960 * MASTER <-> SLAVE sync: receiving 211745066 bytes from master
  271. 1376:S 18 Apr 14:55:13.211 # I/O error trying to sync with MASTER: connection lost
  272. 1376:S 18 Apr 14:55:20.257 * Connecting to MASTER 10.10.52.43:6379
  273. 1376:S 18 Apr 14:55:20.257 * MASTER <-> SLAVE sync started
  274. 1376:S 18 Apr 14:55:21.611 * Non blocking connect for SYNC fired the event.
  275. 1376:S 18 Apr 14:55:21.741 * Master replied to PING, replication can continue...
  276. 1376:S 18 Apr 14:55:23.669 * Partial resynchronization not possible (no cached master)
  277. 1376:S 18 Apr 14:55:24.750 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19630077243571
  278. 1376:S 18 Apr 14:55:30.688 * MASTER <-> SLAVE sync: receiving 211736442 bytes from master
  279. 1376:S 18 Apr 14:58:45.102 # I/O error trying to sync with MASTER: connection lost
  280. 1376:S 18 Apr 14:58:55.824 * Connecting to MASTER 10.10.52.43:6379
  281. 1376:S 18 Apr 14:58:55.824 * MASTER <-> SLAVE sync started
  282. 1376:S 18 Apr 14:58:56.772 * Non blocking connect for SYNC fired the event.
  283. 1376:S 18 Apr 14:58:56.882 * Master replied to PING, replication can continue...
  284. 1376:S 18 Apr 14:58:58.772 * Partial resynchronization not possible (no cached master)
  285. 1376:S 18 Apr 14:58:59.740 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19630357637389
  286. 1376:S 18 Apr 14:59:04.672 * MASTER <-> SLAVE sync: receiving 197582852 bytes from master
  287. 1376:S 18 Apr 15:02:13.347 # I/O error trying to sync with MASTER: connection lost
  288. 1376:S 18 Apr 15:02:25.252 * Connecting to MASTER 10.10.52.43:6379
  289. 1376:S 18 Apr 15:02:25.252 * MASTER <-> SLAVE sync started
  290. 1376:S 18 Apr 15:02:26.416 * Non blocking connect for SYNC fired the event.
  291. 1376:S 18 Apr 15:02:26.543 * Master replied to PING, replication can continue...
  292. 1376:S 18 Apr 15:02:28.867 * Partial resynchronization not possible (no cached master)
  293. 1376:S 18 Apr 15:02:30.054 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19630706510677
  294. 1376:S 18 Apr 15:02:35.861 * MASTER <-> SLAVE sync: receiving 195388605 bytes from master
  295. 1376:S 18 Apr 15:05:39.091 # I/O error trying to sync with MASTER: connection lost
  296. 1376:S 18 Apr 15:05:41.335 * Connecting to MASTER 10.10.52.43:6379
  297. 1376:S 18 Apr 15:05:41.336 * MASTER <-> SLAVE sync started
  298. 1376:S 18 Apr 15:05:42.553 * Non blocking connect for SYNC fired the event.
  299. 1376:S 18 Apr 15:05:42.669 * Master replied to PING, replication can continue...
  300. 1376:S 18 Apr 15:05:44.620 * Partial resynchronization not possible (no cached master)
  301. 1376:S 18 Apr 15:05:45.581 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19631000811968
  302. 1376:S 18 Apr 15:05:50.647 * MASTER <-> SLAVE sync: receiving 193268902 bytes from master
  303. 1376:S 18 Apr 15:09:12.855 # I/O error trying to sync with MASTER: connection lost
  304. 1376:S 18 Apr 15:09:18.607 * Connecting to MASTER 10.10.52.43:6379
  305. 1376:S 18 Apr 15:09:18.608 * MASTER <-> SLAVE sync started
  306. 1376:S 18 Apr 15:09:19.694 * Non blocking connect for SYNC fired the event.
  307. 1376:S 18 Apr 15:09:19.811 * Master replied to PING, replication can continue...
  308. 1376:S 18 Apr 15:09:21.940 * Partial resynchronization not possible (no cached master)
  309. 1376:S 18 Apr 15:09:23.091 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19631349779839
  310. 1376:S 18 Apr 15:09:27.362 * MASTER <-> SLAVE sync: receiving 192856402 bytes from master
  311. 1376:S 18 Apr 15:12:37.497 # I/O error trying to sync with MASTER: connection lost
  312. 1376:S 18 Apr 15:12:38.467 * Connecting to MASTER 10.10.52.43:6379
  313. 1376:S 18 Apr 15:12:38.467 * MASTER <-> SLAVE sync started
  314. 1376:S 18 Apr 15:12:39.533 * Non blocking connect for SYNC fired the event.
  315. 1376:S 18 Apr 15:12:39.655 * Master replied to PING, replication can continue...
  316. 1376:S 18 Apr 15:12:41.882 * Partial resynchronization not possible (no cached master)
  317. 1376:S 18 Apr 15:12:42.962 * Full resync from master: 1bcb01620315ce098721c79ef25e4679b16b9419:19631687816357
  318. 1376:S 18 Apr 15:12:50.589 * MASTER <-> SLAVE sync: receiving 191421359 bytes from master
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!