Advertisement
jamil_nyc

Node 2 log after resetting node.host

Nov 5th, 2017
100
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 15.67 KB | None | 0 0
  1. [2017-11-05T19:23:15,220][INFO ][o.e.n.Node ] [dev-node-2] stopping ...
  2. [2017-11-05T19:23:15,249][INFO ][o.e.n.Node ] [dev-node-2] stopped
  3. [2017-11-05T19:23:15,249][INFO ][o.e.n.Node ] [dev-node-2] closing ...
  4. [2017-11-05T19:23:15,263][INFO ][o.e.n.Node ] [dev-node-2] closed
  5. [2017-11-05T19:23:17,189][INFO ][o.e.n.Node ] [dev-node-2] initializing ...
  6. [2017-11-05T19:23:17,346][INFO ][o.e.e.NodeEnvironment ] [dev-node-2] using [1] data paths, mounts [[/ (/dev/sda1)]], net usable_space [35.5gb], net total_space [39.3gb], spins? [possibl
  7. y], types [ext4]
  8. [2017-11-05T19:23:17,347][INFO ][o.e.e.NodeEnvironment ] [dev-node-2] heap size [1.9gb], compressed ordinary object pointers [true]
  9. [2017-11-05T19:23:17,349][INFO ][o.e.n.Node ] [dev-node-2] node name [dev-node-2], node ID [BesMEgDtSEi7uifonPftTg]
  10. [2017-11-05T19:23:17,349][INFO ][o.e.n.Node ] [dev-node-2] version[5.6.3], pid[2778], build[1a2f265/2017-10-06T20:33:39.012Z], OS[Linux/3.13.0-133-generic/amd64], JVM[Oracle C
  11. orporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_151/25.151-b12]
  12. [2017-11-05T19:23:17,349][INFO ][o.e.n.Node ] [dev-node-2] JVM arguments [-Xms2g, -Xmx2g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiating
  13. OccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.nett
  14. y.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -XX:+HeapDumpOnOutOfMemoryErro
  15. r, -Des.path.home=/usr/share/elasticsearch]
  16. [2017-11-05T19:23:18,855][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [aggs-matrix-stats]
  17. [2017-11-05T19:23:18,856][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [ingest-common]
  18. [2017-11-05T19:23:18,856][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [lang-expression]
  19. [2017-11-05T19:23:18,856][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [lang-groovy]
  20. [2017-11-05T19:23:18,856][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [lang-mustache]
  21. [2017-11-05T19:23:18,856][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [lang-painless]
  22. [2017-11-05T19:23:18,860][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [parent-join]
  23. [2017-11-05T19:23:18,860][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [percolator]
  24. [2017-11-05T19:23:18,861][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [reindex]
  25. [2017-11-05T19:23:18,861][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [transport-netty3]
  26. [2017-11-05T19:23:18,861][INFO ][o.e.p.PluginsService ] [dev-node-2] loaded module [transport-netty4]
  27. [2017-11-05T19:23:18,861][INFO ][o.e.p.PluginsService ] [dev-node-2] no plugins loaded
  28. [2017-11-05T19:23:22,246][INFO ][o.e.d.DiscoveryModule ] [dev-node-2] using discovery type [zen]
  29. [2017-11-05T19:23:22,252][DEBUG][o.e.d.z.UnicastZenPing ] [dev-node-2] using initial hosts [192.168.33.92, 192.168.33.93], with concurrent_connects [10], resolve_timeout [5s]
  30. [2017-11-05T19:23:22,255][DEBUG][o.e.d.z.ElectMasterService] [dev-node-2] using minimum_master_nodes [-1]
  31. [2017-11-05T19:23:22,255][DEBUG][o.e.d.z.ZenDiscovery ] [dev-node-2] using ping_timeout [3s], join.timeout [1m], master_election.ignore_non_master [false]
  32. [2017-11-05T19:23:22,257][DEBUG][o.e.d.z.MasterFaultDetection] [dev-node-2] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
  33. [2017-11-05T19:23:22,259][DEBUG][o.e.d.z.NodesFaultDetection] [dev-node-2] [node ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
  34. [2017-11-05T19:23:23,299][INFO ][o.e.n.Node ] [dev-node-2] initialized
  35. [2017-11-05T19:23:23,299][INFO ][o.e.n.Node ] [dev-node-2] starting ...
  36. [2017-11-05T19:23:23,517][INFO ][o.e.t.TransportService ] [dev-node-2] publish_address {192.168.33.93:9300}, bound_addresses {192.168.33.93:9300}
  37. [2017-11-05T19:23:23,531][INFO ][o.e.b.BootstrapChecks ] [dev-node-2] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
  38. [2017-11-05T19:23:23,561][TRACE][o.e.d.z.NodeJoinController] [dev-node-2] starting an election context, will accumulate joins
  39. [2017-11-05T19:23:23,563][TRACE][o.e.d.z.ZenDiscovery ] [dev-node-2] starting to ping
  40. [2017-11-05T19:23:23,574][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] resolved host [192.168.33.92] to [192.168.33.92:9300]
  41. [2017-11-05T19:23:23,575][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] resolved host [192.168.33.93] to [192.168.33.93:9300]
  42. [2017-11-05T19:23:23,584][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] opening connection to [{#zen_unicast_192.168.33.92_0#}{yhapKaXgSOKiKdH2Y4XOYQ}{192.168.33.92}{192.168.33.92:9300
  43. }]
  44. [2017-11-05T19:23:23,587][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] sending to {dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}
  45. [2017-11-05T19:23:23,591][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] received response from {dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93
  46. :9300}: [ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[1], master [null],cluster_state_version [-1], cluster_name[
  47. search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[2], master [null],cluster_state_version [-1],
  48. cluster_name[search-cluster-dev]}]
  49. [2017-11-05T19:23:23,809][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] sending to {#zen_unicast_192.168.33.92_0#}{yhapKaXgSOKiKdH2Y4XOYQ}{192.168.33.92}{192.168.33.92:9300}
  50. [2017-11-05T19:23:23,816][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] received response from {#zen_unicast_192.168.33.92_0#}{yhapKaXgSOKiKdH2Y4XOYQ}{192.168.33.92}{192.168.33.92:9300
  51. }: [ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[577], master [null],cluster_state_version [-1], cluster_name[sea
  52. rch-cluster-dev]}, ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[579], master [null],cluster_state_version [-1], c
  53. luster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[1], master [null],cluster_state_ve
  54. rsion [-1], cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[582], master [{dev-no
  55. de-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}],cluster_state_version [7], cluster_name[search-cluster-dev]}]
  56. [2017-11-05T19:23:24,582][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] sending to {#zen_unicast_192.168.33.92_0#}{yhapKaXgSOKiKdH2Y4XOYQ}{192.168.33.92}{192.168.33.92:9300}
  57. [2017-11-05T19:23:24,594][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] sending to {dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}
  58. [2017-11-05T19:23:24,595][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] received response from {dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93
  59. :9300}: [ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[1], master [null],cluster_state_version [-1], cluster_name[
  60. search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[3], master [null],cluster_state_version [-1],
  61. cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[4], master [null],cluster_state_v
  62. ersion [-1], cluster_name[search-cluster-dev]}]
  63. [2017-11-05T19:23:24,591][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] received response from {#zen_unicast_192.168.33.92_0#}{yhapKaXgSOKiKdH2Y4XOYQ}{192.168.33.92}{192.168.33.92:9300
  64. }: [ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[577], master [null],cluster_state_version [-1], cluster_name[sea
  65. rch-cluster-dev]}, ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[579], master [null],cluster_state_version [-1], c
  66. luster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[1], master [null],cluster_state_ve
  67. rsion [-1], cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[3], master [null],clu
  68. ster_state_version [-1], cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[583], ma
  69. ster [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}],cluster_state_version [7], cluster_name[search-cluster-dev]}]
  70. [2017-11-05T19:23:25,579][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] sending to {dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}
  71. [2017-11-05T19:23:25,579][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] received response from {dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93
  72. :9300}: [ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[1], master [null],cluster_state_version [-1], cluster_name[
  73. search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[3], master [null],cluster_state_version [-1],
  74. cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[5], master [null],cluster_state_v
  75. ersion [-1], cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[6], master [null],cl
  76. uster_state_version [-1], cluster_name[search-cluster-dev]}]
  77. [2017-11-05T19:23:25,579][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] sending to {#zen_unicast_192.168.33.92_0#}{yhapKaXgSOKiKdH2Y4XOYQ}{192.168.33.92}{192.168.33.92:9300}
  78. [2017-11-05T19:23:25,582][TRACE][o.e.d.z.UnicastZenPing ] [dev-node-2] [1] received response from {#zen_unicast_192.168.33.92_0#}{yhapKaXgSOKiKdH2Y4XOYQ}{192.168.33.92}{192.168.33.92:9300
  79. }: [ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[579], master [null],cluster_state_version [-1], cluster_name[sea
  80. rch-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[1], master [null],cluster_state_version [-1], clu
  81. ster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[3], master [null],cluster_state_vers
  82. ion [-1], cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[5], master [null],clust
  83. er_state_version [-1], cluster_name[search-cluster-dev]}, ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[584], mast
  84. er [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}],cluster_state_version [7], cluster_name[search-cluster-dev]}]
  85. [2017-11-05T19:23:26,580][TRACE][o.e.d.z.ZenDiscovery ] [dev-node-2] full ping responses:
  86. --> ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[584], master [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ
  87. 9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}],cluster_state_version [7], cluster_name[search-cluster-dev]}
  88. [2017-11-05T19:23:26,581][DEBUG][o.e.d.z.ZenDiscovery ] [dev-node-2] filtered ping responses: (ignore_non_masters [false])
  89. --> ping_response{node [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}], id[584], master [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ
  90. 9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}],cluster_state_version [7], cluster_name[search-cluster-dev]}
  91. --> ping_response{node [{dev-node-2}{BesMEgDtSEi7uifonPftTg}{t_PPNrdPSwawp95TJFHXYw}{192.168.33.93}{192.168.33.93:9300}], id[7], master [null],cluster_state_version [-1], cluster_na
  92. me[search-cluster-dev]}
  93. [2017-11-05T19:23:26,582][TRACE][o.e.d.z.NodeJoinController] [dev-node-2] stopping election ([{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}
  94. elected])
  95. [2017-11-05T19:23:26,624][TRACE][o.e.d.z.ZenDiscovery ] [dev-node-2] joining master {dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}
  96. [2017-11-05T19:23:26,722][DEBUG][o.e.d.z.PublishClusterStateAction] [dev-node-2] received full cluster state version [8] with size [821]
  97. [2017-11-05T19:23:26,746][DEBUG][o.e.d.z.ZenDiscovery ] [dev-node-2] got first state from fresh master [-8-B5bwuSvuFBABOLL6fcw]
  98. [2017-11-05T19:23:26,747][INFO ][o.e.c.s.ClusterService ] [dev-node-2] detected_master {dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300}, add
  99. ed {{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300},}, reason: zen-disco-receive(from master [master {dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJ
  100. QQ9g6TxOksu7ymdMCpg}{192.168.33.92}{192.168.33.92:9300} committed version [8]])
  101. [2017-11-05T19:23:26,788][DEBUG][o.e.d.z.MasterFaultDetection] [dev-node-2] [master] restarting fault detection against master [{dev-node-1}{-8-B5bwuSvuFBABOLL6fcw}{8BJQQ9g6TxOksu7ymdMCpg}{
  102. 192.168.33.92}{192.168.33.92:9300}], reason [new cluster state received and we are monitoring the wrong master [null]]
  103. [2017-11-05T19:23:26,805][INFO ][o.e.h.n.Netty4HttpServerTransport] [dev-node-2] publish_address {192.168.33.93:9200}, bound_addresses {192.168.33.93:9200}
  104. [2017-11-05T19:23:26,805][INFO ][o.e.n.Node ] [dev-node-2] started
  105. [2017-11-05T19:23:26,861][DEBUG][o.e.d.z.PublishClusterStateAction] [dev-node-2] received diff cluster state version [9] with uuid [6Wou-WSFQ8KGlcBfyfaeiw], diff size [383]
  106. [2017-11-05T19:23:27,887][DEBUG][o.e.d.z.PublishClusterStateAction] [dev-node-2] received diff cluster state version [10] with uuid [qAQZwpleRqCZxzxTTlfSIg], diff size [544]
  107. [2017-11-05T19:23:27,940][DEBUG][o.e.d.z.PublishClusterStateAction] [dev-node-2] received diff cluster state version [11] with uuid [djK4LfnrT1qZeCAkQPDxfw], diff size [562]
  108. [2017-11-05T19:23:28,467][DEBUG][o.e.d.z.PublishClusterStateAction] [dev-node-2] received diff cluster state version [12] with uuid [lFNuTasQQJCvmKIQ_psYsw], diff size [579]
  109. [2017-11-05T19:23:28,512][DEBUG][o.e.d.z.PublishClusterStateAction] [dev-node-2] received diff cluster state version [13] with uuid [t7jPZGlSRW2Llrotdreb6Q], diff size [575]
  110. [2017-11-05T19:23:29,025][DEBUG][o.e.d.z.PublishClusterStateAction] [dev-node-2] received diff cluster state version [14] with uuid [UI3sjbJ-Suy9kuanmFWz5w], diff size [545]
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement