API tools faq
paste
Advertisement
Guest User

Test output

a guest
Aug 5th, 2015
36
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 112.20 KB | None | 0 0
raw download clone embed print report
  1. 2015-08-05 15:32:53 VerifiableProperties [INFO] Verifying properties
  2. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property auto.create.topics.enable is overridden to false
  3. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property broker.id is overridden to 0
  4. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property controlled.shutdown.enable is overridden to true
  5. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property host.name is overridden to localhost
  6. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property log.dir is overridden to /tmp/kafka-194407
  7. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property port is overridden to 35037
  8. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property replica.socket.timeout.ms is overridden to 1500
  9. 2015-08-05 15:32:53 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  10. 2015-08-05 15:32:53 KafkaServer [INFO] [Kafka Server 0], starting
  11. 2015-08-05 15:32:53 KafkaServer [INFO] [Kafka Server 0], Connecting to zookeeper on 127.0.0.1:46395
  12. 2015-08-05 15:32:53 ZkEventThread [INFO] Starting ZkClient event thread.
  13. 2015-08-05 15:32:53 ZkClient [INFO] zookeeper state changed (SyncConnected)
  14. 2015-08-05 15:32:53 LogManager [INFO] Loading logs.
  15. 2015-08-05 15:32:53 LogManager [INFO] Logs loading complete.
  16. 2015-08-05 15:32:53 LogManager [INFO] Starting log cleanup with a period of 300000 ms.
  17. 2015-08-05 15:32:53 LogManager [INFO] Starting log flusher with a default period of 9223372036854775807 ms.
  18. 2015-08-05 15:32:53 Acceptor [INFO] Awaiting socket connections on localhost:35037.
  19. 2015-08-05 15:32:53 SocketServer [INFO] [Socket Server on Broker 0], Started
  20. 2015-08-05 15:32:53 Mx4jLoader$ [INFO] Will not load MX4J, mx4j-tools.jar is not in the classpath
  21. 2015-08-05 15:32:53 KafkaController [INFO] [Controller 0]: Controller starting up
  22. 2015-08-05 15:32:53 ZookeeperLeaderElector [INFO] 0 successfully elected as leader
  23. 2015-08-05 15:32:53 KafkaController [INFO] [Controller 0]: Broker 0 starting become controller state transition
  24. 2015-08-05 15:32:53 KafkaController [INFO] [Controller 0]: Controller 0 incremented epoch to 1
  25. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Partitions undergoing preferred replica election:
  26. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Partitions that completed preferred replica election:
  27. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Resuming preferred replica election for partitions:
  28. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Partitions being reassigned: Map()
  29. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Partitions already reassigned: List()
  30. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Resuming reassignment of partitions: Map()
  31. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: List of topics to be deleted:
  32. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: List of topics ineligible for deletion:
  33. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Currently active brokers in the cluster: Set()
  34. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Currently shutting brokers in the cluster: Set()
  35. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Current list of topics in the cluster: Set()
  36. 2015-08-05 15:32:54 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Started replica state machine with initial state -> Map()
  37. 2015-08-05 15:32:54 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Started partition state machine with initial state -> Map()
  38. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Broker 0 is ready to serve as the new controller with epoch 1
  39. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Starting preferred replica leader election for partitions
  40. 2015-08-05 15:32:54 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Invoking state change to OnlinePartition for partitions
  41. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: starting the partition rebalance scheduler
  42. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: Controller startup complete
  43. 2015-08-05 15:32:54 ZkUtils$ [INFO] Registered broker 0 at path /brokers/ids/0 with address localhost:35037.
  44. 2015-08-05 15:32:54 KafkaServer [INFO] [Kafka Server 0], started
  45. 2015-08-05 15:32:54 VerifiableProperties [INFO] Verifying properties
  46. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property auto.create.topics.enable is overridden to false
  47. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property broker.id is overridden to 1
  48. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property controlled.shutdown.enable is overridden to true
  49. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property host.name is overridden to localhost
  50. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property log.dir is overridden to /tmp/kafka-419093
  51. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property port is overridden to 55192
  52. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property replica.socket.timeout.ms is overridden to 1500
  53. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  54. 2015-08-05 15:32:54 KafkaServer [INFO] [Kafka Server 1], starting
  55. 2015-08-05 15:32:54 KafkaServer [INFO] [Kafka Server 1], Connecting to zookeeper on 127.0.0.1:46395
  56. 2015-08-05 15:32:54 ZkEventThread [INFO] Starting ZkClient event thread.
  57. 2015-08-05 15:32:54 ZkClient [INFO] zookeeper state changed (SyncConnected)
  58. 2015-08-05 15:32:54 LogManager [INFO] Loading logs.
  59. 2015-08-05 15:32:54 LogManager [INFO] Logs loading complete.
  60. 2015-08-05 15:32:54 LogManager [INFO] Starting log cleanup with a period of 300000 ms.
  61. 2015-08-05 15:32:54 LogManager [INFO] Starting log flusher with a default period of 9223372036854775807 ms.
  62. 2015-08-05 15:32:54 Acceptor [INFO] Awaiting socket connections on localhost:55192.
  63. 2015-08-05 15:32:54 SocketServer [INFO] [Socket Server on Broker 1], Started
  64. 2015-08-05 15:32:54 ZookeeperLeaderElector$LeaderChangeListener [INFO] New leader is 0
  65. 2015-08-05 15:32:54 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 0]: Broker change listener fired for path /brokers/ids with children 0
  66. 2015-08-05 15:32:54 Mx4jLoader$ [INFO] Will not load MX4J, mx4j-tools.jar is not in the classpath
  67. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 1]: Controller starting up
  68. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 1]: Controller startup complete
  69. 2015-08-05 15:32:54 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 0]: Newly added brokers: 0, deleted brokers: , all live brokers: 0
  70. 2015-08-05 15:32:54 RequestSendThread [INFO] [Controller-0-to-broker-0-send-thread], Controller 0 connected to id:0,host:localhost,port:35037 for sending state change requests
  71. 2015-08-05 15:32:54 ZkUtils$ [INFO] Registered broker 1 at path /brokers/ids/1 with address localhost:55192.
  72. 2015-08-05 15:32:54 KafkaServer [INFO] [Kafka Server 1], started
  73. 2015-08-05 15:32:54 VerifiableProperties [INFO] Verifying properties
  74. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property auto.create.topics.enable is overridden to false
  75. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property broker.id is overridden to 2
  76. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property controlled.shutdown.enable is overridden to true
  77. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property host.name is overridden to localhost
  78. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property log.dir is overridden to /tmp/kafka-359526
  79. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property port is overridden to 52827
  80. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property replica.socket.timeout.ms is overridden to 1500
  81. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  82. 2015-08-05 15:32:54 KafkaServer [INFO] [Kafka Server 2], starting
  83. 2015-08-05 15:32:54 KafkaServer [INFO] [Kafka Server 2], Connecting to zookeeper on 127.0.0.1:46395
  84. 2015-08-05 15:32:54 ZkEventThread [INFO] Starting ZkClient event thread.
  85. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: New broker startup callback for 0
  86. 2015-08-05 15:32:54 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 0]: Broker change listener fired for path /brokers/ids with children 0,1
  87. 2015-08-05 15:32:54 ZkClient [INFO] zookeeper state changed (SyncConnected)
  88. 2015-08-05 15:32:54 RequestSendThread [INFO] [Controller-0-to-broker-0-send-thread], Starting
  89. 2015-08-05 15:32:54 LogManager [INFO] Loading logs.
  90. 2015-08-05 15:32:54 LogManager [INFO] Logs loading complete.
  91. 2015-08-05 15:32:54 LogManager [INFO] Starting log cleanup with a period of 300000 ms.
  92. 2015-08-05 15:32:54 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 0]: Newly added brokers: 1, deleted brokers: , all live brokers: 0,1
  93. 2015-08-05 15:32:54 RequestSendThread [INFO] [Controller-0-to-broker-1-send-thread], Controller 0 connected to id:1,host:localhost,port:55192 for sending state change requests
  94. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: New broker startup callback for 1
  95. 2015-08-05 15:32:54 RequestSendThread [INFO] [Controller-0-to-broker-1-send-thread], Starting
  96. 2015-08-05 15:32:54 LogManager [INFO] Starting log flusher with a default period of 9223372036854775807 ms.
  97. 2015-08-05 15:32:54 Acceptor [INFO] Awaiting socket connections on localhost:52827.
  98. 2015-08-05 15:32:54 SocketServer [INFO] [Socket Server on Broker 2], Started
  99. 2015-08-05 15:32:54 Mx4jLoader$ [INFO] Will not load MX4J, mx4j-tools.jar is not in the classpath
  100. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 2]: Controller starting up
  101. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 2]: Controller startup complete
  102. 2015-08-05 15:32:54 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 0]: Broker change listener fired for path /brokers/ids with children 0,1,2
  103. 2015-08-05 15:32:54 ZkUtils$ [INFO] Registered broker 2 at path /brokers/ids/2 with address localhost:52827.
  104. 2015-08-05 15:32:54 KafkaServer [INFO] [Kafka Server 2], started
  105. 2015-08-05 15:32:54 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 0]: Newly added brokers: 2, deleted brokers: , all live brokers: 0,1,2
  106. 2015-08-05 15:32:54 ZkEventThread [INFO] Starting ZkClient event thread.
  107. 2015-08-05 15:32:54 RequestSendThread [INFO] [Controller-0-to-broker-2-send-thread], Controller 0 connected to id:2,host:localhost,port:52827 for sending state change requests
  108. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: New broker startup callback for 2
  109. 2015-08-05 15:32:54 RequestSendThread [INFO] [Controller-0-to-broker-2-send-thread], Starting
  110. 2015-08-05 15:32:54 ZkClient [INFO] zookeeper state changed (SyncConnected)
  111. 2015-08-05 15:32:54 AdminUtils$ [INFO] Topic creation {"version":1,"partitions":{"0":[2,0,1]}}
  112. 2015-08-05 15:32:54 VerifiableProperties [INFO] Verifying properties
  113. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property client.id is overridden to some-job-name
  114. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037,localhost:55192,localhost:52827
  115. 2015-08-05 15:32:54 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 6000
  116. 2015-08-05 15:32:54 PartitionStateMachine$TopicChangeListener [INFO] [TopicChangeListener on Controller 0]: New topics: [Set(input)], deleted topics: [Set()], new partition replica assignment [Map([input,0] -> List(2, 0, 1))]
  117. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: New topic creation callback for [input,0]
  118. 2015-08-05 15:32:54 KafkaController [INFO] [Controller 0]: New partition creation callback for [input,0]
  119. 2015-08-05 15:32:54 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Invoking state change to NewPartition for partitions [input,0]
  120. 2015-08-05 15:32:54 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Invoking state change to NewReplica for replicas [Topic=input,Partition=0,Replica=2],[Topic=input,Partition=0,Replica=0],[Topic=input,Partition=0,Replica=1]
  121. 2015-08-05 15:32:54 ClientUtils$ [INFO] Fetching metadata from broker id:2,host:localhost,port:52827 with correlation id 0 for 1 topic(s) Set(input)
  122. 2015-08-05 15:32:54 SyncProducer [INFO] Connected to localhost:52827 for producing
  123. 2015-08-05 15:32:54 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Invoking state change to OnlinePartition for partitions [input,0]
  124. 2015-08-05 15:32:54 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Invoking state change to OnlineReplica for replicas [Topic=input,Partition=0,Replica=2],[Topic=input,Partition=0,Replica=0],[Topic=input,Partition=0,Replica=1]
  125. 2015-08-05 15:32:54 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 2] Removed fetcher for partitions [input,0]
  126. 2015-08-05 15:32:54 SyncProducer [INFO] Disconnecting from localhost:52827
  127. 2015-08-05 15:32:55 Log [INFO] Completed load of log input-0 with log end offset 0
  128. 2015-08-05 15:32:55 Log [INFO] Completed load of log input-0 with log end offset 0
  129. 2015-08-05 15:32:55 LogManager [INFO] Created log for partition [input,0] in /tmp/kafka-359526 with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 1073741824, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> delete, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000, segment.jitter.ms -> 0}.
  130. 2015-08-05 15:32:55 Partition [WARN] Partition [input,0] on broker 2: No checkpointed highwatermark is found for partition [input,0]
  131. 2015-08-05 15:32:55 LogManager [INFO] Created log for partition [input,0] in /tmp/kafka-194407 with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 1073741824, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> delete, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000, segment.jitter.ms -> 0}.
  132. 2015-08-05 15:32:55 Partition [WARN] Partition [input,0] on broker 0: No checkpointed highwatermark is found for partition [input,0]
  133. 2015-08-05 15:32:55 Log [INFO] Completed load of log input-0 with log end offset 0
  134. 2015-08-05 15:32:55 LogManager [INFO] Created log for partition [input,0] in /tmp/kafka-419093 with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 1073741824, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> delete, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000, segment.jitter.ms -> 0}.
  135. 2015-08-05 15:32:55 Partition [WARN] Partition [input,0] on broker 1: No checkpointed highwatermark is found for partition [input,0]
  136. 2015-08-05 15:32:55 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 1] Removed fetcher for partitions [input,0]
  137. 2015-08-05 15:32:55 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [input,0]
  138. 2015-08-05 15:32:55 Log [INFO] Truncating log input-0 to offset 0.
  139. 2015-08-05 15:32:55 Log [INFO] Truncating log input-0 to offset 0.
  140. 2015-08-05 15:32:55 Processor [INFO] Closing socket connection to /127.0.0.1.
  141. 2015-08-05 15:32:55 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Starting
  142. 2015-08-05 15:32:55 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([[input,0], initOffset 0 to broker id:2,host:localhost,port:52827] )
  143. 2015-08-05 15:32:55 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 0] Added fetcher for partitions List([[input,0], initOffset 0 to broker id:2,host:localhost,port:52827] )
  144. 2015-08-05 15:32:55 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Starting
  145. 2015-08-05 15:32:55 VerifiableProperties [INFO] Verifying properties
  146. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property client.id is overridden to some-job-name
  147. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037,localhost:55192,localhost:52827
  148. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 6000
  149. 2015-08-05 15:32:55 ClientUtils$ [INFO] Fetching metadata from broker id:2,host:localhost,port:52827 with correlation id 1 for 1 topic(s) Set(input)
  150. 2015-08-05 15:32:55 SyncProducer [INFO] Connected to localhost:52827 for producing
  151. 2015-08-05 15:32:55 SyncProducer [INFO] Disconnecting from localhost:52827
  152. 2015-08-05 15:32:55 Processor [INFO] Closing socket connection to /127.0.0.1.
  153. 2015-08-05 15:32:55 VerifiableProperties [INFO] Verifying properties
  154. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  155. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781575616-0
  156. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-1c1c2c42-d7d4-4b64-9eda-47c5bbc895b8
  157. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  158. 2015-08-05 15:32:55 VerifiableProperties [INFO] Verifying properties
  159. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  160. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781575648-1
  161. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-275fe539-0d9c-4e07-be94-a43de335d849
  162. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  163. 2015-08-05 15:32:55 VerifiableProperties [INFO] Verifying properties
  164. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  165. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781575829-2
  166. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-176be2f7-6f9b-4819-9ed1-776f2d16a2bf
  167. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  168. 2015-08-05 15:32:55 VerifiableProperties [INFO] Verifying properties
  169. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  170. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781575843-4
  171. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-69e8581e-59b2-4357-98bd-37e3e1f9d22b
  172. 2015-08-05 15:32:55 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  173. 2015-08-05 15:32:55 ZkEventThread [INFO] Starting ZkClient event thread.
  174. 2015-08-05 15:32:55 ZkClient [INFO] zookeeper state changed (SyncConnected)
  175. 2015-08-05 15:32:55 AdminUtils$ [INFO] Topic creation {"version":1,"partitions":{"0":[1]}}
  176. 2015-08-05 15:32:55 ZkEventThread [INFO] Terminate ZkClient event thread.
  177. 2015-08-05 15:32:55 PartitionStateMachine$TopicChangeListener [INFO] [TopicChangeListener on Controller 0]: New topics: [Set(__samza_coordinator_hello-stateful-world_1)], deleted topics: [Set()], new partition replica assignment [Map([__samza_coordinator_hello-stateful-world_1,0] -> List(1))]
  178. 2015-08-05 15:32:55 KafkaController [INFO] [Controller 0]: New topic creation callback for [__samza_coordinator_hello-stateful-world_1,0]
  179. 2015-08-05 15:32:55 KafkaController [INFO] [Controller 0]: New partition creation callback for [__samza_coordinator_hello-stateful-world_1,0]
  180. 2015-08-05 15:32:55 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Invoking state change to NewPartition for partitions [__samza_coordinator_hello-stateful-world_1,0]
  181. 2015-08-05 15:32:55 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Invoking state change to NewReplica for replicas [Topic=__samza_coordinator_hello-stateful-world_1,Partition=0,Replica=1]
  182. 2015-08-05 15:32:55 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Invoking state change to OnlinePartition for partitions [__samza_coordinator_hello-stateful-world_1,0]
  183. 2015-08-05 15:32:55 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Invoking state change to OnlineReplica for replicas [Topic=__samza_coordinator_hello-stateful-world_1,Partition=0,Replica=1]
  184. 2015-08-05 15:32:55 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 1] Removed fetcher for partitions [__samza_coordinator_hello-stateful-world_1,0]
  185. 2015-08-05 15:32:55 Log [INFO] Completed load of log __samza_coordinator_hello-stateful-world_1-0 with log end offset 0
  186. 2015-08-05 15:32:55 LogManager [INFO] Created log for partition [__samza_coordinator_hello-stateful-world_1,0] in /tmp/kafka-419093 with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 26214400, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> compact, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000, segment.jitter.ms -> 0}.
  187. 2015-08-05 15:32:55 Partition [WARN] Partition [__samza_coordinator_hello-stateful-world_1,0] on broker 1: No checkpointed highwatermark is found for partition [__samza_coordinator_hello-stateful-world_1,0]
  188. 2015-08-05 15:32:56 VerifiableProperties [INFO] Verifying properties
  189. 2015-08-05 15:32:56 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781575616-0
  190. 2015-08-05 15:32:56 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037
  191. 2015-08-05 15:32:56 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  192. 2015-08-05 15:32:56 ClientUtils$ [INFO] Fetching metadata from broker id:0,host:localhost,port:35037 with correlation id 0 for 1 topic(s) Set(__samza_coordinator_hello-stateful-world_1)
  193. 2015-08-05 15:32:56 SyncProducer [INFO] Connected to localhost:35037 for producing
  194. 2015-08-05 15:32:56 SyncProducer [INFO] Disconnecting from localhost:35037
  195. 2015-08-05 15:32:56 Processor [INFO] Closing socket connection to /127.0.0.1.
  196. 2015-08-05 15:32:56 Processor [INFO] Closing socket connection to /127.0.0.1.
  197. 2015-08-05 15:32:57 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  198. 2015-08-05 15:32:57 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  199. java.io.IOException: Broken pipe
  200. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  201. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  202. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  203. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  204. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  205. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  206. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  207. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  208. at kafka.network.Processor.write(SocketServer.scala:472)
  209. at kafka.network.Processor.run(SocketServer.scala:342)
  210. at java.lang.Thread.run(Thread.java:745)
  211. 2015-08-05 15:32:57 Processor [INFO] Closing socket connection to /127.0.0.1.
  212. 2015-08-05 15:32:57 Processor [INFO] Closing socket connection to /127.0.0.1.
  213. 2015-08-05 15:32:57 VerifiableProperties [INFO] Verifying properties
  214. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  215. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781577478-5
  216. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-4127b2b1-2955-479f-966c-a67e80f00ac3
  217. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  218. 2015-08-05 15:32:57 VerifiableProperties [INFO] Verifying properties
  219. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  220. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781577479-6
  221. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-6c1df2c2-c33d-4c02-b60c-6516f6f02922
  222. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  223. 2015-08-05 15:32:57 VerifiableProperties [INFO] Verifying properties
  224. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  225. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781577480-7
  226. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-7b4b7c2d-c5d0-418f-82d7-afd5caea70d1
  227. 2015-08-05 15:32:57 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  228. 2015-08-05 15:32:57 Processor [INFO] Closing socket connection to /127.0.0.1.
  229. 2015-08-05 15:32:58 VerifiableProperties [INFO] Verifying properties
  230. 2015-08-05 15:32:58 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  231. 2015-08-05 15:32:58 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781578557-9
  232. 2015-08-05 15:32:58 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-e2effbc0-9b6b-4acd-85f2-92329e79ced4
  233. 2015-08-05 15:32:58 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  234. 2015-08-05 15:32:58 Processor [INFO] Closing socket connection to /127.0.0.1.
  235. 2015-08-05 15:32:58 Processor [INFO] Closing socket connection to /127.0.0.1.
  236. 2015-08-05 15:32:59 VerifiableProperties [INFO] Verifying properties
  237. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  238. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781579795-10
  239. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-30cc5c67-d1ed-46e0-890b-dc50239040bc
  240. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  241. 2015-08-05 15:32:59 ZkEventThread [INFO] Starting ZkClient event thread.
  242. 2015-08-05 15:32:59 ZkClient [INFO] zookeeper state changed (SyncConnected)
  243. 2015-08-05 15:32:59 AdminUtils$ [INFO] Topic creation {"version":1,"partitions":{"0":[2]}}
  244. 2015-08-05 15:32:59 ZkEventThread [INFO] Terminate ZkClient event thread.
  245. 2015-08-05 15:32:59 PartitionStateMachine$TopicChangeListener [INFO] [TopicChangeListener on Controller 0]: New topics: [Set(mystoreChangelog)], deleted topics: [Set()], new partition replica assignment [Map([mystoreChangelog,0] -> List(2))]
  246. 2015-08-05 15:32:59 KafkaController [INFO] [Controller 0]: New topic creation callback for [mystoreChangelog,0]
  247. 2015-08-05 15:32:59 KafkaController [INFO] [Controller 0]: New partition creation callback for [mystoreChangelog,0]
  248. 2015-08-05 15:32:59 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Invoking state change to NewPartition for partitions [mystoreChangelog,0]
  249. 2015-08-05 15:32:59 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Invoking state change to NewReplica for replicas [Topic=mystoreChangelog,Partition=0,Replica=2]
  250. 2015-08-05 15:32:59 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Invoking state change to OnlinePartition for partitions [mystoreChangelog,0]
  251. 2015-08-05 15:32:59 VerifiableProperties [INFO] Verifying properties
  252. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781579795-10
  253. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037
  254. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  255. 2015-08-05 15:32:59 ClientUtils$ [INFO] Fetching metadata from broker id:0,host:localhost,port:35037 with correlation id 0 for 1 topic(s) Set(mystoreChangelog)
  256. 2015-08-05 15:32:59 SyncProducer [INFO] Connected to localhost:35037 for producing
  257. 2015-08-05 15:32:59 SyncProducer [INFO] Disconnecting from localhost:35037
  258. 2015-08-05 15:32:59 Processor [INFO] Closing socket connection to /127.0.0.1.
  259. 2015-08-05 15:32:59 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Invoking state change to OnlineReplica for replicas [Topic=mystoreChangelog,Partition=0,Replica=2]
  260. 2015-08-05 15:32:59 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 2] Removed fetcher for partitions [mystoreChangelog,0]
  261. 2015-08-05 15:32:59 Log [INFO] Completed load of log mystoreChangelog-0 with log end offset 0
  262. 2015-08-05 15:32:59 LogManager [INFO] Created log for partition [mystoreChangelog,0] in /tmp/kafka-359526 with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 536870912, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> compact, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000, segment.jitter.ms -> 0}.
  263. 2015-08-05 15:32:59 Partition [WARN] Partition [mystoreChangelog,0] on broker 2: No checkpointed highwatermark is found for partition [mystoreChangelog,0]
  264. 2015-08-05 15:32:59 VerifiableProperties [INFO] Verifying properties
  265. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781579795-10
  266. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037
  267. 2015-08-05 15:32:59 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  268. 2015-08-05 15:32:59 ClientUtils$ [INFO] Fetching metadata from broker id:0,host:localhost,port:35037 with correlation id 0 for 1 topic(s) Set(mystoreChangelog)
  269. 2015-08-05 15:32:59 SyncProducer [INFO] Connected to localhost:35037 for producing
  270. 2015-08-05 15:32:59 SyncProducer [INFO] Disconnecting from localhost:35037
  271. 2015-08-05 15:32:59 Processor [INFO] Closing socket connection to /127.0.0.1.
  272. 2015-08-05 15:32:59 Processor [INFO] Closing socket connection to /127.0.0.1.
  273. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  274. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  275. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781580237-11
  276. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-c6aecc67-8c1e-4fc0-b6e5-08e148248578
  277. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  278. 2015-08-05 15:33:00 Processor [INFO] Closing socket connection to /127.0.0.1.
  279. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  280. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  281. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781580245-12
  282. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-753c4485-b540-449d-9718-6d3decea09ae
  283. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  284. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  285. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  286. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781580295-14
  287. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-64942241-b42d-4ad3-b665-3c250bf910a4
  288. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  289. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  290. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  291. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781580297-15
  292. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-2e96cb70-2ddd-455f-b3d1-d549cf8829e6
  293. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  294. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  295. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  296. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781580298-16
  297. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-bcdc46c1-7e30-4a09-9299-66d3490a1162
  298. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  299. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  300. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  301. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781580336-18
  302. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-9d2e614e-f2cf-41d4-80b4-ccc772eb24f3
  303. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  304. 2015-08-05 15:33:00 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  305. 2015-08-05 15:33:00 Processor [INFO] Closing socket connection to /127.0.0.1.
  306. 2015-08-05 15:33:00 Processor [INFO] Closing socket connection to /127.0.0.1.
  307. 2015-08-05 15:33:00 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  308. java.io.IOException: Broken pipe
  309. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  310. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  311. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  312. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  313. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  314. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  315. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  316. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  317. at kafka.network.Processor.write(SocketServer.scala:472)
  318. at kafka.network.Processor.run(SocketServer.scala:342)
  319. at java.lang.Thread.run(Thread.java:745)
  320. 2015-08-05 15:33:00 Processor [INFO] Closing socket connection to /127.0.0.1.
  321. 2015-08-05 15:33:00 Processor [INFO] Closing socket connection to /127.0.0.1.
  322. 2015-08-05 15:33:00 Processor [INFO] Closing socket connection to /127.0.0.1.
  323. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  324. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781580245-12
  325. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037
  326. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  327. 2015-08-05 15:33:00 ClientUtils$ [INFO] Fetching metadata from broker id:0,host:localhost,port:35037 with correlation id 0 for 1 topic(s) Set(input)
  328. 2015-08-05 15:33:00 SyncProducer [INFO] Connected to localhost:35037 for producing
  329. 2015-08-05 15:33:00 SyncProducer [INFO] Disconnecting from localhost:35037
  330. 2015-08-05 15:33:00 Processor [INFO] Closing socket connection to /127.0.0.1.
  331. 2015-08-05 15:33:00 VerifiableProperties [INFO] Verifying properties
  332. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  333. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property group.id is overridden to testShouldStartTaskForFirstTime
  334. 2015-08-05 15:33:00 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  335. 2015-08-05 15:33:00 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], Connecting to zookeeper instance at 127.0.0.1:46395
  336. 2015-08-05 15:33:00 ZkEventThread [INFO] Starting ZkClient event thread.
  337. 2015-08-05 15:33:00 ZkClient [INFO] zookeeper state changed (SyncConnected)
  338. 2015-08-05 15:33:00 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], starting auto committer every 60000 ms
  339. 2015-08-05 15:33:00 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], begin registering consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1 in ZK
  340. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], end registering consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1 in ZK
  341. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], starting watcher executor thread for consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1
  342. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], begin rebalancing consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1 try #0
  343. 2015-08-05 15:33:01 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781580961] Stopping leader finder thread
  344. 2015-08-05 15:33:01 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781580961] Stopping all fetchers
  345. 2015-08-05 15:33:01 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781580961] All connections stopped
  346. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], Cleared all relevant queues for this fetcher
  347. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], Cleared the data chunks in all the consumer message iterators
  348. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], Committing all offsets after clearing the fetcher queues
  349. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], Releasing partition ownership
  350. 2015-08-05 15:33:01 RangeAssignor [INFO] Consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1 rebalancing the following partitions: ArrayBuffer(0) for topic mystoreChangelog with consumers: List(testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-0)
  351. 2015-08-05 15:33:01 RangeAssignor [INFO] testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-0 attempting to claim partition 0
  352. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-0 successfully owned partition 0 for topic mystoreChangelog
  353. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], Consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1 selected partitions : mystoreChangelog:0: fetched offset = -1: consumed offset = -1
  354. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], end rebalancing consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1 try #0
  355. 2015-08-05 15:33:01 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-leader-finder-thread], Starting
  356. 2015-08-05 15:33:01 VerifiableProperties [INFO] Verifying properties
  357. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property client.id is overridden to testShouldStartTaskForFirstTime
  358. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037,localhost:55192,localhost:52827
  359. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  360. 2015-08-05 15:33:01 ClientUtils$ [INFO] Fetching metadata from broker id:2,host:localhost,port:52827 with correlation id 0 for 1 topic(s) Set(mystoreChangelog)
  361. 2015-08-05 15:33:01 SyncProducer [INFO] Connected to localhost:52827 for producing
  362. 2015-08-05 15:33:01 SyncProducer [INFO] Disconnecting from localhost:52827
  363. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  364. 2015-08-05 15:33:01 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-0-2], Starting
  365. 2015-08-05 15:33:01 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781580961] Added fetcher for partitions ArrayBuffer([[mystoreChangelog,0], initOffset -1 to broker id:2,host:localhost,port:52827] )
  366. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], ZKConsumerConnector shutting down
  367. 2015-08-05 15:33:01 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781580961] Stopping leader finder thread
  368. 2015-08-05 15:33:01 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-leader-finder-thread], Shutting down
  369. 2015-08-05 15:33:01 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-leader-finder-thread], Stopped
  370. 2015-08-05 15:33:01 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-leader-finder-thread], Shutdown completed
  371. 2015-08-05 15:33:01 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781580961] Stopping all fetchers
  372. 2015-08-05 15:33:01 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-0-2], Shutting down
  373. 2015-08-05 15:33:01 SimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  374. 2015-08-05 15:33:01 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-0-2], Stopped
  375. 2015-08-05 15:33:01 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1-0-2], Shutdown completed
  376. 2015-08-05 15:33:01 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781580961] All connections stopped
  377. 2015-08-05 15:33:01 ZkEventThread [INFO] Terminate ZkClient event thread.
  378. 2015-08-05 15:33:01 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], ZKConsumerConnector shutdown completed in 56 ms
  379. 2015-08-05 15:33:01 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  380. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  381. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  382. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  383. 2015-08-05 15:33:01 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  384. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  385. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  386. 2015-08-05 15:33:01 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  387. java.io.IOException: Broken pipe
  388. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  389. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  390. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  391. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  392. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  393. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  394. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  395. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  396. at kafka.network.Processor.write(SocketServer.scala:472)
  397. at kafka.network.Processor.run(SocketServer.scala:342)
  398. at java.lang.Thread.run(Thread.java:745)
  399. 2015-08-05 15:33:01 VerifiableProperties [INFO] Verifying properties
  400. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  401. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781581318-19
  402. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-d14696d3-ab34-409d-a02e-72e6e5ea9e56
  403. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  404. 2015-08-05 15:33:01 VerifiableProperties [INFO] Verifying properties
  405. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  406. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781581320-20
  407. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-c1886407-358d-4909-a858-1be2622a4348
  408. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  409. 2015-08-05 15:33:01 VerifiableProperties [INFO] Verifying properties
  410. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  411. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781581322-21
  412. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-77612ef8-b728-41e0-9d62-20a863089de2
  413. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  414. 2015-08-05 15:33:01 VerifiableProperties [INFO] Verifying properties
  415. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  416. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781581323-23
  417. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-e8dfc35b-d75f-47b3-a75c-e809d3196bea
  418. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  419. 2015-08-05 15:33:01 ZkEventThread [INFO] Starting ZkClient event thread.
  420. 2015-08-05 15:33:01 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  421. java.io.IOException: Broken pipe
  422. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  423. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  424. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  425. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  426. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  427. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  428. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  429. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  430. at kafka.network.Processor.write(SocketServer.scala:472)
  431. at kafka.network.Processor.run(SocketServer.scala:342)
  432. at java.lang.Thread.run(Thread.java:745)
  433. 2015-08-05 15:33:01 ZkClient [INFO] zookeeper state changed (SyncConnected)
  434. 2015-08-05 15:33:01 ZkEventThread [INFO] Terminate ZkClient event thread.
  435. 2015-08-05 15:33:01 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  436. java.io.IOException: Broken pipe
  437. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  438. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  439. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  440. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  441. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  442. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  443. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  444. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  445. at kafka.network.Processor.write(SocketServer.scala:472)
  446. at kafka.network.Processor.run(SocketServer.scala:342)
  447. at java.lang.Thread.run(Thread.java:745)
  448. 2015-08-05 15:33:01 VerifiableProperties [INFO] Verifying properties
  449. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781581318-19
  450. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037
  451. 2015-08-05 15:33:01 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  452. 2015-08-05 15:33:01 ClientUtils$ [INFO] Fetching metadata from broker id:0,host:localhost,port:35037 with correlation id 0 for 1 topic(s) Set(__samza_coordinator_hello-stateful-world_1)
  453. 2015-08-05 15:33:01 SyncProducer [INFO] Connected to localhost:35037 for producing
  454. 2015-08-05 15:33:01 SyncProducer [INFO] Disconnecting from localhost:35037
  455. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  456. 2015-08-05 15:33:01 Processor [INFO] Closing socket connection to /127.0.0.1.
  457. 2015-08-05 15:33:02 ZookeeperConsumerConnector [INFO] [testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1], stopping watcher executor thread for consumer testShouldStartTaskForFirstTime_jjung-VirtualBox-1438781580945-f7e503b1
  458. 2015-08-05 15:33:02 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  459. 2015-08-05 15:33:02 Processor [INFO] Closing socket connection to /127.0.0.1.
  460. 2015-08-05 15:33:02 Processor [INFO] Closing socket connection to /127.0.0.1.
  461. 2015-08-05 15:33:02 VerifiableProperties [INFO] Verifying properties
  462. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  463. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781582536-24
  464. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-8e3b55e3-0a55-4828-9473-f1401bfa549b
  465. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  466. 2015-08-05 15:33:02 VerifiableProperties [INFO] Verifying properties
  467. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  468. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781582540-25
  469. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-3d263d1b-5c1c-4bce-b88d-ccedfcae8b80
  470. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  471. 2015-08-05 15:33:02 VerifiableProperties [INFO] Verifying properties
  472. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  473. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781582541-26
  474. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-87ceab24-8bbf-444a-9bb4-b35e9cad8324
  475. 2015-08-05 15:33:02 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  476. 2015-08-05 15:33:02 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  477. java.io.IOException: Broken pipe
  478. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  479. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  480. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  481. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  482. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  483. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  484. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  485. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  486. at kafka.network.Processor.write(SocketServer.scala:472)
  487. at kafka.network.Processor.run(SocketServer.scala:342)
  488. at java.lang.Thread.run(Thread.java:745)
  489. 2015-08-05 15:33:02 Processor [INFO] Closing socket connection to /127.0.0.1.
  490. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  491. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  492. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781583578-28
  493. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-5053ca22-cae8-4c30-b2cf-d0b28659a288
  494. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  495. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  496. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  497. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  498. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  499. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781583703-29
  500. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-7aabbf3f-430d-4e94-b0f5-a30995953ebc
  501. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  502. 2015-08-05 15:33:03 ZkEventThread [INFO] Starting ZkClient event thread.
  503. 2015-08-05 15:33:03 ZkClient [INFO] zookeeper state changed (SyncConnected)
  504. 2015-08-05 15:33:03 ZkEventThread [INFO] Terminate ZkClient event thread.
  505. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  506. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  507. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  508. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781583803-30
  509. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-eb712578-6cd7-489e-89e9-33e2a0be0c25
  510. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  511. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  512. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  513. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  514. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781583809-31
  515. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-053ac370-cdb4-4e56-9d5e-426fc76da42c
  516. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  517. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  518. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  519. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781583819-33
  520. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-69488fbe-a466-47a3-94e4-58bfb2fccd66
  521. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  522. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  523. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  524. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781583821-34
  525. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-00a872c2-0d21-4378-8ded-6ed5e752a543
  526. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  527. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  528. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  529. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781583822-35
  530. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-4fde1d62-2a0f-4e5a-b450-f3e4a2744880
  531. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  532. 2015-08-05 15:33:03 VerifiableProperties [INFO] Verifying properties
  533. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  534. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-hello_stateful_world-1-1438781583825-37
  535. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-6a95370a-6f60-4e38-a236-32bb8c34664c
  536. 2015-08-05 15:33:03 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  537. 2015-08-05 15:33:03 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  538. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  539. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  540. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  541. 2015-08-05 15:33:03 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  542. java.io.IOException: Broken pipe
  543. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  544. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  545. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  546. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  547. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  548. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  549. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  550. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  551. at kafka.network.Processor.write(SocketServer.scala:472)
  552. at kafka.network.Processor.run(SocketServer.scala:342)
  553. at java.lang.Thread.run(Thread.java:745)
  554. 2015-08-05 15:33:03 Processor [INFO] Closing socket connection to /127.0.0.1.
  555. 2015-08-05 15:33:04 Processor [INFO] Closing socket connection to /127.0.0.1.
  556. 2015-08-05 15:33:05 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  557. 2015-08-05 15:33:05 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  558. java.io.IOException: Broken pipe
  559. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  560. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  561. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  562. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  563. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  564. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  565. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  566. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  567. at kafka.network.Processor.write(SocketServer.scala:472)
  568. at kafka.network.Processor.run(SocketServer.scala:342)
  569. at java.lang.Thread.run(Thread.java:745)
  570. 2015-08-05 15:33:05 VerifiableProperties [INFO] Verifying properties
  571. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
  572. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property group.id is overridden to testShouldRestoreStore
  573. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property zookeeper.connect is overridden to 127.0.0.1:46395
  574. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], Connecting to zookeeper instance at 127.0.0.1:46395
  575. 2015-08-05 15:33:05 ZkEventThread [INFO] Starting ZkClient event thread.
  576. 2015-08-05 15:33:05 ZkClient [INFO] zookeeper state changed (SyncConnected)
  577. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], starting auto committer every 60000 ms
  578. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], begin registering consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041 in ZK
  579. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], end registering consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041 in ZK
  580. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], starting watcher executor thread for consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041
  581. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], begin rebalancing consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041 try #0
  582. 2015-08-05 15:33:05 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781585696] Stopping leader finder thread
  583. 2015-08-05 15:33:05 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781585696] Stopping all fetchers
  584. 2015-08-05 15:33:05 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781585696] All connections stopped
  585. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], Cleared all relevant queues for this fetcher
  586. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], Cleared the data chunks in all the consumer message iterators
  587. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], Committing all offsets after clearing the fetcher queues
  588. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], Releasing partition ownership
  589. 2015-08-05 15:33:05 RangeAssignor [INFO] Consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041 rebalancing the following partitions: ArrayBuffer(0) for topic mystoreChangelog with consumers: List(testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-0)
  590. 2015-08-05 15:33:05 RangeAssignor [INFO] testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-0 attempting to claim partition 0
  591. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-0 successfully owned partition 0 for topic mystoreChangelog
  592. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], Consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041 selected partitions : mystoreChangelog:0: fetched offset = -1: consumed offset = -1
  593. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], end rebalancing consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041 try #0
  594. 2015-08-05 15:33:05 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-leader-finder-thread], Starting
  595. 2015-08-05 15:33:05 VerifiableProperties [INFO] Verifying properties
  596. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property client.id is overridden to testShouldRestoreStore
  597. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037,localhost:55192,localhost:52827
  598. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  599. 2015-08-05 15:33:05 ClientUtils$ [INFO] Fetching metadata from broker id:1,host:localhost,port:55192 with correlation id 0 for 1 topic(s) Set(mystoreChangelog)
  600. 2015-08-05 15:33:05 SyncProducer [INFO] Connected to localhost:55192 for producing
  601. 2015-08-05 15:33:05 SyncProducer [INFO] Disconnecting from localhost:55192
  602. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  603. 2015-08-05 15:33:05 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-0-2], Starting
  604. 2015-08-05 15:33:05 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781585696] Added fetcher for partitions ArrayBuffer([[mystoreChangelog,0], initOffset -1 to broker id:2,host:localhost,port:52827] )
  605. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], ZKConsumerConnector shutting down
  606. 2015-08-05 15:33:05 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781585696] Stopping leader finder thread
  607. 2015-08-05 15:33:05 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-leader-finder-thread], Shutting down
  608. 2015-08-05 15:33:05 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-leader-finder-thread], Stopped
  609. 2015-08-05 15:33:05 ConsumerFetcherManager$LeaderFinderThread [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-leader-finder-thread], Shutdown completed
  610. 2015-08-05 15:33:05 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781585696] Stopping all fetchers
  611. 2015-08-05 15:33:05 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-0-2], Shutting down
  612. 2015-08-05 15:33:05 SimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  613. 2015-08-05 15:33:05 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-0-2], Stopped
  614. 2015-08-05 15:33:05 ConsumerFetcherThread [INFO] [ConsumerFetcherThread-testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041-0-2], Shutdown completed
  615. 2015-08-05 15:33:05 ConsumerFetcherManager [INFO] [ConsumerFetcherManager-1438781585696] All connections stopped
  616. 2015-08-05 15:33:05 ZkEventThread [INFO] Terminate ZkClient event thread.
  617. 2015-08-05 15:33:05 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], ZKConsumerConnector shutdown completed in 63 ms
  618. 2015-08-05 15:33:05 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  619. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  620. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  621. 2015-08-05 15:33:05 VerifiableProperties [INFO] Verifying properties
  622. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property client.id is overridden to samza_admin-hello_stateful_world-1-1438781583803-30
  623. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property metadata.broker.list is overridden to localhost:35037
  624. 2015-08-05 15:33:05 VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
  625. 2015-08-05 15:33:05 ClientUtils$ [INFO] Fetching metadata from broker id:0,host:localhost,port:35037 with correlation id 0 for 1 topic(s) Set(mystoreChangelog)
  626. 2015-08-05 15:33:05 SyncProducer [INFO] Connected to localhost:35037 for producing
  627. 2015-08-05 15:33:05 SyncProducer [INFO] Disconnecting from localhost:35037
  628. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  629. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  630. 2015-08-05 15:33:05 DefaultFetchSimpleConsumer [INFO] Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
  631. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  632. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  633. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  634. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  635. 2015-08-05 15:33:05 KafkaServer [INFO] [Kafka Server 0], shutting down
  636. 2015-08-05 15:33:05 KafkaServer [INFO] [Kafka Server 0], Starting controlled shutdown
  637. 2015-08-05 15:33:05 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  638. java.io.IOException: Broken pipe
  639. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  640. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  641. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  642. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  643. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  644. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  645. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  646. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  647. at kafka.network.Processor.write(SocketServer.scala:472)
  648. at kafka.network.Processor.run(SocketServer.scala:342)
  649. at java.lang.Thread.run(Thread.java:745)
  650. 2015-08-05 15:33:05 KafkaController [INFO] [Controller 0]: Shutting down broker 0
  651. 2015-08-05 15:33:05 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Invoking state change to OfflineReplica for replicas [Topic=input,Partition=0,Replica=0]
  652. 2015-08-05 15:33:05 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [input,0]
  653. 2015-08-05 15:33:05 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Shutting down
  654. 2015-08-05 15:33:05 KafkaController [INFO] [Controller 0]: New leader and ISR for partition [input,0] is {"leader":2,"leader_epoch":1,"isr":[2,1]}
  655. 2015-08-05 15:33:05 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 2] Removed fetcher for partitions [input,0]
  656. 2015-08-05 15:33:05 logger [INFO] Broker 1 skipped the become-follower state change after marking its partition as follower with correlation id 22 from controller 0 epoch 1 for partition [input,0] since the new leader 2 is the same as the old leader
  657. 2015-08-05 15:33:05 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 1] Removed fetcher for partitions
  658. 2015-08-05 15:33:05 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 1] Added fetcher for partitions List()
  659. 2015-08-05 15:33:05 KafkaServer [INFO] [Kafka Server 0], Controlled shutdown succeeded
  660. 2015-08-05 15:33:05 SocketServer [INFO] [Socket Server on Broker 0], Shutting down
  661. 2015-08-05 15:33:05 Processor [INFO] Closing socket connection to /127.0.0.1.
  662. 2015-08-05 15:33:05 RequestSendThread [WARN] [Controller-0-to-broker-0-send-thread], Controller 0 epoch 1 fails to send request Name: StopReplicaRequest; Version: 0; CorrelationId: 22; ClientId: ; DeletePartitions: false; ControllerId: 0; ControllerEpoch: 1; Partitions: [input,0] to broker id:0,host:localhost,port:35037. Reconnecting to broker.
  663. java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.
  664. at kafka.utils.Utils$.read(Utils.scala:381)
  665. at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
  666. at kafka.network.Receive$class.readCompletely(Transmission.scala:56)
  667. at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
  668. at kafka.network.BlockingChannel.receive(BlockingChannel.scala:111)
  669. at kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:133)
  670. at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:131)
  671. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
  672. 2015-08-05 15:33:05 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  673. java.io.IOException: Broken pipe
  674. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  675. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  676. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  677. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  678. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  679. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  680. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  681. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  682. at kafka.network.Processor.write(SocketServer.scala:472)
  683. at kafka.network.Processor.run(SocketServer.scala:342)
  684. at java.lang.Thread.run(Thread.java:745)
  685. 2015-08-05 15:33:05 RequestSendThread [INFO] [Controller-0-to-broker-0-send-thread], Controller 0 connected to id:0,host:localhost,port:35037 for sending state change requests
  686. 2015-08-05 15:33:05 Processor [ERROR] Closing socket for /127.0.0.1 because of error
  687. java.io.IOException: Broken pipe
  688. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  689. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  690. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  691. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  692. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  693. at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:123)
  694. at kafka.network.MultiSend.writeTo(Transmission.scala:101)
  695. at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
  696. at kafka.network.Processor.write(SocketServer.scala:472)
  697. at kafka.network.Processor.run(SocketServer.scala:342)
  698. at java.lang.Thread.run(Thread.java:745)
  699. 2015-08-05 15:33:05 SocketServer [INFO] [Socket Server on Broker 0], Shutdown completed
  700. 2015-08-05 15:33:06 KafkaRequestHandlerPool [INFO] [Kafka Request Handler on Broker 0], shutting down
  701. 2015-08-05 15:33:06 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Stopped
  702. 2015-08-05 15:33:06 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Shutdown completed
  703. 2015-08-05 15:33:06 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [input,0]
  704. 2015-08-05 15:33:06 Processor [INFO] Closing socket connection to /127.0.0.1.
  705. 2015-08-05 15:33:06 KafkaRequestHandlerPool [INFO] [Kafka Request Handler on Broker 0], shut down completely
  706. 2015-08-05 15:33:06 ReplicaManager [INFO] [Replica Manager on Broker 0]: Shut down
  707. 2015-08-05 15:33:06 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 0] shutting down
  708. 2015-08-05 15:33:06 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 0] shutdown completed
  709. 2015-08-05 15:33:06 ReplicaManager [INFO] [Replica Manager on Broker 0]: Shut down completely
  710. 2015-08-05 15:33:06 LogManager [INFO] Shutting down.
  711. 2015-08-05 15:33:06 LogManager [INFO] Shutdown complete.
  712. 2015-08-05 15:33:06 PartitionStateMachine [INFO] [Partition state machine on Controller 0]: Stopped partition state machine
  713. 2015-08-05 15:33:06 ReplicaStateMachine [INFO] [Replica state machine on controller 0]: Stopped replica state machine
  714. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-2-send-thread], Shutting down
  715. 2015-08-05 15:33:06 Processor [INFO] Closing socket connection to /127.0.0.1.
  716. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-2-send-thread], Stopped
  717. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-2-send-thread], Shutdown completed
  718. 2015-08-05 15:33:06 Processor [INFO] Closing socket connection to /127.0.0.1.
  719. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-1-send-thread], Shutting down
  720. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-1-send-thread], Stopped
  721. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-1-send-thread], Shutdown completed
  722. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-0-send-thread], Shutting down
  723. 2015-08-05 15:33:06 Utils$ [WARN] sleep interrupted
  724. java.lang.InterruptedException: sleep interrupted
  725. at java.lang.Thread.sleep(Native Method)
  726. at kafka.controller.RequestSendThread$$anonfun$liftedTree1$1$1.apply$mcV$sp(ControllerChannelManager.scala:144)
  727. at kafka.utils.Utils$.swallow(Utils.scala:172)
  728. at kafka.utils.Logging$class.swallowWarn(Logging.scala:92)
  729. at kafka.utils.Utils$.swallowWarn(Utils.scala:45)
  730. at kafka.utils.Logging$class.swallow(Logging.scala:94)
  731. at kafka.utils.Utils$.swallow(Utils.scala:45)
  732. at kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:144)
  733. at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:131)
  734. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
  735. 2015-08-05 15:33:06 RequestSendThread [ERROR] [Controller-0-to-broker-0-send-thread], Controller 0 fails to send a request to broker id:0,host:localhost,port:35037
  736. java.lang.NullPointerException
  737. at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:152)
  738. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
  739. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-0-send-thread], Stopped
  740. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-0-to-broker-0-send-thread], Shutdown completed
  741. 2015-08-05 15:33:06 ZkEventThread [INFO] Terminate ZkClient event thread.
  742. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 0], shut down completed
  743. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 1], shutting down
  744. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 1], Starting controlled shutdown
  745. 2015-08-05 15:33:06 Utils$ [WARN] Controller doesn't exist
  746. kafka.common.KafkaException: Controller doesn't exist
  747. at kafka.utils.ZkUtils$.getController(ZkUtils.scala:67)
  748. at kafka.server.KafkaServer.kafka$server$KafkaServer$$controlledShutdown(KafkaServer.scala:194)
  749. at kafka.server.KafkaServer$$anonfun$shutdown$1.apply$mcV$sp(KafkaServer.scala:269)
  750. at kafka.utils.Utils$.swallow(Utils.scala:172)
  751. at kafka.utils.Logging$class.swallowWarn(Logging.scala:92)
  752. at kafka.utils.Utils$.swallowWarn(Utils.scala:45)
  753. at kafka.utils.Logging$class.swallow(Logging.scala:94)
  754. at kafka.utils.Utils$.swallow(Utils.scala:45)
  755. at kafka.server.KafkaServer.shutdown(KafkaServer.scala:269)
  756. at org.apache.samza.test.integration.TestStatefulTask$.afterCleanLogDirs(TestStatefulTask.scala:169)
  757. at org.apache.samza.test.integration.TestStatefulTask.afterCleanLogDirs(TestStatefulTask.scala)
  758. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  759. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  760. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  761. at java.lang.reflect.Method.invoke(Method.java:497)
  762. at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
  763. at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
  764. at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
  765. at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:37)
  766. at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
  767. at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:86)
  768. at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:49)
  769. at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
  770. at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:48)
  771. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  772. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  773. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  774. at java.lang.reflect.Method.invoke(Method.java:497)
  775. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
  776. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
  777. at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
  778. at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
  779. at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
  780. at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:105)
  781. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  782. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  783. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  784. at java.lang.reflect.Method.invoke(Method.java:497)
  785. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
  786. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
  787. at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
  788. at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:64)
  789. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  790. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  791. at java.lang.Thread.run(Thread.java:745)
  792. 2015-08-05 15:33:06 SocketServer [INFO] [Socket Server on Broker 1], Shutting down
  793. 2015-08-05 15:33:06 SocketServer [INFO] [Socket Server on Broker 1], Shutdown completed
  794. 2015-08-05 15:33:06 KafkaRequestHandlerPool [INFO] [Kafka Request Handler on Broker 1], shutting down
  795. 2015-08-05 15:33:06 ZookeeperLeaderElector [INFO] 2 successfully elected as leader
  796. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Broker 2 starting become controller state transition
  797. 2015-08-05 15:33:06 ZkUtils$ [INFO] conflict in /controller data: {"version":1,"brokerid":1,"timestamp":"1438781586268"} stored data: {"version":1,"brokerid":2,"timestamp":"1438781586267"}
  798. 2015-08-05 15:33:06 KafkaRequestHandlerPool [INFO] [Kafka Request Handler on Broker 1], shut down completely
  799. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Initialized controller epoch to 1 and zk version 0
  800. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Controller 2 incremented epoch to 2
  801. 2015-08-05 15:33:06 ZookeeperLeaderElector$LeaderChangeListener [INFO] New leader is 2
  802. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-1-send-thread], Controller 2 connected to id:1,host:localhost,port:55192 for sending state change requests
  803. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-2-send-thread], Controller 2 connected to id:2,host:localhost,port:52827 for sending state change requests
  804. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-2-send-thread], Starting
  805. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-1-send-thread], Starting
  806. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Partitions undergoing preferred replica election:
  807. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Partitions that completed preferred replica election:
  808. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Resuming preferred replica election for partitions:
  809. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Partitions being reassigned: Map()
  810. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Partitions already reassigned: List()
  811. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Resuming reassignment of partitions: Map()
  812. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: List of topics to be deleted:
  813. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: List of topics ineligible for deletion: input
  814. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Currently active brokers in the cluster: Set(1, 2)
  815. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Currently shutting brokers in the cluster: Set()
  816. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Current list of topics in the cluster: Set(__samza_coordinator_hello-stateful-world_1, input, mystoreChangelog)
  817. 2015-08-05 15:33:06 ReplicaStateMachine [INFO] [Replica state machine on controller 2]: Invoking state change to OnlineReplica for replicas [Topic=input,Partition=0,Replica=1],[Topic=__samza_coordinator_hello-stateful-world_1,Partition=0,Replica=1],[Topic=input,Partition=0,Replica=2],[Topic=mystoreChangelog,Partition=0,Replica=2]
  818. 2015-08-05 15:33:06 ReplicaStateMachine [INFO] [Replica state machine on controller 2]: Started replica state machine with initial state -> Map([Topic=input,Partition=0,Replica=1] -> OnlineReplica, [Topic=input,Partition=0,Replica=0] -> ReplicaDeletionIneligible, [Topic=input,Partition=0,Replica=2] -> OnlineReplica, [Topic=__samza_coordinator_hello-stateful-world_1,Partition=0,Replica=1] -> OnlineReplica, [Topic=mystoreChangelog,Partition=0,Replica=2] -> OnlineReplica)
  819. 2015-08-05 15:33:06 RequestSendThread [WARN] [Controller-2-to-broker-1-send-thread], Controller 2 epoch 2 fails to send request Name:LeaderAndIsrRequest;Version:0;Controller:2;ControllerEpoch:2;CorrelationId:0;ClientId:id_2-host_localhost-port_52827;Leaders:id:1,host:localhost,port:55192,id:2,host:localhost,port:52827;PartitionState:(input,0) -> (LeaderAndIsrInfo:(Leader:2,ISR:2,1,LeaderEpoch:1,ControllerEpoch:1),ReplicationFactor:3),AllReplicas:2,0,1),(__samza_coordinator_hello-stateful-world_1,0) -> (LeaderAndIsrInfo:(Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1),ReplicationFactor:1),AllReplicas:1) to broker id:1,host:localhost,port:55192. Reconnecting to broker.
  820. java.nio.channels.ClosedChannelException
  821. at kafka.network.BlockingChannel.send(BlockingChannel.scala:100)
  822. at kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:132)
  823. at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:131)
  824. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
  825. 2015-08-05 15:33:06 logger [WARN] Broker 2 ignoring LeaderAndIsr request from controller 2 with correlation id 0 epoch 2 for partition [input,0] since its associated leader epoch 1 is old. Current leader epoch is 1
  826. 2015-08-05 15:33:06 logger [WARN] Broker 2 ignoring LeaderAndIsr request from controller 2 with correlation id 0 epoch 2 for partition [mystoreChangelog,0] since its associated leader epoch 0 is old. Current leader epoch is 0
  827. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-1-send-thread], Controller 2 connected to id:1,host:localhost,port:55192 for sending state change requests
  828. 2015-08-05 15:33:06 PartitionStateMachine [INFO] [Partition state machine on Controller 2]: Started partition state machine with initial state -> Map([input,0] -> OnlinePartition, [__samza_coordinator_hello-stateful-world_1,0] -> OnlinePartition, [mystoreChangelog,0] -> OnlinePartition)
  829. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Broker 2 is ready to serve as the new controller with epoch 2
  830. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Starting preferred replica leader election for partitions
  831. 2015-08-05 15:33:06 PartitionStateMachine [INFO] [Partition state machine on Controller 2]: Invoking state change to OnlinePartition for partitions
  832. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: starting the partition rebalance scheduler
  833. 2015-08-05 15:33:06 ZookeeperLeaderElector$LeaderChangeListener [INFO] New leader is 2
  834. 2015-08-05 15:33:06 ReplicaManager [INFO] [Replica Manager on Broker 1]: Shut down
  835. 2015-08-05 15:33:06 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 1] shutting down
  836. 2015-08-05 15:33:06 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Shutting down
  837. 2015-08-05 15:33:06 RequestSendThread [WARN] [Controller-2-to-broker-1-send-thread], Controller 2 epoch 2 fails to send request Name:LeaderAndIsrRequest;Version:0;Controller:2;ControllerEpoch:2;CorrelationId:0;ClientId:id_2-host_localhost-port_52827;Leaders:id:1,host:localhost,port:55192,id:2,host:localhost,port:52827;PartitionState:(input,0) -> (LeaderAndIsrInfo:(Leader:2,ISR:2,1,LeaderEpoch:1,ControllerEpoch:1),ReplicationFactor:3),AllReplicas:2,0,1),(__samza_coordinator_hello-stateful-world_1,0) -> (LeaderAndIsrInfo:(Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1),ReplicationFactor:1),AllReplicas:1) to broker id:1,host:localhost,port:55192. Reconnecting to broker.
  838. java.nio.channels.ClosedChannelException
  839. at kafka.network.BlockingChannel.send(BlockingChannel.scala:100)
  840. at kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:132)
  841. at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:131)
  842. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
  843. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-1-send-thread], Controller 2 connected to id:1,host:localhost,port:55192 for sending state change requests
  844. 2015-08-05 15:33:06 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Stopped
  845. 2015-08-05 15:33:06 ReplicaFetcherThread [INFO] [ReplicaFetcherThread-0-2], Shutdown completed
  846. 2015-08-05 15:33:06 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 1] shutdown completed
  847. 2015-08-05 15:33:06 Processor [INFO] Closing socket connection to /127.0.0.1.
  848. 2015-08-05 15:33:06 ReplicaManager [INFO] [Replica Manager on Broker 1]: Shut down completely
  849. 2015-08-05 15:33:06 LogManager [INFO] Shutting down.
  850. 2015-08-05 15:33:06 LogManager [INFO] Shutdown complete.
  851. 2015-08-05 15:33:06 Utils$ [WARN] Kafka scheduler has not been started
  852. java.lang.IllegalStateException: Kafka scheduler has not been started
  853. at kafka.utils.KafkaScheduler.ensureStarted(KafkaScheduler.scala:114)
  854. at kafka.utils.KafkaScheduler.shutdown(KafkaScheduler.scala:86)
  855. at kafka.controller.KafkaController.onControllerResignation(KafkaController.scala:350)
  856. at kafka.controller.KafkaController.shutdown(KafkaController.scala:664)
  857. at kafka.server.KafkaServer$$anonfun$shutdown$8.apply$mcV$sp(KafkaServer.scala:285)
  858. at kafka.utils.Utils$.swallow(Utils.scala:172)
  859. at kafka.utils.Logging$class.swallowWarn(Logging.scala:92)
  860. at kafka.utils.Utils$.swallowWarn(Utils.scala:45)
  861. at kafka.utils.Logging$class.swallow(Logging.scala:94)
  862. at kafka.utils.Utils$.swallow(Utils.scala:45)
  863. at kafka.server.KafkaServer.shutdown(KafkaServer.scala:285)
  864. at org.apache.samza.test.integration.TestStatefulTask$.afterCleanLogDirs(TestStatefulTask.scala:169)
  865. at org.apache.samza.test.integration.TestStatefulTask.afterCleanLogDirs(TestStatefulTask.scala)
  866. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  867. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  868. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  869. at java.lang.reflect.Method.invoke(Method.java:497)
  870. at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
  871. at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
  872. at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
  873. at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:37)
  874. at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
  875. at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:86)
  876. at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:49)
  877. at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
  878. at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:48)
  879. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  880. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  881. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  882. at java.lang.reflect.Method.invoke(Method.java:497)
  883. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
  884. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
  885. at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
  886. at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
  887. at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
  888. at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:105)
  889. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  890. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  891. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  892. at java.lang.reflect.Method.invoke(Method.java:497)
  893. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
  894. at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
  895. at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
  896. at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:64)
  897. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  898. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  899. at java.lang.Thread.run(Thread.java:745)
  900. 2015-08-05 15:33:06 ZkEventThread [INFO] Terminate ZkClient event thread.
  901. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 1], shut down completed
  902. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 2], shutting down
  903. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 2], Starting controlled shutdown
  904. 2015-08-05 15:33:06 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 2]: Broker change listener fired for path /brokers/ids with children 2
  905. 2015-08-05 15:33:06 ZookeeperConsumerConnector [INFO] [testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041], stopping watcher executor thread for consumer testShouldRestoreStore_jjung-VirtualBox-1438781585688-ba440041
  906. 2015-08-05 15:33:06 ReplicaStateMachine$BrokerChangeListener [INFO] [BrokerChangeListener on Controller 2]: Newly added brokers: , deleted brokers: 1, all live brokers: 2
  907. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-1-send-thread], Shutting down
  908. 2015-08-05 15:33:06 Utils$ [WARN] sleep interrupted
  909. java.lang.InterruptedException: sleep interrupted
  910. at java.lang.Thread.sleep(Native Method)
  911. at kafka.controller.RequestSendThread$$anonfun$liftedTree1$1$1.apply$mcV$sp(ControllerChannelManager.scala:144)
  912. at kafka.utils.Utils$.swallow(Utils.scala:172)
  913. at kafka.utils.Logging$class.swallowWarn(Logging.scala:92)
  914. at kafka.utils.Utils$.swallowWarn(Utils.scala:45)
  915. at kafka.utils.Logging$class.swallow(Logging.scala:94)
  916. at kafka.utils.Utils$.swallow(Utils.scala:45)
  917. at kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:144)
  918. at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:131)
  919. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
  920. 2015-08-05 15:33:06 RequestSendThread [ERROR] [Controller-2-to-broker-1-send-thread], Controller 2 fails to send a request to broker id:1,host:localhost,port:55192
  921. java.lang.NullPointerException
  922. at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:150)
  923. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
  924. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-1-send-thread], Stopped
  925. 2015-08-05 15:33:06 RequestSendThread [INFO] [Controller-2-to-broker-1-send-thread], Shutdown completed
  926. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Broker failure callback for 1
  927. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Removed ArrayBuffer() from list of shutting down brokers.
  928. 2015-08-05 15:33:06 PartitionStateMachine [INFO] [Partition state machine on Controller 2]: Invoking state change to OfflinePartition for partitions [__samza_coordinator_hello-stateful-world_1,0]
  929. 2015-08-05 15:33:06 logger [ERROR] Controller 2 epoch 2 initiated state change for partition [__samza_coordinator_hello-stateful-world_1,0] from OfflinePartition to OnlinePartition failed
  930. kafka.common.NoReplicaOnlineException: No replica for partition [__samza_coordinator_hello-stateful-world_1,0] is alive. Live brokers are: [Set(2)], Assigned replicas are: [List(1)]
  931. at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
  932. at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:357)
  933. at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:206)
  934. at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
  935. at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
  936. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
  937. at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98)
  938. at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98)
  939. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:226)
  940. at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
  941. at scala.collection.mutable.HashMap.foreach(HashMap.scala:98)
  942. at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
  943. at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
  944. at kafka.controller.KafkaController.onBrokerFailure(KafkaController.scala:446)
  945. at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(ReplicaStateMachine.scala:373)
  946. at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1$$anonfun$apply$mcV$sp$1.apply(ReplicaStateMachine.scala:359)
  947. at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1$$anonfun$apply$mcV$sp$1.apply(ReplicaStateMachine.scala:359)
  948. at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
  949. at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1.apply$mcV$sp(ReplicaStateMachine.scala:358)
  950. at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1.apply(ReplicaStateMachine.scala:357)
  951. at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1.apply(ReplicaStateMachine.scala:357)
  952. at kafka.utils.Utils$.inLock(Utils.scala:535)
  953. at kafka.controller.ReplicaStateMachine$BrokerChangeListener.handleChildChange(ReplicaStateMachine.scala:356)
  954. at org.I0Itec.zkclient.ZkClient$7.run(ZkClient.java:568)
  955. at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
  956. 2015-08-05 15:33:06 ReplicaStateMachine [INFO] [Replica state machine on controller 2]: Invoking state change to OfflineReplica for replicas [Topic=input,Partition=0,Replica=1],[Topic=__samza_coordinator_hello-stateful-world_1,Partition=0,Replica=1]
  957. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: New leader and ISR for partition [input,0] is {"leader":2,"leader_epoch":2,"isr":[2]}
  958. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: New leader and ISR for partition [__samza_coordinator_hello-stateful-world_1,0] is {"leader":-1,"leader_epoch":1,"isr":[]}
  959. 2015-08-05 15:33:06 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 2] Removed fetcher for partitions [input,0]
  960. 2015-08-05 15:33:06 ControllerChannelManager [WARN] [Channel manager on controller 2]: Not sending request Name:LeaderAndIsrRequest;Version:0;Controller:2;ControllerEpoch:2;CorrelationId:6;ClientId:id_2-host_localhost-port_52827;Leaders:id:2,host:localhost,port:52827;PartitionState:(input,0) -> (LeaderAndIsrInfo:(Leader:2,ISR:2,LeaderEpoch:2,ControllerEpoch:2),ReplicationFactor:3),AllReplicas:2,0,1) to broker 0, since it is offline.
  961. 2015-08-05 15:33:06 ControllerChannelManager [WARN] [Channel manager on controller 2]: Not sending request Name: StopReplicaRequest; Version: 0; CorrelationId: 6; ClientId: ; DeletePartitions: false; ControllerId: 2; ControllerEpoch: 2; Partitions: [input,0] to broker 1, since it is offline.
  962. 2015-08-05 15:33:06 ControllerChannelManager [WARN] [Channel manager on controller 2]: Not sending request Name: StopReplicaRequest; Version: 0; CorrelationId: 6; ClientId: ; DeletePartitions: false; ControllerId: 2; ControllerEpoch: 2; Partitions: [__samza_coordinator_hello-stateful-world_1,0] to broker 1, since it is offline.
  963. 2015-08-05 15:33:06 KafkaController [INFO] [Controller 2]: Shutting down broker 2
  964. 2015-08-05 15:33:06 PartitionStateMachine [INFO] [Partition state machine on Controller 2]: Invoking state change to OnlinePartition for partitions [input,0]
  965. 2015-08-05 15:33:06 logger [ERROR] Controller 2 epoch 2 encountered error while electing leader for partition [input,0] due to: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2.
  966. 2015-08-05 15:33:06 logger [ERROR] Controller 2 epoch 2 initiated state change for partition [input,0] from OnlinePartition to OnlinePartition failed
  967. kafka.common.StateChangeFailedException: encountered error while electing leader for partition [input,0] due to: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2.
  968. at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:380)
  969. at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:208)
  970. at kafka.controller.PartitionStateMachine$$anonfun$handleStateChanges$2.apply(PartitionStateMachine.scala:146)
  971. at kafka.controller.PartitionStateMachine$$anonfun$handleStateChanges$2.apply(PartitionStateMachine.scala:145)
  972. at scala.collection.immutable.Set$Set1.foreach(Set.scala:74)
  973. at kafka.controller.PartitionStateMachine.handleStateChanges(PartitionStateMachine.scala:145)
  974. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1$$anonfun$apply$mcV$sp$3.apply(KafkaController.scala:258)
  975. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1$$anonfun$apply$mcV$sp$3.apply(KafkaController.scala:253)
  976. at scala.Option.foreach(Option.scala:236)
  977. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply$mcV$sp(KafkaController.scala:253)
  978. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply(KafkaController.scala:253)
  979. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply(KafkaController.scala:253)
  980. at kafka.utils.Utils$.inLock(Utils.scala:535)
  981. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3.apply(KafkaController.scala:252)
  982. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3.apply(KafkaController.scala:249)
  983. at scala.collection.immutable.Set$Set2.foreach(Set.scala:94)
  984. at kafka.controller.KafkaController.shutdownBroker(KafkaController.scala:249)
  985. at kafka.server.KafkaApis.handleControlledShutdownRequest(KafkaApis.scala:154)
  986. at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
  987. at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:59)
  988. at java.lang.Thread.run(Thread.java:745)
  989. Caused by: kafka.common.StateChangeFailedException: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2
  990. at kafka.controller.ControlledShutdownLeaderSelector.selectLeader(PartitionLeaderSelector.scala:196)
  991. at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:357)
  992. ... 20 more
  993. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 2], Remaining partitions to move: [input,0]
  994. 2015-08-05 15:33:06 KafkaServer [INFO] [Kafka Server 2], Error code from controller: 0
  995. 2015-08-05 15:33:11 KafkaServer [WARN] [Kafka Server 2], Retrying controlled shutdown after the previous attempt failed...
  996. 2015-08-05 15:33:11 KafkaController [INFO] [Controller 2]: Shutting down broker 2
  997. 2015-08-05 15:33:11 PartitionStateMachine [INFO] [Partition state machine on Controller 2]: Invoking state change to OnlinePartition for partitions [input,0]
  998. 2015-08-05 15:33:11 logger [ERROR] Controller 2 epoch 2 encountered error while electing leader for partition [input,0] due to: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2.
  999. 2015-08-05 15:33:11 logger [ERROR] Controller 2 epoch 2 initiated state change for partition [input,0] from OnlinePartition to OnlinePartition failed
  1000. kafka.common.StateChangeFailedException: encountered error while electing leader for partition [input,0] due to: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2.
  1001. at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:380)
  1002. at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:208)
  1003. at kafka.controller.PartitionStateMachine$$anonfun$handleStateChanges$2.apply(PartitionStateMachine.scala:146)
  1004. at kafka.controller.PartitionStateMachine$$anonfun$handleStateChanges$2.apply(PartitionStateMachine.scala:145)
  1005. at scala.collection.immutable.Set$Set1.foreach(Set.scala:74)
  1006. at kafka.controller.PartitionStateMachine.handleStateChanges(PartitionStateMachine.scala:145)
  1007. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1$$anonfun$apply$mcV$sp$3.apply(KafkaController.scala:258)
  1008. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1$$anonfun$apply$mcV$sp$3.apply(KafkaController.scala:253)
  1009. at scala.Option.foreach(Option.scala:236)
  1010. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply$mcV$sp(KafkaController.scala:253)
  1011. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply(KafkaController.scala:253)
  1012. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply(KafkaController.scala:253)
  1013. at kafka.utils.Utils$.inLock(Utils.scala:535)
  1014. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3.apply(KafkaController.scala:252)
  1015. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3.apply(KafkaController.scala:249)
  1016. at scala.collection.immutable.Set$Set2.foreach(Set.scala:94)
  1017. at kafka.controller.KafkaController.shutdownBroker(KafkaController.scala:249)
  1018. at kafka.server.KafkaApis.handleControlledShutdownRequest(KafkaApis.scala:154)
  1019. at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
  1020. at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:59)
  1021. at java.lang.Thread.run(Thread.java:745)
  1022. Caused by: kafka.common.StateChangeFailedException: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2
  1023. at kafka.controller.ControlledShutdownLeaderSelector.selectLeader(PartitionLeaderSelector.scala:196)
  1024. at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:357)
  1025. ... 20 more
  1026. 2015-08-05 15:33:11 KafkaServer [INFO] [Kafka Server 2], Remaining partitions to move: [input,0]
  1027. 2015-08-05 15:33:11 KafkaServer [INFO] [Kafka Server 2], Error code from controller: 0
  1028. 2015-08-05 15:33:16 KafkaServer [WARN] [Kafka Server 2], Retrying controlled shutdown after the previous attempt failed...
  1029. 2015-08-05 15:33:16 KafkaController [INFO] [Controller 2]: Shutting down broker 2
  1030. 2015-08-05 15:33:16 PartitionStateMachine [INFO] [Partition state machine on Controller 2]: Invoking state change to OnlinePartition for partitions [input,0]
  1031. 2015-08-05 15:33:16 logger [ERROR] Controller 2 epoch 2 encountered error while electing leader for partition [input,0] due to: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2.
  1032. 2015-08-05 15:33:16 logger [ERROR] Controller 2 epoch 2 initiated state change for partition [input,0] from OnlinePartition to OnlinePartition failed
  1033. kafka.common.StateChangeFailedException: encountered error while electing leader for partition [input,0] due to: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2.
  1034. at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:380)
  1035. at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:208)
  1036. at kafka.controller.PartitionStateMachine$$anonfun$handleStateChanges$2.apply(PartitionStateMachine.scala:146)
  1037. at kafka.controller.PartitionStateMachine$$anonfun$handleStateChanges$2.apply(PartitionStateMachine.scala:145)
  1038. at scala.collection.immutable.Set$Set1.foreach(Set.scala:74)
  1039. at kafka.controller.PartitionStateMachine.handleStateChanges(PartitionStateMachine.scala:145)
  1040. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1$$anonfun$apply$mcV$sp$3.apply(KafkaController.scala:258)
  1041. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1$$anonfun$apply$mcV$sp$3.apply(KafkaController.scala:253)
  1042. at scala.Option.foreach(Option.scala:236)
  1043. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply$mcV$sp(KafkaController.scala:253)
  1044. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply(KafkaController.scala:253)
  1045. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3$$anonfun$apply$1.apply(KafkaController.scala:253)
  1046. at kafka.utils.Utils$.inLock(Utils.scala:535)
  1047. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3.apply(KafkaController.scala:252)
  1048. at kafka.controller.KafkaController$$anonfun$shutdownBroker$3.apply(KafkaController.scala:249)
  1049. at scala.collection.immutable.Set$Set2.foreach(Set.scala:94)
  1050. at kafka.controller.KafkaController.shutdownBroker(KafkaController.scala:249)
  1051. at kafka.server.KafkaApis.handleControlledShutdownRequest(KafkaApis.scala:154)
  1052. at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
  1053. at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:59)
  1054. at java.lang.Thread.run(Thread.java:745)
  1055. Caused by: kafka.common.StateChangeFailedException: No other replicas in ISR 2 for [input,0] besides shutting down brokers 2
  1056. at kafka.controller.ControlledShutdownLeaderSelector.selectLeader(PartitionLeaderSelector.scala:196)
  1057. at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:357)
  1058. ... 20 more
  1059. 2015-08-05 15:33:16 KafkaServer [INFO] [Kafka Server 2], Remaining partitions to move: [input,0]
  1060. 2015-08-05 15:33:16 KafkaServer [INFO] [Kafka Server 2], Error code from controller: 0
  1061. 2015-08-05 15:33:21 KafkaServer [WARN] [Kafka Server 2], Retrying controlled shutdown after the previous attempt failed...
  1062. 2015-08-05 15:33:21 Processor [INFO] Closing socket connection to /127.0.0.1.
  1063. 2015-08-05 15:33:21 KafkaServer [WARN] [Kafka Server 2], Proceeding to do an unclean shutdown as all the controlled shutdown attempts failed
  1064. 2015-08-05 15:33:21 SocketServer [INFO] [Socket Server on Broker 2], Shutting down
  1065. 2015-08-05 15:33:21 SocketServer [INFO] [Socket Server on Broker 2], Shutdown completed
  1066. 2015-08-05 15:33:21 KafkaRequestHandlerPool [INFO] [Kafka Request Handler on Broker 2], shutting down
  1067. 2015-08-05 15:33:21 KafkaRequestHandlerPool [INFO] [Kafka Request Handler on Broker 2], shut down completely
  1068. 2015-08-05 15:33:22 ReplicaManager [INFO] [Replica Manager on Broker 2]: Shut down
  1069. 2015-08-05 15:33:22 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 2] shutting down
  1070. 2015-08-05 15:33:22 ReplicaFetcherManager [INFO] [ReplicaFetcherManager on broker 2] shutdown completed
  1071. 2015-08-05 15:33:22 ReplicaManager [INFO] [Replica Manager on Broker 2]: Shut down completely
  1072. 2015-08-05 15:33:22 LogManager [INFO] Shutting down.
  1073. 2015-08-05 15:33:22 LogManager [INFO] Shutdown complete.
  1074. 2015-08-05 15:33:22 PartitionStateMachine [INFO] [Partition state machine on Controller 2]: Stopped partition state machine
  1075. 2015-08-05 15:33:22 ReplicaStateMachine [INFO] [Replica state machine on controller 2]: Stopped replica state machine
  1076. 2015-08-05 15:33:22 RequestSendThread [INFO] [Controller-2-to-broker-2-send-thread], Shutting down
  1077. 2015-08-05 15:33:22 RequestSendThread [INFO] [Controller-2-to-broker-2-send-thread], Stopped
  1078. 2015-08-05 15:33:22 RequestSendThread [INFO] [Controller-2-to-broker-2-send-thread], Shutdown completed
  1079. 2015-08-05 15:33:22 ZkEventThread [INFO] Terminate ZkClient event thread.
  1080. 2015-08-05 15:33:22 KafkaServer [INFO] [Kafka Server 2], shut down completed
  1081. 2015-08-05 15:33:22 ZkEventThread [INFO] Terminate ZkClient event thread.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!