Guest User

Untitled

a guest
Nov 7th, 2017
243
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 90.23 KB | None | 0 0
  1. INFO 2017-11-07 17:35:47,222 0 org.apache.kafka.clients.producer.ProducerConfig [main] ProducerConfig values:
  2. acks = all
  3. batch.size = 16384
  4. bootstrap.servers = [kafka-kafka.kafka.svc.cluster.local:9092]
  5. buffer.memory = 33554432
  6. client.id =
  7. compression.type = none
  8. connections.max.idle.ms = 540000
  9. enable.idempotence = false
  10. interceptor.classes = null
  11. key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
  12. linger.ms = 0
  13. max.block.ms = 60000
  14. max.in.flight.requests.per.connection = 5
  15. max.request.size = 1048576
  16. metadata.max.age.ms = 300000
  17. metric.reporters = []
  18. metrics.num.samples = 2
  19. metrics.recording.level = INFO
  20. metrics.sample.window.ms = 30000
  21. partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
  22. receive.buffer.bytes = 32768
  23. reconnect.backoff.max.ms = 1000
  24. reconnect.backoff.ms = 50
  25. request.timeout.ms = 30000
  26. retries = 1
  27. retry.backoff.ms = 100
  28. sasl.jaas.config = null
  29. sasl.kerberos.kinit.cmd = /usr/bin/kinit
  30. sasl.kerberos.min.time.before.relogin = 60000
  31. sasl.kerberos.service.name = null
  32. sasl.kerberos.ticket.renew.jitter = 0.05
  33. sasl.kerberos.ticket.renew.window.factor = 0.8
  34. sasl.mechanism = GSSAPI
  35. security.protocol = PLAINTEXT
  36. send.buffer.bytes = 131072
  37. ssl.cipher.suites = null
  38. ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
  39. ssl.endpoint.identification.algorithm = null
  40. ssl.key.password = null
  41. ssl.keymanager.algorithm = SunX509
  42. ssl.keystore.location = null
  43. ssl.keystore.password = null
  44. ssl.keystore.type = JKS
  45. ssl.protocol = TLS
  46. ssl.provider = null
  47. ssl.secure.random.implementation = null
  48. ssl.trustmanager.algorithm = PKIX
  49. ssl.truststore.location = null
  50. ssl.truststore.password = null
  51. ssl.truststore.type = JKS
  52. transaction.timeout.ms = 60000
  53. transactional.id = null
  54. value.serializer = class io.confluent.kafka.serializers.KafkaAvroSerializer
  55.  
  56. INFO 2017-11-07 17:35:47,729 507 io.confluent.kafka.serializers.KafkaAvroSerializerConfig [main] KafkaAvroSerializerConfig values:
  57. schema.registry.url = [http://sad-squid-schema-registry.schema-registry.svc.cluster.local:8000]
  58. max.schemas.per.subject = 1000
  59.  
  60. DEBUG 2017-11-07 17:35:48,729 1507 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bufferpool-wait-time
  61. DEBUG 2017-11-07 17:35:48,732 1510 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name buffer-exhausted-records
  62. DEBUG 2017-11-07 17:35:48,825 1603 org.apache.kafka.clients.Metadata [main] Updated cluster metadata version 1 to Cluster(id = null, nodes = [kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)], partitions = [])
  63. DEBUG 2017-11-07 17:35:48,831 1609 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name produce-throttle-time
  64. DEBUG 2017-11-07 17:35:48,839 1617 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-closed:
  65. DEBUG 2017-11-07 17:35:48,840 1618 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-created:
  66. DEBUG 2017-11-07 17:35:48,840 1618 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent-received:
  67. DEBUG 2017-11-07 17:35:48,840 1618 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent:
  68. DEBUG 2017-11-07 17:35:48,840 1618 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-received:
  69. DEBUG 2017-11-07 17:35:48,841 1619 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name select-time:
  70. DEBUG 2017-11-07 17:35:48,841 1619 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name io-time:
  71. DEBUG 2017-11-07 17:35:48,925 1703 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name batch-size
  72. DEBUG 2017-11-07 17:35:48,925 1703 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name compression-rate
  73. DEBUG 2017-11-07 17:35:48,925 1703 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name queue-time
  74. DEBUG 2017-11-07 17:35:48,926 1704 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name request-time
  75. DEBUG 2017-11-07 17:35:48,926 1704 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name records-per-request
  76. DEBUG 2017-11-07 17:35:48,926 1704 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name record-retries
  77. DEBUG 2017-11-07 17:35:48,926 1704 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name errors
  78. DEBUG 2017-11-07 17:35:48,926 1704 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name record-size-max
  79. DEBUG 2017-11-07 17:35:48,927 1705 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name batch-split-rate
  80. INFO 2017-11-07 17:35:48,932 1710 org.apache.kafka.common.utils.AppInfoParser [main] Kafka version : 0.11.0.1
  81. INFO 2017-11-07 17:35:48,932 1710 org.apache.kafka.common.utils.AppInfoParser [main] Kafka commitId : c2a0d5f9b1f45bf5
  82. DEBUG 2017-11-07 17:35:48,933 1711 org.apache.kafka.clients.producer.KafkaProducer [main] Kafka producer with client id producer-1 created
  83. DEBUG 2017-11-07 17:35:49,018 1796 org.apache.kafka.clients.producer.internals.Sender [kafka-producer-network-thread | producer-1] Starting Kafka producer I/O thread.
  84. INFO 2017-11-07 17:35:49,037 1815 org.apache.kafka.streams.StreamsConfig [main] StreamsConfig values:
  85. application.id = invoices
  86. application.server =
  87. bootstrap.servers = [kafka-kafka.kafka.svc.cluster.local:9092]
  88. buffered.records.per.partition = 1000
  89. cache.max.bytes.buffering = 10485760
  90. client.id =
  91. commit.interval.ms = 30000
  92. connections.max.idle.ms = 540000
  93. default.key.serde = class org.apache.kafka.common.serialization.Serdes$ByteArraySerde
  94. default.timestamp.extractor = class org.apache.kafka.streams.processor.FailOnInvalidTimestamp
  95. default.value.serde = class io.confluent.kafka.streams.serdes.avro.SpecificAvroSerde
  96. key.serde = null
  97. metadata.max.age.ms = 300000
  98. metric.reporters = []
  99. metrics.num.samples = 2
  100. metrics.recording.level = INFO
  101. metrics.sample.window.ms = 30000
  102. num.standby.replicas = 0
  103. num.stream.threads = 1
  104. partition.grouper = class org.apache.kafka.streams.processor.DefaultPartitionGrouper
  105. poll.ms = 100
  106. processing.guarantee = at_least_once
  107. receive.buffer.bytes = 32768
  108. reconnect.backoff.max.ms = 1000
  109. reconnect.backoff.ms = 50
  110. replication.factor = 1
  111. request.timeout.ms = 40000
  112. retry.backoff.ms = 100
  113. rocksdb.config.setter = null
  114. security.protocol = PLAINTEXT
  115. send.buffer.bytes = 131072
  116. state.cleanup.delay.ms = 600000
  117. state.dir = /tmp/kafka-streams
  118. timestamp.extractor = null
  119. value.serde = null
  120. windowstore.changelog.additional.retention.ms = 86400000
  121. zookeeper.connect =
  122.  
  123. INFO 2017-11-07 17:35:49,227 2005 org.apache.kafka.clients.consumer.ConsumerConfig [main] ConsumerConfig values:
  124. auto.commit.interval.ms = 5000
  125. auto.offset.reset = earliest
  126. bootstrap.servers = [kafka-kafka.kafka.svc.cluster.local:9092]
  127. check.crcs = true
  128. client.id = invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-global-restore-consumer
  129. connections.max.idle.ms = 540000
  130. enable.auto.commit = false
  131. exclude.internal.topics = true
  132. fetch.max.bytes = 52428800
  133. fetch.max.wait.ms = 500
  134. fetch.min.bytes = 1
  135. group.id =
  136. heartbeat.interval.ms = 3000
  137. interceptor.classes = null
  138. internal.leave.group.on.close = false
  139. isolation.level = read_uncommitted
  140. key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
  141. max.partition.fetch.bytes = 1048576
  142. max.poll.interval.ms = 2147483647
  143. max.poll.records = 1000
  144. metadata.max.age.ms = 300000
  145. metric.reporters = []
  146. metrics.num.samples = 2
  147. metrics.recording.level = INFO
  148. metrics.sample.window.ms = 30000
  149. partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
  150. receive.buffer.bytes = 65536
  151. reconnect.backoff.max.ms = 1000
  152. reconnect.backoff.ms = 50
  153. request.timeout.ms = 305000
  154. retry.backoff.ms = 100
  155. sasl.jaas.config = null
  156. sasl.kerberos.kinit.cmd = /usr/bin/kinit
  157. sasl.kerberos.min.time.before.relogin = 60000
  158. sasl.kerberos.service.name = null
  159. sasl.kerberos.ticket.renew.jitter = 0.05
  160. sasl.kerberos.ticket.renew.window.factor = 0.8
  161. sasl.mechanism = GSSAPI
  162. security.protocol = PLAINTEXT
  163. send.buffer.bytes = 131072
  164. session.timeout.ms = 10000
  165. ssl.cipher.suites = null
  166. ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
  167. ssl.endpoint.identification.algorithm = null
  168. ssl.key.password = null
  169. ssl.keymanager.algorithm = SunX509
  170. ssl.keystore.location = null
  171. ssl.keystore.password = null
  172. ssl.keystore.type = JKS
  173. ssl.protocol = TLS
  174. ssl.provider = null
  175. ssl.secure.random.implementation = null
  176. ssl.trustmanager.algorithm = PKIX
  177. ssl.truststore.location = null
  178. ssl.truststore.password = null
  179. ssl.truststore.type = JKS
  180. value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
  181.  
  182. DEBUG 2017-11-07 17:35:49,227 2005 org.apache.kafka.clients.consumer.KafkaConsumer [main] Starting the Kafka consumer
  183. DEBUG 2017-11-07 17:35:49,319 2097 org.apache.kafka.clients.Metadata [main] Updated cluster metadata version 1 to Cluster(id = null, nodes = [kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)], partitions = [])
  184. DEBUG 2017-11-07 17:35:49,326 2104 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name fetch-throttle-time
  185. DEBUG 2017-11-07 17:35:49,327 2105 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-closed:
  186. DEBUG 2017-11-07 17:35:49,327 2105 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-created:
  187. DEBUG 2017-11-07 17:35:49,327 2105 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent-received:
  188. DEBUG 2017-11-07 17:35:49,327 2105 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent:
  189. DEBUG 2017-11-07 17:35:49,327 2105 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-received:
  190. DEBUG 2017-11-07 17:35:49,327 2105 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name select-time:
  191. DEBUG 2017-11-07 17:35:49,328 2106 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name io-time:
  192. DEBUG 2017-11-07 17:35:49,522 2300 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name heartbeat-latency
  193. DEBUG 2017-11-07 17:35:49,523 2301 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name join-latency
  194. DEBUG 2017-11-07 17:35:49,523 2301 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name sync-latency
  195. DEBUG 2017-11-07 17:35:49,525 2303 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name commit-latency
  196. DEBUG 2017-11-07 17:35:49,527 2305 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-fetched
  197. DEBUG 2017-11-07 17:35:49,528 2306 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name records-fetched
  198. DEBUG 2017-11-07 17:35:49,528 2306 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name fetch-latency
  199. DEBUG 2017-11-07 17:35:49,528 2306 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name records-lag
  200. INFO 2017-11-07 17:35:49,528 2306 org.apache.kafka.common.utils.AppInfoParser [main] Kafka version : 0.11.0.1
  201. INFO 2017-11-07 17:35:49,528 2306 org.apache.kafka.common.utils.AppInfoParser [main] Kafka commitId : c2a0d5f9b1f45bf5
  202. DEBUG 2017-11-07 17:35:49,528 2306 org.apache.kafka.clients.consumer.KafkaConsumer [main] Kafka consumer with client id invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-global-restore-consumer created
  203. DEBUG 2017-11-07 17:35:49,624 2402 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name thread.invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1.commit-latency
  204. DEBUG 2017-11-07 17:35:49,625 2403 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name thread.invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1.poll-latency
  205. DEBUG 2017-11-07 17:35:49,625 2403 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name thread.invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1.process-latency
  206. DEBUG 2017-11-07 17:35:49,625 2403 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name thread.invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1.punctuate-latency
  207. DEBUG 2017-11-07 17:35:49,625 2403 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name thread.invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1.task-created
  208. DEBUG 2017-11-07 17:35:49,625 2403 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name thread.invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1.task-closed
  209. DEBUG 2017-11-07 17:35:49,626 2404 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name thread.invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1.skipped-records
  210. INFO 2017-11-07 17:35:49,626 2404 org.apache.kafka.streams.processor.internals.StreamThread [main] stream-thread [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1] Creating consumer client
  211. INFO 2017-11-07 17:35:49,627 2405 org.apache.kafka.clients.consumer.ConsumerConfig [main] ConsumerConfig values:
  212. auto.commit.interval.ms = 5000
  213. auto.offset.reset = earliest
  214. bootstrap.servers = [kafka-kafka.kafka.svc.cluster.local:9092]
  215. check.crcs = true
  216. client.id = invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1-consumer
  217. connections.max.idle.ms = 540000
  218. enable.auto.commit = false
  219. exclude.internal.topics = true
  220. fetch.max.bytes = 52428800
  221. fetch.max.wait.ms = 500
  222. fetch.min.bytes = 1
  223. group.id = invoices
  224. heartbeat.interval.ms = 3000
  225. interceptor.classes = null
  226. internal.leave.group.on.close = false
  227. isolation.level = read_uncommitted
  228. key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
  229. max.partition.fetch.bytes = 1048576
  230. max.poll.interval.ms = 2147483647
  231. max.poll.records = 1000
  232. metadata.max.age.ms = 300000
  233. metric.reporters = []
  234. metrics.num.samples = 2
  235. metrics.recording.level = INFO
  236. metrics.sample.window.ms = 30000
  237. partition.assignment.strategy = [org.apache.kafka.streams.processor.internals.StreamPartitionAssignor]
  238. receive.buffer.bytes = 65536
  239. reconnect.backoff.max.ms = 1000
  240. reconnect.backoff.ms = 50
  241. request.timeout.ms = 305000
  242. retry.backoff.ms = 100
  243. sasl.jaas.config = null
  244. sasl.kerberos.kinit.cmd = /usr/bin/kinit
  245. sasl.kerberos.min.time.before.relogin = 60000
  246. sasl.kerberos.service.name = null
  247. sasl.kerberos.ticket.renew.jitter = 0.05
  248. sasl.kerberos.ticket.renew.window.factor = 0.8
  249. sasl.mechanism = GSSAPI
  250. security.protocol = PLAINTEXT
  251. send.buffer.bytes = 131072
  252. session.timeout.ms = 10000
  253. ssl.cipher.suites = null
  254. ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
  255. ssl.endpoint.identification.algorithm = null
  256. ssl.key.password = null
  257. ssl.keymanager.algorithm = SunX509
  258. ssl.keystore.location = null
  259. ssl.keystore.password = null
  260. ssl.keystore.type = JKS
  261. ssl.protocol = TLS
  262. ssl.provider = null
  263. ssl.secure.random.implementation = null
  264. ssl.trustmanager.algorithm = PKIX
  265. ssl.truststore.location = null
  266. ssl.truststore.password = null
  267. ssl.truststore.type = JKS
  268. value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
  269.  
  270. DEBUG 2017-11-07 17:35:49,627 2405 org.apache.kafka.clients.consumer.KafkaConsumer [main] Starting the Kafka consumer
  271. DEBUG 2017-11-07 17:35:49,628 2406 org.apache.kafka.clients.Metadata [main] Updated cluster metadata version 1 to Cluster(id = null, nodes = [kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)], partitions = [])
  272. DEBUG 2017-11-07 17:35:49,628 2406 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name fetch-throttle-time
  273. DEBUG 2017-11-07 17:35:49,628 2406 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-closed:
  274. DEBUG 2017-11-07 17:35:49,628 2406 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-created:
  275. DEBUG 2017-11-07 17:35:49,628 2406 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent-received:
  276. DEBUG 2017-11-07 17:35:49,629 2407 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent:
  277. DEBUG 2017-11-07 17:35:49,629 2407 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-received:
  278. DEBUG 2017-11-07 17:35:49,629 2407 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name select-time:
  279. DEBUG 2017-11-07 17:35:49,629 2407 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name io-time:
  280. DEBUG 2017-11-07 17:35:49,722 2500 org.apache.kafka.clients.Metadata [main] Updated cluster metadata version 1 to Cluster(id = null, nodes = [kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)], partitions = [])
  281. DEBUG 2017-11-07 17:35:49,723 2501 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-closed:
  282. DEBUG 2017-11-07 17:35:49,723 2501 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-created:
  283. DEBUG 2017-11-07 17:35:49,723 2501 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent-received:
  284. DEBUG 2017-11-07 17:35:49,724 2502 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent:
  285. DEBUG 2017-11-07 17:35:49,724 2502 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-received:
  286. DEBUG 2017-11-07 17:35:49,724 2502 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name select-time:
  287. DEBUG 2017-11-07 17:35:49,724 2502 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name io-time:
  288. DEBUG 2017-11-07 17:35:49,725 2503 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name heartbeat-latency
  289. DEBUG 2017-11-07 17:35:49,726 2504 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name join-latency
  290. DEBUG 2017-11-07 17:35:49,726 2504 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name sync-latency
  291. DEBUG 2017-11-07 17:35:49,726 2504 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name commit-latency
  292. DEBUG 2017-11-07 17:35:49,727 2505 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-fetched
  293. DEBUG 2017-11-07 17:35:49,727 2505 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name records-fetched
  294. DEBUG 2017-11-07 17:35:49,727 2505 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name fetch-latency
  295. DEBUG 2017-11-07 17:35:49,728 2506 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name records-lag
  296. INFO 2017-11-07 17:35:49,728 2506 org.apache.kafka.common.utils.AppInfoParser [main] Kafka version : 0.11.0.1
  297. INFO 2017-11-07 17:35:49,728 2506 org.apache.kafka.common.utils.AppInfoParser [main] Kafka commitId : c2a0d5f9b1f45bf5
  298. DEBUG 2017-11-07 17:35:49,728 2506 org.apache.kafka.clients.consumer.KafkaConsumer [main] Kafka consumer with client id invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1-consumer created
  299. INFO 2017-11-07 17:35:49,728 2506 org.apache.kafka.streams.processor.internals.StreamThread [main] stream-thread [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1] Creating restore consumer client
  300. INFO 2017-11-07 17:35:49,729 2507 org.apache.kafka.clients.consumer.ConsumerConfig [main] ConsumerConfig values:
  301. auto.commit.interval.ms = 5000
  302. auto.offset.reset = earliest
  303. bootstrap.servers = [kafka-kafka.kafka.svc.cluster.local:9092]
  304. check.crcs = true
  305. client.id = invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1-restore-consumer
  306. connections.max.idle.ms = 540000
  307. enable.auto.commit = false
  308. exclude.internal.topics = true
  309. fetch.max.bytes = 52428800
  310. fetch.max.wait.ms = 500
  311. fetch.min.bytes = 1
  312. group.id =
  313. heartbeat.interval.ms = 3000
  314. interceptor.classes = null
  315. internal.leave.group.on.close = false
  316. isolation.level = read_uncommitted
  317. key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
  318. max.partition.fetch.bytes = 1048576
  319. max.poll.interval.ms = 2147483647
  320. max.poll.records = 1000
  321. metadata.max.age.ms = 300000
  322. metric.reporters = []
  323. metrics.num.samples = 2
  324. metrics.recording.level = INFO
  325. metrics.sample.window.ms = 30000
  326. partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
  327. receive.buffer.bytes = 65536
  328. reconnect.backoff.max.ms = 1000
  329. reconnect.backoff.ms = 50
  330. request.timeout.ms = 305000
  331. retry.backoff.ms = 100
  332. sasl.jaas.config = null
  333. sasl.kerberos.kinit.cmd = /usr/bin/kinit
  334. sasl.kerberos.min.time.before.relogin = 60000
  335. sasl.kerberos.service.name = null
  336. sasl.kerberos.ticket.renew.jitter = 0.05
  337. sasl.kerberos.ticket.renew.window.factor = 0.8
  338. sasl.mechanism = GSSAPI
  339. security.protocol = PLAINTEXT
  340. send.buffer.bytes = 131072
  341. session.timeout.ms = 10000
  342. ssl.cipher.suites = null
  343. ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
  344. ssl.endpoint.identification.algorithm = null
  345. ssl.key.password = null
  346. ssl.keymanager.algorithm = SunX509
  347. ssl.keystore.location = null
  348. ssl.keystore.password = null
  349. ssl.keystore.type = JKS
  350. ssl.protocol = TLS
  351. ssl.provider = null
  352. ssl.secure.random.implementation = null
  353. ssl.trustmanager.algorithm = PKIX
  354. ssl.truststore.location = null
  355. ssl.truststore.password = null
  356. ssl.truststore.type = JKS
  357. value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
  358.  
  359. DEBUG 2017-11-07 17:35:49,729 2507 org.apache.kafka.clients.consumer.KafkaConsumer [main] Starting the Kafka consumer
  360. DEBUG 2017-11-07 17:35:49,729 2507 org.apache.kafka.clients.Metadata [main] Updated cluster metadata version 1 to Cluster(id = null, nodes = [kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)], partitions = [])
  361. DEBUG 2017-11-07 17:35:49,729 2507 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name fetch-throttle-time
  362. DEBUG 2017-11-07 17:35:49,730 2508 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-closed:
  363. DEBUG 2017-11-07 17:35:49,730 2508 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name connections-created:
  364. DEBUG 2017-11-07 17:35:49,730 2508 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent-received:
  365. DEBUG 2017-11-07 17:35:49,730 2508 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-sent:
  366. DEBUG 2017-11-07 17:35:49,818 2596 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-received:
  367. DEBUG 2017-11-07 17:35:49,819 2597 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name select-time:
  368. DEBUG 2017-11-07 17:35:49,819 2597 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name io-time:
  369. DEBUG 2017-11-07 17:35:49,820 2598 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name heartbeat-latency
  370. DEBUG 2017-11-07 17:35:49,820 2598 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name join-latency
  371. DEBUG 2017-11-07 17:35:49,820 2598 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name sync-latency
  372. DEBUG 2017-11-07 17:35:49,821 2599 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name commit-latency
  373. DEBUG 2017-11-07 17:35:49,821 2599 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name bytes-fetched
  374. DEBUG 2017-11-07 17:35:49,821 2599 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name records-fetched
  375. DEBUG 2017-11-07 17:35:49,822 2600 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name fetch-latency
  376. DEBUG 2017-11-07 17:35:49,822 2600 org.apache.kafka.common.metrics.Metrics [main] Added sensor with name records-lag
  377. INFO 2017-11-07 17:35:49,822 2600 org.apache.kafka.common.utils.AppInfoParser [main] Kafka version : 0.11.0.1
  378. INFO 2017-11-07 17:35:49,822 2600 org.apache.kafka.common.utils.AppInfoParser [main] Kafka commitId : c2a0d5f9b1f45bf5
  379. DEBUG 2017-11-07 17:35:49,822 2600 org.apache.kafka.clients.consumer.KafkaConsumer [main] Kafka consumer with client id invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-StreamThread-1-restore-consumer created
  380. DEBUG 2017-11-07 17:35:49,918 2696 org.apache.kafka.streams.KafkaStreams [Thread-1] stream-client [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493] Starting Kafka Stream process.
  381. DEBUG 2017-11-07 17:35:50,230 3008 org.apache.kafka.clients.Metadata [Thread-1] Updated cluster metadata version 1 to Cluster(id = null, nodes = [kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)], partitions = [])
  382. DEBUG 2017-11-07 17:35:50,318 3096 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name connections-closed:
  383. DEBUG 2017-11-07 17:35:50,318 3096 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name connections-created:
  384. DEBUG 2017-11-07 17:35:50,319 3097 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name bytes-sent-received:
  385. DEBUG 2017-11-07 17:35:50,319 3097 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name bytes-sent:
  386. DEBUG 2017-11-07 17:35:50,319 3097 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name bytes-received:
  387. DEBUG 2017-11-07 17:35:50,319 3097 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name select-time:
  388. DEBUG 2017-11-07 17:35:50,320 3098 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name io-time:
  389. DEBUG 2017-11-07 17:35:50,320 3098 org.apache.kafka.clients.Metadata [Thread-1] Updated cluster metadata version 1 to Cluster(id = null, nodes = [kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)], partitions = [])
  390. DEBUG 2017-11-07 17:35:50,321 3099 org.apache.kafka.clients.NetworkClient [Thread-1] Initiating connection to node kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)
  391. DEBUG 2017-11-07 17:35:50,420 3198 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name node--1.bytes-sent
  392. DEBUG 2017-11-07 17:35:50,420 3198 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name node--1.bytes-received
  393. DEBUG 2017-11-07 17:35:50,420 3198 org.apache.kafka.common.metrics.Metrics [Thread-1] Added sensor with name node--1.latency
  394. DEBUG 2017-11-07 17:35:50,421 3199 org.apache.kafka.common.network.Selector [Thread-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1
  395. DEBUG 2017-11-07 17:35:50,424 3202 org.apache.kafka.clients.NetworkClient [Thread-1] Completed connection to node -1. Fetching API versions.
  396. DEBUG 2017-11-07 17:35:50,424 3202 org.apache.kafka.clients.NetworkClient [Thread-1] Initiating API versions fetch from node -1.
  397. DEBUG 2017-11-07 17:35:50,830 3608 org.apache.kafka.clients.NetworkClient [Thread-1] Recorded API versions for node -1: (Produce(0): 0 to 3 [usable: 3], Fetch(1): 0 to 5 [usable: 5], Offsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 4 [usable: 4], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 [usable: 0], AlterConfigs(33): 0 [usable: 0])
  398. DEBUG 2017-11-07 17:35:50,883 3661 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name connections-closed:
  399. DEBUG 2017-11-07 17:35:50,883 3661 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name connections-created:
  400. DEBUG 2017-11-07 17:35:50,883 3661 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name bytes-sent-received:
  401. DEBUG 2017-11-07 17:35:50,884 3662 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name bytes-sent:
  402. DEBUG 2017-11-07 17:35:50,884 3662 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name bytes-received:
  403. DEBUG 2017-11-07 17:35:50,884 3662 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name select-time:
  404. DEBUG 2017-11-07 17:35:50,884 3662 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name io-time:
  405. DEBUG 2017-11-07 17:35:50,884 3662 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name node--1.bytes-sent
  406. DEBUG 2017-11-07 17:35:50,885 3663 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name node--1.bytes-received
  407. DEBUG 2017-11-07 17:35:50,885 3663 org.apache.kafka.common.metrics.Metrics [Thread-1] Removed sensor with name node--1.latency
  408. INFO 2017-11-07 17:35:50,934 3712 io.confluent.kafka.serializers.KafkaAvroSerializerConfig [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] KafkaAvroSerializerConfig values:
  409. schema.registry.url = [http://sad-squid-schema-registry.schema-registry.svc.cluster.local:8000]
  410. max.schemas.per.subject = 1000
  411.  
  412. INFO 2017-11-07 17:35:50,935 3713 io.confluent.kafka.serializers.KafkaAvroDeserializerConfig [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] KafkaAvroDeserializerConfig values:
  413. schema.registry.url = [http://sad-squid-schema-registry.schema-registry.svc.cluster.local:8000]
  414. max.schemas.per.subject = 1000
  415. specific.avro.reader = true
  416.  
  417. DEBUG 2017-11-07 17:35:50,944 3722 org.apache.kafka.streams.processor.internals.StateDirectory [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] stream-thread [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Acquired global state dir lock
  418. DEBUG 2017-11-07 17:35:51,018 3796 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name put
  419. DEBUG 2017-11-07 17:35:51,019 3797 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-put
  420. DEBUG 2017-11-07 17:35:51,019 3797 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name put-if-absent
  421. DEBUG 2017-11-07 17:35:51,020 3798 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-put-if-absent
  422. DEBUG 2017-11-07 17:35:51,020 3798 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name get
  423. DEBUG 2017-11-07 17:35:51,021 3799 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-get
  424. DEBUG 2017-11-07 17:35:51,022 3800 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name delete
  425. DEBUG 2017-11-07 17:35:51,022 3800 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-delete
  426. DEBUG 2017-11-07 17:35:51,022 3800 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name put-all
  427. DEBUG 2017-11-07 17:35:51,023 3801 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-put-all
  428. DEBUG 2017-11-07 17:35:51,023 3801 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name all
  429. DEBUG 2017-11-07 17:35:51,023 3801 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-all
  430. DEBUG 2017-11-07 17:35:51,024 3802 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name range
  431. DEBUG 2017-11-07 17:35:51,024 3802 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-range
  432. DEBUG 2017-11-07 17:35:51,024 3802 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name flush
  433. DEBUG 2017-11-07 17:35:51,024 3802 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-flush
  434. DEBUG 2017-11-07 17:35:51,025 3803 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restore
  435. DEBUG 2017-11-07 17:35:51,025 3803 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-restore
  436. INFO 2017-11-07 17:35:52,024 4802 org.apache.kafka.streams.processor.internals.GlobalStateManagerImpl [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] restoring state for global store orders
  437. DEBUG 2017-11-07 17:35:52,027 4805 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating connection to node kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)
  438. DEBUG 2017-11-07 17:35:52,028 4806 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node--1.bytes-sent
  439. DEBUG 2017-11-07 17:35:52,028 4806 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node--1.bytes-received
  440. DEBUG 2017-11-07 17:35:52,028 4806 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node--1.latency
  441. DEBUG 2017-11-07 17:35:52,029 4807 org.apache.kafka.common.network.Selector [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1
  442. DEBUG 2017-11-07 17:35:52,029 4807 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Completed connection to node -1. Fetching API versions.
  443. DEBUG 2017-11-07 17:35:52,029 4807 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating API versions fetch from node -1.
  444. DEBUG 2017-11-07 17:35:52,031 4809 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Recorded API versions for node -1: (Produce(0): 0 to 3 [usable: 3], Fetch(1): 0 to 5 [usable: 5], Offsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 4 [usable: 4], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 [usable: 0], AlterConfigs(33): 0 [usable: 0])
  445. DEBUG 2017-11-07 17:35:52,031 4809 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending metadata request (type=MetadataRequest, topics=) to node kafka-kafka.kafka.svc.cluster.local:9092 (id: -1 rack: null)
  446. DEBUG 2017-11-07 17:35:52,033 4811 org.apache.kafka.clients.Metadata [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Updated cluster metadata version 2 to Cluster(id = LLJLwedVTHOXROA2dbB0rQ, nodes = [kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null), kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null), kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)], partitions = [])
  447. DEBUG 2017-11-07 17:35:52,042 4820 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Partition orders-state-0 is unknown for fetching offset, wait for metadata refresh
  448. DEBUG 2017-11-07 17:35:52,043 4821 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initialize connection to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null) for sending metadata request
  449. DEBUG 2017-11-07 17:35:52,043 4821 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating connection to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  450. DEBUG 2017-11-07 17:35:52,045 4823 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-1.bytes-sent
  451. DEBUG 2017-11-07 17:35:52,045 4823 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-1.bytes-received
  452. DEBUG 2017-11-07 17:35:52,118 4896 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-1.latency
  453. DEBUG 2017-11-07 17:35:52,118 4896 org.apache.kafka.common.network.Selector [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 1
  454. DEBUG 2017-11-07 17:35:52,118 4896 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Completed connection to node 1. Fetching API versions.
  455. DEBUG 2017-11-07 17:35:52,118 4896 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating API versions fetch from node 1.
  456. DEBUG 2017-11-07 17:35:52,119 4897 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initialize connection to node kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null) for sending metadata request
  457. DEBUG 2017-11-07 17:35:52,119 4897 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating connection to node kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null)
  458. DEBUG 2017-11-07 17:35:52,122 4900 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-0.bytes-sent
  459. DEBUG 2017-11-07 17:35:52,122 4900 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-0.bytes-received
  460. DEBUG 2017-11-07 17:35:52,123 4901 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-0.latency
  461. DEBUG 2017-11-07 17:35:52,123 4901 org.apache.kafka.common.network.Selector [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0
  462. DEBUG 2017-11-07 17:35:52,123 4901 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Completed connection to node 0. Fetching API versions.
  463. DEBUG 2017-11-07 17:35:52,123 4901 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating API versions fetch from node 0.
  464. DEBUG 2017-11-07 17:35:52,123 4901 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initialize connection to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null) for sending metadata request
  465. DEBUG 2017-11-07 17:35:52,123 4901 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating connection to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  466. DEBUG 2017-11-07 17:35:52,126 4904 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Recorded API versions for node 1: (Produce(0): 0 to 3 [usable: 3], Fetch(1): 0 to 5 [usable: 5], Offsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 4 [usable: 4], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 [usable: 0], AlterConfigs(33): 0 [usable: 0])
  467. DEBUG 2017-11-07 17:35:52,126 4904 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending metadata request (type=MetadataRequest, topics=orders-state) to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  468. DEBUG 2017-11-07 17:35:52,127 4905 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-2.bytes-sent
  469. DEBUG 2017-11-07 17:35:52,127 4905 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-2.bytes-received
  470. DEBUG 2017-11-07 17:35:52,127 4905 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name node-2.latency
  471. DEBUG 2017-11-07 17:35:52,127 4905 org.apache.kafka.common.network.Selector [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2
  472. DEBUG 2017-11-07 17:35:52,128 4906 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Recorded API versions for node 0: (Produce(0): 0 to 3 [usable: 3], Fetch(1): 0 to 5 [usable: 5], Offsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 4 [usable: 4], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 [usable: 0], AlterConfigs(33): 0 [usable: 0])
  473. DEBUG 2017-11-07 17:35:52,128 4906 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Completed connection to node 2. Fetching API versions.
  474. DEBUG 2017-11-07 17:35:52,128 4906 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Initiating API versions fetch from node 2.
  475. DEBUG 2017-11-07 17:35:52,142 4920 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Recorded API versions for node 2: (Produce(0): 0 to 3 [usable: 3], Fetch(1): 0 to 5 [usable: 5], Offsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 4 [usable: 4], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 [usable: 0], AlterConfigs(33): 0 [usable: 0])
  476. DEBUG 2017-11-07 17:35:52,204 4982 org.apache.kafka.clients.Metadata [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Updated cluster metadata version 3 to Cluster(id = LLJLwedVTHOXROA2dbB0rQ, nodes = [kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null), kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null), kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)], partitions = [Partition(topic = orders-state, partition = 0, leader = 1, replicas = [1,2,0], isr = [1,2,0])])
  477. DEBUG 2017-11-07 17:35:52,223 5001 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for orders-state-0. Fetched offset 114, timestamp -1
  478. DEBUG 2017-11-07 17:35:52,224 5002 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Subscribed to partition(s): orders-state-0
  479. DEBUG 2017-11-07 17:35:52,225 5003 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Seeking to beginning of partition orders-state-0
  480. DEBUG 2017-11-07 17:35:52,226 5004 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for orders-state-0. Fetched offset 0, timestamp -1
  481. DEBUG 2017-11-07 17:35:52,226 5004 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Resetting offset for partition orders-state-0 to offset 0.
  482. DEBUG 2017-11-07 17:35:52,227 5005 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition orders-state-0 at offset 0 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  483. DEBUG 2017-11-07 17:35:52,227 5005 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [orders-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  484. DEBUG 2017-11-07 17:35:52,312 5090 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 0 for partition orders-state-0 returned fetch data (error=NONE, highWaterMark=114, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=117103)
  485. DEBUG 2017-11-07 17:35:52,336 5114 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.orders-state.bytes-fetched
  486. DEBUG 2017-11-07 17:35:52,337 5115 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.orders-state.records-fetched
  487. DEBUG 2017-11-07 17:35:52,337 5115 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name orders-state-0.records-lag
  488. DEBUG 2017-11-07 17:35:52,419 5197 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition orders-state-0 at offset 114 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  489. DEBUG 2017-11-07 17:35:52,419 5197 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [orders-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  490. DEBUG 2017-11-07 17:35:52,421 5199 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Unsubscribed all topics or patterns and assigned partitions
  491. DEBUG 2017-11-07 17:35:52,422 5200 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Removed sensor with name orders-state-0.records-lag
  492. DEBUG 2017-11-07 17:35:52,424 5202 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name hitRatio
  493. DEBUG 2017-11-07 17:35:52,425 5203 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-put
  494. DEBUG 2017-11-07 17:35:52,425 5203 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-put-if-absent
  495. DEBUG 2017-11-07 17:35:52,425 5203 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-get
  496. DEBUG 2017-11-07 17:35:52,426 5204 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-delete
  497. DEBUG 2017-11-07 17:35:52,426 5204 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-put-all
  498. DEBUG 2017-11-07 17:35:52,426 5204 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-all
  499. DEBUG 2017-11-07 17:35:52,426 5204 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-range
  500. DEBUG 2017-11-07 17:35:52,427 5205 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-flush
  501. DEBUG 2017-11-07 17:35:52,427 5205 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-restore
  502. INFO 2017-11-07 17:35:52,523 5301 org.apache.kafka.streams.processor.internals.GlobalStateManagerImpl [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] restoring state for global store users
  503. got orders
  504. DEBUG 2017-11-07 17:35:52,546 5324 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Partition users-state-0 is unknown for fetching offset, wait for metadata refresh
  505. DEBUG 2017-11-07 17:35:52,546 5324 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending metadata request (type=MetadataRequest, topics=users-state,orders-state) to node kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null)
  506. DEBUG 2017-11-07 17:35:52,548 5326 org.apache.kafka.clients.Metadata [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Updated cluster metadata version 4 to Cluster(id = LLJLwedVTHOXROA2dbB0rQ, nodes = [kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null), kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null), kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null)], partitions = [Partition(topic = users-state, partition = 0, leader = 2, replicas = [2,0,1], isr = [1,2,0]), Partition(topic = orders-state, partition = 0, leader = 1, replicas = [1,2,0], isr = [1,2,0])])
  507. DEBUG 2017-11-07 17:35:52,549 5327 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for users-state-0. Fetched offset 395, timestamp -1
  508. DEBUG 2017-11-07 17:35:52,549 5327 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Subscribed to partition(s): users-state-0
  509. DEBUG 2017-11-07 17:35:52,550 5328 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Seeking to beginning of partition users-state-0
  510. DEBUG 2017-11-07 17:35:52,551 5329 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for users-state-0. Fetched offset 0, timestamp -1
  511. DEBUG 2017-11-07 17:35:52,618 5396 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Resetting offset for partition users-state-0 to offset 0.
  512. DEBUG 2017-11-07 17:35:52,618 5396 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition users-state-0 at offset 0 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  513. DEBUG 2017-11-07 17:35:52,618 5396 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [users-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  514. DEBUG 2017-11-07 17:35:52,621 5399 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 0 for partition users-state-0 returned fetch data (error=NONE, highWaterMark=395, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=43289)
  515. DEBUG 2017-11-07 17:35:52,627 5405 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.users-state.bytes-fetched
  516. DEBUG 2017-11-07 17:35:52,628 5406 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.users-state.records-fetched
  517. DEBUG 2017-11-07 17:35:52,628 5406 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name users-state-0.records-lag
  518. DEBUG 2017-11-07 17:35:52,628 5406 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition users-state-0 at offset 393 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  519. DEBUG 2017-11-07 17:35:52,628 5406 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [users-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  520. DEBUG 2017-11-07 17:35:52,719 5497 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 393 for partition users-state-0 returned fetch data (error=NONE, highWaterMark=395, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=335)
  521. DEBUG 2017-11-07 17:35:52,719 5497 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition users-state-0 at offset 395 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  522. DEBUG 2017-11-07 17:35:52,719 5497 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [users-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  523. DEBUG 2017-11-07 17:35:52,720 5498 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Unsubscribed all topics or patterns and assigned partitions
  524. DEBUG 2017-11-07 17:35:52,720 5498 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Removed sensor with name users-state-0.records-lag
  525. DEBUG 2017-11-07 17:35:52,721 5499 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-put
  526. DEBUG 2017-11-07 17:35:52,721 5499 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-put-if-absent
  527. DEBUG 2017-11-07 17:35:52,721 5499 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-get
  528. DEBUG 2017-11-07 17:35:52,722 5500 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-delete
  529. DEBUG 2017-11-07 17:35:52,722 5500 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-put-all
  530. DEBUG 2017-11-07 17:35:52,722 5500 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-all
  531. DEBUG 2017-11-07 17:35:52,722 5500 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-range
  532. DEBUG 2017-11-07 17:35:52,723 5501 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-flush
  533. DEBUG 2017-11-07 17:35:52,723 5501 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-restore
  534. got users
  535. INFO 2017-11-07 17:35:52,762 5540 org.apache.kafka.streams.processor.internals.GlobalStateManagerImpl [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] restoring state for global store restaurants
  536. DEBUG 2017-11-07 17:35:52,818 5596 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Partition restaurants-state-0 is unknown for fetching offset, wait for metadata refresh
  537. DEBUG 2017-11-07 17:35:52,818 5596 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending metadata request (type=MetadataRequest, topics=users-state,restaurants-state) to node kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null)
  538. DEBUG 2017-11-07 17:35:52,847 5625 org.apache.kafka.clients.Metadata [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Updated cluster metadata version 5 to Cluster(id = LLJLwedVTHOXROA2dbB0rQ, nodes = [kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null), kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null), kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)], partitions = [Partition(topic = users-state, partition = 0, leader = 2, replicas = [2,0,1], isr = [1,2,0]), Partition(topic = restaurants-state, partition = 0, leader = 2, replicas = [2,0,1], isr = [1,2,0])])
  539. DEBUG 2017-11-07 17:35:52,921 5699 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 114 for partition orders-state-0 returned fetch data (error=NONE, highWaterMark=114, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  540. DEBUG 2017-11-07 17:35:53,222 6000 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 395 for partition users-state-0 returned fetch data (error=NONE, highWaterMark=395, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  541. DEBUG 2017-11-07 17:35:53,223 6001 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for restaurants-state-0. Fetched offset 613, timestamp -1
  542. DEBUG 2017-11-07 17:35:53,223 6001 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Subscribed to partition(s): restaurants-state-0
  543. DEBUG 2017-11-07 17:35:53,223 6001 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Seeking to beginning of partition restaurants-state-0
  544. DEBUG 2017-11-07 17:35:53,224 6002 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for restaurants-state-0. Fetched offset 0, timestamp -1
  545. DEBUG 2017-11-07 17:35:53,224 6002 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Resetting offset for partition restaurants-state-0 to offset 0.
  546. DEBUG 2017-11-07 17:35:53,225 6003 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Ignoring fetched records for partition orders-state-0 since it is no longer fetchable
  547. DEBUG 2017-11-07 17:35:53,225 6003 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Ignoring fetched records for partition users-state-0 since it is no longer fetchable
  548. DEBUG 2017-11-07 17:35:53,225 6003 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition restaurants-state-0 at offset 0 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  549. DEBUG 2017-11-07 17:35:53,225 6003 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [restaurants-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  550. DEBUG 2017-11-07 17:35:53,227 6005 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 0 for partition restaurants-state-0 returned fetch data (error=NONE, highWaterMark=613, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=40459)
  551. DEBUG 2017-11-07 17:35:53,230 6008 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.restaurants-state.bytes-fetched
  552. DEBUG 2017-11-07 17:35:53,230 6008 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.restaurants-state.records-fetched
  553. DEBUG 2017-11-07 17:35:53,230 6008 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurants-state-0.records-lag
  554. DEBUG 2017-11-07 17:35:53,231 6009 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition restaurants-state-0 at offset 609 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  555. DEBUG 2017-11-07 17:35:53,231 6009 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [restaurants-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  556. DEBUG 2017-11-07 17:35:53,232 6010 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 609 for partition restaurants-state-0 returned fetch data (error=NONE, highWaterMark=613, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=640)
  557. DEBUG 2017-11-07 17:35:53,233 6011 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition restaurants-state-0 at offset 613 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  558. DEBUG 2017-11-07 17:35:53,233 6011 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [restaurants-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  559. DEBUG 2017-11-07 17:35:53,233 6011 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Unsubscribed all topics or patterns and assigned partitions
  560. DEBUG 2017-11-07 17:35:53,233 6011 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Removed sensor with name restaurants-state-0.records-lag
  561. DEBUG 2017-11-07 17:35:53,234 6012 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-put
  562. DEBUG 2017-11-07 17:35:53,319 6097 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-put-if-absent
  563. DEBUG 2017-11-07 17:35:53,319 6097 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-get
  564. DEBUG 2017-11-07 17:35:53,319 6097 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-delete
  565. DEBUG 2017-11-07 17:35:53,320 6098 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-put-all
  566. DEBUG 2017-11-07 17:35:53,320 6098 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-all
  567. DEBUG 2017-11-07 17:35:53,320 6098 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-range
  568. DEBUG 2017-11-07 17:35:53,321 6099 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-flush
  569. DEBUG 2017-11-07 17:35:53,321 6099 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-restore
  570. got restaurants
  571. INFO 2017-11-07 17:35:53,335 6113 org.apache.kafka.streams.processor.internals.GlobalStateManagerImpl [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] restoring state for global store restaurant-groups
  572. DEBUG 2017-11-07 17:35:53,399 6177 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Partition restaurant-groups-state-0 is unknown for fetching offset, wait for metadata refresh
  573. DEBUG 2017-11-07 17:35:53,399 6177 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending metadata request (type=MetadataRequest, topics=restaurant-groups-state,restaurants-state) to node kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null)
  574. DEBUG 2017-11-07 17:35:53,446 6224 org.apache.kafka.clients.Metadata [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Updated cluster metadata version 6 to Cluster(id = LLJLwedVTHOXROA2dbB0rQ, nodes = [kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null), kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null), kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)], partitions = [Partition(topic = restaurant-groups-state, partition = 0, leader = 2, replicas = [2,1,0], isr = [1,2,0]), Partition(topic = restaurants-state, partition = 0, leader = 2, replicas = [2,0,1], isr = [1,2,0])])
  575. DEBUG 2017-11-07 17:35:53,734 6512 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 613 for partition restaurants-state-0 returned fetch data (error=NONE, highWaterMark=613, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  576. DEBUG 2017-11-07 17:35:53,734 6512 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for restaurant-groups-state-0. Fetched offset 10, timestamp -1
  577. DEBUG 2017-11-07 17:35:53,734 6512 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Subscribed to partition(s): restaurant-groups-state-0
  578. DEBUG 2017-11-07 17:35:53,734 6512 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Seeking to beginning of partition restaurant-groups-state-0
  579. DEBUG 2017-11-07 17:35:53,741 6519 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for restaurant-groups-state-0. Fetched offset 0, timestamp -1
  580. DEBUG 2017-11-07 17:35:53,741 6519 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Resetting offset for partition restaurant-groups-state-0 to offset 0.
  581. DEBUG 2017-11-07 17:35:53,741 6519 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Ignoring fetched records for partition restaurants-state-0 since it is no longer fetchable
  582. DEBUG 2017-11-07 17:35:53,741 6519 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition restaurant-groups-state-0 at offset 0 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  583. DEBUG 2017-11-07 17:35:53,741 6519 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [restaurant-groups-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  584. DEBUG 2017-11-07 17:35:53,743 6521 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 0 for partition restaurant-groups-state-0 returned fetch data (error=NONE, highWaterMark=10, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=1433)
  585. DEBUG 2017-11-07 17:35:53,743 6521 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.restaurant-groups-state.bytes-fetched
  586. DEBUG 2017-11-07 17:35:53,743 6521 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.restaurant-groups-state.records-fetched
  587. DEBUG 2017-11-07 17:35:53,744 6522 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name restaurant-groups-state-0.records-lag
  588. DEBUG 2017-11-07 17:35:53,744 6522 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition restaurant-groups-state-0 at offset 10 to node kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  589. DEBUG 2017-11-07 17:35:53,744 6522 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [restaurant-groups-state-0] to broker kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null)
  590. DEBUG 2017-11-07 17:35:53,744 6522 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Unsubscribed all topics or patterns and assigned partitions
  591. DEBUG 2017-11-07 17:35:53,744 6522 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Removed sensor with name restaurant-groups-state-0.records-lag
  592. DEBUG 2017-11-07 17:35:53,745 6523 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-put
  593. DEBUG 2017-11-07 17:35:53,745 6523 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-put-if-absent
  594. DEBUG 2017-11-07 17:35:53,745 6523 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-get
  595. DEBUG 2017-11-07 17:35:53,745 6523 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-delete
  596. DEBUG 2017-11-07 17:35:53,745 6523 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-put-all
  597. DEBUG 2017-11-07 17:35:53,745 6523 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-all
  598. DEBUG 2017-11-07 17:35:53,746 6524 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-range
  599. DEBUG 2017-11-07 17:35:53,746 6524 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-flush
  600. DEBUG 2017-11-07 17:35:53,746 6524 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-restore
  601. INFO 2017-11-07 17:35:53,761 6539 org.apache.kafka.streams.processor.internals.GlobalStateManagerImpl [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] restoring state for global store invoices
  602. DEBUG 2017-11-07 17:35:53,763 6541 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Partition invoices-state-0 is unknown for fetching offset, wait for metadata refresh
  603. DEBUG 2017-11-07 17:35:53,763 6541 org.apache.kafka.clients.NetworkClient [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending metadata request (type=MetadataRequest, topics=invoices-state,restaurant-groups-state) to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  604. DEBUG 2017-11-07 17:35:53,819 6597 org.apache.kafka.clients.Metadata [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Updated cluster metadata version 7 to Cluster(id = LLJLwedVTHOXROA2dbB0rQ, nodes = [kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null), kafka-kafka-2.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 2 rack: null), kafka-kafka-0.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 0 rack: null)], partitions = [Partition(topic = restaurant-groups-state, partition = 0, leader = 2, replicas = [2,1,0], isr = [1,2,0]), Partition(topic = invoices-state, partition = 0, leader = 1, replicas = [1,0,2], isr = [1,2,0])])
  605. DEBUG 2017-11-07 17:35:53,820 6598 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for invoices-state-0. Fetched offset 2, timestamp -1
  606. DEBUG 2017-11-07 17:35:53,820 6598 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Subscribed to partition(s): invoices-state-0
  607. DEBUG 2017-11-07 17:35:53,820 6598 org.apache.kafka.clients.consumer.KafkaConsumer [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Seeking to beginning of partition invoices-state-0
  608. DEBUG 2017-11-07 17:35:53,822 6600 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Handling ListOffsetResponse response for invoices-state-0. Fetched offset 0, timestamp -1
  609. DEBUG 2017-11-07 17:35:53,822 6600 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Resetting offset for partition invoices-state-0 to offset 0.
  610. DEBUG 2017-11-07 17:35:53,822 6600 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 0 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  611. DEBUG 2017-11-07 17:35:53,822 6600 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  612. DEBUG 2017-11-07 17:35:53,824 6602 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 0 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=308)
  613. DEBUG 2017-11-07 17:35:53,824 6602 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.invoices-state.bytes-fetched
  614. DEBUG 2017-11-07 17:35:53,824 6602 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name topic.invoices-state.records-fetched
  615. DEBUG 2017-11-07 17:35:53,824 6602 org.apache.kafka.common.metrics.Metrics [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added sensor with name invoices-state-0.records-lag
  616. got groups
  617. DEBUG 2017-11-07 17:35:53,831 6609 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  618. DEBUG 2017-11-07 17:35:53,831 6609 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  619. DEBUG 2017-11-07 17:35:54,246 7024 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 10 for partition restaurant-groups-state-0 returned fetch data (error=NONE, highWaterMark=10, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  620. DEBUG 2017-11-07 17:35:54,246 7024 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Ignoring fetched records for partition restaurant-groups-state-0 since it is no longer fetchable
  621. DEBUG 2017-11-07 17:35:54,399 7177 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  622. DEBUG 2017-11-07 17:35:54,399 7177 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  623. DEBUG 2017-11-07 17:35:54,399 7177 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  624. DEBUG 2017-11-07 17:35:54,901 7679 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  625. DEBUG 2017-11-07 17:35:54,901 7679 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  626. DEBUG 2017-11-07 17:35:54,901 7679 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  627. DEBUG 2017-11-07 17:35:55,404 8182 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  628. DEBUG 2017-11-07 17:35:55,405 8183 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  629. DEBUG 2017-11-07 17:35:55,405 8183 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  630. DEBUG 2017-11-07 17:35:55,907 8685 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  631. DEBUG 2017-11-07 17:35:55,907 8685 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  632. DEBUG 2017-11-07 17:35:55,907 8685 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  633. DEBUG 2017-11-07 17:35:56,409 9187 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  634. DEBUG 2017-11-07 17:35:56,410 9188 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  635. DEBUG 2017-11-07 17:35:56,410 9188 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  636. DEBUG 2017-11-07 17:35:56,911 9689 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  637. DEBUG 2017-11-07 17:35:56,912 9690 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  638. DEBUG 2017-11-07 17:35:56,912 9690 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  639. DEBUG 2017-11-07 17:35:57,413 10191 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  640. DEBUG 2017-11-07 17:35:57,414 10192 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  641. DEBUG 2017-11-07 17:35:57,414 10192 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  642. DEBUG 2017-11-07 17:35:57,916 10694 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  643. DEBUG 2017-11-07 17:35:57,917 10695 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  644. DEBUG 2017-11-07 17:35:57,917 10695 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  645. DEBUG 2017-11-07 17:35:58,418 11196 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Fetch READ_UNCOMMITTED at offset 2 for partition invoices-state-0 returned fetch data (error=NONE, highWaterMark=2, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=0)
  646. DEBUG 2017-11-07 17:35:58,418 11196 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Added READ_UNCOMMITTED fetch request for partition invoices-state-0 at offset 2 to node kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
  647. DEBUG 2017-11-07 17:35:58,418 11196 org.apache.kafka.clients.consumer.internals.Fetcher [invoices-9475b5b5-3940-4830-86b2-65a8a4cd6493-GlobalStreamThread] Sending READ_UNCOMMITTED fetch for partitions [invoices-state-0] to broker kafka-kafka-1.kafka-kafka-headless.kafka.svc.cluster.local:9092 (id: 1 rack: null)
Advertisement
Add Comment
Please, Sign In to add comment