API tools faq
paste
IEE1394

Kafka Failure Log

IEE1394
Nov 2nd, 2019
356
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.80 KB | None | 0 0
raw download clone embed print report
  1. 2019-11-02 08:00:01.441 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Disabling heartbeat thread
  2. 2019-11-02 08:00:01.441 INFO 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] (Re-)joining group
  3. 2019-11-02 08:00:01.441 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Joining group with current subscription: [topic-c]
  4. 2019-11-02 08:00:01.441 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Sending JoinGroup (JoinGroupRequestData(groupId='my-app', sessionTimeoutMs=10000, rebalanceTimeoutMs=300000, memberId='consumer-3-fafd33d5-6f82-451c-ac8f-8ad0d805e557', groupInstanceId='null', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 0, 0, 0, 0, 1, 0, 33, 101, 118, 101, 110, 116, 46, 98, 101, 115, 116, 99, 111, 114, 101, 99, 111, 110, 110, 101, 99, 116, 111, 114, 46, 112, 97, 114, 97, 109, 101, 116, 101, 114, 0, 0, 0, 0])])) to coordinator kafka-2.kafka-headless.bd-iot.svc.cluster.local:9092 (id: 2147482644 rack: null)
  5. 2019-11-02 08:00:01.473 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=82, protocolName='range', leader='consumer-1-6fd4258a-c64f-4404-9b67-445606ccee33', memberId='consumer-3-fafd33d5-6f82-451c-ac8f-8ad0d805e557', members=[])
  6. 2019-11-02 08:00:01.473 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Sending follower SyncGroup to coordinator kafka-2.kafka-headless.bd-iot.svc.cluster.local:9092 (id: 2147482644 rack: null): SyncGroupRequestData(groupId='my-app', generationId=82, memberId='consumer-3-fafd33d5-6f82-451c-ac8f-8ad0d805e557', groupInstanceId='null', assignments=[])
  7. 2019-11-02 08:00:01.477 INFO 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Successfully joined group with generation 82
  8. 2019-11-02 08:00:01.477 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Enabling heartbeat thread
  9. 2019-11-02 08:00:01.488 INFO 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Setting newly assigned partitions: topic-c-0
  10. 2019-11-02 08:00:01.488 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Fetching committed offsets for partitions: [topic-c-0]
  11. 2019-11-02 08:00:01.494 INFO 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Setting offset for partition topic-c-0 to the committed offset FetchPosition{offset=38732827, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=kafka-2.kafka-headless.bd-iot.svc.cluster.local:9092 (id: 1003 rack: null), epoch=1}}
  12. 2019-11-02 08:00:01.495 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Committing on assignment: {topic-c-0=OffsetAndMetadata{offset=38732827, leaderEpoch=null, metadata=''}}
  13. 2019-11-02 08:00:01.498 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Committed offset 38732827 for partition topic-c-0
  14. 2019-11-02 08:00:01.498 INFO 1 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : my-app: partitions assigned: [topic-c-0]
  15. 2019-11-02 08:00:01.601 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 100 records
  16. ...
  17. 2019-11-02 08:16:06.108 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {topic-c-0=OffsetAndMetadata{offset=38758630, leaderEpoch=null, metadata=''}}
  18. 2019-11-02 08:16:06.108 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Committing: {topic-c-0=OffsetAndMetadata{offset=38758630, leaderEpoch=null, metadata=''}}
  19. 2019-11-02 08:16:06.175 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Committed offset 38758630 for partition topic-c-0
  20. 2019-11-02 08:16:06.335 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 14 records
  21.  
  22. Repeats 14 times:
  23. 2019-11-02 08:16:06.395 DEBUG 1 --- [ntainer#0-0-C-1] .a.RecordMessagingMessageListenerAdapter : Processing [GenericMessage [payload=..., headers={kafka_offset=38758630, kafka_consumer=org.apache.kafka.clients.consumer.KafkaConsumer@2ebb10f5, kafka_timestampType=CREATE_TIME, kafka_receivedMessageKey=null, kafka_receivedPartitionId=0, kafka_receivedTopic=topic-c, kafka_receivedTimestamp=1572682565098, kafka_groupId=my-app}]]
  24.  
  25. 2019-11-02 08:16:06.732 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {topic-c-0=OffsetAndMetadata{offset=38758644, leaderEpoch=null, metadata=''}}
  26. 2019-11-02 08:16:06.732 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Committing: {topic-c-0=OffsetAndMetadata{offset=38758644, leaderEpoch=null, metadata=''}}
  27. 2019-11-02 08:16:06.756 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Committed offset 38758644 for partition topic-c-0
  28.  
  29. GROUP TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID
  30. my-app topic-a 0 2562429 2562429 0 consumer-1-6fd4258a-c64f-4404-9b67-445606ccee33 /10.244.3.70 consumer-1
  31. my-app topic-a 1 2562429 2562429 0 consumer-1-6fd4258a-c64f-4404-9b67-445606ccee33 /10.244.3.70 consumer-1
  32. my-app topic-b 0 278363 278363 0 consumer-2-c79ac840-84c8-4a48-921e-c2831d681ab4 /10.244.3.70 consumer-2
  33. my-app topic-b 1 278362 278362 0 consumer-2-c79ac840-84c8-4a48-921e-c2831d681ab4 /10.244.3.70 consumer-2
  34. my-app topic-d 0 2881 2881 0 consumer-4-c91f82fa-2de3-44fb-9958-3fc33b89d25f /10.244.3.70 consumer-4
  35. my-app topic-c 0 38758644 38770559 11915 consumer-3-fafd33d5-6f82-451c-ac8f-8ad0d805e557 /10.244.3.70 consumer-3
  36.  
  37. 2019-11-02 08:16:06.779 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful Heartbeat response
  38. 2019-11-02 08:16:09.891 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful Heartbeat response
  39. 2019-11-02 08:16:11.819 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0 records
  40. 2019-11-02 08:16:11.825 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
  41. 2019-11-02 08:16:13.132 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful Heartbeat response
  42. 2019-11-02 08:16:16.000 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful Heartbeat response
  43. 2019-11-02 08:16:16.829 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0 records
  44. 2019-11-02 08:16:16.829 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
  45. 2019-11-02 08:16:19.001 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful Heartbeat response
  46. 2019-11-02 08:16:21.895 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0 records
  47. 2019-11-02 08:16:21.916 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
  48. 2019-11-02 08:16:22.027 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful Heartbeat response
  49. 2019-11-02 08:16:25.287 DEBUG 1 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-3, groupId=my-app] Received successful Heartbeat response
  50. 2019-11-02 08:16:26.935 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0 records
  51. 2019-11-02 08:16:26.935 DEBUG 1 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!