API tools faq
paste
severun

External producer

severun
Mar 13th, 2017
41
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.46 KB | None | 0 0
raw download clone embed print report
  1. # ~/kafka/bin/kafka-console-producer.sh --broker-list server0:30092,server1:30092,server2:30092 --topic test
  2.  
  3. [2017-03-13 11:55:07,214] DEBUG Added sensor with name bufferpool-wait-time (org.apache.kafka.common.metrics.Metrics)
  4. [2017-03-13 11:55:07,227] DEBUG Added sensor with name buffer-exhausted-records (org.apache.kafka.common.metrics.Metrics)
  5. [2017-03-13 11:55:07,231] DEBUG Updated cluster metadata version 1 to Cluster(id = null, nodes = [server0:30092 (id: -3 rack: null), server2:30092 (id: -2 rack: null), server1:30092 (id: -1 rack: null)], partitions = []) (org.apache.kafka.clients.Metadata)
  6. [2017-03-13 11:55:07,239] DEBUG Added sensor with name connections-closed: (org.apache.kafka.common.metrics.Metrics)
  7. [2017-03-13 11:55:07,240] DEBUG Added sensor with name connections-created: (org.apache.kafka.common.metrics.Metrics)
  8. [2017-03-13 11:55:07,240] DEBUG Added sensor with name bytes-sent-received: (org.apache.kafka.common.metrics.Metrics)
  9. [2017-03-13 11:55:07,240] DEBUG Added sensor with name bytes-sent: (org.apache.kafka.common.metrics.Metrics)
  10. [2017-03-13 11:55:07,241] DEBUG Added sensor with name bytes-received: (org.apache.kafka.common.metrics.Metrics)
  11. [2017-03-13 11:55:07,242] DEBUG Added sensor with name select-time: (org.apache.kafka.common.metrics.Metrics)
  12. [2017-03-13 11:55:07,242] DEBUG Added sensor with name io-time: (org.apache.kafka.common.metrics.Metrics)
  13. [2017-03-13 11:55:07,246] DEBUG Added sensor with name batch-size (org.apache.kafka.common.metrics.Metrics)
  14. [2017-03-13 11:55:07,247] DEBUG Added sensor with name compression-rate (org.apache.kafka.common.metrics.Metrics)
  15. [2017-03-13 11:55:07,247] DEBUG Added sensor with name queue-time (org.apache.kafka.common.metrics.Metrics)
  16. [2017-03-13 11:55:07,247] DEBUG Added sensor with name request-time (org.apache.kafka.common.metrics.Metrics)
  17. [2017-03-13 11:55:07,247] DEBUG Added sensor with name produce-throttle-time (org.apache.kafka.common.metrics.Metrics)
  18. [2017-03-13 11:55:07,248] DEBUG Added sensor with name records-per-request (org.apache.kafka.common.metrics.Metrics)
  19. [2017-03-13 11:55:07,248] DEBUG Added sensor with name record-retries (org.apache.kafka.common.metrics.Metrics)
  20. [2017-03-13 11:55:07,248] DEBUG Added sensor with name errors (org.apache.kafka.common.metrics.Metrics)
  21. [2017-03-13 11:55:07,249] DEBUG Added sensor with name record-size-max (org.apache.kafka.common.metrics.Metrics)
  22. [2017-03-13 11:55:07,250] DEBUG Starting Kafka producer I/O thread. (org.apache.kafka.clients.producer.internals.Sender)
  23. [2017-03-13 11:55:07,252] INFO Kafka version : 0.10.1.0 (org.apache.kafka.common.utils.AppInfoParser)
  24. [2017-03-13 11:55:07,252] INFO Kafka commitId : 3402a74efb23d1d4 (org.apache.kafka.common.utils.AppInfoParser)
  25. [2017-03-13 11:55:07,252] DEBUG Kafka producer started (org.apache.kafka.clients.producer.KafkaProducer)
  26. test-message
  27. [2017-03-13 11:55:09,402] DEBUG Initialize connection to node -1 for sending metadata request (org.apache.kafka.clients.NetworkClient)
  28. [2017-03-13 11:55:09,402] DEBUG Initiating connection to node -1 at server1:30092. (org.apache.kafka.clients.NetworkClient)
  29. [2017-03-13 11:55:09,413] DEBUG Added sensor with name node--1.bytes-sent (org.apache.kafka.common.metrics.Metrics)
  30. [2017-03-13 11:55:09,414] DEBUG Added sensor with name node--1.bytes-received (org.apache.kafka.common.metrics.Metrics)
  31. [2017-03-13 11:55:09,415] DEBUG Added sensor with name node--1.latency (org.apache.kafka.common.metrics.Metrics)
  32. [2017-03-13 11:55:09,416] DEBUG Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 102400, SO_TIMEOUT = 0 to node -1 (org.apache.kafka.common.network.Selector)
  33. [2017-03-13 11:55:09,416] DEBUG Completed connection to node -1 (org.apache.kafka.clients.NetworkClient)
  34. [2017-03-13 11:55:09,459] DEBUG Sending metadata request {topics=[test]} to node -1 (org.apache.kafka.clients.NetworkClient)
  35. [2017-03-13 11:55:09,486] DEBUG Updated cluster metadata version 2 to Cluster(id = fZCI7_S1QdSZkJwJfOm81g, nodes = [server0:30092 (id: 0 rack: null), server2:30092 (id: 2 rack: null), server1:30092 (id: 1 rack: null)], partitions = [Partition(topic = test, partition = 0, leader = 0, replicas = [0,1,2,], isr = [0,1,2,])]) (org.apache.kafka.clients.Metadata)
  36. [2017-03-13 11:55:10,497] DEBUG Initiating connection to node 0 at server0:30092. (org.apache.kafka.clients.NetworkClient)
  37. [2017-03-13 11:55:10,498] DEBUG Added sensor with name node-0.bytes-sent (org.apache.kafka.common.metrics.Metrics)
  38. [2017-03-13 11:55:10,499] DEBUG Added sensor with name node-0.bytes-received (org.apache.kafka.common.metrics.Metrics)
  39. [2017-03-13 11:55:10,499] DEBUG Added sensor with name node-0.latency (org.apache.kafka.common.metrics.Metrics)
  40. [2017-03-13 11:55:10,500] DEBUG Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 102400, SO_TIMEOUT = 0 to node 0 (org.apache.kafka.common.network.Selector)
  41. [2017-03-13 11:55:10,500] DEBUG Completed connection to node 0 (org.apache.kafka.clients.NetworkClient)
  42. [2017-03-13 11:55:10,500] DEBUG Added sensor with name topic.test.records-per-batch (org.apache.kafka.common.metrics.Metrics)
  43. [2017-03-13 11:55:10,501] DEBUG Added sensor with name topic.test.bytes (org.apache.kafka.common.metrics.Metrics)
  44. [2017-03-13 11:55:10,501] DEBUG Added sensor with name topic.test.compression-rate (org.apache.kafka.common.metrics.Metrics)
  45. [2017-03-13 11:55:10,502] DEBUG Added sensor with name topic.test.record-retries (org.apache.kafka.common.metrics.Metrics)
  46. [2017-03-13 11:55:10,502] DEBUG Added sensor with name topic.test.record-errors (org.apache.kafka.common.metrics.Metrics)
  47. [2017-03-13 11:55:10,509] WARN Got error produce response with correlation id 1 on topic-partition test-0, retrying (2 attempts left). Error: NOT_LEADER_FOR_PARTITION (org.apache.kafka.clients.producer.internals.Sender)
  48. [2017-03-13 11:55:10,509] DEBUG Sending metadata request {topics=[test]} to node 0 (org.apache.kafka.clients.NetworkClient)
  49. [2017-03-13 11:55:10,511] DEBUG Updated cluster metadata version 3 to Cluster(id = fZCI7_S1QdSZkJwJfOm81g, nodes = [server2:30092 (id: 2 rack: null), server0:30092 (id: 0 rack: null), server1:30092 (id: 1 rack: null)], partitions = [Partition(topic = test, partition = 0, leader = 0, replicas = [0,1,2,], isr = [0,1,2,])]) (org.apache.kafka.clients.Metadata)
  50. [2017-03-13 11:55:10,611] WARN Got error produce response with correlation id 3 on topic-partition test-0, retrying (1 attempts left). Error: NOT_LEADER_FOR_PARTITION (org.apache.kafka.clients.producer.internals.Sender)
  51. [2017-03-13 11:55:10,612] DEBUG Sending metadata request {topics=[test]} to node 0 (org.apache.kafka.clients.NetworkClient)
  52. [2017-03-13 11:55:10,614] DEBUG Updated cluster metadata version 4 to Cluster(id = fZCI7_S1QdSZkJwJfOm81g, nodes = [server0:30092 (id: 0 rack: null), server1:30092 (id: 1 rack: null), server2:30092 (id: 2 rack: null)], partitions = [Partition(topic = test, partition = 0, leader = 0, replicas = [0,1,2,], isr = [0,1,2,])]) (org.apache.kafka.clients.Metadata)
  53. [2017-03-13 11:55:10,714] WARN Got error produce response with correlation id 5 on topic-partition test-0, retrying (0 attempts left). Error: NOT_LEADER_FOR_PARTITION (org.apache.kafka.clients.producer.internals.Sender)
  54. [2017-03-13 11:55:10,714] DEBUG Sending metadata request {topics=[test]} to node 0 (org.apache.kafka.clients.NetworkClient)
  55. [2017-03-13 11:55:10,716] DEBUG Updated cluster metadata version 5 to Cluster(id = fZCI7_S1QdSZkJwJfOm81g, nodes = [server0:30092 (id: 0 rack: null), server2:30092 (id: 2 rack: null), server1:30092 (id: 1 rack: null)], partitions = [Partition(topic = test, partition = 0, leader = 0, replicas = [0,1,2,], isr = [0,1,2,])]) (org.apache.kafka.clients.Metadata)
  56. [2017-03-13 11:55:10,817] ERROR Error when sending message to topic test with key: null, value: 6 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
  57. org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.
  58. [2017-03-13 11:55:10,819] DEBUG Sending metadata request {topics=[test]} to node 0 (org.apache.kafka.clients.NetworkClient)
  59. [2017-03-13 11:55:10,820] DEBUG Updated cluster metadata version 6 to Cluster(id = fZCI7_S1QdSZkJwJfOm81g, nodes = [server1:30092 (id: 1 rack: null), server2:30092 (id: 2 rack: null), server0:30092 (id: 0 rack: null)], partitions = [Partition(topic = test, partition = 0, leader = 0, replicas = [0,1,2,], isr = [0,1,2,])]) (org.apache.kafka.clients.Metadata)
  60. ^C[2017-03-13 11:55:14,864] INFO Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (org.apache.kafka.clients.producer.KafkaProducer)
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!