Guest User

Untitled

a guest
Jul 23rd, 2018
74
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.60 KB | None | 0 0
  1. require "kafka"
  2.  
  3. logger = Logger.new($stderr)
  4. brokers = ENV.fetch("KAFKA_BROKERS")
  5.  
  6. # Make sure to create this topic in your Kafka cluster or configure the
  7. # cluster to auto-create topics.
  8. topic = "text"
  9.  
  10. kafka = Kafka.new(
  11. seed_brokers: brokers,
  12. client_id: "simple-producer",
  13. logger: logger,
  14. )
  15.  
  16. producer = kafka.producer
  17.  
  18. begin
  19. $stdin.each_with_index do |line, index|
  20. producer.produce(line, topic: topic)
  21.  
  22. # Send messages for every 10 lines.
  23. producer.deliver_messages if index % 10 == 0
  24. end
  25. ensure
  26. # Make sure to send any remaining messages.
  27. producer.deliver_messages
  28.  
  29. producer.shutdown
  30. end
Add Comment
Please, Sign In to add comment