API tools faq
paste
Guest User

Untitled

a guest
Jul 28th, 2016
404
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 340.78 KB | None | 0 0
raw download clone embed print report
  1. [2016-07-28 11:57:29,665] INFO Hadoop configuration directory /etc/hadoop/conf (io.confluent.connect.hdfs.DataWriter:94)
  2. [2016-07-28 11:57:29,665] INFO Hadoop configuration directory /etc/hadoop/conf (io.confluent.connect.hdfs.DataWriter:94)
  3. [2016-07-28 11:57:29,665] INFO Hadoop configuration directory /etc/hadoop/conf (io.confluent.connect.hdfs.DataWriter:94)
  4. [2016-07-28 11:57:29,665] INFO Hadoop configuration directory /etc/hadoop/conf (io.confluent.connect.hdfs.DataWriter:94)
  5. [2016-07-28 11:57:30,024] WARN Unable to load native-hadoop library for your platform... using builtin-java classes where applicable (org.apache.hadoop.util.NativeCodeLoader:62)
  6. [2016-07-28 11:57:30,841] WARN The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. (org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory:117)
  7. [2016-07-28 11:57:30,987] ERROR getRecordWriterProvider ProtoParquetRecordWriterProvider (se.deltaprojects.kafka.ProtoParquetFormat:18)
  8. [2016-07-28 11:57:30,987] ERROR getRecordWriterProvider ProtoParquetRecordWriterProvider (se.deltaprojects.kafka.ProtoParquetFormat:18)
  9. [2016-07-28 11:57:30,987] ERROR getRecordWriterProvider ProtoParquetRecordWriterProvider (se.deltaprojects.kafka.ProtoParquetFormat:18)
  10. [2016-07-28 11:57:30,987] ERROR getRecordWriterProvider ProtoParquetRecordWriterProvider (se.deltaprojects.kafka.ProtoParquetFormat:18)
  11. [2016-07-28 11:57:31,136] INFO Sink task WorkerSinkTask{id=hdfs-sink-sting-impression-2} finished initialization and start (org.apache.kafka.connect.runtime.WorkerSinkTask:208)
  12. [2016-07-28 11:57:31,140] INFO Sink task WorkerSinkTask{id=hdfs-sink-sting-impression-4} finished initialization and start (org.apache.kafka.connect.runtime.WorkerSinkTask:208)
  13. [2016-07-28 11:57:31,136] INFO Sink task WorkerSinkTask{id=hdfs-sink-sting-impression-6} finished initialization and start (org.apache.kafka.connect.runtime.WorkerSinkTask:208)
  14. [2016-07-28 11:57:31,140] INFO Sink task WorkerSinkTask{id=hdfs-sink-sting-impression-0} finished initialization and start (org.apache.kafka.connect.runtime.WorkerSinkTask:208)
  15. [2016-07-28 11:57:31,149] INFO Discovered coordinator kafka-ix01.se-ix.delta.prod:6667 (id: 2137162630 rack: null) for group connect-hdfs-sink-sting-impression. (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:505)
  16. [2016-07-28 11:57:31,150] INFO Revoking previously assigned partitions [] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:280)
  17. [2016-07-28 11:57:31,150] INFO (Re-)joining group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:326)
  18. [2016-07-28 11:57:31,243] INFO Discovered coordinator kafka-ix01.se-ix.delta.prod:6667 (id: 2137162630 rack: null) for group connect-hdfs-sink-sting-impression. (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:505)
  19. [2016-07-28 11:57:31,243] INFO Revoking previously assigned partitions [] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:280)
  20. [2016-07-28 11:57:31,244] INFO (Re-)joining group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:326)
  21. [2016-07-28 11:57:31,245] INFO Discovered coordinator kafka-ix01.se-ix.delta.prod:6667 (id: 2137162630 rack: null) for group connect-hdfs-sink-sting-impression. (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:505)
  22. [2016-07-28 11:57:31,246] INFO Revoking previously assigned partitions [] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:280)
  23. [2016-07-28 11:57:31,246] INFO (Re-)joining group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:326)
  24. [2016-07-28 11:57:31,249] INFO Discovered coordinator kafka-ix01.se-ix.delta.prod:6667 (id: 2137162630 rack: null) for group connect-hdfs-sink-sting-impression. (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:505)
  25. [2016-07-28 11:57:31,250] INFO Revoking previously assigned partitions [] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:280)
  26. [2016-07-28 11:57:31,250] INFO (Re-)joining group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:326)
  27. [2016-07-28 11:58:01,055] INFO Successfully joined group connect-hdfs-sink-sting-impression with generation 4 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:434)
  28. [2016-07-28 11:58:01,055] INFO Successfully joined group connect-hdfs-sink-sting-impression with generation 4 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:434)
  29. [2016-07-28 11:58:01,055] INFO Successfully joined group connect-hdfs-sink-sting-impression with generation 4 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:434)
  30. [2016-07-28 11:58:01,057] INFO Setting newly assigned partitions [sting_actions_click-96, sting_actions_impression-79, sting_actions_click-92, sting_actions_impression-75, sting_actions_impression-87, sting_actions_inscreen-76, sting_actions_impression-83, sting_actions_inscreen-80, sting_actions_inscreen-85, sting_actions_click-80, sting_actions_impression-95, sting_actions_inscreen-89, sting_actions_click-76, sting_actions_impression-91, sting_actions_inscreen-93, sting_actions_click-88, sting_actions_inscreen-97, sting_actions_click-84, sting_actions_impression-99, sting_actions_click-97, sting_actions_impression-82, sting_actions_click-93, sting_actions_impression-78, sting_actions_impression-90, sting_actions_inscreen-75, sting_actions_impression-86, sting_actions_inscreen-79, sting_actions_click-81, sting_actions_impression-98, sting_actions_inscreen-84, sting_actions_click-77, sting_actions_impression-94, sting_actions_inscreen-88, sting_actions_click-89, sting_actions_inscreen-92, sting_actions_click-85, sting_actions_inscreen-96, sting_actions_impression-81, sting_actions_inscreen-99, sting_actions_click-94, sting_actions_impression-77, sting_actions_click-90, sting_actions_impression-89, sting_actions_inscreen-78, sting_actions_impression-85, sting_actions_inscreen-82, sting_actions_click-98, sting_actions_impression-97, sting_actions_inscreen-83, sting_actions_click-78, sting_actions_impression-93, sting_actions_inscreen-87, sting_actions_inscreen-91, sting_actions_click-86, sting_actions_inscreen-95, sting_actions_click-82, sting_actions_click-95, sting_actions_impression-80, sting_actions_click-91, sting_actions_impression-76, sting_actions_inscreen-77, sting_actions_impression-88, sting_actions_inscreen-81, sting_actions_click-99, sting_actions_impression-84, sting_actions_inscreen-86, sting_actions_click-79, sting_actions_impression-96, sting_actions_inscreen-90, sting_actions_click-75, sting_actions_impression-92, sting_actions_inscreen-94, sting_actions_click-87, sting_actions_inscreen-98, sting_actions_click-83] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:219)
  31. [2016-07-28 11:58:01,057] INFO Setting newly assigned partitions [sting_actions_inscreen-35, sting_actions_click-30, sting_actions_impression-46, sting_actions_inscreen-39, sting_actions_click-26, sting_actions_impression-25, sting_actions_inscreen-43, sting_actions_click-38, sting_actions_inscreen-47, sting_actions_click-34, sting_actions_impression-33, sting_actions_click-47, sting_actions_impression-29, sting_actions_click-43, sting_actions_impression-41, sting_actions_inscreen-27, sting_actions_impression-37, sting_actions_inscreen-31, sting_actions_impression-49, sting_actions_inscreen-38, sting_actions_click-31, sting_actions_impression-45, sting_actions_inscreen-42, sting_actions_click-27, sting_actions_inscreen-46, sting_actions_click-39, sting_actions_click-35, sting_actions_click-48, sting_actions_impression-32, sting_actions_click-44, sting_actions_inscreen-26, sting_actions_impression-28, sting_actions_inscreen-30, sting_actions_impression-40, sting_actions_inscreen-34, sting_actions_impression-36, sting_actions_inscreen-37, sting_actions_click-32, sting_actions_impression-48, sting_actions_inscreen-41, sting_actions_click-28, sting_actions_impression-44, sting_actions_inscreen-45, sting_actions_click-40, sting_actions_inscreen-49, sting_actions_click-36, sting_actions_click-49, sting_actions_impression-31, sting_actions_click-45, sting_actions_inscreen-25, sting_actions_impression-27, sting_actions_inscreen-29, sting_actions_impression-39, sting_actions_inscreen-33, sting_actions_impression-35, sting_actions_click-33, sting_actions_impression-47, sting_actions_inscreen-36, sting_actions_click-29, sting_actions_impression-43, sting_actions_inscreen-40, sting_actions_click-41, sting_actions_impression-26, sting_actions_inscreen-44, sting_actions_click-37, sting_actions_inscreen-48, sting_actions_impression-34, sting_actions_click-46, sting_actions_impression-30, sting_actions_click-42, sting_actions_click-25, sting_actions_impression-42, sting_actions_inscreen-28, sting_actions_impression-38, sting_actions_inscreen-32] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:219)
  32. [2016-07-28 11:58:01,055] INFO Successfully joined group connect-hdfs-sink-sting-impression with generation 4 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:434)
  33. [2016-07-28 11:58:01,056] INFO Setting newly assigned partitions [sting_actions_impression-17, sting_actions_click-1, sting_actions_inscreen-6, sting_actions_impression-13, sting_actions_inscreen-10, sting_actions_click-9, sting_actions_inscreen-14, sting_actions_impression-21, sting_actions_click-5, sting_actions_inscreen-18, sting_actions_inscreen-19, sting_actions_impression-0, sting_actions_click-14, sting_actions_inscreen-23, sting_actions_click-10, sting_actions_impression-8, sting_actions_click-22, sting_actions_inscreen-2, sting_actions_impression-4, sting_actions_click-18, sting_actions_inscreen-5, sting_actions_impression-16, sting_actions_inscreen-9, sting_actions_impression-12, sting_actions_inscreen-13, sting_actions_impression-24, sting_actions_click-6, sting_actions_inscreen-17, sting_actions_impression-20, sting_actions_click-2, sting_actions_inscreen-22, sting_actions_click-15, sting_actions_click-11, sting_actions_impression-7, sting_actions_click-23, sting_actions_inscreen-1, sting_actions_impression-3, sting_actions_click-19, sting_actions_impression-15, sting_actions_inscreen-4, sting_actions_impression-11, sting_actions_inscreen-8, sting_actions_impression-23, sting_actions_click-7, sting_actions_inscreen-12, sting_actions_impression-19, sting_actions_click-3, sting_actions_inscreen-16, sting_actions_inscreen-21, sting_actions_impression-2, sting_actions_click-16, sting_actions_click-12, sting_actions_impression-10, sting_actions_click-24, sting_actions_impression-6, sting_actions_click-20, sting_actions_inscreen-0, sting_actions_impression-18, sting_actions_click-0, sting_actions_inscreen-3, sting_actions_impression-14, sting_actions_inscreen-7, sting_actions_click-8, sting_actions_inscreen-11, sting_actions_impression-22, sting_actions_click-4, sting_actions_inscreen-15, sting_actions_impression-1, sting_actions_click-17, sting_actions_inscreen-20, sting_actions_click-13, sting_actions_inscreen-24, sting_actions_impression-9, sting_actions_impression-5, sting_actions_click-21] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:219)
  34. [2016-07-28 11:58:01,061] INFO Setting newly assigned partitions [sting_actions_impression-50, sting_actions_click-63, sting_actions_inscreen-68, sting_actions_click-59, sting_actions_inscreen-72, sting_actions_impression-58, sting_actions_click-71, sting_actions_impression-54, sting_actions_click-67, sting_actions_impression-66, sting_actions_inscreen-52, sting_actions_impression-62, sting_actions_inscreen-56, sting_actions_impression-74, sting_actions_click-55, sting_actions_inscreen-60, sting_actions_impression-70, sting_actions_click-51, sting_actions_inscreen-64, sting_actions_click-64, sting_actions_inscreen-67, sting_actions_click-60, sting_actions_inscreen-71, sting_actions_impression-57, sting_actions_click-72, sting_actions_impression-53, sting_actions_click-68, sting_actions_inscreen-50, sting_actions_impression-65, sting_actions_inscreen-51, sting_actions_impression-61, sting_actions_inscreen-55, sting_actions_impression-73, sting_actions_click-56, sting_actions_inscreen-59, sting_actions_impression-69, sting_actions_click-52, sting_actions_inscreen-63, sting_actions_click-65, sting_actions_inscreen-70, sting_actions_click-61, sting_actions_inscreen-74, sting_actions_click-73, sting_actions_impression-56, sting_actions_click-69, sting_actions_impression-52, sting_actions_inscreen-54, sting_actions_impression-64, sting_actions_inscreen-58, sting_actions_impression-60, sting_actions_click-74, sting_actions_click-57, sting_actions_inscreen-62, sting_actions_impression-72, sting_actions_click-53, sting_actions_inscreen-66, sting_actions_impression-68, sting_actions_inscreen-69, sting_actions_click-62, sting_actions_inscreen-73, sting_actions_click-58, sting_actions_impression-55, sting_actions_click-70, sting_actions_impression-51, sting_actions_click-66, sting_actions_inscreen-53, sting_actions_impression-63, sting_actions_inscreen-57, sting_actions_impression-59, sting_actions_inscreen-61, sting_actions_impression-71, sting_actions_click-54, sting_actions_inscreen-65, sting_actions_impression-67, sting_actions_click-50] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:219)
  35. [2016-07-28 11:58:01,097] INFO Started recovery for topic partition sting_actions_impression-50 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  36. [2016-07-28 11:58:01,100] INFO Started recovery for topic partition sting_actions_click-96 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  37. [2016-07-28 11:58:01,098] INFO Started recovery for topic partition sting_actions_impression-17 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  38. [2016-07-28 11:58:01,100] INFO Started recovery for topic partition sting_actions_inscreen-35 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  39. [2016-07-28 11:58:02,310] INFO Finished recovery for topic partition sting_actions_click-96 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  40. [2016-07-28 11:58:02,311] INFO Started recovery for topic partition sting_actions_impression-79 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  41. [2016-07-28 11:58:02,337] INFO Finished recovery for topic partition sting_actions_inscreen-35 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  42. [2016-07-28 11:58:02,338] INFO Started recovery for topic partition sting_actions_click-30 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  43. [2016-07-28 11:58:02,695] INFO Finished recovery for topic partition sting_actions_impression-17 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  44. [2016-07-28 11:58:02,695] INFO Started recovery for topic partition sting_actions_click-1 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  45. [2016-07-28 11:58:02,762] INFO Finished recovery for topic partition sting_actions_impression-50 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  46. [2016-07-28 11:58:02,763] INFO Started recovery for topic partition sting_actions_click-63 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  47. [2016-07-28 11:58:02,797] INFO Finished recovery for topic partition sting_actions_click-30 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  48. [2016-07-28 11:58:02,797] INFO Started recovery for topic partition sting_actions_impression-46 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  49. [2016-07-28 11:58:03,086] INFO Finished recovery for topic partition sting_actions_click-1 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  50. [2016-07-28 11:58:03,087] INFO Started recovery for topic partition sting_actions_inscreen-6 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  51. [2016-07-28 11:58:03,116] INFO Finished recovery for topic partition sting_actions_click-63 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  52. [2016-07-28 11:58:03,117] INFO Started recovery for topic partition sting_actions_inscreen-68 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  53. [2016-07-28 11:58:03,120] INFO Finished recovery for topic partition sting_actions_impression-79 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  54. [2016-07-28 11:58:03,120] INFO Started recovery for topic partition sting_actions_click-92 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  55. [2016-07-28 11:58:03,491] INFO Finished recovery for topic partition sting_actions_inscreen-6 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  56. [2016-07-28 11:58:03,492] INFO Started recovery for topic partition sting_actions_impression-13 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  57. [2016-07-28 11:58:03,557] INFO Finished recovery for topic partition sting_actions_inscreen-68 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  58. [2016-07-28 11:58:03,558] INFO Started recovery for topic partition sting_actions_click-59 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  59. [2016-07-28 11:58:03,562] INFO Finished recovery for topic partition sting_actions_click-92 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  60. [2016-07-28 11:58:03,563] INFO Started recovery for topic partition sting_actions_impression-75 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  61. [2016-07-28 11:58:03,571] INFO Finished recovery for topic partition sting_actions_impression-46 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  62. [2016-07-28 11:58:03,571] INFO Started recovery for topic partition sting_actions_inscreen-39 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  63. [2016-07-28 11:58:03,803] INFO Finished recovery for topic partition sting_actions_click-59 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  64. [2016-07-28 11:58:03,803] INFO Started recovery for topic partition sting_actions_inscreen-72 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  65. [2016-07-28 11:58:03,848] INFO Finished recovery for topic partition sting_actions_inscreen-39 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  66. [2016-07-28 11:58:03,849] INFO Started recovery for topic partition sting_actions_click-26 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  67. [2016-07-28 11:58:03,978] INFO Finished recovery for topic partition sting_actions_impression-13 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  68. [2016-07-28 11:58:03,978] INFO Started recovery for topic partition sting_actions_inscreen-10 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  69. [2016-07-28 11:58:04,040] INFO Finished recovery for topic partition sting_actions_click-26 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  70. [2016-07-28 11:58:04,040] INFO Started recovery for topic partition sting_actions_impression-25 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  71. [2016-07-28 11:58:04,051] INFO Finished recovery for topic partition sting_actions_inscreen-72 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  72. [2016-07-28 11:58:04,052] INFO Started recovery for topic partition sting_actions_impression-58 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  73. [2016-07-28 11:58:04,100] INFO Finished recovery for topic partition sting_actions_impression-75 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  74. [2016-07-28 11:58:04,100] INFO Started recovery for topic partition sting_actions_impression-87 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  75. [2016-07-28 11:58:04,259] INFO Finished recovery for topic partition sting_actions_inscreen-10 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  76. [2016-07-28 11:58:04,260] INFO Started recovery for topic partition sting_actions_click-9 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  77. [2016-07-28 11:58:04,519] INFO Finished recovery for topic partition sting_actions_click-9 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  78. [2016-07-28 11:58:04,519] INFO Started recovery for topic partition sting_actions_inscreen-14 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  79. [2016-07-28 11:58:04,542] INFO Finished recovery for topic partition sting_actions_impression-58 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  80. [2016-07-28 11:58:04,542] INFO Started recovery for topic partition sting_actions_click-71 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  81. [2016-07-28 11:58:04,635] INFO Finished recovery for topic partition sting_actions_impression-25 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  82. [2016-07-28 11:58:04,636] INFO Started recovery for topic partition sting_actions_inscreen-43 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  83. [2016-07-28 11:58:04,657] INFO Finished recovery for topic partition sting_actions_impression-87 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  84. [2016-07-28 11:58:04,658] INFO Started recovery for topic partition sting_actions_inscreen-76 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  85. [2016-07-28 11:58:04,832] INFO Finished recovery for topic partition sting_actions_inscreen-14 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  86. [2016-07-28 11:58:04,833] INFO Started recovery for topic partition sting_actions_impression-21 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  87. [2016-07-28 11:58:04,854] INFO Finished recovery for topic partition sting_actions_click-71 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  88. [2016-07-28 11:58:04,855] INFO Started recovery for topic partition sting_actions_impression-54 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  89. [2016-07-28 11:58:04,928] INFO Finished recovery for topic partition sting_actions_inscreen-43 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  90. [2016-07-28 11:58:04,929] INFO Started recovery for topic partition sting_actions_click-38 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  91. [2016-07-28 11:58:05,075] INFO Finished recovery for topic partition sting_actions_inscreen-76 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  92. [2016-07-28 11:58:05,076] INFO Started recovery for topic partition sting_actions_impression-83 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  93. [2016-07-28 11:58:05,243] INFO Finished recovery for topic partition sting_actions_click-38 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  94. [2016-07-28 11:58:05,243] INFO Started recovery for topic partition sting_actions_inscreen-47 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  95. [2016-07-28 11:58:05,427] INFO Finished recovery for topic partition sting_actions_impression-21 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  96. [2016-07-28 11:58:05,428] INFO Started recovery for topic partition sting_actions_click-5 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  97. [2016-07-28 11:58:05,634] INFO Finished recovery for topic partition sting_actions_inscreen-47 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  98. [2016-07-28 11:58:05,635] INFO Started recovery for topic partition sting_actions_click-34 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  99. [2016-07-28 11:58:05,645] INFO Finished recovery for topic partition sting_actions_impression-54 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  100. [2016-07-28 11:58:05,645] INFO Started recovery for topic partition sting_actions_click-67 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  101. [2016-07-28 11:58:05,709] INFO Finished recovery for topic partition sting_actions_impression-83 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  102. [2016-07-28 11:58:05,709] INFO Started recovery for topic partition sting_actions_inscreen-80 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  103. [2016-07-28 11:58:05,746] INFO Finished recovery for topic partition sting_actions_click-5 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  104. [2016-07-28 11:58:05,747] INFO Started recovery for topic partition sting_actions_inscreen-18 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  105. [2016-07-28 11:58:05,863] INFO Finished recovery for topic partition sting_actions_click-34 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  106. [2016-07-28 11:58:05,865] INFO Started recovery for topic partition sting_actions_impression-33 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  107. [2016-07-28 11:58:05,877] INFO Finished recovery for topic partition sting_actions_click-67 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  108. [2016-07-28 11:58:05,877] INFO Started recovery for topic partition sting_actions_impression-66 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  109. [2016-07-28 11:58:05,973] INFO Finished recovery for topic partition sting_actions_inscreen-80 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  110. [2016-07-28 11:58:05,974] INFO Started recovery for topic partition sting_actions_inscreen-85 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  111. [2016-07-28 11:58:06,006] INFO Finished recovery for topic partition sting_actions_inscreen-18 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  112. [2016-07-28 11:58:06,007] INFO Started recovery for topic partition sting_actions_inscreen-19 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  113. [2016-07-28 11:58:06,248] INFO Finished recovery for topic partition sting_actions_inscreen-85 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  114. [2016-07-28 11:58:06,250] INFO Started recovery for topic partition sting_actions_click-80 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  115. [2016-07-28 11:58:06,299] INFO Finished recovery for topic partition sting_actions_inscreen-19 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  116. [2016-07-28 11:58:06,300] INFO Started recovery for topic partition sting_actions_impression-0 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  117. [2016-07-28 11:58:06,362] INFO Finished recovery for topic partition sting_actions_impression-66 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  118. [2016-07-28 11:58:06,363] INFO Started recovery for topic partition sting_actions_inscreen-52 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  119. [2016-07-28 11:58:06,395] INFO Finished recovery for topic partition sting_actions_impression-33 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  120. [2016-07-28 11:58:06,395] INFO Started recovery for topic partition sting_actions_click-47 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  121. [2016-07-28 11:58:06,554] INFO Finished recovery for topic partition sting_actions_click-80 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  122. [2016-07-28 11:58:06,554] INFO Started recovery for topic partition sting_actions_impression-95 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  123. [2016-07-28 11:58:06,707] INFO Finished recovery for topic partition sting_actions_click-47 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  124. [2016-07-28 11:58:06,708] INFO Started recovery for topic partition sting_actions_impression-29 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  125. [2016-07-28 11:58:06,992] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/52/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  126. [2016-07-28 11:58:07,036] INFO Finished recovery for topic partition sting_actions_impression-0 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  127. [2016-07-28 11:58:07,036] INFO Started recovery for topic partition sting_actions_click-14 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  128. [2016-07-28 11:58:07,260] INFO Finished recovery for topic partition sting_actions_impression-95 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  129. [2016-07-28 11:58:07,261] INFO Started recovery for topic partition sting_actions_inscreen-89 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  130. [2016-07-28 11:58:07,323] INFO Finished recovery for topic partition sting_actions_click-14 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  131. [2016-07-28 11:58:07,324] INFO Started recovery for topic partition sting_actions_inscreen-23 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  132. [2016-07-28 11:58:07,392] INFO Finished recovery for topic partition sting_actions_impression-29 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  133. [2016-07-28 11:58:07,392] INFO Started recovery for topic partition sting_actions_click-43 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  134. [2016-07-28 11:58:07,434] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/43/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  135. [2016-07-28 11:58:07,548] INFO Finished recovery for topic partition sting_actions_inscreen-89 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  136. [2016-07-28 11:58:07,549] INFO Started recovery for topic partition sting_actions_click-76 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  137. [2016-07-28 11:58:07,651] INFO Finished recovery for topic partition sting_actions_inscreen-23 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  138. [2016-07-28 11:58:07,651] INFO Started recovery for topic partition sting_actions_click-10 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  139. [2016-07-28 11:58:07,746] INFO Finished recovery for topic partition sting_actions_click-76 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  140. [2016-07-28 11:58:07,746] INFO Started recovery for topic partition sting_actions_impression-91 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  141. [2016-07-28 11:58:07,848] INFO Finished recovery for topic partition sting_actions_click-10 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  142. [2016-07-28 11:58:07,849] INFO Started recovery for topic partition sting_actions_impression-8 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  143. [2016-07-28 11:58:08,035] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/52/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  144. [2016-07-28 11:58:08,257] INFO Finished recovery for topic partition sting_actions_impression-91 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  145. [2016-07-28 11:58:08,258] INFO Started recovery for topic partition sting_actions_inscreen-93 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  146. [2016-07-28 11:58:08,293] INFO Finished recovery for topic partition sting_actions_impression-8 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  147. [2016-07-28 11:58:08,293] INFO Started recovery for topic partition sting_actions_click-22 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  148. [2016-07-28 11:58:08,314] ERROR Recovery failed at state RECOVERY_PARTITION_PAUSED (io.confluent.connect.hdfs.TopicPartitionWriter:214)
  149. org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/22/log
  150. at io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:91)
  151. at io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
  152. at io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:441)
  153. at io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:197)
  154. at io.confluent.connect.hdfs.DataWriter.recover(DataWriter.java:239)
  155. at io.confluent.connect.hdfs.DataWriter.open(DataWriter.java:281)
  156. at io.confluent.connect.hdfs.HdfsSinkTask.open(HdfsSinkTask.java:104)
  157. at org.apache.kafka.connect.runtime.WorkerSinkTask.openPartitions(WorkerSinkTask.java:417)
  158. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1000(WorkerSinkTask.java:54)
  159. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:453)
  160. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
  161. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
  162. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
  163. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  164. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  165. at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
  166. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  167. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  168. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
  169. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
  170. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
  171. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
  172. at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
  173. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  174. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  175. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
  176. at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
  177. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
  178. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
  179. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
  180. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
  181. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
  182. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  183. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  184. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  185. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  186. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  187. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  188. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  189. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  190. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  191. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  192. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  193. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  194. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  195. at java.lang.Thread.run(Thread.java:745)
  196. Caused by: java.io.EOFException
  197. at java.io.DataInputStream.readFully(DataInputStream.java:197)
  198. at java.io.DataInputStream.readFully(DataInputStream.java:169)
  199. at io.confluent.connect.hdfs.wal.WALFile$Reader.init(WALFile.java:590)
  200. at io.confluent.connect.hdfs.wal.WALFile$Reader.initialize(WALFile.java:558)
  201. at io.confluent.connect.hdfs.wal.WALFile$Reader.<init>(WALFile.java:535)
  202. at io.confluent.connect.hdfs.wal.WALFile$Writer.<init>(WALFile.java:215)
  203. at io.confluent.connect.hdfs.wal.WALFile.createWriter(WALFile.java:67)
  204. at io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:73)
  205. ... 45 more
  206. [2016-07-28 11:58:08,319] INFO Started recovery for topic partition sting_actions_inscreen-2 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  207. [2016-07-28 11:58:08,457] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/43/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  208. [2016-07-28 11:58:08,489] INFO Finished recovery for topic partition sting_actions_inscreen-93 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  209. [2016-07-28 11:58:08,489] INFO Started recovery for topic partition sting_actions_click-88 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  210. [2016-07-28 11:58:08,523] INFO Finished recovery for topic partition sting_actions_inscreen-2 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  211. [2016-07-28 11:58:08,524] INFO Started recovery for topic partition sting_actions_impression-4 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  212. [2016-07-28 11:58:08,673] INFO Finished recovery for topic partition sting_actions_click-88 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  213. [2016-07-28 11:58:08,673] INFO Started recovery for topic partition sting_actions_inscreen-97 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  214. [2016-07-28 11:58:08,894] INFO Finished recovery for topic partition sting_actions_inscreen-97 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  215. [2016-07-28 11:58:08,894] INFO Started recovery for topic partition sting_actions_click-84 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  216. [2016-07-28 11:58:08,960] INFO Finished recovery for topic partition sting_actions_impression-4 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  217. [2016-07-28 11:58:08,960] INFO Started recovery for topic partition sting_actions_click-18 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  218. [2016-07-28 11:58:08,983] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/18/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  219. [2016-07-28 11:58:09,076] INFO Finished recovery for topic partition sting_actions_click-84 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  220. [2016-07-28 11:58:09,076] INFO Started recovery for topic partition sting_actions_impression-99 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  221. [2016-07-28 11:58:09,457] INFO Finished recovery for topic partition sting_actions_impression-99 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  222. [2016-07-28 11:58:09,457] INFO Started recovery for topic partition sting_actions_click-97 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  223. [2016-07-28 11:58:09,605] INFO Finished recovery for topic partition sting_actions_click-97 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  224. [2016-07-28 11:58:09,606] INFO Started recovery for topic partition sting_actions_impression-82 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  225. [2016-07-28 11:58:09,907] INFO Finished recovery for topic partition sting_actions_impression-82 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  226. [2016-07-28 11:58:09,908] INFO Started recovery for topic partition sting_actions_click-93 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  227. [2016-07-28 11:58:10,003] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/18/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  228. [2016-07-28 11:58:10,055] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/52/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  229. [2016-07-28 11:58:10,082] INFO Finished recovery for topic partition sting_actions_click-93 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  230. [2016-07-28 11:58:10,083] INFO Started recovery for topic partition sting_actions_impression-78 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  231. [2016-07-28 11:58:10,377] INFO Finished recovery for topic partition sting_actions_impression-78 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  232. [2016-07-28 11:58:10,377] INFO Started recovery for topic partition sting_actions_impression-90 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  233. [2016-07-28 11:58:10,483] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/43/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  234. [2016-07-28 11:58:10,726] INFO Finished recovery for topic partition sting_actions_impression-90 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  235. [2016-07-28 11:58:10,726] INFO Started recovery for topic partition sting_actions_inscreen-75 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  236. [2016-07-28 11:58:10,878] INFO Finished recovery for topic partition sting_actions_inscreen-75 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  237. [2016-07-28 11:58:10,879] INFO Started recovery for topic partition sting_actions_impression-86 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  238. [2016-07-28 11:58:11,247] INFO Finished recovery for topic partition sting_actions_impression-86 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  239. [2016-07-28 11:58:11,248] INFO Started recovery for topic partition sting_actions_inscreen-79 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  240. [2016-07-28 11:58:11,426] INFO Finished recovery for topic partition sting_actions_inscreen-79 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  241. [2016-07-28 11:58:11,426] INFO Started recovery for topic partition sting_actions_click-81 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  242. [2016-07-28 11:58:11,567] INFO Finished recovery for topic partition sting_actions_click-81 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  243. [2016-07-28 11:58:11,568] INFO Started recovery for topic partition sting_actions_impression-98 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  244. [2016-07-28 11:58:11,968] INFO Finished recovery for topic partition sting_actions_impression-98 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  245. [2016-07-28 11:58:11,968] INFO Started recovery for topic partition sting_actions_inscreen-84 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  246. [2016-07-28 11:58:12,029] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/18/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  247. [2016-07-28 11:58:12,163] INFO Finished recovery for topic partition sting_actions_inscreen-84 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  248. [2016-07-28 11:58:12,164] INFO Started recovery for topic partition sting_actions_click-77 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  249. [2016-07-28 11:58:12,338] INFO Finished recovery for topic partition sting_actions_click-77 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  250. [2016-07-28 11:58:12,339] INFO Started recovery for topic partition sting_actions_impression-94 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  251. [2016-07-28 11:58:12,716] INFO Finished recovery for topic partition sting_actions_impression-94 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  252. [2016-07-28 11:58:12,716] INFO Started recovery for topic partition sting_actions_inscreen-88 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  253. [2016-07-28 11:58:12,929] INFO Finished recovery for topic partition sting_actions_inscreen-88 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  254. [2016-07-28 11:58:12,929] INFO Started recovery for topic partition sting_actions_click-89 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  255. [2016-07-28 11:58:13,104] INFO Finished recovery for topic partition sting_actions_click-89 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  256. [2016-07-28 11:58:13,105] INFO Started recovery for topic partition sting_actions_inscreen-92 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  257. [2016-07-28 11:58:13,340] INFO Finished recovery for topic partition sting_actions_inscreen-92 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  258. [2016-07-28 11:58:13,340] INFO Started recovery for topic partition sting_actions_click-85 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  259. [2016-07-28 11:58:13,529] INFO Finished recovery for topic partition sting_actions_click-85 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  260. [2016-07-28 11:58:13,529] INFO Started recovery for topic partition sting_actions_inscreen-96 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  261. [2016-07-28 11:58:13,747] INFO Finished recovery for topic partition sting_actions_inscreen-96 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  262. [2016-07-28 11:58:13,748] INFO Started recovery for topic partition sting_actions_impression-81 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  263. [2016-07-28 11:58:14,107] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/52/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  264. [2016-07-28 11:58:14,154] INFO Finished recovery for topic partition sting_actions_impression-81 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  265. [2016-07-28 11:58:14,155] INFO Started recovery for topic partition sting_actions_inscreen-99 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  266. [2016-07-28 11:58:14,366] INFO Finished recovery for topic partition sting_actions_inscreen-52 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  267. [2016-07-28 11:58:14,367] INFO Started recovery for topic partition sting_actions_impression-62 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  268. [2016-07-28 11:58:14,393] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/62/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  269. [2016-07-28 11:58:14,394] INFO Finished recovery for topic partition sting_actions_inscreen-99 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  270. [2016-07-28 11:58:14,394] INFO Started recovery for topic partition sting_actions_click-94 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  271. [2016-07-28 11:58:14,500] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/43/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  272. [2016-07-28 11:58:14,606] INFO Finished recovery for topic partition sting_actions_click-94 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  273. [2016-07-28 11:58:14,606] INFO Started recovery for topic partition sting_actions_impression-77 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  274. [2016-07-28 11:58:14,731] INFO Finished recovery for topic partition sting_actions_click-43 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  275. [2016-07-28 11:58:14,732] INFO Started recovery for topic partition sting_actions_impression-41 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  276. [2016-07-28 11:58:14,992] INFO Finished recovery for topic partition sting_actions_impression-77 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  277. [2016-07-28 11:58:14,992] INFO Started recovery for topic partition sting_actions_click-90 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  278. [2016-07-28 11:58:15,104] INFO Finished recovery for topic partition sting_actions_impression-41 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  279. [2016-07-28 11:58:15,104] INFO Started recovery for topic partition sting_actions_inscreen-27 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  280. [2016-07-28 11:58:15,209] INFO Finished recovery for topic partition sting_actions_click-90 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  281. [2016-07-28 11:58:15,210] INFO Started recovery for topic partition sting_actions_impression-89 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  282. [2016-07-28 11:58:15,345] INFO Finished recovery for topic partition sting_actions_inscreen-27 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  283. [2016-07-28 11:58:15,345] INFO Started recovery for topic partition sting_actions_impression-37 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  284. [2016-07-28 11:58:15,421] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/62/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  285. [2016-07-28 11:58:15,644] INFO Finished recovery for topic partition sting_actions_impression-89 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  286. [2016-07-28 11:58:15,644] INFO Started recovery for topic partition sting_actions_inscreen-78 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  287. [2016-07-28 11:58:15,708] INFO Finished recovery for topic partition sting_actions_impression-37 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  288. [2016-07-28 11:58:15,708] INFO Started recovery for topic partition sting_actions_inscreen-31 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  289. [2016-07-28 11:58:15,861] INFO Finished recovery for topic partition sting_actions_inscreen-78 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  290. [2016-07-28 11:58:15,861] INFO Started recovery for topic partition sting_actions_impression-85 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  291. [2016-07-28 11:58:15,893] INFO Finished recovery for topic partition sting_actions_inscreen-31 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  292. [2016-07-28 11:58:15,893] INFO Started recovery for topic partition sting_actions_impression-49 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  293. [2016-07-28 11:58:16,040] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/18/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  294. [2016-07-28 11:58:16,259] INFO Finished recovery for topic partition sting_actions_click-18 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  295. [2016-07-28 11:58:16,259] INFO Started recovery for topic partition sting_actions_inscreen-5 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  296. [2016-07-28 11:58:16,309] INFO Finished recovery for topic partition sting_actions_impression-85 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  297. [2016-07-28 11:58:16,309] INFO Started recovery for topic partition sting_actions_inscreen-82 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  298. [2016-07-28 11:58:16,362] INFO Finished recovery for topic partition sting_actions_impression-49 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  299. [2016-07-28 11:58:16,362] INFO Started recovery for topic partition sting_actions_inscreen-38 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  300. [2016-07-28 11:58:16,492] INFO Finished recovery for topic partition sting_actions_inscreen-5 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  301. [2016-07-28 11:58:16,493] INFO Started recovery for topic partition sting_actions_impression-16 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  302. [2016-07-28 11:58:16,525] INFO Finished recovery for topic partition sting_actions_inscreen-82 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  303. [2016-07-28 11:58:16,526] INFO Started recovery for topic partition sting_actions_click-98 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  304. [2016-07-28 11:58:16,567] INFO Finished recovery for topic partition sting_actions_inscreen-38 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  305. [2016-07-28 11:58:16,567] INFO Started recovery for topic partition sting_actions_click-31 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  306. [2016-07-28 11:58:16,588] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/31/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  307. [2016-07-28 11:58:16,735] INFO Finished recovery for topic partition sting_actions_click-98 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  308. [2016-07-28 11:58:16,735] INFO Started recovery for topic partition sting_actions_impression-97 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  309. [2016-07-28 11:58:16,896] INFO Finished recovery for topic partition sting_actions_impression-16 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  310. [2016-07-28 11:58:16,896] INFO Started recovery for topic partition sting_actions_inscreen-9 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  311. [2016-07-28 11:58:16,907] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/9/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  312. [2016-07-28 11:58:17,091] INFO Finished recovery for topic partition sting_actions_impression-97 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  313. [2016-07-28 11:58:17,091] INFO Started recovery for topic partition sting_actions_inscreen-83 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  314. [2016-07-28 11:58:17,173] INFO Finished recovery for topic partition sting_actions_inscreen-9 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  315. [2016-07-28 11:58:17,173] INFO Started recovery for topic partition sting_actions_impression-12 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  316. [2016-07-28 11:58:17,311] INFO Finished recovery for topic partition sting_actions_inscreen-83 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  317. [2016-07-28 11:58:17,311] INFO Started recovery for topic partition sting_actions_click-78 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  318. [2016-07-28 11:58:17,444] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/62/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  319. [2016-07-28 11:58:17,509] INFO Finished recovery for topic partition sting_actions_click-78 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  320. [2016-07-28 11:58:17,509] INFO Started recovery for topic partition sting_actions_impression-93 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  321. [2016-07-28 11:58:17,588] INFO Finished recovery for topic partition sting_actions_impression-12 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  322. [2016-07-28 11:58:17,589] INFO Started recovery for topic partition sting_actions_inscreen-13 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  323. [2016-07-28 11:58:17,606] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/31/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  324. [2016-07-28 11:58:17,881] INFO Finished recovery for topic partition sting_actions_inscreen-13 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  325. [2016-07-28 11:58:17,882] INFO Started recovery for topic partition sting_actions_impression-24 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  326. [2016-07-28 11:58:17,917] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/24/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  327. [2016-07-28 11:58:17,986] INFO Finished recovery for topic partition sting_actions_impression-93 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  328. [2016-07-28 11:58:17,987] INFO Started recovery for topic partition sting_actions_inscreen-87 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  329. [2016-07-28 11:58:18,184] INFO Finished recovery for topic partition sting_actions_inscreen-87 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  330. [2016-07-28 11:58:18,185] INFO Started recovery for topic partition sting_actions_inscreen-91 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  331. [2016-07-28 11:58:18,403] INFO Finished recovery for topic partition sting_actions_inscreen-91 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  332. [2016-07-28 11:58:18,404] INFO Started recovery for topic partition sting_actions_click-86 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  333. [2016-07-28 11:58:18,597] INFO Finished recovery for topic partition sting_actions_click-86 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  334. [2016-07-28 11:58:18,597] INFO Started recovery for topic partition sting_actions_inscreen-95 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  335. [2016-07-28 11:58:18,796] INFO Finished recovery for topic partition sting_actions_inscreen-95 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  336. [2016-07-28 11:58:18,797] INFO Started recovery for topic partition sting_actions_click-82 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  337. [2016-07-28 11:58:18,938] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/24/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  338. [2016-07-28 11:58:18,984] INFO Finished recovery for topic partition sting_actions_click-82 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  339. [2016-07-28 11:58:18,984] INFO Started recovery for topic partition sting_actions_click-95 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  340. [2016-07-28 11:58:19,180] INFO Finished recovery for topic partition sting_actions_click-95 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  341. [2016-07-28 11:58:19,181] INFO Started recovery for topic partition sting_actions_impression-80 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  342. [2016-07-28 11:58:19,593] INFO Finished recovery for topic partition sting_actions_impression-80 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  343. [2016-07-28 11:58:19,593] INFO Started recovery for topic partition sting_actions_click-91 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  344. [2016-07-28 11:58:19,627] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/31/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  345. [2016-07-28 11:58:19,788] INFO Finished recovery for topic partition sting_actions_click-91 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  346. [2016-07-28 11:58:19,788] INFO Started recovery for topic partition sting_actions_impression-76 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  347. [2016-07-28 11:58:20,127] INFO Finished recovery for topic partition sting_actions_impression-76 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  348. [2016-07-28 11:58:20,128] INFO Started recovery for topic partition sting_actions_inscreen-77 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  349. [2016-07-28 11:58:20,289] INFO Finished recovery for topic partition sting_actions_inscreen-77 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  350. [2016-07-28 11:58:20,290] INFO Started recovery for topic partition sting_actions_impression-88 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  351. [2016-07-28 11:58:20,679] INFO Finished recovery for topic partition sting_actions_impression-88 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  352. [2016-07-28 11:58:20,679] INFO Started recovery for topic partition sting_actions_inscreen-81 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  353. [2016-07-28 11:58:20,889] INFO Finished recovery for topic partition sting_actions_inscreen-81 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  354. [2016-07-28 11:58:20,890] INFO Started recovery for topic partition sting_actions_click-99 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  355. [2016-07-28 11:58:20,955] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/24/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  356. [2016-07-28 11:58:21,079] INFO Finished recovery for topic partition sting_actions_click-99 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  357. [2016-07-28 11:58:21,079] INFO Started recovery for topic partition sting_actions_impression-84 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  358. [2016-07-28 11:58:21,461] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/62/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  359. [2016-07-28 11:58:21,480] INFO Finished recovery for topic partition sting_actions_impression-84 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  360. [2016-07-28 11:58:21,480] INFO Started recovery for topic partition sting_actions_inscreen-86 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  361. [2016-07-28 11:58:21,682] INFO Finished recovery for topic partition sting_actions_inscreen-86 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  362. [2016-07-28 11:58:21,683] INFO Started recovery for topic partition sting_actions_click-79 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  363. [2016-07-28 11:58:21,846] INFO Finished recovery for topic partition sting_actions_click-79 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  364. [2016-07-28 11:58:21,847] INFO Started recovery for topic partition sting_actions_impression-96 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  365. [2016-07-28 11:58:22,261] INFO Finished recovery for topic partition sting_actions_impression-96 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  366. [2016-07-28 11:58:22,261] INFO Started recovery for topic partition sting_actions_inscreen-90 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  367. [2016-07-28 11:58:22,473] INFO Finished recovery for topic partition sting_actions_inscreen-90 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  368. [2016-07-28 11:58:22,473] INFO Started recovery for topic partition sting_actions_click-75 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  369. [2016-07-28 11:58:22,628] INFO Finished recovery for topic partition sting_actions_click-75 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  370. [2016-07-28 11:58:22,628] INFO Started recovery for topic partition sting_actions_impression-92 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  371. [2016-07-28 11:58:23,016] INFO Finished recovery for topic partition sting_actions_impression-92 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  372. [2016-07-28 11:58:23,017] INFO Started recovery for topic partition sting_actions_inscreen-94 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  373. [2016-07-28 11:58:23,214] INFO Finished recovery for topic partition sting_actions_inscreen-94 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  374. [2016-07-28 11:58:23,215] INFO Started recovery for topic partition sting_actions_click-87 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  375. [2016-07-28 11:58:23,389] INFO Finished recovery for topic partition sting_actions_click-87 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  376. [2016-07-28 11:58:23,390] INFO Started recovery for topic partition sting_actions_inscreen-98 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  377. [2016-07-28 11:58:23,400] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/98/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  378. [2016-07-28 11:58:23,635] INFO Finished recovery for topic partition sting_actions_inscreen-98 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  379. [2016-07-28 11:58:23,635] INFO Started recovery for topic partition sting_actions_click-83 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  380. [2016-07-28 11:58:23,643] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/31/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  381. [2016-07-28 11:58:23,800] INFO Finished recovery for topic partition sting_actions_click-83 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  382. [2016-07-28 11:58:24,676] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  383. [2016-07-28 11:58:24,825] INFO Starting commit and rotation for topic partition sting_actions_impression-79 with start offsets {year=2016/month=07/day=28/hour=11/=23239078} and end offsets {year=2016/month=07/day=28/hour=11/=23239078} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  384. [2016-07-28 11:58:24,980] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/24/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  385. [2016-07-28 11:58:28,460] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/79/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  386. [2016-07-28 11:58:29,461] ERROR Recovery failed at state RECOVERY_PARTITION_PAUSED (io.confluent.connect.hdfs.TopicPartitionWriter:214)
  387. org.apache.kafka.connect.errors.ConnectException: Cannot acquire lease after timeout, will retry.
  388. at io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:95)
  389. at io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
  390. at io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:441)
  391. at io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:197)
  392. at io.confluent.connect.hdfs.DataWriter.recover(DataWriter.java:239)
  393. at io.confluent.connect.hdfs.DataWriter.open(DataWriter.java:281)
  394. at io.confluent.connect.hdfs.HdfsSinkTask.open(HdfsSinkTask.java:104)
  395. at org.apache.kafka.connect.runtime.WorkerSinkTask.openPartitions(WorkerSinkTask.java:417)
  396. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1000(WorkerSinkTask.java:54)
  397. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:453)
  398. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
  399. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
  400. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
  401. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  402. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  403. at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
  404. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  405. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  406. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
  407. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
  408. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
  409. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
  410. at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
  411. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  412. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  413. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
  414. at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
  415. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
  416. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
  417. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
  418. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
  419. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
  420. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  421. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  422. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  423. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  424. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  425. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  426. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  427. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  428. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  429. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  430. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  431. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  432. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  433. at java.lang.Thread.run(Thread.java:745)
  434. [2016-07-28 11:58:29,462] INFO Started recovery for topic partition sting_actions_inscreen-56 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  435. [2016-07-28 11:58:29,485] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/79/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  436. [2016-07-28 11:58:29,608] INFO Finished recovery for topic partition sting_actions_inscreen-56 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  437. [2016-07-28 11:58:29,609] INFO Started recovery for topic partition sting_actions_impression-74 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  438. [2016-07-28 11:58:29,629] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/74/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  439. [2016-07-28 11:58:30,643] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/74/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  440. [2016-07-28 11:58:31,505] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/79/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  441. [2016-07-28 11:58:31,644] ERROR Recovery failed at state RECOVERY_PARTITION_PAUSED (io.confluent.connect.hdfs.TopicPartitionWriter:214)
  442. org.apache.kafka.connect.errors.ConnectException: Cannot acquire lease after timeout, will retry.
  443. at io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:95)
  444. at io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
  445. at io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:441)
  446. at io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:197)
  447. at io.confluent.connect.hdfs.DataWriter.recover(DataWriter.java:239)
  448. at io.confluent.connect.hdfs.DataWriter.open(DataWriter.java:281)
  449. at io.confluent.connect.hdfs.HdfsSinkTask.open(HdfsSinkTask.java:104)
  450. at org.apache.kafka.connect.runtime.WorkerSinkTask.openPartitions(WorkerSinkTask.java:417)
  451. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1000(WorkerSinkTask.java:54)
  452. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:453)
  453. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
  454. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
  455. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
  456. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  457. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  458. at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
  459. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  460. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  461. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
  462. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
  463. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
  464. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
  465. at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
  466. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  467. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  468. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
  469. at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
  470. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
  471. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
  472. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
  473. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
  474. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
  475. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  476. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  477. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  478. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  479. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  480. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  481. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  482. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  483. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  484. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  485. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  486. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  487. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  488. at java.lang.Thread.run(Thread.java:745)
  489. [2016-07-28 11:58:31,645] INFO Started recovery for topic partition sting_actions_impression-45 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  490. [2016-07-28 11:58:31,666] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/45/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  491. [2016-07-28 11:58:32,088] INFO Finished recovery for topic partition sting_actions_impression-45 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  492. [2016-07-28 11:58:32,088] INFO Started recovery for topic partition sting_actions_inscreen-42 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  493. [2016-07-28 11:58:32,296] INFO Finished recovery for topic partition sting_actions_inscreen-42 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  494. [2016-07-28 11:58:32,296] INFO Started recovery for topic partition sting_actions_click-27 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  495. [2016-07-28 11:58:32,530] INFO Finished recovery for topic partition sting_actions_click-27 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  496. [2016-07-28 11:58:32,530] INFO Started recovery for topic partition sting_actions_inscreen-46 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  497. [2016-07-28 11:58:32,565] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/46/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  498. [2016-07-28 11:58:32,659] INFO Cannot acquire lease on WAL hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/74/log (io.confluent.connect.hdfs.wal.FSWAL:80)
  499. [2016-07-28 11:58:32,810] INFO Finished recovery for topic partition sting_actions_inscreen-46 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  500. [2016-07-28 11:58:32,810] INFO Started recovery for topic partition sting_actions_click-39 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  501. [2016-07-28 11:58:32,980] ERROR Recovery failed at state RECOVERY_PARTITION_PAUSED (io.confluent.connect.hdfs.TopicPartitionWriter:214)
  502. org.apache.kafka.connect.errors.ConnectException: Cannot acquire lease after timeout, will retry.
  503. at io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:95)
  504. at io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
  505. at io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:441)
  506. at io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:197)
  507. at io.confluent.connect.hdfs.DataWriter.recover(DataWriter.java:239)
  508. at io.confluent.connect.hdfs.DataWriter.open(DataWriter.java:281)
  509. at io.confluent.connect.hdfs.HdfsSinkTask.open(HdfsSinkTask.java:104)
  510. at org.apache.kafka.connect.runtime.WorkerSinkTask.openPartitions(WorkerSinkTask.java:417)
  511. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1000(WorkerSinkTask.java:54)
  512. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:453)
  513. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
  514. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
  515. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
  516. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  517. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  518. at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
  519. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  520. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  521. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
  522. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
  523. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
  524. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
  525. at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
  526. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  527. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  528. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
  529. at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
  530. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
  531. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
  532. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
  533. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
  534. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
  535. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  536. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  537. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  538. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  539. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  540. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  541. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  542. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  543. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  544. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  545. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  546. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  547. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  548. at java.lang.Thread.run(Thread.java:745)
  549. [2016-07-28 11:58:32,981] INFO Started recovery for topic partition sting_actions_click-6 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  550. [2016-07-28 11:58:32,987] INFO Finished recovery for topic partition sting_actions_click-39 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  551. [2016-07-28 11:58:32,987] INFO Started recovery for topic partition sting_actions_click-35 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  552. [2016-07-28 11:58:33,053] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/6/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  553. [2016-07-28 11:58:33,109] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/35/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  554. [2016-07-28 11:58:33,307] INFO Finished recovery for topic partition sting_actions_click-35 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  555. [2016-07-28 11:58:33,308] INFO Started recovery for topic partition sting_actions_click-48 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  556. [2016-07-28 11:58:33,308] INFO Finished recovery for topic partition sting_actions_click-6 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  557. [2016-07-28 11:58:33,308] INFO Started recovery for topic partition sting_actions_inscreen-17 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  558. [2016-07-28 11:58:33,450] INFO Finished recovery for topic partition sting_actions_click-48 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  559. [2016-07-28 11:58:33,450] INFO Started recovery for topic partition sting_actions_impression-32 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  560. [2016-07-28 11:58:33,493] INFO Finished recovery for topic partition sting_actions_inscreen-17 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  561. [2016-07-28 11:58:33,495] INFO Started recovery for topic partition sting_actions_impression-20 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  562. [2016-07-28 11:58:33,902] INFO Finished recovery for topic partition sting_actions_impression-20 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  563. [2016-07-28 11:58:33,902] INFO Started recovery for topic partition sting_actions_click-2 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  564. [2016-07-28 11:58:33,907] INFO Finished recovery for topic partition sting_actions_impression-32 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  565. [2016-07-28 11:58:33,907] INFO Started recovery for topic partition sting_actions_click-44 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  566. [2016-07-28 11:58:34,050] INFO Finished recovery for topic partition sting_actions_click-2 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  567. [2016-07-28 11:58:34,051] INFO Started recovery for topic partition sting_actions_inscreen-22 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  568. [2016-07-28 11:58:34,060] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/22/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  569. [2016-07-28 11:58:34,082] INFO Finished recovery for topic partition sting_actions_click-44 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  570. [2016-07-28 11:58:34,082] INFO Started recovery for topic partition sting_actions_inscreen-26 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  571. [2016-07-28 11:58:34,306] INFO Finished recovery for topic partition sting_actions_inscreen-26 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  572. [2016-07-28 11:58:34,306] INFO Started recovery for topic partition sting_actions_impression-28 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  573. [2016-07-28 11:58:34,328] INFO Finished recovery for topic partition sting_actions_inscreen-22 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  574. [2016-07-28 11:58:34,328] INFO Started recovery for topic partition sting_actions_click-15 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  575. [2016-07-28 11:58:34,421] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/15/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  576. [2016-07-28 11:58:34,630] INFO Finished recovery for topic partition sting_actions_click-15 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  577. [2016-07-28 11:58:34,631] INFO Started recovery for topic partition sting_actions_click-11 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  578. [2016-07-28 11:58:34,730] INFO Finished recovery for topic partition sting_actions_impression-28 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  579. [2016-07-28 11:58:34,730] INFO Started recovery for topic partition sting_actions_inscreen-30 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  580. [2016-07-28 11:58:34,802] INFO Finished recovery for topic partition sting_actions_click-11 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  581. [2016-07-28 11:58:34,802] INFO Started recovery for topic partition sting_actions_impression-7 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  582. [2016-07-28 11:58:34,946] INFO Finished recovery for topic partition sting_actions_inscreen-30 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  583. [2016-07-28 11:58:34,947] INFO Started recovery for topic partition sting_actions_impression-40 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  584. [2016-07-28 11:58:35,137] INFO Finished recovery for topic partition sting_actions_impression-7 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  585. [2016-07-28 11:58:35,137] INFO Started recovery for topic partition sting_actions_click-23 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  586. [2016-07-28 11:58:35,322] INFO Finished recovery for topic partition sting_actions_click-23 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  587. [2016-07-28 11:58:35,322] INFO Started recovery for topic partition sting_actions_inscreen-1 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  588. [2016-07-28 11:58:35,323] INFO Finished recovery for topic partition sting_actions_impression-40 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  589. [2016-07-28 11:58:35,323] INFO Started recovery for topic partition sting_actions_inscreen-34 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  590. [2016-07-28 11:58:35,368] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/34/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  591. [2016-07-28 11:58:35,604] INFO Finished recovery for topic partition sting_actions_inscreen-1 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  592. [2016-07-28 11:58:35,604] INFO Started recovery for topic partition sting_actions_impression-3 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  593. [2016-07-28 11:58:35,609] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/79/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  594. [2016-07-28 11:58:35,685] INFO Finished recovery for topic partition sting_actions_inscreen-34 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  595. [2016-07-28 11:58:35,685] INFO Started recovery for topic partition sting_actions_impression-36 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  596. [2016-07-28 11:58:35,715] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/36/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  597. [2016-07-28 11:58:35,981] INFO Finished recovery for topic partition sting_actions_impression-3 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  598. [2016-07-28 11:58:35,982] INFO Started recovery for topic partition sting_actions_click-19 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  599. [2016-07-28 11:58:36,147] INFO Finished recovery for topic partition sting_actions_click-19 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  600. [2016-07-28 11:58:36,148] INFO Started recovery for topic partition sting_actions_impression-15 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  601. [2016-07-28 11:58:36,172] INFO Finished recovery for topic partition sting_actions_impression-36 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  602. [2016-07-28 11:58:36,172] INFO Started recovery for topic partition sting_actions_inscreen-37 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  603. [2016-07-28 11:58:36,192] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/37/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  604. [2016-07-28 11:58:36,329] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_impression/year=2016/month=07/day=28/hour=11//sting_actions_impression+79+0023239078+0023239078.parquet for sting_actions_impression-79 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  605. [2016-07-28 11:58:36,413] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  606. [2016-07-28 11:58:36,479] INFO Finished recovery for topic partition sting_actions_inscreen-37 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  607. [2016-07-28 11:58:36,483] INFO Started recovery for topic partition sting_actions_click-32 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  608. [2016-07-28 11:58:36,693] INFO Ignoring stale out-of-order record in sting_actions_click-92. Has offset 1769342 instead of expected offset 1769343 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  609. [2016-07-28 11:58:36,694] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/74/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  610. [2016-07-28 11:58:36,694] INFO Starting commit and rotation for topic partition sting_actions_click-92 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  611. [2016-07-28 11:58:36,716] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/92/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  612. [2016-07-28 11:58:36,731] INFO Finished recovery for topic partition sting_actions_impression-15 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  613. [2016-07-28 11:58:36,732] INFO Started recovery for topic partition sting_actions_inscreen-4 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  614. [2016-07-28 11:58:36,804] INFO Finished recovery for topic partition sting_actions_click-32 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  615. [2016-07-28 11:58:36,805] INFO Started recovery for topic partition sting_actions_impression-48 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  616. [2016-07-28 11:58:36,844] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/48/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  617. [2016-07-28 11:58:36,952] INFO Finished recovery for topic partition sting_actions_inscreen-4 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  618. [2016-07-28 11:58:36,952] INFO Started recovery for topic partition sting_actions_impression-11 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  619. [2016-07-28 11:58:36,963] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/11/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  620. [2016-07-28 11:58:36,979] INFO Recovered from stale out-of-order records in sting_actions_click-92 with offset 1769343 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  621. [2016-07-28 11:58:36,991] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  622. [2016-07-28 11:58:37,039] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  623. [2016-07-28 11:58:37,041] INFO Starting commit and rotation for topic partition sting_actions_inscreen-80 with start offsets {year=2016/month=07/day=28/hour=11/=4773044} and end offsets {year=2016/month=07/day=28/hour=11/=4773044} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  624. [2016-07-28 11:58:37,091] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/80/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  625. [2016-07-28 11:58:37,262] INFO Finished recovery for topic partition sting_actions_impression-74 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  626. [2016-07-28 11:58:37,262] INFO Started recovery for topic partition sting_actions_click-55 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  627. [2016-07-28 11:58:37,291] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/55/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  628. [2016-07-28 11:58:37,330] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_inscreen/year=2016/month=07/day=28/hour=11//sting_actions_inscreen+80+0004773044+0004773044.parquet for sting_actions_inscreen-80 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  629. [2016-07-28 11:58:37,339] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  630. [2016-07-28 11:58:37,359] INFO Finished recovery for topic partition sting_actions_impression-48 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  631. [2016-07-28 11:58:37,360] INFO Started recovery for topic partition sting_actions_inscreen-41 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  632. [2016-07-28 11:58:37,455] INFO Finished recovery for topic partition sting_actions_impression-11 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  633. [2016-07-28 11:58:37,456] INFO Started recovery for topic partition sting_actions_inscreen-8 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  634. [2016-07-28 11:58:37,616] INFO Finished recovery for topic partition sting_actions_click-55 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  635. [2016-07-28 11:58:37,616] INFO Started recovery for topic partition sting_actions_inscreen-60 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  636. [2016-07-28 11:58:37,630] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  637. [2016-07-28 11:58:37,631] INFO Starting commit and rotation for topic partition sting_actions_click-80 with start offsets {year=2016/month=07/day=28/hour=11/=1769223} and end offsets {year=2016/month=07/day=28/hour=11/=1769223} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  638. [2016-07-28 11:58:37,676] INFO Finished recovery for topic partition sting_actions_inscreen-41 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  639. [2016-07-28 11:58:37,677] INFO Started recovery for topic partition sting_actions_click-28 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  640. [2016-07-28 11:58:37,701] INFO Finished recovery for topic partition sting_actions_inscreen-8 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  641. [2016-07-28 11:58:37,702] INFO Started recovery for topic partition sting_actions_impression-23 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  642. [2016-07-28 11:58:37,741] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/28/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  643. [2016-07-28 11:58:37,741] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/80/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  644. [2016-07-28 11:58:37,906] INFO Finished recovery for topic partition sting_actions_inscreen-60 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  645. [2016-07-28 11:58:37,908] INFO Started recovery for topic partition sting_actions_impression-70 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  646. [2016-07-28 11:58:37,922] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/70/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  647. [2016-07-28 11:58:38,077] INFO Finished recovery for topic partition sting_actions_click-28 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  648. [2016-07-28 11:58:38,078] INFO Started recovery for topic partition sting_actions_impression-44 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  649. [2016-07-28 11:58:38,222] INFO Finished recovery for topic partition sting_actions_impression-23 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  650. [2016-07-28 11:58:38,223] INFO Started recovery for topic partition sting_actions_click-7 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  651. [2016-07-28 11:58:38,336] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_click/year=2016/month=07/day=28/hour=11//sting_actions_click+80+0001769223+0001769223.parquet for sting_actions_click-80 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  652. [2016-07-28 11:58:38,359] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  653. [2016-07-28 11:58:38,367] INFO Ignoring stale out-of-order record in sting_actions_inscreen-89. Has offset 4773039 instead of expected offset 4773040 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  654. [2016-07-28 11:58:38,367] INFO Starting commit and rotation for topic partition sting_actions_inscreen-89 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  655. [2016-07-28 11:58:38,379] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/89/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  656. [2016-07-28 11:58:38,515] INFO Finished recovery for topic partition sting_actions_click-7 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  657. [2016-07-28 11:58:38,515] INFO Started recovery for topic partition sting_actions_inscreen-12 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  658. [2016-07-28 11:58:38,526] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/12/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  659. [2016-07-28 11:58:38,531] INFO Finished recovery for topic partition sting_actions_impression-70 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  660. [2016-07-28 11:58:38,533] INFO Started recovery for topic partition sting_actions_click-51 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  661. [2016-07-28 11:58:38,535] INFO Finished recovery for topic partition sting_actions_impression-44 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  662. [2016-07-28 11:58:38,536] INFO Started recovery for topic partition sting_actions_inscreen-45 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  663. [2016-07-28 11:58:38,759] INFO Finished recovery for topic partition sting_actions_click-51 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  664. [2016-07-28 11:58:38,760] INFO Started recovery for topic partition sting_actions_inscreen-64 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  665. [2016-07-28 11:58:38,802] INFO Finished recovery for topic partition sting_actions_inscreen-12 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  666. [2016-07-28 11:58:38,802] INFO Started recovery for topic partition sting_actions_impression-19 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  667. [2016-07-28 11:58:38,818] INFO Finished recovery for topic partition sting_actions_inscreen-45 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  668. [2016-07-28 11:58:38,818] INFO Started recovery for topic partition sting_actions_click-40 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  669. [2016-07-28 11:58:38,905] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/40/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  670. [2016-07-28 11:58:38,976] INFO Finished recovery for topic partition sting_actions_inscreen-64 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  671. [2016-07-28 11:58:38,976] INFO Started recovery for topic partition sting_actions_click-64 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  672. [2016-07-28 11:58:39,015] INFO Recovered from stale out-of-order records in sting_actions_inscreen-89 with offset 4773040 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  673. [2016-07-28 11:58:39,033] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  674. [2016-07-28 11:58:39,138] INFO Ignoring stale out-of-order record in sting_actions_impression-91. Has offset 23239096 instead of expected offset 23239097 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  675. [2016-07-28 11:58:39,138] INFO Starting commit and rotation for topic partition sting_actions_impression-91 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  676. [2016-07-28 11:58:39,151] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/91/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  677. [2016-07-28 11:58:39,206] INFO Finished recovery for topic partition sting_actions_click-40 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  678. [2016-07-28 11:58:39,207] INFO Started recovery for topic partition sting_actions_inscreen-49 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  679. [2016-07-28 11:58:39,226] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/49/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  680. [2016-07-28 11:58:39,254] INFO Finished recovery for topic partition sting_actions_click-64 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  681. [2016-07-28 11:58:39,254] INFO Started recovery for topic partition sting_actions_inscreen-67 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  682. [2016-07-28 11:58:39,258] INFO Finished recovery for topic partition sting_actions_impression-19 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  683. [2016-07-28 11:58:39,259] INFO Started recovery for topic partition sting_actions_click-3 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  684. [2016-07-28 11:58:39,268] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/3/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  685. [2016-07-28 11:58:39,450] INFO Finished recovery for topic partition sting_actions_inscreen-67 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  686. [2016-07-28 11:58:39,450] INFO Started recovery for topic partition sting_actions_click-60 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  687. [2016-07-28 11:58:39,464] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/60/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  688. [2016-07-28 11:58:39,466] INFO Finished recovery for topic partition sting_actions_inscreen-49 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  689. [2016-07-28 11:58:39,467] INFO Started recovery for topic partition sting_actions_click-36 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  690. [2016-07-28 11:58:39,481] INFO Finished recovery for topic partition sting_actions_click-3 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  691. [2016-07-28 11:58:39,481] INFO Started recovery for topic partition sting_actions_inscreen-16 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  692. [2016-07-28 11:58:39,649] INFO Finished recovery for topic partition sting_actions_click-36 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  693. [2016-07-28 11:58:39,650] INFO Started recovery for topic partition sting_actions_click-49 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  694. [2016-07-28 11:58:39,662] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/49/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  695. [2016-07-28 11:58:39,676] INFO Finished recovery for topic partition sting_actions_click-60 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  696. [2016-07-28 11:58:39,676] INFO Started recovery for topic partition sting_actions_inscreen-71 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  697. [2016-07-28 11:58:39,688] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/71/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  698. [2016-07-28 11:58:39,702] INFO Finished recovery for topic partition sting_actions_inscreen-16 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  699. [2016-07-28 11:58:39,703] INFO Started recovery for topic partition sting_actions_inscreen-21 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  700. [2016-07-28 11:58:39,873] INFO Finished recovery for topic partition sting_actions_click-49 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  701. [2016-07-28 11:58:39,874] INFO Started recovery for topic partition sting_actions_impression-31 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  702. [2016-07-28 11:58:39,905] INFO Finished recovery for topic partition sting_actions_inscreen-21 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  703. [2016-07-28 11:58:39,905] INFO Started recovery for topic partition sting_actions_impression-2 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  704. [2016-07-28 11:58:39,920] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/2/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  705. [2016-07-28 11:58:39,930] INFO Finished recovery for topic partition sting_actions_inscreen-71 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  706. [2016-07-28 11:58:39,931] INFO Started recovery for topic partition sting_actions_impression-57 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  707. [2016-07-28 11:58:39,941] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/57/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  708. [2016-07-28 11:58:40,299] INFO Finished recovery for topic partition sting_actions_impression-31 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  709. [2016-07-28 11:58:40,299] INFO Started recovery for topic partition sting_actions_click-45 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  710. [2016-07-28 11:58:40,395] INFO Finished recovery for topic partition sting_actions_impression-2 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  711. [2016-07-28 11:58:40,396] INFO Started recovery for topic partition sting_actions_click-16 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  712. [2016-07-28 11:58:40,403] INFO Finished recovery for topic partition sting_actions_impression-57 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  713. [2016-07-28 11:58:40,403] INFO Started recovery for topic partition sting_actions_click-72 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  714. [2016-07-28 11:58:40,423] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/72/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  715. [2016-07-28 11:58:40,500] INFO Finished recovery for topic partition sting_actions_click-45 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  716. [2016-07-28 11:58:40,500] INFO Started recovery for topic partition sting_actions_inscreen-25 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  717. [2016-07-28 11:58:40,516] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/25/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  718. [2016-07-28 11:58:40,654] INFO Finished recovery for topic partition sting_actions_click-16 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  719. [2016-07-28 11:58:40,654] INFO Started recovery for topic partition sting_actions_click-12 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  720. [2016-07-28 11:58:40,664] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/12/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  721. [2016-07-28 11:58:40,678] INFO Finished recovery for topic partition sting_actions_click-72 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  722. [2016-07-28 11:58:40,679] INFO Started recovery for topic partition sting_actions_impression-53 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  723. [2016-07-28 11:58:40,758] INFO Finished recovery for topic partition sting_actions_inscreen-25 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  724. [2016-07-28 11:58:40,760] INFO Started recovery for topic partition sting_actions_impression-27 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  725. [2016-07-28 11:58:40,773] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/27/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  726. [2016-07-28 11:58:40,880] INFO Finished recovery for topic partition sting_actions_click-12 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  727. [2016-07-28 11:58:40,880] INFO Started recovery for topic partition sting_actions_impression-10 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  728. [2016-07-28 11:58:41,015] INFO Finished recovery for topic partition sting_actions_impression-53 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  729. [2016-07-28 11:58:41,016] INFO Started recovery for topic partition sting_actions_click-68 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  730. [2016-07-28 11:58:41,257] INFO Finished recovery for topic partition sting_actions_impression-27 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  731. [2016-07-28 11:58:41,258] INFO Started recovery for topic partition sting_actions_inscreen-29 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  732. [2016-07-28 11:58:41,303] INFO Finished recovery for topic partition sting_actions_click-68 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  733. [2016-07-28 11:58:41,303] INFO Started recovery for topic partition sting_actions_inscreen-50 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  734. [2016-07-28 11:58:41,315] INFO Finished recovery for topic partition sting_actions_impression-10 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  735. [2016-07-28 11:58:41,315] INFO Started recovery for topic partition sting_actions_click-24 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  736. [2016-07-28 11:58:41,463] INFO Finished recovery for topic partition sting_actions_inscreen-29 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  737. [2016-07-28 11:58:41,463] INFO Started recovery for topic partition sting_actions_impression-39 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  738. [2016-07-28 11:58:41,476] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/39/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  739. [2016-07-28 11:58:41,494] INFO Finished recovery for topic partition sting_actions_click-24 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  740. [2016-07-28 11:58:41,494] INFO Started recovery for topic partition sting_actions_impression-6 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  741. [2016-07-28 11:58:41,509] INFO Finished recovery for topic partition sting_actions_inscreen-50 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  742. [2016-07-28 11:58:41,510] INFO Started recovery for topic partition sting_actions_impression-65 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  743. [2016-07-28 11:58:41,519] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/65/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  744. [2016-07-28 11:58:41,937] INFO Finished recovery for topic partition sting_actions_impression-6 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  745. [2016-07-28 11:58:41,938] INFO Started recovery for topic partition sting_actions_click-20 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  746. [2016-07-28 11:58:41,938] INFO Finished recovery for topic partition sting_actions_impression-65 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  747. [2016-07-28 11:58:41,939] INFO Started recovery for topic partition sting_actions_inscreen-51 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  748. [2016-07-28 11:58:41,941] INFO Finished recovery for topic partition sting_actions_impression-39 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  749. [2016-07-28 11:58:41,941] INFO Started recovery for topic partition sting_actions_inscreen-33 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  750. [2016-07-28 11:58:41,960] INFO Recovered from stale out-of-order records in sting_actions_impression-91 with offset 23239097 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  751. [2016-07-28 11:58:41,965] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  752. [2016-07-28 11:58:42,059] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  753. [2016-07-28 11:58:42,060] INFO Starting commit and rotation for topic partition sting_actions_impression-82 with start offsets {year=2016/month=07/day=28/hour=11/=23239240} and end offsets {year=2016/month=07/day=28/hour=11/=23239240} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  754. [2016-07-28 11:58:42,090] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/82/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  755. [2016-07-28 11:58:42,182] INFO Finished recovery for topic partition sting_actions_click-20 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  756. [2016-07-28 11:58:42,183] INFO Started recovery for topic partition sting_actions_inscreen-0 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  757. [2016-07-28 11:58:42,193] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/0/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  758. [2016-07-28 11:58:42,196] INFO Finished recovery for topic partition sting_actions_inscreen-51 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  759. [2016-07-28 11:58:42,197] INFO Started recovery for topic partition sting_actions_impression-61 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  760. [2016-07-28 11:58:42,228] INFO Finished recovery for topic partition sting_actions_inscreen-33 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  761. [2016-07-28 11:58:42,229] INFO Started recovery for topic partition sting_actions_impression-35 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  762. [2016-07-28 11:58:42,415] INFO Finished recovery for topic partition sting_actions_inscreen-0 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  763. [2016-07-28 11:58:42,415] INFO Started recovery for topic partition sting_actions_impression-18 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  764. [2016-07-28 11:58:42,473] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_impression/year=2016/month=07/day=28/hour=11//sting_actions_impression+82+0023239240+0023239240.parquet for sting_actions_impression-82 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  765. [2016-07-28 11:58:42,478] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  766. [2016-07-28 11:58:42,583] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  767. [2016-07-28 11:58:42,584] INFO Starting commit and rotation for topic partition sting_actions_click-77 with start offsets {year=2016/month=07/day=28/hour=11/=1769280} and end offsets {year=2016/month=07/day=28/hour=11/=1769280} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  768. [2016-07-28 11:58:42,755] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/77/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  769. [2016-07-28 11:58:42,770] INFO Finished recovery for topic partition sting_actions_impression-61 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  770. [2016-07-28 11:58:42,771] INFO Started recovery for topic partition sting_actions_inscreen-55 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  771. [2016-07-28 11:58:42,785] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/55/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  772. [2016-07-28 11:58:42,813] INFO Finished recovery for topic partition sting_actions_impression-35 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  773. [2016-07-28 11:58:42,813] INFO Started recovery for topic partition sting_actions_click-33 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  774. [2016-07-28 11:58:42,995] INFO Finished recovery for topic partition sting_actions_impression-18 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  775. [2016-07-28 11:58:42,996] INFO Started recovery for topic partition sting_actions_click-0 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  776. [2016-07-28 11:58:43,008] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/0/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  777. [2016-07-28 11:58:43,036] INFO Finished recovery for topic partition sting_actions_click-33 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  778. [2016-07-28 11:58:43,036] INFO Started recovery for topic partition sting_actions_impression-47 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  779. [2016-07-28 11:58:43,049] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_click/year=2016/month=07/day=28/hour=11//sting_actions_click+77+0001769280+0001769280.parquet for sting_actions_click-77 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  780. [2016-07-28 11:58:43,060] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  781. [2016-07-28 11:58:43,068] INFO Ignoring stale out-of-order record in sting_actions_impression-94. Has offset 23239223 instead of expected offset 23239224 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  782. [2016-07-28 11:58:43,068] INFO Starting commit and rotation for topic partition sting_actions_impression-94 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  783. [2016-07-28 11:58:43,075] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/94/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  784. [2016-07-28 11:58:43,086] INFO Finished recovery for topic partition sting_actions_inscreen-55 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  785. [2016-07-28 11:58:43,086] INFO Started recovery for topic partition sting_actions_impression-73 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  786. [2016-07-28 11:58:43,108] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/73/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  787. [2016-07-28 11:58:43,243] INFO Finished recovery for topic partition sting_actions_click-0 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  788. [2016-07-28 11:58:43,243] INFO Started recovery for topic partition sting_actions_inscreen-3 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  789. [2016-07-28 11:58:43,253] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/3/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  790. [2016-07-28 11:58:43,475] INFO Finished recovery for topic partition sting_actions_inscreen-3 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  791. [2016-07-28 11:58:43,475] INFO Started recovery for topic partition sting_actions_impression-14 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  792. [2016-07-28 11:58:43,479] INFO Finished recovery for topic partition sting_actions_impression-47 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  793. [2016-07-28 11:58:43,480] INFO Started recovery for topic partition sting_actions_inscreen-36 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  794. [2016-07-28 11:58:43,486] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/14/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  795. [2016-07-28 11:58:43,570] INFO Finished recovery for topic partition sting_actions_impression-73 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  796. [2016-07-28 11:58:43,571] INFO Started recovery for topic partition sting_actions_click-56 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  797. [2016-07-28 11:58:43,640] INFO Recovered from stale out-of-order records in sting_actions_impression-94 with offset 23239224 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  798. [2016-07-28 11:58:43,644] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  799. [2016-07-28 11:58:43,696] INFO Ignoring stale out-of-order record in sting_actions_click-89. Has offset 1769234 instead of expected offset 1769235 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  800. [2016-07-28 11:58:43,696] INFO Starting commit and rotation for topic partition sting_actions_click-89 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  801. [2016-07-28 11:58:43,701] INFO Finished recovery for topic partition sting_actions_inscreen-36 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  802. [2016-07-28 11:58:43,702] INFO Started recovery for topic partition sting_actions_click-29 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  803. [2016-07-28 11:58:43,702] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/89/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  804. [2016-07-28 11:58:43,797] INFO Finished recovery for topic partition sting_actions_click-56 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  805. [2016-07-28 11:58:43,798] INFO Started recovery for topic partition sting_actions_inscreen-59 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  806. [2016-07-28 11:58:43,845] INFO Recovered from stale out-of-order records in sting_actions_click-89 with offset 1769235 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  807. [2016-07-28 11:58:43,852] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  808. [2016-07-28 11:58:43,862] INFO Ignoring stale out-of-order record in sting_actions_inscreen-92. Has offset 4773079 instead of expected offset 4773080 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  809. [2016-07-28 11:58:43,862] INFO Starting commit and rotation for topic partition sting_actions_inscreen-92 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  810. [2016-07-28 11:58:43,871] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/92/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  811. [2016-07-28 11:58:43,910] INFO Finished recovery for topic partition sting_actions_click-29 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  812. [2016-07-28 11:58:43,910] INFO Started recovery for topic partition sting_actions_impression-43 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  813. [2016-07-28 11:58:44,032] INFO Finished recovery for topic partition sting_actions_impression-14 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  814. [2016-07-28 11:58:44,032] INFO Started recovery for topic partition sting_actions_inscreen-7 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  815. [2016-07-28 11:58:44,047] INFO Finished recovery for topic partition sting_actions_inscreen-59 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  816. [2016-07-28 11:58:44,047] INFO Started recovery for topic partition sting_actions_impression-69 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  817. [2016-07-28 11:58:44,278] INFO Finished recovery for topic partition sting_actions_inscreen-7 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  818. [2016-07-28 11:58:44,279] INFO Started recovery for topic partition sting_actions_click-8 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  819. [2016-07-28 11:58:44,339] INFO Finished recovery for topic partition sting_actions_impression-43 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  820. [2016-07-28 11:58:44,340] INFO Started recovery for topic partition sting_actions_inscreen-40 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  821. [2016-07-28 11:58:44,347] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/40/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  822. [2016-07-28 11:58:44,445] INFO Finished recovery for topic partition sting_actions_impression-69 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  823. [2016-07-28 11:58:44,445] INFO Started recovery for topic partition sting_actions_click-52 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  824. [2016-07-28 11:58:44,501] INFO Finished recovery for topic partition sting_actions_click-8 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  825. [2016-07-28 11:58:44,501] INFO Started recovery for topic partition sting_actions_inscreen-11 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  826. [2016-07-28 11:58:44,516] INFO Recovered from stale out-of-order records in sting_actions_inscreen-92 with offset 4773080 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  827. [2016-07-28 11:58:44,521] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  828. [2016-07-28 11:58:44,608] INFO Finished recovery for topic partition sting_actions_inscreen-40 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  829. [2016-07-28 11:58:44,608] INFO Started recovery for topic partition sting_actions_click-41 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  830. [2016-07-28 11:58:44,618] INFO Ignoring stale out-of-order record in sting_actions_impression-85. Has offset 23239135 instead of expected offset 23239136 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  831. [2016-07-28 11:58:44,618] INFO Starting commit and rotation for topic partition sting_actions_impression-85 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  832. [2016-07-28 11:58:44,628] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/85/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  833. [2016-07-28 11:58:44,668] INFO Finished recovery for topic partition sting_actions_click-52 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  834. [2016-07-28 11:58:44,669] INFO Started recovery for topic partition sting_actions_inscreen-63 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  835. [2016-07-28 11:58:44,679] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/63/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  836. [2016-07-28 11:58:44,722] INFO Finished recovery for topic partition sting_actions_inscreen-11 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  837. [2016-07-28 11:58:44,722] INFO Started recovery for topic partition sting_actions_impression-22 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  838. [2016-07-28 11:58:44,778] INFO Finished recovery for topic partition sting_actions_click-41 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  839. [2016-07-28 11:58:44,779] INFO Started recovery for topic partition sting_actions_impression-26 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  840. [2016-07-28 11:58:44,896] INFO Recovered from stale out-of-order records in sting_actions_impression-85 with offset 23239136 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  841. [2016-07-28 11:58:44,904] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  842. [2016-07-28 11:58:44,993] INFO Ignoring stale out-of-order record in sting_actions_click-98. Has offset 1769235 instead of expected offset 1769236 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  843. [2016-07-28 11:58:44,994] INFO Starting commit and rotation for topic partition sting_actions_click-98 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  844. [2016-07-28 11:58:44,997] INFO Finished recovery for topic partition sting_actions_inscreen-63 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  845. [2016-07-28 11:58:44,997] INFO Started recovery for topic partition sting_actions_click-65 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  846. [2016-07-28 11:58:44,999] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/98/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  847. [2016-07-28 11:58:45,131] INFO Finished recovery for topic partition sting_actions_impression-22 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  848. [2016-07-28 11:58:45,132] INFO Started recovery for topic partition sting_actions_click-4 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  849. [2016-07-28 11:58:45,196] INFO Finished recovery for topic partition sting_actions_click-65 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  850. [2016-07-28 11:58:45,197] INFO Started recovery for topic partition sting_actions_inscreen-70 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  851. [2016-07-28 11:58:45,234] INFO Finished recovery for topic partition sting_actions_impression-26 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  852. [2016-07-28 11:58:45,235] INFO Started recovery for topic partition sting_actions_inscreen-44 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  853. [2016-07-28 11:58:45,259] INFO Recovered from stale out-of-order records in sting_actions_click-98 with offset 1769236 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  854. [2016-07-28 11:58:45,271] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  855. [2016-07-28 11:58:45,282] INFO Ignoring stale out-of-order record in sting_actions_impression-97. Has offset 23239011 instead of expected offset 23239012 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  856. [2016-07-28 11:58:45,283] INFO Starting commit and rotation for topic partition sting_actions_impression-97 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  857. [2016-07-28 11:58:45,299] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/97/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  858. [2016-07-28 11:58:45,365] INFO Finished recovery for topic partition sting_actions_click-4 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  859. [2016-07-28 11:58:45,365] INFO Started recovery for topic partition sting_actions_inscreen-15 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  860. [2016-07-28 11:58:45,377] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/15/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  861. [2016-07-28 11:58:45,499] INFO Finished recovery for topic partition sting_actions_inscreen-44 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  862. [2016-07-28 11:58:45,499] INFO Started recovery for topic partition sting_actions_click-37 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  863. [2016-07-28 11:58:45,519] INFO Finished recovery for topic partition sting_actions_inscreen-70 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  864. [2016-07-28 11:58:45,520] INFO Started recovery for topic partition sting_actions_click-61 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  865. [2016-07-28 11:58:45,532] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/37/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  866. [2016-07-28 11:58:45,567] INFO Finished recovery for topic partition sting_actions_inscreen-15 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  867. [2016-07-28 11:58:45,567] INFO Started recovery for topic partition sting_actions_impression-1 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  868. [2016-07-28 11:58:45,687] INFO Finished recovery for topic partition sting_actions_click-37 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  869. [2016-07-28 11:58:45,688] INFO Started recovery for topic partition sting_actions_inscreen-48 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  870. [2016-07-28 11:58:45,692] INFO Recovered from stale out-of-order records in sting_actions_impression-97 with offset 23239012 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  871. [2016-07-28 11:58:45,698] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  872. [2016-07-28 11:58:45,750] INFO Finished recovery for topic partition sting_actions_click-61 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  873. [2016-07-28 11:58:45,750] INFO Started recovery for topic partition sting_actions_inscreen-74 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  874. [2016-07-28 11:58:45,772] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  875. [2016-07-28 11:58:45,773] INFO Starting commit and rotation for topic partition sting_actions_inscreen-83 with start offsets {year=2016/month=07/day=28/hour=11/=4773062} and end offsets {year=2016/month=07/day=28/hour=11/=4773062} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  876. [2016-07-28 11:58:45,827] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/83/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  877. [2016-07-28 11:58:45,936] INFO Finished recovery for topic partition sting_actions_inscreen-48 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  878. [2016-07-28 11:58:45,937] INFO Started recovery for topic partition sting_actions_impression-34 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  879. [2016-07-28 11:58:45,953] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/34/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  880. [2016-07-28 11:58:45,969] INFO Finished recovery for topic partition sting_actions_inscreen-74 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  881. [2016-07-28 11:58:45,970] INFO Started recovery for topic partition sting_actions_click-73 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  882. [2016-07-28 11:58:46,005] INFO Finished recovery for topic partition sting_actions_impression-1 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  883. [2016-07-28 11:58:46,005] INFO Started recovery for topic partition sting_actions_click-17 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  884. [2016-07-28 11:58:46,151] INFO Finished recovery for topic partition sting_actions_click-73 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  885. [2016-07-28 11:58:46,152] INFO Started recovery for topic partition sting_actions_impression-56 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  886. [2016-07-28 11:58:46,169] INFO Finished recovery for topic partition sting_actions_click-17 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  887. [2016-07-28 11:58:46,174] INFO Started recovery for topic partition sting_actions_inscreen-20 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  888. [2016-07-28 11:58:46,317] INFO Finished recovery for topic partition sting_actions_inscreen-20 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  889. [2016-07-28 11:58:46,318] INFO Started recovery for topic partition sting_actions_click-13 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  890. [2016-07-28 11:58:46,366] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_inscreen/year=2016/month=07/day=28/hour=11//sting_actions_inscreen+83+0004773062+0004773062.parquet for sting_actions_inscreen-83 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  891. [2016-07-28 11:58:46,372] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  892. [2016-07-28 11:58:46,389] INFO Finished recovery for topic partition sting_actions_impression-34 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  893. [2016-07-28 11:58:46,390] INFO Started recovery for topic partition sting_actions_click-46 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  894. [2016-07-28 11:58:46,401] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/46/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  895. [2016-07-28 11:58:46,444] INFO Ignoring stale out-of-order record in sting_actions_click-86. Has offset 1769287 instead of expected offset 1769288 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  896. [2016-07-28 11:58:46,445] INFO Starting commit and rotation for topic partition sting_actions_click-86 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  897. [2016-07-28 11:58:46,450] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/86/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  898. [2016-07-28 11:58:46,497] INFO Finished recovery for topic partition sting_actions_click-13 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  899. [2016-07-28 11:58:46,498] INFO Started recovery for topic partition sting_actions_inscreen-24 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  900. [2016-07-28 11:58:46,573] INFO Finished recovery for topic partition sting_actions_click-46 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  901. [2016-07-28 11:58:46,573] INFO Started recovery for topic partition sting_actions_impression-30 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  902. [2016-07-28 11:58:46,592] INFO Finished recovery for topic partition sting_actions_impression-56 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  903. [2016-07-28 11:58:46,592] INFO Started recovery for topic partition sting_actions_click-69 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  904. [2016-07-28 11:58:46,604] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/69/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  905. [2016-07-28 11:58:46,653] INFO Recovered from stale out-of-order records in sting_actions_click-86 with offset 1769288 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  906. [2016-07-28 11:58:46,660] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  907. [2016-07-28 11:58:46,670] INFO Ignoring stale out-of-order record in sting_actions_inscreen-95. Has offset 4773110 instead of expected offset 4773111 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  908. [2016-07-28 11:58:46,670] INFO Starting commit and rotation for topic partition sting_actions_inscreen-95 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  909. [2016-07-28 11:58:46,675] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/95/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  910. [2016-07-28 11:58:46,703] INFO Finished recovery for topic partition sting_actions_inscreen-24 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  911. [2016-07-28 11:58:46,703] INFO Started recovery for topic partition sting_actions_impression-9 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  912. [2016-07-28 11:58:46,821] INFO Finished recovery for topic partition sting_actions_click-69 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  913. [2016-07-28 11:58:46,822] INFO Started recovery for topic partition sting_actions_impression-52 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  914. [2016-07-28 11:58:46,831] INFO Recovered from stale out-of-order records in sting_actions_inscreen-95 with offset 4773111 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  915. [2016-07-28 11:58:46,836] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  916. [2016-07-28 11:58:46,912] INFO Ignoring stale out-of-order record in sting_actions_click-95. Has offset 1769277 instead of expected offset 1769278 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  917. [2016-07-28 11:58:46,912] INFO Starting commit and rotation for topic partition sting_actions_click-95 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  918. [2016-07-28 11:58:46,921] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/95/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  919. [2016-07-28 11:58:47,021] INFO Finished recovery for topic partition sting_actions_impression-30 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  920. [2016-07-28 11:58:47,021] INFO Started recovery for topic partition sting_actions_click-42 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  921. [2016-07-28 11:58:47,072] INFO Recovered from stale out-of-order records in sting_actions_click-95 with offset 1769278 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  922. [2016-07-28 11:58:47,079] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  923. [2016-07-28 11:58:47,090] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  924. [2016-07-28 11:58:47,096] INFO Starting commit and rotation for topic partition sting_actions_impression-76 with start offsets {year=2016/month=07/day=28/hour=11/=23239191} and end offsets {year=2016/month=07/day=28/hour=11/=23239191} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  925. [2016-07-28 11:58:47,124] INFO Finished recovery for topic partition sting_actions_impression-9 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  926. [2016-07-28 11:58:47,124] INFO Started recovery for topic partition sting_actions_impression-5 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  927. [2016-07-28 11:58:47,135] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/76/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  928. [2016-07-28 11:58:47,146] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/5/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  929. [2016-07-28 11:58:47,219] INFO Finished recovery for topic partition sting_actions_click-42 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  930. [2016-07-28 11:58:47,220] INFO Started recovery for topic partition sting_actions_click-25 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  931. [2016-07-28 11:58:47,233] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/25/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  932. [2016-07-28 11:58:47,265] INFO Finished recovery for topic partition sting_actions_impression-52 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  933. [2016-07-28 11:58:47,265] INFO Started recovery for topic partition sting_actions_inscreen-54 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  934. [2016-07-28 11:58:47,400] INFO Finished recovery for topic partition sting_actions_click-25 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  935. [2016-07-28 11:58:47,401] INFO Started recovery for topic partition sting_actions_impression-42 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  936. [2016-07-28 11:58:47,412] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/42/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  937. [2016-07-28 11:58:47,498] INFO Finished recovery for topic partition sting_actions_inscreen-54 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  938. [2016-07-28 11:58:47,498] INFO Started recovery for topic partition sting_actions_impression-64 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  939. [2016-07-28 11:58:47,587] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/64/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  940. [2016-07-28 11:58:47,656] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_impression/year=2016/month=07/day=28/hour=11//sting_actions_impression+76+0023239191+0023239191.parquet for sting_actions_impression-76 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  941. [2016-07-28 11:58:47,662] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  942. [2016-07-28 11:58:47,714] INFO Finished recovery for topic partition sting_actions_impression-5 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  943. [2016-07-28 11:58:47,716] INFO Started recovery for topic partition sting_actions_click-21 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  944. [2016-07-28 11:58:47,729] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  945. [2016-07-28 11:58:47,730] INFO Starting commit and rotation for topic partition sting_actions_inscreen-77 with start offsets {year=2016/month=07/day=28/hour=11/=4773117} and end offsets {year=2016/month=07/day=28/hour=11/=4773117} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  946. [2016-07-28 11:58:47,779] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/77/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  947. [2016-07-28 11:58:47,946] INFO Finished recovery for topic partition sting_actions_click-21 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  948. [2016-07-28 11:58:47,992] INFO Finished recovery for topic partition sting_actions_impression-42 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  949. [2016-07-28 11:58:47,992] INFO Started recovery for topic partition sting_actions_inscreen-28 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  950. [2016-07-28 11:58:48,005] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/28/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  951. [2016-07-28 11:58:48,060] INFO Finished recovery for topic partition sting_actions_impression-64 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  952. [2016-07-28 11:58:48,061] INFO Started recovery for topic partition sting_actions_inscreen-58 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  953. [2016-07-28 11:58:48,170] INFO Finished recovery for topic partition sting_actions_click-22 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  954. [2016-07-28 11:58:48,254] INFO Finished recovery for topic partition sting_actions_inscreen-28 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  955. [2016-07-28 11:58:48,254] INFO Started recovery for topic partition sting_actions_impression-38 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  956. [2016-07-28 11:58:48,268] INFO Finished recovery for topic partition sting_actions_inscreen-58 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  957. [2016-07-28 11:58:48,269] INFO Started recovery for topic partition sting_actions_impression-60 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  958. [2016-07-28 11:58:48,434] INFO Committed hdfs://hdpcluster/tmp/kafka-connect/topics/sting_actions_inscreen/year=2016/month=07/day=28/hour=11//sting_actions_inscreen+77+0004773117+0004773117.parquet for sting_actions_inscreen-77 (io.confluent.connect.hdfs.TopicPartitionWriter:577)
  959. [2016-07-28 11:58:48,439] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  960. [2016-07-28 11:58:48,515] INFO Ignoring stale out-of-order record in sting_actions_impression-88. Has offset 23239190 instead of expected offset 23239191 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  961. [2016-07-28 11:58:48,515] INFO Starting commit and rotation for topic partition sting_actions_impression-88 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  962. [2016-07-28 11:58:48,528] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/88/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  963. [2016-07-28 11:58:48,663] INFO Finished recovery for topic partition sting_actions_impression-24 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  964. [2016-07-28 11:58:48,663] INFO WorkerSinkTask{id=hdfs-sink-sting-impression-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSinkTask:244)
  965. [2016-07-28 11:58:48,701] ERROR Commit of WorkerSinkTask{id=hdfs-sink-sting-impression-0} offsets threw an unexpected exception: (org.apache.kafka.connect.runtime.WorkerSinkTask:180)
  966. org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured session.timeout.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
  967. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:578)
  968. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:519)
  969. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
  970. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
  971. at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
  972. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  973. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  974. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
  975. at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
  976. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
  977. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
  978. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:201)
  979. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:998)
  980. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  981. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  982. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  983. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  984. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  985. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  986. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  987. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  988. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  989. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  990. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  991. at java.lang.Thread.run(Thread.java:745)
  992. [2016-07-28 11:58:48,702] INFO Revoking previously assigned partitions [sting_actions_impression-17, sting_actions_click-1, sting_actions_inscreen-6, sting_actions_impression-13, sting_actions_inscreen-10, sting_actions_click-9, sting_actions_inscreen-14, sting_actions_impression-21, sting_actions_click-5, sting_actions_inscreen-18, sting_actions_inscreen-19, sting_actions_impression-0, sting_actions_click-14, sting_actions_inscreen-23, sting_actions_click-10, sting_actions_impression-8, sting_actions_click-22, sting_actions_inscreen-2, sting_actions_impression-4, sting_actions_click-18, sting_actions_inscreen-5, sting_actions_impression-16, sting_actions_inscreen-9, sting_actions_impression-12, sting_actions_inscreen-13, sting_actions_impression-24, sting_actions_click-6, sting_actions_inscreen-17, sting_actions_impression-20, sting_actions_click-2, sting_actions_inscreen-22, sting_actions_click-15, sting_actions_click-11, sting_actions_impression-7, sting_actions_click-23, sting_actions_inscreen-1, sting_actions_impression-3, sting_actions_click-19, sting_actions_impression-15, sting_actions_inscreen-4, sting_actions_impression-11, sting_actions_inscreen-8, sting_actions_impression-23, sting_actions_click-7, sting_actions_inscreen-12, sting_actions_impression-19, sting_actions_click-3, sting_actions_inscreen-16, sting_actions_inscreen-21, sting_actions_impression-2, sting_actions_click-16, sting_actions_click-12, sting_actions_impression-10, sting_actions_click-24, sting_actions_impression-6, sting_actions_click-20, sting_actions_inscreen-0, sting_actions_impression-18, sting_actions_click-0, sting_actions_inscreen-3, sting_actions_impression-14, sting_actions_inscreen-7, sting_actions_click-8, sting_actions_inscreen-11, sting_actions_impression-22, sting_actions_click-4, sting_actions_inscreen-15, sting_actions_impression-1, sting_actions_click-17, sting_actions_inscreen-20, sting_actions_click-13, sting_actions_inscreen-24, sting_actions_impression-9, sting_actions_impression-5, sting_actions_click-21] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:280)
  993. [2016-07-28 11:58:48,705] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  994. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216850_24604559 does not exist or is not under Constructionnull
  995. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  996. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  997. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  998. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  999. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1000. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1001. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1002. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1003. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1004. at java.security.AccessController.doPrivileged(Native Method)
  1005. at javax.security.auth.Subject.doAs(Subject.java:422)
  1006. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1007. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1008.  
  1009. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1010. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1011. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1012. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1013. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1014. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1015. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1016. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1017. at java.lang.reflect.Method.invoke(Method.java:498)
  1018. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1019. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1020. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1021. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1022. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1023. [2016-07-28 11:58:48,706] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/18/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1024. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/18/log
  1025. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1026. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1027. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1028. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1029. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1030. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1031. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1032. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1033. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1034. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1035. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1036. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1037. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1038. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1039. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1040. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1041. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1042. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1043. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1044. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1045. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1046. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1047. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1048. at java.lang.Thread.run(Thread.java:745)
  1049. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216850_24604559 does not exist or is not under Constructionnull
  1050. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1051. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1052. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1053. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1054. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1055. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1056. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1057. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1058. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1059. at java.security.AccessController.doPrivileged(Native Method)
  1060. at javax.security.auth.Subject.doAs(Subject.java:422)
  1061. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1062. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1063.  
  1064. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1065. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1066. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1067. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1068. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1069. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1070. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1071. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1072. at java.lang.reflect.Method.invoke(Method.java:498)
  1073. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1074. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1075. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1076. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1077. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1078. [2016-07-28 11:58:48,717] ERROR Error closing writer for sting_actions_click-18. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1079. [2016-07-28 11:58:48,721] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1080. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216852_24604561 does not exist or is not under Constructionnull
  1081. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1082. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1083. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1084. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1085. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1086. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1087. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1088. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1089. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1090. at java.security.AccessController.doPrivileged(Native Method)
  1091. at javax.security.auth.Subject.doAs(Subject.java:422)
  1092. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1093. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1094.  
  1095. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1096. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1097. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1098. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1099. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1100. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1101. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1102. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1103. at java.lang.reflect.Method.invoke(Method.java:498)
  1104. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1105. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1106. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1107. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1108. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1109. [2016-07-28 11:58:48,722] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/9/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1110. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/9/log
  1111. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1112. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1113. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1114. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1115. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1116. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1117. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1118. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1119. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1120. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1121. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1122. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1123. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1124. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1125. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1126. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1127. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1128. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1129. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1130. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1131. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1132. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1133. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1134. at java.lang.Thread.run(Thread.java:745)
  1135. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216852_24604561 does not exist or is not under Constructionnull
  1136. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1137. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1138. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1139. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1140. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1141. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1142. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1143. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1144. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1145. at java.security.AccessController.doPrivileged(Native Method)
  1146. at javax.security.auth.Subject.doAs(Subject.java:422)
  1147. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1148. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1149.  
  1150. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1151. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1152. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1153. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1154. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1155. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1156. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1157. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1158. at java.lang.reflect.Method.invoke(Method.java:498)
  1159. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1160. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1161. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1162. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1163. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1164. [2016-07-28 11:58:48,723] ERROR Error closing writer for sting_actions_inscreen-9. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1165. [2016-07-28 11:58:48,728] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1166. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216856_24604565 does not exist or is not under Constructionnull
  1167. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1168. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1169. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1170. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1171. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1172. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1173. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1174. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1175. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1176. at java.security.AccessController.doPrivileged(Native Method)
  1177. at javax.security.auth.Subject.doAs(Subject.java:422)
  1178. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1179. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1180.  
  1181. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1182. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1183. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1184. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1185. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1186. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1187. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1188. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1189. at java.lang.reflect.Method.invoke(Method.java:498)
  1190. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1191. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1192. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1193. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1194. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1195. [2016-07-28 11:58:48,729] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/6/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1196. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/6/log
  1197. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1198. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1199. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1200. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1201. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1202. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1203. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1204. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1205. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1206. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1207. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1208. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1209. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1210. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1211. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1212. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1213. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1214. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1215. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1216. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1217. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1218. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1219. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1220. at java.lang.Thread.run(Thread.java:745)
  1221. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216856_24604565 does not exist or is not under Constructionnull
  1222. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1223. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1224. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1225. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1226. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1227. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1228. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1229. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1230. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1231. at java.security.AccessController.doPrivileged(Native Method)
  1232. at javax.security.auth.Subject.doAs(Subject.java:422)
  1233. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1234. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1235.  
  1236. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1237. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1238. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1239. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1240. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1241. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1242. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1243. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1244. at java.lang.reflect.Method.invoke(Method.java:498)
  1245. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1246. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1247. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1248. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1249. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1250. [2016-07-28 11:58:48,730] ERROR Error closing writer for sting_actions_click-6. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1251. [2016-07-28 11:58:48,733] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1252. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216882_24604592 does not exist or is not under Constructionnull
  1253. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1254. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1255. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1256. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1257. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1258. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1259. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1260. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1261. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1262. at java.security.AccessController.doPrivileged(Native Method)
  1263. at javax.security.auth.Subject.doAs(Subject.java:422)
  1264. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1265. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1266.  
  1267. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1268. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1269. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1270. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1271. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1272. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1273. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1274. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1275. at java.lang.reflect.Method.invoke(Method.java:498)
  1276. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1277. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1278. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1279. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1280. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1281. [2016-07-28 11:58:48,734] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/22/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1282. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/22/log
  1283. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1284. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1285. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1286. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1287. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1288. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1289. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1290. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1291. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1292. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1293. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1294. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1295. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1296. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1297. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1298. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1299. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1300. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1301. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1302. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1303. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1304. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1305. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1306. at java.lang.Thread.run(Thread.java:745)
  1307. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216882_24604592 does not exist or is not under Constructionnull
  1308. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1309. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1310. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1311. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1312. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1313. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1314. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1315. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1316. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1317. at java.security.AccessController.doPrivileged(Native Method)
  1318. at javax.security.auth.Subject.doAs(Subject.java:422)
  1319. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1320. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1321.  
  1322. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1323. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1324. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1325. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1326. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1327. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1328. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1329. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1330. at java.lang.reflect.Method.invoke(Method.java:498)
  1331. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1332. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1333. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1334. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1335. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1336. [2016-07-28 11:58:48,735] ERROR Error closing writer for sting_actions_inscreen-22. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1337. [2016-07-28 11:58:48,739] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1338. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216860_24604569 does not exist or is not under Constructionnull
  1339. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1340. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1341. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1342. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1343. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1344. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1345. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1346. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1347. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1348. at java.security.AccessController.doPrivileged(Native Method)
  1349. at javax.security.auth.Subject.doAs(Subject.java:422)
  1350. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1351. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1352.  
  1353. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1354. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1355. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1356. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1357. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1358. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1359. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1360. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1361. at java.lang.reflect.Method.invoke(Method.java:498)
  1362. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1363. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1364. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1365. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1366. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1367. [2016-07-28 11:58:48,740] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/15/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1368. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/15/log
  1369. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1370. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1371. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1372. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1373. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1374. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1375. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1376. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1377. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1378. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1379. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1380. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1381. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1382. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1383. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1384. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1385. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1386. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1387. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1388. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1389. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1390. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1391. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1392. at java.lang.Thread.run(Thread.java:745)
  1393. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216860_24604569 does not exist or is not under Constructionnull
  1394. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1395. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1396. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1397. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1398. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1399. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1400. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1401. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1402. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1403. at java.security.AccessController.doPrivileged(Native Method)
  1404. at javax.security.auth.Subject.doAs(Subject.java:422)
  1405. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1406. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1407.  
  1408. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1409. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1410. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1411. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1412. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1413. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1414. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1415. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1416. at java.lang.reflect.Method.invoke(Method.java:498)
  1417. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1418. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1419. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1420. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1421. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1422. [2016-07-28 11:58:48,741] ERROR Error closing writer for sting_actions_click-15. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1423. [2016-07-28 11:58:48,742] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1424. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216862_24604572 does not exist or is not under Constructionnull
  1425. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1426. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1427. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1428. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1429. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1430. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1431. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1432. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1433. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1434. at java.security.AccessController.doPrivileged(Native Method)
  1435. at javax.security.auth.Subject.doAs(Subject.java:422)
  1436. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1437. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1438.  
  1439. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1440. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1441. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1442. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1443. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1444. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1445. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1446. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1447. at java.lang.reflect.Method.invoke(Method.java:498)
  1448. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1449. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1450. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1451. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1452. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1453. [2016-07-28 11:58:48,743] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/11/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1454. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/11/log
  1455. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1456. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1457. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1458. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1459. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1460. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1461. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1462. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1463. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1464. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1465. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1466. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1467. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1468. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1469. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1470. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1471. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1472. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1473. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1474. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1475. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1476. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1477. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1478. at java.lang.Thread.run(Thread.java:745)
  1479. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216862_24604572 does not exist or is not under Constructionnull
  1480. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1481. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1482. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1483. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1484. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1485. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1486. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1487. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1488. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1489. at java.security.AccessController.doPrivileged(Native Method)
  1490. at javax.security.auth.Subject.doAs(Subject.java:422)
  1491. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1492. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1493.  
  1494. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1495. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1496. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1497. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1498. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1499. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1500. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1501. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1502. at java.lang.reflect.Method.invoke(Method.java:498)
  1503. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1504. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1505. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1506. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1507. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1508. [2016-07-28 11:58:48,744] ERROR Error closing writer for sting_actions_impression-11. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1509. [2016-07-28 11:58:48,747] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1510. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216863_24604573 does not exist or is not under Constructionnull
  1511. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1512. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1513. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1514. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1515. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1516. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1517. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1518. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1519. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1520. at java.security.AccessController.doPrivileged(Native Method)
  1521. at javax.security.auth.Subject.doAs(Subject.java:422)
  1522. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1523. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1524.  
  1525. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1526. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1527. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1528. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1529. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1530. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1531. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1532. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1533. at java.lang.reflect.Method.invoke(Method.java:498)
  1534. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1535. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1536. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1537. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1538. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1539. [2016-07-28 11:58:48,748] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/12/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1540. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/12/log
  1541. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1542. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1543. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1544. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1545. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1546. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1547. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1548. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1549. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1550. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1551. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1552. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1553. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1554. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1555. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1556. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1557. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1558. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1559. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1560. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1561. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1562. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1563. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1564. at java.lang.Thread.run(Thread.java:745)
  1565. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216863_24604573 does not exist or is not under Constructionnull
  1566. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1567. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1568. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1569. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1570. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1571. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1572. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1573. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1574. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1575. at java.security.AccessController.doPrivileged(Native Method)
  1576. at javax.security.auth.Subject.doAs(Subject.java:422)
  1577. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1578. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1579.  
  1580. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1581. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1582. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1583. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1584. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1585. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1586. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1587. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1588. at java.lang.reflect.Method.invoke(Method.java:498)
  1589. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1590. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1591. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1592. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1593. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1594. [2016-07-28 11:58:48,749] ERROR Error closing writer for sting_actions_inscreen-12. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1595. [2016-07-28 11:58:48,751] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1596. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216870_24604580 does not exist or is not under Constructionnull
  1597. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1598. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1599. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1600. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1601. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1602. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1603. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1604. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1605. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1606. at java.security.AccessController.doPrivileged(Native Method)
  1607. at javax.security.auth.Subject.doAs(Subject.java:422)
  1608. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1609. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1610.  
  1611. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1612. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1613. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1614. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1615. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1616. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1617. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1618. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1619. at java.lang.reflect.Method.invoke(Method.java:498)
  1620. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1621. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1622. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1623. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1624. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1625. [2016-07-28 11:58:48,751] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/3/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1626. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/3/log
  1627. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1628. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1629. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1630. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1631. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1632. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1633. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1634. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1635. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1636. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1637. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1638. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1639. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1640. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1641. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1642. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1643. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1644. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1645. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1646. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1647. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1648. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1649. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1650. at java.lang.Thread.run(Thread.java:745)
  1651. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216870_24604580 does not exist or is not under Constructionnull
  1652. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1653. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1654. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1655. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1656. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1657. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1658. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1659. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1660. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1661. at java.security.AccessController.doPrivileged(Native Method)
  1662. at javax.security.auth.Subject.doAs(Subject.java:422)
  1663. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1664. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1665.  
  1666. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1667. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1668. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1669. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1670. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1671. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1672. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1673. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1674. at java.lang.reflect.Method.invoke(Method.java:498)
  1675. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1676. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1677. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1678. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1679. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1680. [2016-07-28 11:58:48,752] ERROR Error closing writer for sting_actions_click-3. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1681. [2016-07-28 11:58:48,768] INFO Finished recovery for topic partition sting_actions_impression-60 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  1682. [2016-07-28 11:58:48,769] INFO Started recovery for topic partition sting_actions_click-74 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  1683. [2016-07-28 11:58:48,779] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/74/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  1684. [2016-07-28 11:58:48,807] INFO Finished recovery for topic partition sting_actions_impression-38 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  1685. [2016-07-28 11:58:48,808] INFO Started recovery for topic partition sting_actions_inscreen-32 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  1686. [2016-07-28 11:58:48,977] INFO Finished recovery for topic partition sting_actions_click-74 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  1687. [2016-07-28 11:58:48,979] INFO Started recovery for topic partition sting_actions_click-57 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  1688. [2016-07-28 11:58:49,215] INFO Finished recovery for topic partition sting_actions_inscreen-32 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  1689. [2016-07-28 11:58:49,327] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1690. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216877_24604587 does not exist or is not under Constructionnull
  1691. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1692. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1693. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1694. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1695. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1696. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1697. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1698. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1699. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1700. at java.security.AccessController.doPrivileged(Native Method)
  1701. at javax.security.auth.Subject.doAs(Subject.java:422)
  1702. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1703. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1704.  
  1705. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1706. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1707. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1708. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1709. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1710. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1711. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1712. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1713. at java.lang.reflect.Method.invoke(Method.java:498)
  1714. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1715. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1716. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1717. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1718. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1719. [2016-07-28 11:58:49,327] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/12/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1720. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/12/log
  1721. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1722. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1723. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1724. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1725. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1726. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1727. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1728. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1729. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1730. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1731. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1732. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1733. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1734. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1735. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1736. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1737. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1738. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1739. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1740. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1741. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1742. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1743. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1744. at java.lang.Thread.run(Thread.java:745)
  1745. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216877_24604587 does not exist or is not under Constructionnull
  1746. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1747. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1748. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1749. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1750. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1751. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1752. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1753. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1754. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1755. at java.security.AccessController.doPrivileged(Native Method)
  1756. at javax.security.auth.Subject.doAs(Subject.java:422)
  1757. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1758. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1759.  
  1760. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1761. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1762. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1763. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1764. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1765. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1766. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1767. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1768. at java.lang.reflect.Method.invoke(Method.java:498)
  1769. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1770. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1771. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1772. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1773. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1774. [2016-07-28 11:58:49,330] ERROR Error closing writer for sting_actions_click-12. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1775. [2016-07-28 11:58:49,385] INFO Recovered from stale out-of-order records in sting_actions_impression-88 with offset 23239191 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  1776. [2016-07-28 11:58:49,440] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  1777. [2016-07-28 11:58:49,515] INFO Ignoring stale out-of-order record in sting_actions_inscreen-86. Has offset 4773172 instead of expected offset 4773173 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  1778. [2016-07-28 11:58:49,515] INFO Starting commit and rotation for topic partition sting_actions_inscreen-86 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  1779. [2016-07-28 11:58:49,542] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/86/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  1780. [2016-07-28 11:58:49,551] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1781. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216886_24604596 does not exist or is not under Constructionnull
  1782. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1783. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1784. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1785. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1786. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1787. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1788. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1789. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1790. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1791. at java.security.AccessController.doPrivileged(Native Method)
  1792. at javax.security.auth.Subject.doAs(Subject.java:422)
  1793. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1794. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1795.  
  1796. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1797. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1798. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1799. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1800. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1801. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1802. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1803. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1804. at java.lang.reflect.Method.invoke(Method.java:498)
  1805. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1806. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1807. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1808. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1809. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1810. [2016-07-28 11:58:49,552] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/0/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1811. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/0/log
  1812. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1813. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1814. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1815. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1816. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1817. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1818. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1819. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1820. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1821. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1822. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1823. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1824. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1825. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1826. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1827. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1828. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1829. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1830. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1831. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1832. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1833. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1834. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1835. at java.lang.Thread.run(Thread.java:745)
  1836. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216886_24604596 does not exist or is not under Constructionnull
  1837. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1838. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1839. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1840. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1841. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1842. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1843. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1844. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1845. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1846. at java.security.AccessController.doPrivileged(Native Method)
  1847. at javax.security.auth.Subject.doAs(Subject.java:422)
  1848. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1849. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1850.  
  1851. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1852. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1853. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1854. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1855. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1856. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  1857. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  1858. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1859. at java.lang.reflect.Method.invoke(Method.java:498)
  1860. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1861. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1862. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1863. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1864. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1865. [2016-07-28 11:58:49,553] ERROR Error closing writer for sting_actions_click-0. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1866. [2016-07-28 11:58:49,560] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1867. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216893_24604603 does not exist or is not under Constructionnull
  1868. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1869. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1870. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1871. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1872. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1873. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1874. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1875. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1876. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1877. at java.security.AccessController.doPrivileged(Native Method)
  1878. at javax.security.auth.Subject.doAs(Subject.java:422)
  1879. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1880. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1881.  
  1882. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1883. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1884. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1885. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1886. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1887. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  1888. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1889. at java.lang.reflect.Method.invoke(Method.java:498)
  1890. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1891. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1892. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1893. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1894. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1895. [2016-07-28 11:58:49,560] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/3/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1896. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/3/log
  1897. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1898. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1899. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1900. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1901. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1902. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1903. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1904. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1905. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1906. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1907. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1908. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1909. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1910. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1911. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1912. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1913. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1914. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1915. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  1916. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1917. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1918. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1919. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1920. at java.lang.Thread.run(Thread.java:745)
  1921. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216893_24604603 does not exist or is not under Constructionnull
  1922. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1923. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1924. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1925. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1926. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1927. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1928. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1929. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1930. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1931. at java.security.AccessController.doPrivileged(Native Method)
  1932. at javax.security.auth.Subject.doAs(Subject.java:422)
  1933. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1934. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1935.  
  1936. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1937. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1938. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1939. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1940. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1941. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  1942. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1943. at java.lang.reflect.Method.invoke(Method.java:498)
  1944. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1945. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1946. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1947. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1948. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1949. [2016-07-28 11:58:49,561] ERROR Error closing writer for sting_actions_inscreen-3. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  1950. [2016-07-28 11:58:49,646] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  1951. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216897_24604607 does not exist or is not under Constructionnull
  1952. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  1953. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  1954. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  1955. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  1956. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  1957. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  1958. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  1959. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  1960. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  1961. at java.security.AccessController.doPrivileged(Native Method)
  1962. at javax.security.auth.Subject.doAs(Subject.java:422)
  1963. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  1964. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  1965.  
  1966. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  1967. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  1968. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  1969. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  1970. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  1971. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  1972. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1973. at java.lang.reflect.Method.invoke(Method.java:498)
  1974. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  1975. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  1976. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  1977. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  1978. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  1979. [2016-07-28 11:58:49,647] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/14/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  1980. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/14/log
  1981. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  1982. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  1983. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  1984. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  1985. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  1986. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  1987. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  1988. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  1989. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  1990. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  1991. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  1992. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  1993. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  1994. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  1995. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  1996. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  1997. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  1998. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  1999. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2000. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2001. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2002. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2003. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2004. at java.lang.Thread.run(Thread.java:745)
  2005. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216897_24604607 does not exist or is not under Constructionnull
  2006. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2007. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2008. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2009. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2010. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2011. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2012. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2013. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2014. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2015. at java.security.AccessController.doPrivileged(Native Method)
  2016. at javax.security.auth.Subject.doAs(Subject.java:422)
  2017. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2018. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2019.  
  2020. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2021. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2022. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2023. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2024. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2025. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2026. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2027. at java.lang.reflect.Method.invoke(Method.java:498)
  2028. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2029. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2030. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2031. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2032. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2033. [2016-07-28 11:58:49,648] ERROR Error closing writer for sting_actions_impression-14. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2034. [2016-07-28 11:58:49,840] INFO Recovered from stale out-of-order records in sting_actions_inscreen-86 with offset 4773173 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  2035. [2016-07-28 11:58:49,871] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  2036. [2016-07-28 11:58:49,944] INFO Finished recovery for topic partition sting_actions_click-57 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  2037. [2016-07-28 11:58:49,944] INFO Started recovery for topic partition sting_actions_inscreen-62 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  2038. [2016-07-28 11:58:49,950] INFO Ignoring stale out-of-order record in sting_actions_inscreen-98. Has offset 4773027 instead of expected offset 4773028 (io.confluent.connect.hdfs.TopicPartitionWriter:470)
  2039. [2016-07-28 11:58:49,950] INFO Starting commit and rotation for topic partition sting_actions_inscreen-98 with start offsets {} and end offsets {} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  2040. [2016-07-28 11:58:49,966] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/62/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  2041. [2016-07-28 11:58:50,041] INFO Finished recovery for topic partition sting_actions_click-31 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  2042. [2016-07-28 11:58:50,042] INFO WorkerSinkTask{id=hdfs-sink-sting-impression-2} Committing offsets (org.apache.kafka.connect.runtime.WorkerSinkTask:244)
  2043. [2016-07-28 11:58:50,063] ERROR Commit of WorkerSinkTask{id=hdfs-sink-sting-impression-2} offsets threw an unexpected exception: (org.apache.kafka.connect.runtime.WorkerSinkTask:180)
  2044. org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured session.timeout.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
  2045. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:578)
  2046. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:519)
  2047. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
  2048. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
  2049. at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
  2050. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  2051. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  2052. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
  2053. at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
  2054. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
  2055. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
  2056. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:201)
  2057. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:998)
  2058. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2059. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2060. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2061. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2062. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2063. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2064. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2065. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2066. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2067. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2068. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2069. at java.lang.Thread.run(Thread.java:745)
  2070. [2016-07-28 11:58:50,064] INFO Revoking previously assigned partitions [sting_actions_inscreen-35, sting_actions_click-30, sting_actions_impression-46, sting_actions_inscreen-39, sting_actions_click-26, sting_actions_impression-25, sting_actions_inscreen-43, sting_actions_click-38, sting_actions_inscreen-47, sting_actions_click-34, sting_actions_impression-33, sting_actions_click-47, sting_actions_impression-29, sting_actions_click-43, sting_actions_impression-41, sting_actions_inscreen-27, sting_actions_impression-37, sting_actions_inscreen-31, sting_actions_impression-49, sting_actions_inscreen-38, sting_actions_click-31, sting_actions_impression-45, sting_actions_inscreen-42, sting_actions_click-27, sting_actions_inscreen-46, sting_actions_click-39, sting_actions_click-35, sting_actions_click-48, sting_actions_impression-32, sting_actions_click-44, sting_actions_inscreen-26, sting_actions_impression-28, sting_actions_inscreen-30, sting_actions_impression-40, sting_actions_inscreen-34, sting_actions_impression-36, sting_actions_inscreen-37, sting_actions_click-32, sting_actions_impression-48, sting_actions_inscreen-41, sting_actions_click-28, sting_actions_impression-44, sting_actions_inscreen-45, sting_actions_click-40, sting_actions_inscreen-49, sting_actions_click-36, sting_actions_click-49, sting_actions_impression-31, sting_actions_click-45, sting_actions_inscreen-25, sting_actions_impression-27, sting_actions_inscreen-29, sting_actions_impression-39, sting_actions_inscreen-33, sting_actions_impression-35, sting_actions_click-33, sting_actions_impression-47, sting_actions_inscreen-36, sting_actions_click-29, sting_actions_impression-43, sting_actions_inscreen-40, sting_actions_click-41, sting_actions_impression-26, sting_actions_inscreen-44, sting_actions_click-37, sting_actions_inscreen-48, sting_actions_impression-34, sting_actions_click-46, sting_actions_impression-30, sting_actions_click-42, sting_actions_click-25, sting_actions_impression-42, sting_actions_inscreen-28, sting_actions_impression-38, sting_actions_inscreen-32] for group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:280)
  2071. [2016-07-28 11:58:50,149] INFO Finished recovery for topic partition sting_actions_inscreen-62 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  2072. [2016-07-28 11:58:50,150] INFO Started recovery for topic partition sting_actions_impression-72 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  2073. [2016-07-28 11:58:50,311] INFO WorkerSinkTask{id=hdfs-sink-sting-impression-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSinkTask:244)
  2074. [2016-07-28 11:58:50,356] ERROR Commit of WorkerSinkTask{id=hdfs-sink-sting-impression-0} offsets threw an unexpected exception: (org.apache.kafka.connect.runtime.WorkerSinkTask:180)
  2075. org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured session.timeout.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
  2076. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:578)
  2077. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:519)
  2078. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
  2079. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
  2080. at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
  2081. at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
  2082. at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
  2083. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
  2084. at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
  2085. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
  2086. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
  2087. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
  2088. at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
  2089. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:404)
  2090. at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1058)
  2091. at org.apache.kafka.connect.runtime.WorkerSinkTask.doCommit(WorkerSinkTask.java:247)
  2092. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:293)
  2093. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2094. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2095. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2096. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2097. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2098. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2099. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2100. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2101. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2102. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2103. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2104. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2105. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2106. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2107. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2108. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2109. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2110. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2111. at java.lang.Thread.run(Thread.java:745)
  2112. [2016-07-28 11:58:50,357] INFO (Re-)joining group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:326)
  2113. [2016-07-28 11:58:50,359] INFO (Re-)joining group connect-hdfs-sink-sting-impression (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:326)
  2114. [2016-07-28 11:58:50,373] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2115. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216854_24604563 does not exist or is not under Constructionnull
  2116. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2117. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2118. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2119. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2120. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2121. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2122. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2123. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2124. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2125. at java.security.AccessController.doPrivileged(Native Method)
  2126. at javax.security.auth.Subject.doAs(Subject.java:422)
  2127. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2128. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2129.  
  2130. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2131. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2132. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2133. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2134. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2135. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2136. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2137. at java.lang.reflect.Method.invoke(Method.java:498)
  2138. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2139. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2140. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2141. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2142. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2143. [2016-07-28 11:58:50,373] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/45/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2144. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/45/log
  2145. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2146. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2147. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2148. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2149. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2150. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2151. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2152. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2153. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2154. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2155. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2156. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2157. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2158. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2159. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2160. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2161. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2162. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2163. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2164. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2165. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2166. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2167. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2168. at java.lang.Thread.run(Thread.java:745)
  2169. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216854_24604563 does not exist or is not under Constructionnull
  2170. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2171. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2172. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2173. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2174. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2175. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2176. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2177. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2178. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2179. at java.security.AccessController.doPrivileged(Native Method)
  2180. at javax.security.auth.Subject.doAs(Subject.java:422)
  2181. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2182. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2183.  
  2184. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2185. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2186. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2187. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2188. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2189. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2190. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2191. at java.lang.reflect.Method.invoke(Method.java:498)
  2192. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2193. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2194. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2195. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2196. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2197. [2016-07-28 11:58:50,373] ERROR Error closing writer for sting_actions_impression-45. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2198. [2016-07-28 11:58:50,376] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2199. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216864_24604574 does not exist or is not under Constructionnull
  2200. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2201. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2202. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2203. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2204. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2205. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2206. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2207. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2208. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2209. at java.security.AccessController.doPrivileged(Native Method)
  2210. at javax.security.auth.Subject.doAs(Subject.java:422)
  2211. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2212. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2213.  
  2214. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2215. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2216. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2217. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2218. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2219. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2220. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2221. at java.lang.reflect.Method.invoke(Method.java:498)
  2222. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2223. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2224. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2225. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2226. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2227. [2016-07-28 11:58:50,376] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/46/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2228. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/46/log
  2229. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2230. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2231. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2232. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2233. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2234. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2235. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2236. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2237. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2238. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2239. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2240. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2241. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2242. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2243. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2244. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2245. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2246. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2247. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2248. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2249. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2250. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2251. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2252. at java.lang.Thread.run(Thread.java:745)
  2253. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216864_24604574 does not exist or is not under Constructionnull
  2254. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2255. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2256. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2257. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2258. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2259. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2260. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2261. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2262. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2263. at java.security.AccessController.doPrivileged(Native Method)
  2264. at javax.security.auth.Subject.doAs(Subject.java:422)
  2265. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2266. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2267.  
  2268. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2269. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2270. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2271. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2272. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2273. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2274. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2275. at java.lang.reflect.Method.invoke(Method.java:498)
  2276. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2277. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2278. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2279. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2280. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2281. [2016-07-28 11:58:50,376] ERROR Error closing writer for sting_actions_inscreen-46. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2282. [2016-07-28 11:58:50,378] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2283. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216951_24604662 does not exist or is not under Constructionnull
  2284. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2285. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2286. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2287. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2288. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2289. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2290. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2291. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2292. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2293. at java.security.AccessController.doPrivileged(Native Method)
  2294. at javax.security.auth.Subject.doAs(Subject.java:422)
  2295. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2296. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2297.  
  2298. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2299. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2300. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2301. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2302. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2303. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2304. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2305. at java.lang.reflect.Method.invoke(Method.java:498)
  2306. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2307. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2308. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2309. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2310. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2311. [2016-07-28 11:58:50,378] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/35/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2312. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/35/log
  2313. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2314. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2315. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2316. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2317. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2318. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2319. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2320. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2321. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2322. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2323. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2324. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2325. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2326. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2327. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2328. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2329. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2330. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2331. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2332. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2333. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2334. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2335. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2336. at java.lang.Thread.run(Thread.java:745)
  2337. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216951_24604662 does not exist or is not under Constructionnull
  2338. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2339. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2340. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2341. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2342. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2343. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2344. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2345. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2346. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2347. at java.security.AccessController.doPrivileged(Native Method)
  2348. at javax.security.auth.Subject.doAs(Subject.java:422)
  2349. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2350. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2351.  
  2352. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2353. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2354. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2355. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2356. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2357. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2358. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2359. at java.lang.reflect.Method.invoke(Method.java:498)
  2360. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2361. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2362. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2363. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2364. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2365. [2016-07-28 11:58:50,378] ERROR Error closing writer for sting_actions_click-35. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2366. [2016-07-28 11:58:50,511] INFO Recovered from stale out-of-order records in sting_actions_inscreen-98 with offset 4773028 (io.confluent.connect.hdfs.TopicPartitionWriter:479)
  2367. [2016-07-28 11:58:50,523] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  2368. [2016-07-28 11:58:50,545] INFO Finished recovery for topic partition sting_actions_impression-72 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  2369. [2016-07-28 11:58:50,546] INFO Started recovery for topic partition sting_actions_click-53 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  2370. [2016-07-28 11:58:50,563] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2371. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216908_24604618 does not exist or is not under Constructionnull
  2372. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2373. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2374. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2375. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2376. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2377. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2378. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2379. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2380. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2381. at java.security.AccessController.doPrivileged(Native Method)
  2382. at javax.security.auth.Subject.doAs(Subject.java:422)
  2383. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2384. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2385.  
  2386. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2387. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2388. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2389. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2390. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2391. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2392. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2393. at java.lang.reflect.Method.invoke(Method.java:498)
  2394. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2395. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2396. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2397. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2398. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2399. [2016-07-28 11:58:50,563] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/37/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2400. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/37/log
  2401. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2402. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2403. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2404. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2405. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2406. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2407. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2408. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2409. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2410. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2411. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2412. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2413. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2414. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2415. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2416. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2417. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2418. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2419. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2420. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2421. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2422. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2423. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2424. at java.lang.Thread.run(Thread.java:745)
  2425. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216908_24604618 does not exist or is not under Constructionnull
  2426. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2427. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2428. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2429. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2430. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2431. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2432. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2433. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2434. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2435. at java.security.AccessController.doPrivileged(Native Method)
  2436. at javax.security.auth.Subject.doAs(Subject.java:422)
  2437. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2438. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2439.  
  2440. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2441. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2442. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2443. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2444. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2445. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2446. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2447. at java.lang.reflect.Method.invoke(Method.java:498)
  2448. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2449. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2450. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2451. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2452. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2453. [2016-07-28 11:58:50,564] ERROR Error closing writer for sting_actions_inscreen-37. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2454. [2016-07-28 11:58:50,567] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2455. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216878_24604588 does not exist or is not under Constructionnull
  2456. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2457. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2458. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2459. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2460. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2461. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2462. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2463. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2464. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2465. at java.security.AccessController.doPrivileged(Native Method)
  2466. at javax.security.auth.Subject.doAs(Subject.java:422)
  2467. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2468. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2469.  
  2470. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2471. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2472. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2473. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2474. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2475. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2476. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2477. at java.lang.reflect.Method.invoke(Method.java:498)
  2478. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2479. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2480. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2481. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2482. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2483. [2016-07-28 11:58:50,568] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/48/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2484. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/48/log
  2485. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2486. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2487. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2488. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2489. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2490. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2491. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2492. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2493. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2494. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2495. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2496. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2497. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2498. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2499. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2500. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2501. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2502. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2503. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2504. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2505. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2506. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2507. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2508. at java.lang.Thread.run(Thread.java:745)
  2509. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216878_24604588 does not exist or is not under Constructionnull
  2510. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2511. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2512. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2513. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2514. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2515. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2516. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2517. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2518. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2519. at java.security.AccessController.doPrivileged(Native Method)
  2520. at javax.security.auth.Subject.doAs(Subject.java:422)
  2521. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2522. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2523.  
  2524. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2525. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2526. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2527. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2528. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2529. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2530. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2531. at java.lang.reflect.Method.invoke(Method.java:498)
  2532. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2533. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2534. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2535. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2536. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2537. [2016-07-28 11:58:50,568] ERROR Error closing writer for sting_actions_impression-48. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2538. [2016-07-28 11:58:50,583] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2539. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216910_24604620 does not exist or is not under Constructionnull
  2540. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2541. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2542. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2543. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2544. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2545. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2546. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2547. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2548. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2549. at java.security.AccessController.doPrivileged(Native Method)
  2550. at javax.security.auth.Subject.doAs(Subject.java:422)
  2551. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2552. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2553.  
  2554. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2555. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2556. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2557. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2558. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2559. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2560. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2561. at java.lang.reflect.Method.invoke(Method.java:498)
  2562. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2563. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2564. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2565. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2566. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2567. [2016-07-28 11:58:50,584] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/28/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2568. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/28/log
  2569. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2570. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2571. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2572. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2573. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2574. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2575. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2576. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2577. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2578. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2579. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2580. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2581. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2582. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2583. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2584. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2585. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2586. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2587. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2588. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2589. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2590. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2591. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2592. at java.lang.Thread.run(Thread.java:745)
  2593. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216910_24604620 does not exist or is not under Constructionnull
  2594. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2595. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2596. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2597. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2598. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2599. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2600. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2601. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2602. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2603. at java.security.AccessController.doPrivileged(Native Method)
  2604. at javax.security.auth.Subject.doAs(Subject.java:422)
  2605. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2606. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2607.  
  2608. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2609. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2610. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2611. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2612. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2613. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2614. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2615. at java.lang.reflect.Method.invoke(Method.java:498)
  2616. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2617. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2618. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2619. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2620. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2621. [2016-07-28 11:58:50,584] ERROR Error closing writer for sting_actions_click-28. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2622. [2016-07-28 11:58:50,654] INFO Got brand-new compressor [.snappy] (org.apache.hadoop.io.compress.CodecPool:153)
  2623. [2016-07-28 11:58:50,655] INFO Starting commit and rotation for topic partition sting_actions_click-83 with start offsets {year=2016/month=07/day=28/hour=11/=1769253} and end offsets {year=2016/month=07/day=28/hour=11/=1769253} (io.confluent.connect.hdfs.TopicPartitionWriter:267)
  2624. [2016-07-28 11:58:50,722] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2625. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216885_24604595 does not exist or is not under Constructionnull
  2626. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2627. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2628. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2629. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2630. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2631. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2632. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2633. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2634. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2635. at java.security.AccessController.doPrivileged(Native Method)
  2636. at javax.security.auth.Subject.doAs(Subject.java:422)
  2637. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2638. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2639.  
  2640. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2641. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2642. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2643. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2644. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2645. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2646. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2647. at java.lang.reflect.Method.invoke(Method.java:498)
  2648. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2649. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2650. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2651. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2652. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2653. [2016-07-28 11:58:50,723] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/49/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2654. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/49/log
  2655. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2656. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2657. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2658. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2659. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2660. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2661. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2662. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2663. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2664. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2665. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2666. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2667. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2668. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2669. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2670. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2671. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2672. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2673. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2674. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2675. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2676. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2677. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2678. at java.lang.Thread.run(Thread.java:745)
  2679. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216885_24604595 does not exist or is not under Constructionnull
  2680. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2681. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2682. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2683. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2684. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2685. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2686. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2687. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2688. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2689. at java.security.AccessController.doPrivileged(Native Method)
  2690. at javax.security.auth.Subject.doAs(Subject.java:422)
  2691. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2692. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2693.  
  2694. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2695. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2696. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2697. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2698. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2699. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2700. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2701. at java.lang.reflect.Method.invoke(Method.java:498)
  2702. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2703. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2704. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2705. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2706. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2707. [2016-07-28 11:58:50,723] ERROR Error closing writer for sting_actions_click-49. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2708. [2016-07-28 11:58:50,725] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/83/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  2709. [2016-07-28 11:58:50,726] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2710. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216912_24604622 does not exist or is not under Constructionnull
  2711. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2712. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2713. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2714. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2715. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2716. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2717. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2718. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2719. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2720. at java.security.AccessController.doPrivileged(Native Method)
  2721. at javax.security.auth.Subject.doAs(Subject.java:422)
  2722. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2723. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2724.  
  2725. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2726. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2727. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2728. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2729. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2730. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2731. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2732. at java.lang.reflect.Method.invoke(Method.java:498)
  2733. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2734. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2735. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2736. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2737. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2738. [2016-07-28 11:58:50,727] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/25/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2739. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/25/log
  2740. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2741. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2742. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2743. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2744. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2745. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2746. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2747. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2748. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2749. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2750. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2751. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2752. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2753. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2754. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2755. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2756. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2757. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2758. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2759. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2760. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2761. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2762. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2763. at java.lang.Thread.run(Thread.java:745)
  2764. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216912_24604622 does not exist or is not under Constructionnull
  2765. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2766. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2767. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2768. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2769. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2770. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2771. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2772. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2773. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2774. at java.security.AccessController.doPrivileged(Native Method)
  2775. at javax.security.auth.Subject.doAs(Subject.java:422)
  2776. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2777. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2778.  
  2779. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2780. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2781. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2782. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2783. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2784. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2785. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2786. at java.lang.reflect.Method.invoke(Method.java:498)
  2787. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2788. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2789. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2790. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2791. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2792. [2016-07-28 11:58:50,727] ERROR Error closing writer for sting_actions_inscreen-25. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2793. [2016-07-28 11:58:50,729] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2794. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216914_24604624 does not exist or is not under Constructionnull
  2795. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2796. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2797. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2798. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2799. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2800. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2801. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2802. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2803. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2804. at java.security.AccessController.doPrivileged(Native Method)
  2805. at javax.security.auth.Subject.doAs(Subject.java:422)
  2806. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2807. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2808.  
  2809. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2810. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2811. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2812. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2813. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2814. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2815. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2816. at java.lang.reflect.Method.invoke(Method.java:498)
  2817. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2818. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2819. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2820. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2821. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2822. [2016-07-28 11:58:50,730] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/27/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2823. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/27/log
  2824. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2825. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2826. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2827. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2828. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2829. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2830. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2831. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2832. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2833. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2834. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2835. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2836. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2837. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2838. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2839. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2840. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2841. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2842. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2843. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2844. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2845. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2846. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2847. at java.lang.Thread.run(Thread.java:745)
  2848. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216914_24604624 does not exist or is not under Constructionnull
  2849. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2850. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2851. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2852. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2853. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2854. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2855. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2856. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2857. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2858. at java.security.AccessController.doPrivileged(Native Method)
  2859. at javax.security.auth.Subject.doAs(Subject.java:422)
  2860. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2861. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2862.  
  2863. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2864. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2865. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2866. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2867. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2868. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2869. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2870. at java.lang.reflect.Method.invoke(Method.java:498)
  2871. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2872. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2873. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2874. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2875. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2876. [2016-07-28 11:58:50,731] ERROR Error closing writer for sting_actions_impression-27. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2877. [2016-07-28 11:58:50,733] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2878. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216915_24604625 does not exist or is not under Constructionnull
  2879. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2880. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2881. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2882. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2883. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2884. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2885. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2886. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2887. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2888. at java.security.AccessController.doPrivileged(Native Method)
  2889. at javax.security.auth.Subject.doAs(Subject.java:422)
  2890. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2891. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2892.  
  2893. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2894. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2895. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2896. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2897. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2898. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2899. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2900. at java.lang.reflect.Method.invoke(Method.java:498)
  2901. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2902. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2903. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2904. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2905. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2906. [2016-07-28 11:58:50,733] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/39/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2907. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_impression/39/log
  2908. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2909. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2910. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2911. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2912. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  2913. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  2914. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  2915. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  2916. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  2917. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  2918. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  2919. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  2920. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  2921. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  2922. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  2923. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  2924. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  2925. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  2926. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  2927. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2928. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2929. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2930. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2931. at java.lang.Thread.run(Thread.java:745)
  2932. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216915_24604625 does not exist or is not under Constructionnull
  2933. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2934. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2935. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2936. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2937. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2938. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2939. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2940. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2941. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2942. at java.security.AccessController.doPrivileged(Native Method)
  2943. at javax.security.auth.Subject.doAs(Subject.java:422)
  2944. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2945. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2946.  
  2947. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2948. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2949. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2950. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2951. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2952. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2953. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2954. at java.lang.reflect.Method.invoke(Method.java:498)
  2955. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2956. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2957. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2958. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2959. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2960. [2016-07-28 11:58:50,734] ERROR Error closing writer for sting_actions_impression-39. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  2961. [2016-07-28 11:58:50,778] INFO Finished recovery for topic partition sting_actions_click-53 (io.confluent.connect.hdfs.TopicPartitionWriter:208)
  2962. [2016-07-28 11:58:50,779] INFO Started recovery for topic partition sting_actions_inscreen-66 (io.confluent.connect.hdfs.TopicPartitionWriter:193)
  2963. [2016-07-28 11:58:50,791] INFO Successfully acquired lease for hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscreen/66/log (io.confluent.connect.hdfs.wal.FSWAL:75)
  2964. [2016-07-28 11:58:50,841] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  2965. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216918_24604628 does not exist or is not under Constructionnull
  2966. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  2967. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  2968. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  2969. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  2970. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  2971. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  2972. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  2973. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  2974. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  2975. at java.security.AccessController.doPrivileged(Native Method)
  2976. at javax.security.auth.Subject.doAs(Subject.java:422)
  2977. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  2978. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  2979.  
  2980. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  2981. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  2982. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  2983. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  2984. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  2985. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  2986. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2987. at java.lang.reflect.Method.invoke(Method.java:498)
  2988. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  2989. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  2990. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  2991. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  2992. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  2993. [2016-07-28 11:58:50,842] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/37/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  2994. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/37/log
  2995. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  2996. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  2997. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  2998. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  2999. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  3000. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  3001. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  3002. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  3003. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  3004. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  3005. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  3006. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  3007. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  3008. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  3009. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  3010. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  3011. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  3012. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  3013. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  3014. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  3015. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  3016. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  3017. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  3018. at java.lang.Thread.run(Thread.java:745)
  3019. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216918_24604628 does not exist or is not under Constructionnull
  3020. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  3021. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  3022. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  3023. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  3024. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  3025. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  3026. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  3027. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  3028. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  3029. at java.security.AccessController.doPrivileged(Native Method)
  3030. at javax.security.auth.Subject.doAs(Subject.java:422)
  3031. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  3032. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  3033.  
  3034. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  3035. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  3036. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  3037. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  3038. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  3039. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  3040. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  3041. at java.lang.reflect.Method.invoke(Method.java:498)
  3042. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  3043. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  3044. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  3045. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  3046. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  3047. [2016-07-28 11:58:50,842] ERROR Error closing writer for sting_actions_click-37. Error: {] (io.confluent.connect.hdfs.DataWriter:298)
  3048. [2016-07-28 11:58:50,915] WARN DataStreamer Exception (org.apache.hadoop.hdfs.DFSClient:558)
  3049. org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216894_24604604 does not exist or is not under Constructionnull
  3050. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  3051. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  3052. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  3053. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  3054. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  3055. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  3056. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  3057. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  3058. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  3059. at java.security.AccessController.doPrivileged(Native Method)
  3060. at javax.security.auth.Subject.doAs(Subject.java:422)
  3061. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  3062. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  3063.  
  3064. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  3065. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  3066. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  3067. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  3068. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  3069. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  3070. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  3071. at java.lang.reflect.Method.invoke(Method.java:498)
  3072. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  3073. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  3074. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  3075. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  3076. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
  3077. [2016-07-28 11:58:50,916] ERROR Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/46/log. (io.confluent.connect.hdfs.TopicPartitionWriter:328)
  3078. org.apache.kafka.connect.errors.ConnectException: Error closing hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_click/46/log
  3079. at io.confluent.connect.hdfs.wal.FSWAL.close(FSWAL.java:156)
  3080. at io.confluent.connect.hdfs.TopicPartitionWriter.close(TopicPartitionWriter.java:326)
  3081. at io.confluent.connect.hdfs.DataWriter.close(DataWriter.java:296)
  3082. at io.confluent.connect.hdfs.HdfsSinkTask.close(HdfsSinkTask.java:109)
  3083. at org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask.java:290)
  3084. at org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTask.java:421)
  3085. at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1100(WorkerSinkTask.java:54)
  3086. at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsRevoked(WorkerSinkTask.java:465)
  3087. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
  3088. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
  3089. at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:345)
  3090. at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:977)
  3091. at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:937)
  3092. at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:305)
  3093. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222)
  3094. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
  3095. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
  3096. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
  3097. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
  3098. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  3099. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  3100. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  3101. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  3102. at java.lang.Thread.run(Thread.java:745)
  3103. Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): BP-141202528-10.3.138.26-1448020478061:blk_1098216894_24604604 does not exist or is not under Constructionnull
  3104. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:6344)
  3105. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.updateBlockForPipeline(FSNamesystem.java:6411)
  3106. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:870)
  3107. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:955)
  3108. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
  3109. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
  3110. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
  3111. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
  3112. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
  3113. at java.security.AccessController.doPrivileged(Native Method)
  3114. at javax.security.auth.Subject.doAs(Subject.java:422)
  3115. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  3116. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
  3117.  
  3118. at org.apache.hadoop.ipc.Client.call(Client.java:1476)
  3119. at org.apache.hadoop.ipc.Client.call(Client.java:1407)
  3120. at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
  3121. at com.sun.proxy.$Proxy48.updateBlockForPipeline(Unknown Source)
  3122. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolTranslatorPB.java:902)
  3123. at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
  3124. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  3125. at java.lang.reflect.Method.invoke(Method.java:498)
  3126. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  3127. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  3128. at com.sun.proxy.$Proxy49.updateBlockForPipeline(Unknown Source)
  3129. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1144)
  3130. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!