Guest User

Untitled

a guest
Jan 14th, 2018
109
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.16 KB | None | 0 0
  1. ~$ confluent load s3-sink { "name": "s3-sink", "config": {
  2. "connector.class": "io.confluent.connect.s3.S3SinkConnector",
  3. "tasks.max": "1",
  4. "topics": "s3_hose",
  5. "s3.region": "us-east-1",
  6. "s3.bucket.name": "some-bucket-name",
  7. "s3.part.size": "5242880",
  8. "flush.size": "1",
  9. "storage.class": "io.confluent.connect.s3.storage.S3Storage",
  10. "format.class": "io.confluent.connect.s3.format.json.JsonFormat",
  11. "schema.generator.class": "io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator",
  12. "partitioner.class": "io.confluent.connect.storage.partitioner.DefaultPartitioner",
  13. "schema.compatibility": "NONE",
  14. "name": "s3-sink" }, "tasks": [
  15. {
  16. "connector": "s3-sink",
  17. "task": 0
  18. } ], "type": null }
  19.  
  20. [2018-01-14 14:41:30,832] ERROR WorkerSinkTask{id=s3-sink-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runti me.WorkerTask:172) org.apache.kafka.connect.errors.DataException: s3_hose
  21. at io.confluent.connect.avro.AvroConverter.toConnectData(AvroConverter.java:96)
  22. at org.apache.kafka.connect.runtime.WorkerSinkTask.convertMessages(WorkerSinkTask.java:454)
  23. at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:287)
  24. at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:198)
  25. at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:166)
  26. at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:170)
  27. at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:214)
  28. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  29. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  30. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  31. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  32. at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id -1 Caused by: org.apache.kafka.common.errors.SerializationException: Unknown magic byte!
Add Comment
Please, Sign In to add comment