daily pastebin goal
55%
SHARE
TWEET

Untitled

a guest Jan 14th, 2018 49 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. ~$ confluent load s3-sink  {   "name": "s3-sink",   "config": {
  2.     "connector.class": "io.confluent.connect.s3.S3SinkConnector",
  3.     "tasks.max": "1",
  4.     "topics": "s3_hose",
  5.     "s3.region": "us-east-1",
  6.     "s3.bucket.name": "some-bucket-name",
  7.     "s3.part.size": "5242880",
  8.     "flush.size": "1",
  9.     "storage.class": "io.confluent.connect.s3.storage.S3Storage",
  10.     "format.class": "io.confluent.connect.s3.format.json.JsonFormat",
  11.     "schema.generator.class": "io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator",
  12.     "partitioner.class": "io.confluent.connect.storage.partitioner.DefaultPartitioner",
  13.     "schema.compatibility": "NONE",
  14.     "name": "s3-sink"   },   "tasks": [
  15.     {
  16.       "connector": "s3-sink",
  17.       "task": 0
  18.     }   ],   "type": null }
  19.    
  20. [2018-01-14 14:41:30,832] ERROR WorkerSinkTask{id=s3-sink-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runti me.WorkerTask:172) org.apache.kafka.connect.errors.DataException: s3_hose
  21.         at io.confluent.connect.avro.AvroConverter.toConnectData(AvroConverter.java:96)
  22.         at org.apache.kafka.connect.runtime.WorkerSinkTask.convertMessages(WorkerSinkTask.java:454)
  23.         at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:287)
  24.         at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:198)
  25.         at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:166)
  26.         at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:170)
  27.         at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:214)
  28.         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  29.         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  30.         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  31.         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  32.         at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id -1 Caused by: org.apache.kafka.common.errors.SerializationException: Unknown magic byte!
RAW Paste Data
Top