daily pastebin goal
32%
SHARE
TWEET

Untitled

a guest Jan 14th, 2018 58 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. ~$ confluent load s3-sink  {   "name": "s3-sink",   "config": {
  2.     "connector.class": "io.confluent.connect.s3.S3SinkConnector",
  3.     "tasks.max": "1",
  4.     "topics": "s3_hose",
  5.     "s3.region": "us-east-1",
  6.     "s3.bucket.name": "some-bucket-name",
  7.     "s3.part.size": "5242880",
  8.     "flush.size": "1",
  9.     "storage.class": "io.confluent.connect.s3.storage.S3Storage",
  10.     "format.class": "io.confluent.connect.s3.format.json.JsonFormat",
  11.     "schema.generator.class": "io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator",
  12.     "partitioner.class": "io.confluent.connect.storage.partitioner.DefaultPartitioner",
  13.     "schema.compatibility": "NONE",
  14.     "name": "s3-sink"   },   "tasks": [
  15.     {
  16.       "connector": "s3-sink",
  17.       "task": 0
  18.     }   ],   "type": null }
  19.    
  20. [2018-01-14 14:41:30,832] ERROR WorkerSinkTask{id=s3-sink-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runti me.WorkerTask:172) org.apache.kafka.connect.errors.DataException: s3_hose
  21.         at io.confluent.connect.avro.AvroConverter.toConnectData(AvroConverter.java:96)
  22.         at org.apache.kafka.connect.runtime.WorkerSinkTask.convertMessages(WorkerSinkTask.java:454)
  23.         at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:287)
  24.         at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:198)
  25.         at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:166)
  26.         at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:170)
  27.         at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:214)
  28.         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  29.         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  30.         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  31.         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  32.         at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id -1 Caused by: org.apache.kafka.common.errors.SerializationException: Unknown magic byte!
RAW Paste Data
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy. OK, I Understand
 
Top