Advertisement
Guest User

Untitled

a guest
Sep 5th, 2015
136
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.24 KB | None | 0 0
  1. 15/09/05 16:12:58 INFO DAGScheduler: Job 10 failed: runJob at RDDFunctions.scala:36, took 0.013266 s
  2. Traceback (most recent call last):
  3. File "<stdin>", line 1, in <module>
  4. File "build/bdist.linux-x86_64/egg/pyspark_cassandra/rdd.py", line 244, in saveToCassandra
  5. File "/usr/local/src/spark/spark-1.4.1/python/lib/py4j-0.8.2.1-src.zip/py4j/java_gateway.py", line 538, in __call__
  6. File "/usr/local/src/spark/spark-1.4.1/python/lib/py4j-0.8.2.1-src.zip/py4j/protocol.py", line 300, in get_return_value
  7. py4j.protocol.Py4JJavaError: An error occurred while calling o316.saveToCassandra.
  8. : org.apache.spark.SparkException: Job aborted due to stage failure: Task serialization failed: java.io.IOException: Failed to create local dir in /tm
  9. p/spark-ecc6f278-ff4f-4ff0-87f3-47c9b7aeb78a/blockmgr-cd6091c4-76e1-422e-a99c-36f18f07db55/23.
  10. org.apache.spark.storage.DiskBlockManager.getFile(DiskBlockManager.scala:73)
  11. org.apache.spark.storage.DiskStore.contains(DiskStore.scala:168)
  12. org.apache.spark.storage.BlockManager.org$apache$spark$storage$BlockManager$$getCurrentBlockStatus(BlockManager.scala:400)
  13. org.apache.spark.storage.BlockManager.doPut(BlockManager.scala:809)
  14. org.apache.spark.storage.BlockManager.putIterator(BlockManager.scala:637)
  15. org.apache.spark.storage.BlockManager.putSingle(BlockManager.scala:995)
  16. org.apache.spark.broadcast.TorrentBroadcast.writeBlocks(TorrentBroadcast.scala:99)
  17. org.apache.spark.broadcast.TorrentBroadcast.<init>(TorrentBroadcast.scala:85)
  18. org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(TorrentBroadcastFactory.scala:34)
  19. org.apache.spark.broadcast.BroadcastManager.newBroadcast(BroadcastManager.scala:62)
  20. org.apache.spark.SparkContext.broadcast(SparkContext.scala:1291)
  21. org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$submitMissingTasks(DAGScheduler.scala:874)
  22. org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$submitStage(DAGScheduler.scala:815)
  23. org.apache.spark.scheduler.DAGScheduler.handleJobSubmitted(DAGScheduler.scala:799)
  24. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1426)
  25. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1418)
  26. org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement