Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 15/09/05 16:12:58 INFO DAGScheduler: Job 10 failed: runJob at RDDFunctions.scala:36, took 0.013266 s
- Traceback (most recent call last):
- File "<stdin>", line 1, in <module>
- File "build/bdist.linux-x86_64/egg/pyspark_cassandra/rdd.py", line 244, in saveToCassandra
- File "/usr/local/src/spark/spark-1.4.1/python/lib/py4j-0.8.2.1-src.zip/py4j/java_gateway.py", line 538, in __call__
- File "/usr/local/src/spark/spark-1.4.1/python/lib/py4j-0.8.2.1-src.zip/py4j/protocol.py", line 300, in get_return_value
- py4j.protocol.Py4JJavaError: An error occurred while calling o316.saveToCassandra.
- : org.apache.spark.SparkException: Job aborted due to stage failure: Task serialization failed: java.io.IOException: Failed to create local dir in /tm
- p/spark-ecc6f278-ff4f-4ff0-87f3-47c9b7aeb78a/blockmgr-cd6091c4-76e1-422e-a99c-36f18f07db55/23.
- org.apache.spark.storage.DiskBlockManager.getFile(DiskBlockManager.scala:73)
- org.apache.spark.storage.DiskStore.contains(DiskStore.scala:168)
- org.apache.spark.storage.BlockManager.org$apache$spark$storage$BlockManager$$getCurrentBlockStatus(BlockManager.scala:400)
- org.apache.spark.storage.BlockManager.doPut(BlockManager.scala:809)
- org.apache.spark.storage.BlockManager.putIterator(BlockManager.scala:637)
- org.apache.spark.storage.BlockManager.putSingle(BlockManager.scala:995)
- org.apache.spark.broadcast.TorrentBroadcast.writeBlocks(TorrentBroadcast.scala:99)
- org.apache.spark.broadcast.TorrentBroadcast.<init>(TorrentBroadcast.scala:85)
- org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(TorrentBroadcastFactory.scala:34)
- org.apache.spark.broadcast.BroadcastManager.newBroadcast(BroadcastManager.scala:62)
- org.apache.spark.SparkContext.broadcast(SparkContext.scala:1291)
- org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$submitMissingTasks(DAGScheduler.scala:874)
- org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$submitStage(DAGScheduler.scala:815)
- org.apache.spark.scheduler.DAGScheduler.handleJobSubmitted(DAGScheduler.scala:799)
- org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1426)
- org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1418)
- org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement