API tools faq
paste
Guest User

Untitled

a guest
Mar 9th, 2018
539
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 20.61 KB | None | 0 0
raw download clone embed print report
  1.     Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
  2.    Setting default log level to "WARN".
  3.    To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
  4.    18/03/09 14:41:28 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  5.    [Stage 0:>                                                          (0 + 4) / 4]18/03/09 14:41:31 ERROR Executor: Exception in task 3.0 in stage 0.0 (TID 3)
  6.    org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  7.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
  8.        process()
  9.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
  10.        serializer.dump_stream(func(split_index, iterator), outfile)
  11.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
  12.        vs = list(itertools.islice(iterator, batch))
  13.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 144, in load_stream
  14.        yield self._read_with_length(stream)
  15.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 169, in _read_with_length
  16.        return self.loads(obj)
  17.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 455, in loads
  18.        return pickle.loads(obj, encoding=encoding)
  19.    AttributeError: Can't get attribute 'Individual' on <module 'deap.creator' from '/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/creator.py'>
  20.  
  21.         at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
  22.         at org.apache.spark.api.python.PythonRunner$$anon$1.<init>(PythonRDD.scala:234)
  23.         at org.apache.spark.api.python.PythonRunner.compute(PythonRDD.scala:152)
  24.         at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
  25.         at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
  26.         at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
  27.         at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
  28.         at org.apache.spark.scheduler.Task.run(Task.scala:108)
  29.         at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
  30.         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  31.         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  32.         at java.lang.Thread.run(Thread.java:748)
  33.     18/03/09 14:41:31 ERROR Executor: Exception in task 2.0 in stage 0.0 (TID 2)
  34.     org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  35.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
  36.         process()
  37.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
  38.         serializer.dump_stream(func(split_index, iterator), outfile)
  39.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
  40.         vs = list(itertools.islice(iterator, batch))
  41.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 144, in load_stream
  42.         yield self._read_with_length(stream)
  43.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 169, in _read_with_length
  44.         return self.loads(obj)
  45.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 455, in loads
  46.         return pickle.loads(obj, encoding=encoding)
  47.     AttributeError: Can't get attribute 'Individual' on <module 'deap.creator' from '/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/creator.py'>
  48.  
  49.        at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
  50.        at org.apache.spark.api.python.PythonRunner$$anon$1.<init>(PythonRDD.scala:234)
  51.        at org.apache.spark.api.python.PythonRunner.compute(PythonRDD.scala:152)
  52.        at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
  53.        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
  54.        at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
  55.        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
  56.        at org.apache.spark.scheduler.Task.run(Task.scala:108)
  57.        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
  58.        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  59.        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  60.        at java.lang.Thread.run(Thread.java:748)
  61.    18/03/09 14:41:31 ERROR Executor: Exception in task 1.0 in stage 0.0 (TID 1)
  62.    org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  63.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
  64.        process()
  65.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
  66.        serializer.dump_stream(func(split_index, iterator), outfile)
  67.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
  68.        vs = list(itertools.islice(iterator, batch))
  69.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 144, in load_stream
  70.        yield self._read_with_length(stream)
  71.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 169, in _read_with_length
  72.        return self.loads(obj)
  73.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 455, in loads
  74.        return pickle.loads(obj, encoding=encoding)
  75.    AttributeError: Can't get attribute 'Individual' on <module 'deap.creator' from '/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/creator.py'>
  76.  
  77.         at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
  78.         at org.apache.spark.api.python.PythonRunner$$anon$1.<init>(PythonRDD.scala:234)
  79.         at org.apache.spark.api.python.PythonRunner.compute(PythonRDD.scala:152)
  80.         at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
  81.         at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
  82.         at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
  83.         at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
  84.         at org.apache.spark.scheduler.Task.run(Task.scala:108)
  85.         at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
  86.         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  87.         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  88.         at java.lang.Thread.run(Thread.java:748)
  89.     18/03/09 14:41:31 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
  90.     org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  91.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
  92.         process()
  93.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
  94.         serializer.dump_stream(func(split_index, iterator), outfile)
  95.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
  96.         vs = list(itertools.islice(iterator, batch))
  97.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 144, in load_stream
  98.         yield self._read_with_length(stream)
  99.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 169, in _read_with_length
  100.         return self.loads(obj)
  101.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 455, in loads
  102.         return pickle.loads(obj, encoding=encoding)
  103.     AttributeError: Can't get attribute 'Individual' on <module 'deap.creator' from '/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/creator.py'>
  104.  
  105.        at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
  106.        at org.apache.spark.api.python.PythonRunner$$anon$1.<init>(PythonRDD.scala:234)
  107.        at org.apache.spark.api.python.PythonRunner.compute(PythonRDD.scala:152)
  108.        at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
  109.        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
  110.        at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
  111.        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
  112.        at org.apache.spark.scheduler.Task.run(Task.scala:108)
  113.        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
  114.        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  115.        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  116.        at java.lang.Thread.run(Thread.java:748)
  117.    18/03/09 14:41:31 WARN TaskSetManager: Lost task 0.0 in stage 0.0 (TID 0, localhost, executor driver): org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  118.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
  119.        process()
  120.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
  121.        serializer.dump_stream(func(split_index, iterator), outfile)
  122.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
  123.        vs = list(itertools.islice(iterator, batch))
  124.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 144, in load_stream
  125.        yield self._read_with_length(stream)
  126.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 169, in _read_with_length
  127.        return self.loads(obj)
  128.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 455, in loads
  129.        return pickle.loads(obj, encoding=encoding)
  130.    AttributeError: Can't get attribute 'Individual' on <module 'deap.creator' from '/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/creator.py'>
  131.  
  132.         at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
  133.         at org.apache.spark.api.python.PythonRunner$$anon$1.<init>(PythonRDD.scala:234)
  134.         at org.apache.spark.api.python.PythonRunner.compute(PythonRDD.scala:152)
  135.         at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
  136.         at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
  137.         at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
  138.         at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
  139.         at org.apache.spark.scheduler.Task.run(Task.scala:108)
  140.         at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
  141.         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  142.         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  143.         at java.lang.Thread.run(Thread.java:748)
  144.  
  145.     18/03/09 14:41:31 ERROR TaskSetManager: Task 0 in stage 0.0 failed 1 times; aborting job
  146.     Traceback (most recent call last):
  147.       File "test-deap.py", line 45, in <module>
  148.         stats=stats, halloffame=hof, verbose=True)
  149.       File "/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/algorithms.py", line 150, in eaSimple
  150.         fitnesses = toolbox.map(toolbox.evaluate, invalid_ind)
  151.       File "test-deap.py", line 32, in sparkMap
  152.         return sc.parallelize(population).map(algorithm).collect()
  153.       File "/usr/local/lib/python3.6/site-packages/pyspark/rdd.py", line 809, in collect
  154.         port = self.ctx._jvm.PythonRDD.collectAndServe(self._jrdd.rdd())
  155.       File "/usr/local/lib/python3.6/site-packages/py4j/java_gateway.py", line 1133, in __call__
  156.         answer, self.gateway_client, self.target_id, self.name)
  157.       File "/usr/local/lib/python3.6/site-packages/py4j/protocol.py", line 319, in get_return_value
  158.         format(target_id, ".", name), value)
  159.     py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe.
  160.     : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost, executor driver): org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  161.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
  162.         process()
  163.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
  164.         serializer.dump_stream(func(split_index, iterator), outfile)
  165.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
  166.         vs = list(itertools.islice(iterator, batch))
  167.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 144, in load_stream
  168.         yield self._read_with_length(stream)
  169.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 169, in _read_with_length
  170.         return self.loads(obj)
  171.       File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 455, in loads
  172.         return pickle.loads(obj, encoding=encoding)
  173.     AttributeError: Can't get attribute 'Individual' on <module 'deap.creator' from '/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/creator.py'>
  174.  
  175.        at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
  176.        at org.apache.spark.api.python.PythonRunner$$anon$1.<init>(PythonRDD.scala:234)
  177.        at org.apache.spark.api.python.PythonRunner.compute(PythonRDD.scala:152)
  178.        at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
  179.        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
  180.        at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
  181.        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
  182.        at org.apache.spark.scheduler.Task.run(Task.scala:108)
  183.        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
  184.        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  185.        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  186.        at java.lang.Thread.run(Thread.java:748)
  187.  
  188.    Driver stacktrace:
  189.        at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1517)
  190.        at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1505)
  191.        at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1504)
  192.        at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
  193.        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
  194.        at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1504)
  195.        at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:814)
  196.        at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:814)
  197.        at scala.Option.foreach(Option.scala:257)
  198.        at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:814)
  199.        at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1732)
  200.        at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1687)
  201.        at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1676)
  202.        at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
  203.        at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:630)
  204.        at org.apache.spark.SparkContext.runJob(SparkContext.scala:2029)
  205.        at org.apache.spark.SparkContext.runJob(SparkContext.scala:2050)
  206.        at org.apache.spark.SparkContext.runJob(SparkContext.scala:2069)
  207.        at org.apache.spark.SparkContext.runJob(SparkContext.scala:2094)
  208.        at org.apache.spark.rdd.RDD$$anonfun$collect$1.apply(RDD.scala:936)
  209.        at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  210.        at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
  211.        at org.apache.spark.rdd.RDD.withScope(RDD.scala:362)
  212.        at org.apache.spark.rdd.RDD.collect(RDD.scala:935)
  213.        at org.apache.spark.api.python.PythonRDD$.collectAndServe(PythonRDD.scala:467)
  214.        at org.apache.spark.api.python.PythonRDD.collectAndServe(PythonRDD.scala)
  215.        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  216.        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  217.        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  218.        at java.lang.reflect.Method.invoke(Method.java:498)
  219.        at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
  220.        at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
  221.        at py4j.Gateway.invoke(Gateway.java:280)
  222.        at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
  223.        at py4j.commands.CallCommand.execute(CallCommand.java:79)
  224.        at py4j.GatewayConnection.run(GatewayConnection.java:214)
  225.        at java.lang.Thread.run(Thread.java:748)
  226.    Caused by: org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  227.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
  228.        process()
  229.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
  230.        serializer.dump_stream(func(split_index, iterator), outfile)
  231.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
  232.        vs = list(itertools.islice(iterator, batch))
  233.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 144, in load_stream
  234.        yield self._read_with_length(stream)
  235.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 169, in _read_with_length
  236.        return self.loads(obj)
  237.      File "/usr/local/lib/python3.6/site-packages/pyspark/python/lib/pyspark.zip/pyspark/serializers.py", line 455, in loads
  238.        return pickle.loads(obj, encoding=encoding)
  239.    AttributeError: Can't get attribute 'Individual' on <module 'deap.creator' from '/usr/local/lib/python3.6/site-packages/deap-1.2.2-py3.6-macosx-10.13-x86_64.egg/deap/creator.py'>
  240.  
  241.         at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
  242.         at org.apache.spark.api.python.PythonRunner$$anon$1.<init>(PythonRDD.scala:234)
  243.         at org.apache.spark.api.python.PythonRunner.compute(PythonRDD.scala:152)
  244.         at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
  245.         at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
  246.         at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
  247.         at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
  248.         at org.apache.spark.scheduler.Task.run(Task.scala:108)
  249.         at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
  250.         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  251.         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  252.         ... 1 more
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!