16/05/04 09:32:14 INFO storage.BlockManagerInfo: Added broadcast_6_piece3 in memory on ip-10-0-2-246.ap-southeast-1.compute.internal:56347 (size: 4.0 MB, free: 2.8 GB)
16/05/04 09:32:14 INFO storage.BlockManagerInfo: Added broadcast_6_piece4 in memory on ip-10-0-2-246.ap-southeast-1.compute.internal:39398 (size: 490.2 KB, free: 2.8 GB)
16/05/04 09:32:14 INFO storage.BlockManagerInfo: Added broadcast_6_piece4 in memory on ip-10-0-2-246.ap-southeast-1.compute.internal:56347 (size: 490.2 KB, free: 2.8 GB)
16/05/04 09:32:14 INFO storage.BlockManagerInfo: Added broadcast_6_piece0 in memory on ip-10-0-2-246.ap-southeast-1.compute.internal:39398 (size: 4.0 MB, free: 2.8 GB)
16/05/04 09:32:14 INFO storage.BlockManagerInfo: Added broadcast_6_piece3 in memory on ip-10-0-2-246.ap-southeast-1.compute.internal:39398 (size: 4.0 MB, free: 2.8 GB)
16/05/04 09:32:14 INFO scheduler.TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, ip-10-0-2-206.ap-southeast-1.compute.internal, PROCESS_LOCAL, 1368 bytes)
16/05/04 09:32:14 WARN scheduler.TaskSetManager: Lost task 7.0 in stage 0.0 (TID 7, ip-10-0-2-206.ap-southeast-1.compute.internal): java.io.IOException: alluxio.exception.BlockInfoException:
Cannot complete a file without all the blocks committed
        at alluxio.client.file.FileOutStream.close(FileOutStream.java:173)
        at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
        at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106)
        at org.apache.hadoop.mapred.TextOutputFormat$LineRecordWriter.close(TextOutputFormat.java:108)
        at org.apache.spark.SparkHadoopWriter.close(SparkHadoopWriter.scala:102)
        at org.apache.spark.rdd.PairRDDFunctions$$anonfun$13.apply(PairRDDFunctions.scala:1072)
        at org.apache.spark.rdd.PairRDDFunctions$$anonfun$13.apply(PairRDDFunctions.scala:1051)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
        at org.apache.spark.scheduler.Task.run(Task.scala:56)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:200)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: alluxio.exception.BlockInfoException: Cannot complete a file without all the blocks committed
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at alluxio.exception.AlluxioException.from(AlluxioException.java:72)
        at alluxio.AbstractClient.retryRPC(AbstractClient.java:324)
        at alluxio.client.file.FileSystemMasterClient.completeFile(FileSystemMasterClient.java:130)
        at alluxio.client.file.FileOutStream.close(FileOutStream.java:171)