19/10/10 09:15:39 WARN DependencyUtils: Skip remote jar s3://et4310-lab2-ruben-us-east-1/lab1_2.11-1.0.jar.
19/10/10 09:15:40 INFO RMProxy: Connecting to ResourceManager at ip-172-31-18-212.ec2.internal/172.31.18.212:8032
19/10/10 09:15:40 INFO Client: Requesting a new application from cluster with 4 NodeManagers
19/10/10 09:15:40 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (53248 MB per container)
19/10/10 09:15:40 INFO Client: Will allocate AM container, with 1408 MB memory including 384 MB overhead
19/10/10 09:15:40 INFO Client: Setting up container launch context for our AM
19/10/10 09:15:40 INFO Client: Setting up the launch environment for our AM container
19/10/10 09:15:40 INFO Client: Preparing resources for our AM container
19/10/10 09:15:40 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
19/10/10 09:15:42 INFO Client: Uploading resource file:/mnt/tmp/spark-7d80d4d2-5091-4503-bf90-91d2c360f4e3/__spark_libs__1144593390807618974.zip -> hdfs://ip-172-31-18-212.ec2.internal:8020/user/hadoop/.sparkStaging/application_1570698154192_0002/__spark_libs__1144593390807618974.zip
19/10/10 09:15:44 INFO Client: Uploading resource s3://et4310-lab2-ruben-us-east-1/lab1_2.11-1.0.jar -> hdfs://ip-172-31-18-212.ec2.internal:8020/user/hadoop/.sparkStaging/application_1570698154192_0002/lab1_2.11-1.0.jar
19/10/10 09:15:45 INFO S3NativeFileSystem: Opening 's3://et4310-lab2-ruben-us-east-1/lab1_2.11-1.0.jar' for reading
19/10/10 09:15:45 INFO Client: Uploading resource file:/mnt/tmp/spark-7d80d4d2-5091-4503-bf90-91d2c360f4e3/__spark_conf__5373847283083138489.zip -> hdfs://ip-172-31-18-212.ec2.internal:8020/user/hadoop/.sparkStaging/application_1570698154192_0002/__spark_conf__.zip
19/10/10 09:15:45 INFO SecurityManager: Changing view acls to: hadoop
19/10/10 09:15:45 INFO SecurityManager: Changing modify acls to: hadoop
19/10/10 09:15:45 INFO SecurityManager: Changing view acls groups to:
19/10/10 09:15:45 INFO SecurityManager: Changing modify acls groups to:
19/10/10 09:15:45 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(hadoop); groups with view permissions: Set(); users  with modify permissions: Set(hadoop); groups with modify permissions: Set()
19/10/10 09:15:46 INFO Client: Submitting application application_1570698154192_0002 to ResourceManager
19/10/10 09:15:46 INFO YarnClientImpl: Submitted application application_1570698154192_0002
19/10/10 09:15:47 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:15:47 INFO Client:
	 client token: N/A
	 diagnostics: AM container is launched, waiting for AM container to Register with RM
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1570698946500
	 final status: UNDEFINED
	 tracking URL: http://ip-172-31-18-212.ec2.internal:20888/proxy/application_1570698154192_0002/
	 user: hadoop
19/10/10 09:15:48 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:15:49 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:15:50 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:15:51 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:15:52 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:15:52 INFO Client:
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: ip-172-31-17-220.ec2.internal
	 ApplicationMaster RPC port: 45841
	 queue: default
	 start time: 1570698946500
	 final status: UNDEFINED
	 tracking URL: http://ip-172-31-18-212.ec2.internal:20888/proxy/application_1570698154192_0002/
	 user: hadoop
19/10/10 09:15:53 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:15:54 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:15:55 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:15:56 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:15:57 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:15:58 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:15:59 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:00 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:01 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:02 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:03 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:04 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:05 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:06 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:07 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:08 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:09 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:10 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:11 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:12 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:13 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:14 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:15 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:16 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:17 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:18 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:19 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:20 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:21 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:22 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:23 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:24 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:25 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:26 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:27 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:28 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:29 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:30 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:31 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:32 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:33 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:34 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:35 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:36 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:37 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:38 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:39 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:40 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:41 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:42 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:43 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:44 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:16:44 INFO Client:
	 client token: N/A
	 diagnostics: AM container is launched, waiting for AM container to Register with RM
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1570698946500
	 final status: UNDEFINED
	 tracking URL: http://ip-172-31-18-212.ec2.internal:20888/proxy/application_1570698154192_0002/
	 user: hadoop
19/10/10 09:16:45 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:16:46 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:16:47 INFO Client: Application report for application_1570698154192_0002 (state: ACCEPTED)
19/10/10 09:16:48 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:48 INFO Client:
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: ip-172-31-25-170.ec2.internal
	 ApplicationMaster RPC port: 41631
	 queue: default
	 start time: 1570698946500
	 final status: UNDEFINED
	 tracking URL: http://ip-172-31-18-212.ec2.internal:20888/proxy/application_1570698154192_0002/
	 user: hadoop
19/10/10 09:16:49 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:50 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:51 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:52 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:53 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:54 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:55 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:56 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:57 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:58 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:16:59 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:00 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:01 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:02 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:03 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:04 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:05 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:06 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:07 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:08 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:09 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:10 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:11 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:12 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:13 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:14 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:15 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:16 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:17 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:18 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:19 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:20 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:21 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:22 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:23 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:24 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:25 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:26 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:27 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:28 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:29 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:30 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:31 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:32 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:33 INFO Client: Application report for application_1570698154192_0002 (state: RUNNING)
19/10/10 09:17:34 INFO Client: Application report for application_1570698154192_0002 (state: FAILED)
19/10/10 09:17:34 INFO Client:
	 client token: N/A
	 diagnostics: Application application_1570698154192_0002 failed 2 times due to AM Container for appattempt_1570698154192_0002_000002 exited with  exitCode: -104
Failing this attempt.Diagnostics: Container [pid=18260,containerID=container_1570698154192_0002_02_000001] is running beyond physical memory limits. Current usage: 1.4 GB of 1.4 GB physical memory used; 3.6 GB of 6.9 GB virtual memory used. Killing container.
Dump of the process-tree for container_1570698154192_0002_02_000001 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 18266 18260 18260 18260 (java) 10738 360 3763003392 360750 /usr/lib/jvm/java-openjdk/bin/java -server -Xmx1024m -Djava.io.tmpdir=/mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/tmp -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70 -XX:+CMSClassUnloadingEnabled -XX:OnOutOfMemoryError=kill -9 %p -Dspark.yarn.app.container.log.dir=/var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001 org.apache.spark.deploy.yarn.ApplicationMaster --class DatasetApplication --jar s3://et4310-lab2-ruben-us-east-1/lab1_2.11-1.0.jar --arg s3://gdelt-open-data/v2/gkg/201*.gkg.csv --arg s3://et4310-lab2-ruben-us-east-1 --properties-file /mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/__spark_conf__/__spark_conf__.properties
	|- 18260 18258 18260 18260 (bash) 0 0 115871744 708 /bin/bash -c LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:/usr/lib/hadoop-lzo/lib/native:::/usr/lib/hadoop-lzo/lib/native:/usr/lib/hadoop/lib/native::/usr/lib/hadoop-lzo/lib/native:/usr/lib/hadoop/lib/native:/usr/lib/hadoop-lzo/lib/native:/usr/lib/hadoop/lib/native" /usr/lib/jvm/java-openjdk/bin/java -server -Xmx1024m -Djava.io.tmpdir=/mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/tmp '-XX:+UseConcMarkSweepGC' '-XX:CMSInitiatingOccupancyFraction=70' '-XX:MaxHeapFreeRatio=70' '-XX:+CMSClassUnloadingEnabled' '-XX:OnOutOfMemoryError=kill -9 %p' -Dspark.yarn.app.container.log.dir=/var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001 org.apache.spark.deploy.yarn.ApplicationMaster --class 'DatasetApplication' --jar s3://et4310-lab2-ruben-us-east-1/lab1_2.11-1.0.jar --arg 's3://gdelt-open-data/v2/gkg/201*.gkg.csv' --arg 's3://et4310-lab2-ruben-us-east-1' --properties-file /mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/__spark_conf__/__spark_conf__.properties 1> /var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001/stdout 2> /var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001/stderr

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
For more detailed output, check the application tracking page: http://ip-172-31-18-212.ec2.internal:8088/cluster/app/application_1570698154192_0002 Then click on links to logs of each attempt.
. Failing the application.
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1570698946500
	 final status: FAILED
	 tracking URL: http://ip-172-31-18-212.ec2.internal:8088/cluster/app/application_1570698154192_0002
	 user: hadoop
19/10/10 09:17:34 INFO Client: Deleted staging directory hdfs://ip-172-31-18-212.ec2.internal:8020/user/hadoop/.sparkStaging/application_1570698154192_0002
19/10/10 09:17:34 ERROR Client: Application diagnostics message: Application application_1570698154192_0002 failed 2 times due to AM Container for appattempt_1570698154192_0002_000002 exited with  exitCode: -104
Failing this attempt.Diagnostics: Container [pid=18260,containerID=container_1570698154192_0002_02_000001] is running beyond physical memory limits. Current usage: 1.4 GB of 1.4 GB physical memory used; 3.6 GB of 6.9 GB virtual memory used. Killing container.
Dump of the process-tree for container_1570698154192_0002_02_000001 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 18266 18260 18260 18260 (java) 10738 360 3763003392 360750 /usr/lib/jvm/java-openjdk/bin/java -server -Xmx1024m -Djava.io.tmpdir=/mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/tmp -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70 -XX:+CMSClassUnloadingEnabled -XX:OnOutOfMemoryError=kill -9 %p -Dspark.yarn.app.container.log.dir=/var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001 org.apache.spark.deploy.yarn.ApplicationMaster --class DatasetApplication --jar s3://et4310-lab2-ruben-us-east-1/lab1_2.11-1.0.jar --arg s3://gdelt-open-data/v2/gkg/201*.gkg.csv --arg s3://et4310-lab2-ruben-us-east-1 --properties-file /mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/__spark_conf__/__spark_conf__.properties
	|- 18260 18258 18260 18260 (bash) 0 0 115871744 708 /bin/bash -c LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:/usr/lib/hadoop-lzo/lib/native:::/usr/lib/hadoop-lzo/lib/native:/usr/lib/hadoop/lib/native::/usr/lib/hadoop-lzo/lib/native:/usr/lib/hadoop/lib/native:/usr/lib/hadoop-lzo/lib/native:/usr/lib/hadoop/lib/native" /usr/lib/jvm/java-openjdk/bin/java -server -Xmx1024m -Djava.io.tmpdir=/mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/tmp '-XX:+UseConcMarkSweepGC' '-XX:CMSInitiatingOccupancyFraction=70' '-XX:MaxHeapFreeRatio=70' '-XX:+CMSClassUnloadingEnabled' '-XX:OnOutOfMemoryError=kill -9 %p' -Dspark.yarn.app.container.log.dir=/var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001 org.apache.spark.deploy.yarn.ApplicationMaster --class 'DatasetApplication' --jar s3://et4310-lab2-ruben-us-east-1/lab1_2.11-1.0.jar --arg 's3://gdelt-open-data/v2/gkg/201*.gkg.csv' --arg 's3://et4310-lab2-ruben-us-east-1' --properties-file /mnt3/yarn/usercache/hadoop/appcache/application_1570698154192_0002/container_1570698154192_0002_02_000001/__spark_conf__/__spark_conf__.properties 1> /var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001/stdout 2> /var/log/hadoop-yarn/containers/application_1570698154192_0002/container_1570698154192_0002_02_000001/stderr

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
For more detailed output, check the application tracking page: http://ip-172-31-18-212.ec2.internal:8088/cluster/app/application_1570698154192_0002 Then click on links to logs of each attempt.
. Failing the application.
Exception in thread "main" org.apache.spark.SparkException: Application application_1570698154192_0002 finished with failed status
	at org.apache.spark.deploy.yarn.Client.run(Client.scala:1149)
	at org.apache.spark.deploy.yarn.YarnClusterApplication.start(Client.scala:1526)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:853)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:928)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:937)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
19/10/10 09:17:34 INFO ShutdownHookManager: Shutdown hook called
19/10/10 09:17:34 INFO ShutdownHookManager: Deleting directory /mnt/tmp/spark-cac55d4e-a491-4b44-9ecb-69f3dea8107c
19/10/10 09:17:34 INFO ShutdownHookManager: Deleting directory /mnt/tmp/spark-7d80d4d2-5091-4503-bf90-91d2c360f4e3
Command exiting with ret '1'