daily pastebin goal
39%
SHARE
TWEET

Untitled

a guest Oct 13th, 2017 55 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. 17/10/13 05:22:45 INFO RMProxy: Connecting to ResourceManager at ip-10-5-0-147.ec2.internal/10.5.0.147:8032
  2.             17/10/13 05:22:46 INFO Client: Requesting a new application from cluster with 1 NodeManagers
  3.             17/10/13 05:22:46 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (2048 MB per container)
  4.             17/10/13 05:22:46 INFO Client: Will allocate AM container, with 1408 MB memory including 384 MB overhead
  5.             17/10/13 05:22:46 INFO Client: Setting up container launch context for our AM
  6.             17/10/13 05:22:46 INFO Client: Setting up the launch environment for our AM container
  7.             17/10/13 05:22:46 INFO Client: Preparing resources for our AM container
  8.             17/10/13 05:22:53 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
  9.             17/10/13 05:23:02 INFO Client: Uploading resource file:/mnt/tmp/spark-fdeecf22-10a0-4d51-9e2f-ff63f3787b82/__spark_libs__6942539995783678180.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/__spark_libs__6942539995783678180.zip
  10.             17/10/13 05:23:10 INFO Client: Uploading resource file:/etc/spark/conf/hive-site.xml -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/hive-site.xml
  11.             17/10/13 05:23:17 INFO Client: Uploading resource s3://mach-big-data-infra/ingest.py -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/ingest.py
  12.             17/10/13 05:23:17 INFO S3NativeFileSystem: Opening 's3://mach-big-data-infra/ingest.py' for reading
  13.             17/10/13 05:23:17 INFO Client: Uploading resource file:/usr/lib/spark/python/lib/pyspark.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/pyspark.zip
  14.             17/10/13 05:23:17 INFO Client: Uploading resource file:/usr/lib/spark/python/lib/py4j-0.10.4-src.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/py4j-0.10.4-src.zip
  15.             17/10/13 05:23:17 INFO Client: Uploading resource file:/mnt/tmp/spark-fdeecf22-10a0-4d51-9e2f-ff63f3787b82/__spark_conf__7536775293554442846.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/__spark_conf__.zip
  16.             17/10/13 05:23:18 INFO SecurityManager: Changing view acls to: hadoop
  17.             17/10/13 05:23:18 INFO SecurityManager: Changing modify acls to: hadoop
  18.             17/10/13 05:23:18 INFO SecurityManager: Changing view acls groups to:
  19.             17/10/13 05:23:18 INFO SecurityManager: Changing modify acls groups to:
  20.             17/10/13 05:23:18 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(hadoop); groups with view permissions: Set(); users  with modify permissions: Set(hadoop); groups with modify permissions: Set()
  21.             17/10/13 05:23:18 INFO Client: Submitting application application_1507870642238_0001 to ResourceManager
  22.             17/10/13 05:23:18 INFO YarnClientImpl: Submitted application application_1507870642238_0001
  23.             17/10/13 05:23:20 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  24.             17/10/13 05:23:20 INFO Client:
  25.                  client token: N/A
  26.                  diagnostics: N/A
  27.                  ApplicationMaster host: N/A
  28.                  ApplicationMaster RPC port: -1
  29.                  queue: default
  30.                  start time: 1507872198394
  31.                  final status: UNDEFINED
  32.                  tracking URL: http://ip-10-5-0-147.ec2.internal:20888/proxy/application_1507870642238_0001/
  33.                  user: hadoop
  34.             17/10/13 05:23:21 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  35.             17/10/13 05:23:22 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  36.             17/10/13 05:23:23 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  37.             17/10/13 05:23:24 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  38.             17/10/13 05:23:25 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  39.             17/10/13 05:23:26 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  40.             17/10/13 05:23:27 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  41.             17/10/13 05:23:28 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  42.             17/10/13 05:23:29 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  43.             17/10/13 05:23:30 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  44.             17/10/13 05:23:31 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  45.             17/10/13 05:23:32 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  46.             17/10/13 05:23:33 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  47.             17/10/13 05:23:34 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  48.             17/10/13 05:23:35 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  49.             17/10/13 05:23:36 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  50.             17/10/13 05:23:37 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  51.             17/10/13 05:23:38 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  52.             17/10/13 05:23:39 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  53.             17/10/13 05:23:40 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  54.             17/10/13 05:23:41 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  55.             17/10/13 05:23:42 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  56.             17/10/13 05:23:43 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  57.             17/10/13 05:23:44 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  58.             17/10/13 05:23:45 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  59.             17/10/13 05:23:45 INFO Client:
  60.                  client token: N/A
  61.                  diagnostics: N/A
  62.                  ApplicationMaster host: 10.5.0.9
  63.                  ApplicationMaster RPC port: 0
  64.                  queue: default
  65.                  start time: 1507872198394
  66.                  final status: UNDEFINED
  67.                  tracking URL: http://ip-10-5-0-147.ec2.internal:20888/proxy/application_1507870642238_0001/
  68.                  user: hadoop
  69.             17/10/13 05:23:46 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  70.             17/10/13 05:23:47 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  71.             17/10/13 05:23:48 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  72.             17/10/13 05:23:49 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  73.             17/10/13 05:23:50 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
RAW Paste Data
Top