API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Oct 13th, 2017
88
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 7.60 KB | None | 0 0
raw download clone embed print report
  1. 17/10/13 05:22:45 INFO RMProxy: Connecting to ResourceManager at ip-10-5-0-147.ec2.internal/10.5.0.147:8032
  2. 17/10/13 05:22:46 INFO Client: Requesting a new application from cluster with 1 NodeManagers
  3. 17/10/13 05:22:46 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (2048 MB per container)
  4. 17/10/13 05:22:46 INFO Client: Will allocate AM container, with 1408 MB memory including 384 MB overhead
  5. 17/10/13 05:22:46 INFO Client: Setting up container launch context for our AM
  6. 17/10/13 05:22:46 INFO Client: Setting up the launch environment for our AM container
  7. 17/10/13 05:22:46 INFO Client: Preparing resources for our AM container
  8. 17/10/13 05:22:53 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
  9. 17/10/13 05:23:02 INFO Client: Uploading resource file:/mnt/tmp/spark-fdeecf22-10a0-4d51-9e2f-ff63f3787b82/__spark_libs__6942539995783678180.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/__spark_libs__6942539995783678180.zip
  10. 17/10/13 05:23:10 INFO Client: Uploading resource file:/etc/spark/conf/hive-site.xml -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/hive-site.xml
  11. 17/10/13 05:23:17 INFO Client: Uploading resource s3://mach-big-data-infra/ingest.py -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/ingest.py
  12. 17/10/13 05:23:17 INFO S3NativeFileSystem: Opening 's3://mach-big-data-infra/ingest.py' for reading
  13. 17/10/13 05:23:17 INFO Client: Uploading resource file:/usr/lib/spark/python/lib/pyspark.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/pyspark.zip
  14. 17/10/13 05:23:17 INFO Client: Uploading resource file:/usr/lib/spark/python/lib/py4j-0.10.4-src.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/py4j-0.10.4-src.zip
  15. 17/10/13 05:23:17 INFO Client: Uploading resource file:/mnt/tmp/spark-fdeecf22-10a0-4d51-9e2f-ff63f3787b82/__spark_conf__7536775293554442846.zip -> hdfs://ip-10-5-0-147.ec2.internal:8020/user/hadoop/.sparkStaging/application_1507870642238_0001/__spark_conf__.zip
  16. 17/10/13 05:23:18 INFO SecurityManager: Changing view acls to: hadoop
  17. 17/10/13 05:23:18 INFO SecurityManager: Changing modify acls to: hadoop
  18. 17/10/13 05:23:18 INFO SecurityManager: Changing view acls groups to:
  19. 17/10/13 05:23:18 INFO SecurityManager: Changing modify acls groups to:
  20. 17/10/13 05:23:18 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); groups with view permissions: Set(); users with modify permissions: Set(hadoop); groups with modify permissions: Set()
  21. 17/10/13 05:23:18 INFO Client: Submitting application application_1507870642238_0001 to ResourceManager
  22. 17/10/13 05:23:18 INFO YarnClientImpl: Submitted application application_1507870642238_0001
  23. 17/10/13 05:23:20 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  24. 17/10/13 05:23:20 INFO Client:
  25. client token: N/A
  26. diagnostics: N/A
  27. ApplicationMaster host: N/A
  28. ApplicationMaster RPC port: -1
  29. queue: default
  30. start time: 1507872198394
  31. final status: UNDEFINED
  32. tracking URL: http://ip-10-5-0-147.ec2.internal:20888/proxy/application_1507870642238_0001/
  33. user: hadoop
  34. 17/10/13 05:23:21 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  35. 17/10/13 05:23:22 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  36. 17/10/13 05:23:23 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  37. 17/10/13 05:23:24 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  38. 17/10/13 05:23:25 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  39. 17/10/13 05:23:26 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  40. 17/10/13 05:23:27 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  41. 17/10/13 05:23:28 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  42. 17/10/13 05:23:29 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  43. 17/10/13 05:23:30 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  44. 17/10/13 05:23:31 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  45. 17/10/13 05:23:32 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  46. 17/10/13 05:23:33 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  47. 17/10/13 05:23:34 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  48. 17/10/13 05:23:35 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  49. 17/10/13 05:23:36 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  50. 17/10/13 05:23:37 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  51. 17/10/13 05:23:38 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  52. 17/10/13 05:23:39 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  53. 17/10/13 05:23:40 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  54. 17/10/13 05:23:41 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  55. 17/10/13 05:23:42 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  56. 17/10/13 05:23:43 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  57. 17/10/13 05:23:44 INFO Client: Application report for application_1507870642238_0001 (state: ACCEPTED)
  58. 17/10/13 05:23:45 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  59. 17/10/13 05:23:45 INFO Client:
  60. client token: N/A
  61. diagnostics: N/A
  62. ApplicationMaster host: 10.5.0.9
  63. ApplicationMaster RPC port: 0
  64. queue: default
  65. start time: 1507872198394
  66. final status: UNDEFINED
  67. tracking URL: http://ip-10-5-0-147.ec2.internal:20888/proxy/application_1507870642238_0001/
  68. user: hadoop
  69. 17/10/13 05:23:46 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  70. 17/10/13 05:23:47 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  71. 17/10/13 05:23:48 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  72. 17/10/13 05:23:49 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
  73. 17/10/13 05:23:50 INFO Client: Application report for application_1507870642238_0001 (state: RUNNING)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!