API tools faq
paste
Advertisement
weifengcui

nm-log

weifengcui
May 20th, 2016
212
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 144.35 KB | None | 0 0
raw download clone embed print report
  1. 2016-05-20 18:27:18,502 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1463692924309_0002
  2. 2016-05-20 18:27:18,502 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc IP=10.228.168.113 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000001
  3. 2016-05-20 18:27:18,502 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1463692924309_0002 transitioned from NEW to INITING
  4. 2016-05-20 18:27:18,502 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1463692924309_0002_01_000001 to application application_1463692924309_0002
  5. 2016-05-20 18:27:18,504 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished.
  6. 2016-05-20 18:27:18,514 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1463692924309_0002 transitioned from INITING to RUNNING
  7. 2016-05-20 18:27:18,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000001 transitioned from NEW to LOCALIZING
  8. 2016-05-20 18:27:18,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1463692924309_0002
  9. 2016-05-20 18:27:18,515 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_1463692924309_0002_01_000001
  10. 2016-05-20 18:27:18,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://a9sl-sldsp-testcluster-master-6001.iad6.amazon.com:9000/user/weifengc/.sparkStaging/application_1463692924309_0002/__spark_conf__9074368820769265737.zip transitioned from INIT to DOWNLOADING
  11. 2016-05-20 18:27:18,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://a9sl-sldsp-testcluster-master-6001.iad6.amazon.com:9000/user/weifengc/.sparkStaging/application_1463692924309_0002/spark-assembly-1.6.1-hadoop2.6.0.jar transitioned from INIT to DOWNLOADING
  12. 2016-05-20 18:27:18,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1463692924309_0002_01_000001
  13. 2016-05-20 18:27:18,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /local_1/data/hadoop/nm-local-dir/nmPrivate/container_1463692924309_0002_01_000001.tokens. Credentials list:
  14. 2016-05-20 18:27:18,522 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user weifengc
  15. 2016-05-20 18:27:18,522 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /local_1/data/hadoop/nm-local-dir/nmPrivate/container_1463692924309_0002_01_000001.tokens to /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000001.tokens
  16. 2016-05-20 18:27:18,523 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002 = file:/local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002
  17. 2016-05-20 18:27:18,560 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://a9sl-sldsp-testcluster-master-6001.iad6.amazon.com:9000/user/weifengc/.sparkStaging/application_1463692924309_0002/__spark_conf__9074368820769265737.zip(->/local_1/data/hadoop/nm-local-dir/usercache/weifengc/filecache/12/__spark_conf__9074368820769265737.zip) transitioned from DOWNLOADING to LOCALIZED
  18. 2016-05-20 18:27:18,966 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://a9sl-sldsp-testcluster-master-6001.iad6.amazon.com:9000/user/weifengc/.sparkStaging/application_1463692924309_0002/spark-assembly-1.6.1-hadoop2.6.0.jar(->/local_1/data/hadoop/nm-local-dir/usercache/weifengc/filecache/13/spark-assembly-1.6.1-hadoop2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
  19. 2016-05-20 18:27:18,966 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
  20. 2016-05-20 18:27:18,978 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000001 transitioned from LOCALIZED to RUNNING
  21. 2016-05-20 18:27:18,980 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000001/default_container_executor.sh]
  22. 2016-05-20 18:27:19,524 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1463692924309_0002_01_000001
  23. 2016-05-20 18:27:19,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 92.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  24. 2016-05-20 18:27:22,535 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.2 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  25. 2016-05-20 18:27:25,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  26. 2016-05-20 18:27:28,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  27. 2016-05-20 18:27:31,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  28. 2016-05-20 18:27:34,557 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  29. 2016-05-20 18:27:37,563 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  30. 2016-05-20 18:27:40,568 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  31. 2016-05-20 18:27:43,574 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  32. 2016-05-20 18:27:46,579 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  33. 2016-05-20 18:27:49,585 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  34. 2016-05-20 18:27:52,591 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  35. 2016-05-20 18:27:55,596 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  36. 2016-05-20 18:27:58,602 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  37. 2016-05-20 18:28:01,607 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  38. 2016-05-20 18:28:04,613 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  39. 2016-05-20 18:28:07,619 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  40. 2016-05-20 18:28:10,624 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  41. 2016-05-20 18:28:13,629 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  42. 2016-05-20 18:28:16,635 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  43. 2016-05-20 18:28:19,640 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  44. 2016-05-20 18:28:22,650 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  45. 2016-05-20 18:28:25,655 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  46. 2016-05-20 18:28:28,661 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  47. 2016-05-20 18:28:31,666 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  48. 2016-05-20 18:28:34,671 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  49. 2016-05-20 18:28:37,677 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  50. 2016-05-20 18:28:40,682 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  51. 2016-05-20 18:28:43,688 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  52. 2016-05-20 18:28:46,693 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  53. 2016-05-20 18:28:49,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  54. 2016-05-20 18:28:52,703 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  55. 2016-05-20 18:28:55,709 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  56. 2016-05-20 18:28:58,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  57. 2016-05-20 18:29:01,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  58. 2016-05-20 18:29:04,724 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  59. 2016-05-20 18:29:07,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.7 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  60. 2016-05-20 18:29:10,734 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  61. 2016-05-20 18:29:13,739 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  62. 2016-05-20 18:29:16,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  63. 2016-05-20 18:29:19,749 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  64. 2016-05-20 18:29:22,754 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  65. 2016-05-20 18:29:25,759 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  66. 2016-05-20 18:29:28,763 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  67. 2016-05-20 18:29:31,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 252.8 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  68. 2016-05-20 18:29:34,773 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  69. 2016-05-20 18:29:37,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  70. 2016-05-20 18:29:40,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  71. 2016-05-20 18:29:43,787 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  72. 2016-05-20 18:29:46,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  73. 2016-05-20 18:29:49,797 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  74. 2016-05-20 18:29:52,802 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  75. 2016-05-20 18:29:55,807 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  76. 2016-05-20 18:29:58,811 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  77. 2016-05-20 18:30:01,817 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  78. 2016-05-20 18:30:04,823 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  79. 2016-05-20 18:30:07,828 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  80. 2016-05-20 18:30:10,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  81. 2016-05-20 18:30:13,839 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  82. 2016-05-20 18:30:16,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  83. 2016-05-20 18:30:19,850 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  84. 2016-05-20 18:30:22,856 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  85. 2016-05-20 18:30:25,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  86. 2016-05-20 18:30:28,873 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  87. 2016-05-20 18:30:31,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  88. 2016-05-20 18:30:34,884 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  89. 2016-05-20 18:30:37,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  90. 2016-05-20 18:30:40,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  91. 2016-05-20 18:30:43,900 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  92. 2016-05-20 18:30:46,906 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 253.6 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  93. 2016-05-20 18:30:48,711 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1463692924309_0002_000001 (auth:SIMPLE)
  94. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1463692924309_0002_01_000002 by user weifengc
  95. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc IP=10.228.168.236 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000002
  96. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1463692924309_0002_01_000002 to application application_1463692924309_0002
  97. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000002 transitioned from NEW to LOCALIZING
  98. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1463692924309_0002
  99. 2016-05-20 18:30:48,714 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_1463692924309_0002_01_000002
  100. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1463692924309_0002
  101. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service spark_shuffle
  102. 2016-05-20 18:30:48,714 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1463692924309_0002
  103. 2016-05-20 18:30:48,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
  104. 2016-05-20 18:30:48,726 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000002 transitioned from LOCALIZED to RUNNING
  105. 2016-05-20 18:30:48,729 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000002/default_container_executor.sh]
  106. 2016-05-20 18:30:49,906 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1463692924309_0002_01_000002
  107. 2016-05-20 18:30:49,911 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.2 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  108. 2016-05-20 18:30:49,917 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17216 for container-id container_1463692924309_0002_01_000002: 146.2 MB of 2 GB physical memory used; 2.6 GB of 8 GB virtual memory used
  109. 2016-05-20 18:30:50,007 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1463692924309_0002_000001 (auth:SIMPLE)
  110. 2016-05-20 18:30:50,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1463692924309_0002_01_000003 by user weifengc
  111. 2016-05-20 18:30:50,012 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc IP=10.228.168.236 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000003
  112. 2016-05-20 18:30:50,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1463692924309_0002_01_000003 to application application_1463692924309_0002
  113. 2016-05-20 18:30:50,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000003 transitioned from NEW to LOCALIZING
  114. 2016-05-20 18:30:50,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1463692924309_0002
  115. 2016-05-20 18:30:50,012 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_1463692924309_0002_01_000003
  116. 2016-05-20 18:30:50,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1463692924309_0002
  117. 2016-05-20 18:30:50,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service spark_shuffle
  118. 2016-05-20 18:30:50,012 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1463692924309_0002
  119. 2016-05-20 18:30:50,013 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
  120. 2016-05-20 18:30:50,033 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000003 transitioned from LOCALIZED to RUNNING
  121. 2016-05-20 18:30:50,034 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000003/default_container_executor.sh]
  122. 2016-05-20 18:30:51,026 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  123. java.lang.NullPointerException
  124. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  125. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  126. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  127. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  128. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  129. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  130. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  131. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  132. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  133. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  134. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  135. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  136. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  137. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  138. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  139. at java.lang.Thread.run(Thread.java:745)
  140. 2016-05-20 18:30:51,027 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0x550d4c4e, /10.228.168.236:38060 => /10.228.168.236:7337]
  141. java.lang.NullPointerException
  142. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  143. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  144. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  145. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  146. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  147. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  148. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  149. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  150. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  151. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  152. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  153. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  154. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  155. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  156. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  157. at java.lang.Thread.run(Thread.java:745)
  158. 2016-05-20 18:30:52,356 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  159. java.lang.NullPointerException
  160. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  161. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  162. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  163. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  164. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  165. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  166. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  167. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  168. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  169. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  170. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  171. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  172. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  173. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  174. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  175. at java.lang.Thread.run(Thread.java:745)
  176. 2016-05-20 18:30:52,356 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0x48805178, /10.228.168.236:38064 => /10.228.168.236:7337]
  177. java.lang.NullPointerException
  178. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  179. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  180. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  181. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  182. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  183. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  184. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  185. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  186. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  187. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  188. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  189. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  190. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  191. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  192. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  193. at java.lang.Thread.run(Thread.java:745)
  194. 2016-05-20 18:30:52,917 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1463692924309_0002_01_000003
  195. 2016-05-20 18:30:52,923 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17261 for container-id container_1463692924309_0002_01_000003: 310.4 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  196. 2016-05-20 18:30:52,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.2 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  197. 2016-05-20 18:30:52,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17216 for container-id container_1463692924309_0002_01_000002: 322.5 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  198. 2016-05-20 18:30:55,940 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17261 for container-id container_1463692924309_0002_01_000003: 327.3 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  199. 2016-05-20 18:30:55,945 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  200. 2016-05-20 18:30:55,951 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17216 for container-id container_1463692924309_0002_01_000002: 320.2 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  201. 2016-05-20 18:30:56,057 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  202. java.lang.NullPointerException
  203. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  204. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  205. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  206. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  207. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  208. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  209. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  210. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  211. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  212. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  213. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  214. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  215. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  216. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  217. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  218. at java.lang.Thread.run(Thread.java:745)
  219. 2016-05-20 18:30:56,057 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0xe229880f, /10.228.168.236:38066 => /10.228.168.236:7337]
  220. java.lang.NullPointerException
  221. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  222. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  223. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  224. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  225. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  226. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  227. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  228. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  229. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  230. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  231. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  232. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  233. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  234. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  235. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  236. at java.lang.Thread.run(Thread.java:745)
  237. 2016-05-20 18:30:57,375 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  238. java.lang.NullPointerException
  239. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  240. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  241. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  242. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  243. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  244. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  245. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  246. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  247. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  248. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  249. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  250. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  251. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  252. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  253. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  254. at java.lang.Thread.run(Thread.java:745)
  255. 2016-05-20 18:30:57,375 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0xa7bbc237, /10.228.168.236:38067 => /10.228.168.236:7337]
  256. java.lang.NullPointerException
  257. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  258. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  259. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  260. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  261. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  262. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  263. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  264. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  265. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  266. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  267. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  268. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  269. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  270. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  271. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  272. at java.lang.Thread.run(Thread.java:745)
  273. 2016-05-20 18:30:58,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17261 for container-id container_1463692924309_0002_01_000003: 327.5 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  274. 2016-05-20 18:30:58,962 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  275. 2016-05-20 18:30:58,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17216 for container-id container_1463692924309_0002_01_000002: 320.4 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  276. 2016-05-20 18:31:01,061 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  277. java.lang.NullPointerException
  278. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  279. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  280. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  281. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  282. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  283. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  284. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  285. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  286. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  287. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  288. at io.netty.channel.AbstractChannel$AbstractUnsafe.register(AbstractChannel.java:418)
  289. at io.netty.channel.SingleThreadEventLoop.register(SingleThreadEventLoop.java:60)
  290. at io.netty.channel.SingleThreadEventLoop.register(SingleThreadEventLoop.java:48)
  291. at io.netty.channel.MultithreadEventLoopGroup.register(MultithreadEventLoopGroup.java:64)
  292. at io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.channelRead(ServerBootstrap.java:251)
  293. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
  294. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
  295. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:846)
  296. at io.netty.channel.nio.AbstractNioMessageChannel$NioMessageUnsafe.read(AbstractNioMessageChannel.java:93)
  297. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
  298. at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
  299. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
  300. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
  301. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  302. at java.lang.Thread.run(Thread.java:745)
  303. 2016-05-20 18:31:01,062 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0xe6e3c5cb, /10.228.168.236:38069 => /10.228.168.236:7337]
  304. java.lang.NullPointerException
  305. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  306. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  307. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  308. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  309. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  310. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  311. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  312. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  313. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  314. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  315. at io.netty.channel.AbstractChannel$AbstractUnsafe.register(AbstractChannel.java:418)
  316. at io.netty.channel.SingleThreadEventLoop.register(SingleThreadEventLoop.java:60)
  317. at io.netty.channel.SingleThreadEventLoop.register(SingleThreadEventLoop.java:48)
  318. at io.netty.channel.MultithreadEventLoopGroup.register(MultithreadEventLoopGroup.java:64)
  319. at io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.channelRead(ServerBootstrap.java:251)
  320. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
  321. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
  322. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:846)
  323. at io.netty.channel.nio.AbstractNioMessageChannel$NioMessageUnsafe.read(AbstractNioMessageChannel.java:93)
  324. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
  325. at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
  326. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
  327. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
  328. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  329. at java.lang.Thread.run(Thread.java:745)
  330. 2016-05-20 18:31:01,403 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1463692924309_0002_01_000002 is : 1
  331. 2016-05-20 18:31:01,403 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1463692924309_0002_01_000002 and exit code: 1
  332. ExitCodeException exitCode=1:
  333. at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  334. at org.apache.hadoop.util.Shell.run(Shell.java:455)
  335. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  336. at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  337. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  338. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  339. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  340. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  341. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  342. at java.lang.Thread.run(Thread.java:745)
  343. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.
  344. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1463692924309_0002_01_000002
  345. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 1
  346. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Stack trace: ExitCodeException exitCode=1:
  347. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  348. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.run(Shell.java:455)
  349. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  350. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  351. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  352. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  353. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  354. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  355. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  356. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.lang.Thread.run(Thread.java:745)
  357. 2016-05-20 18:31:01,403 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container exited with a non-zero exit code 1
  358. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000002 transitioned from RUNNING to EXITED_WITH_FAILURE
  359. 2016-05-20 18:31:01,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1463692924309_0002_01_000002
  360. 2016-05-20 18:31:01,415 WARN org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc OPERATION=Container Finished - Failed TARGET=ContainerImpl RESULT=FAILURE DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000002
  361. 2016-05-20 18:31:01,415 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000002
  362. 2016-05-20 18:31:01,415 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000002 transitioned from EXITED_WITH_FAILURE to DONE
  363. 2016-05-20 18:31:01,415 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1463692924309_0002_01_000002 from application application_1463692924309_0002
  364. 2016-05-20 18:31:01,415 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1463692924309_0002_01_000002 for log-aggregation
  365. 2016-05-20 18:31:01,415 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1463692924309_0002
  366. 2016-05-20 18:31:01,415 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_1463692924309_0002_01_000002
  367. 2016-05-20 18:31:01,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1463692924309_0002_01_000002
  368. 2016-05-20 18:31:01,973 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17261 for container-id container_1463692924309_0002_01_000003: 327.5 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  369. 2016-05-20 18:31:01,978 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.1 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  370. 2016-05-20 18:31:02,379 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  371. java.lang.NullPointerException
  372. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  373. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  374. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  375. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  376. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  377. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  378. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  379. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  380. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  381. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  382. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  383. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  384. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  385. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  386. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  387. at java.lang.Thread.run(Thread.java:745)
  388. 2016-05-20 18:31:02,380 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0xf2e3fea2, /10.228.168.236:38071 => /10.228.168.236:7337]
  389. java.lang.NullPointerException
  390. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  391. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  392. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  393. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  394. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  395. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  396. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  397. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  398. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  399. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  400. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  401. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  402. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  403. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  404. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  405. at java.lang.Thread.run(Thread.java:745)
  406. 2016-05-20 18:31:02,719 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1463692924309_0002_01_000003 is : 1
  407. 2016-05-20 18:31:02,719 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1463692924309_0002_01_000003 and exit code: 1
  408. ExitCodeException exitCode=1:
  409. at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  410. at org.apache.hadoop.util.Shell.run(Shell.java:455)
  411. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  412. at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  413. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  414. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  415. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  416. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  417. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  418. at java.lang.Thread.run(Thread.java:745)
  419. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.
  420. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1463692924309_0002_01_000003
  421. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 1
  422. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Stack trace: ExitCodeException exitCode=1:
  423. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  424. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.run(Shell.java:455)
  425. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  426. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  427. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  428. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  429. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  430. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  431. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  432. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.lang.Thread.run(Thread.java:745)
  433. 2016-05-20 18:31:02,719 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container exited with a non-zero exit code 1
  434. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000003 transitioned from RUNNING to EXITED_WITH_FAILURE
  435. 2016-05-20 18:31:02,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1463692924309_0002_01_000003
  436. 2016-05-20 18:31:02,732 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000003
  437. 2016-05-20 18:31:02,732 WARN org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc OPERATION=Container Finished - Failed TARGET=ContainerImpl RESULT=FAILURE DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000003
  438. 2016-05-20 18:31:02,732 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000003 transitioned from EXITED_WITH_FAILURE to DONE
  439. 2016-05-20 18:31:02,732 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1463692924309_0002_01_000003 from application application_1463692924309_0002
  440. 2016-05-20 18:31:02,732 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1463692924309_0002_01_000003 for log-aggregation
  441. 2016-05-20 18:31:02,732 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1463692924309_0002
  442. 2016-05-20 18:31:02,732 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_1463692924309_0002_01_000003
  443. 2016-05-20 18:31:03,579 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1463692924309_0002_01_000002]
  444. 2016-05-20 18:31:04,138 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1463692924309_0002_000001 (auth:SIMPLE)
  445. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1463692924309_0002_01_000004 by user weifengc
  446. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc IP=10.228.168.236 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000004
  447. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1463692924309_0002_01_000004 to application application_1463692924309_0002
  448. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000004 transitioned from NEW to LOCALIZING
  449. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1463692924309_0002
  450. 2016-05-20 18:31:04,142 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_1463692924309_0002_01_000004
  451. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1463692924309_0002
  452. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service spark_shuffle
  453. 2016-05-20 18:31:04,142 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1463692924309_0002
  454. 2016-05-20 18:31:04,142 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000004 transitioned from LOCALIZING to LOCALIZED
  455. 2016-05-20 18:31:04,153 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000004 transitioned from LOCALIZED to RUNNING
  456. 2016-05-20 18:31:04,155 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000004/default_container_executor.sh]
  457. 2016-05-20 18:31:04,978 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1463692924309_0002_01_000004
  458. 2016-05-20 18:31:04,978 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1463692924309_0002_01_000003
  459. 2016-05-20 18:31:04,984 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17550 for container-id container_1463692924309_0002_01_000004: 128.0 MB of 2 GB physical memory used; 2.6 GB of 8 GB virtual memory used
  460. 2016-05-20 18:31:04,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.2 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  461. 2016-05-20 18:31:06,147 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  462. java.lang.NullPointerException
  463. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  464. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  465. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  466. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  467. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  468. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  469. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  470. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  471. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  472. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  473. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  474. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  475. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  476. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  477. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  478. at java.lang.Thread.run(Thread.java:745)
  479. 2016-05-20 18:31:06,147 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0x8a133b56, /10.228.168.236:38076 => /10.228.168.236:7337]
  480. java.lang.NullPointerException
  481. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  482. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  483. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  484. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  485. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  486. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  487. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  488. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  489. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  490. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  491. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  492. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  493. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  494. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  495. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  496. at java.lang.Thread.run(Thread.java:745)
  497. 2016-05-20 18:31:07,580 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1463692924309_0002_01_000003]
  498. 2016-05-20 18:31:07,745 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1463692924309_0002_000001 (auth:SIMPLE)
  499. 2016-05-20 18:31:07,753 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1463692924309_0002_01_000005 by user weifengc
  500. 2016-05-20 18:31:07,753 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc IP=10.228.168.236 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000005
  501. 2016-05-20 18:31:07,753 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1463692924309_0002_01_000005 to application application_1463692924309_0002
  502. 2016-05-20 18:31:07,754 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000005 transitioned from NEW to LOCALIZING
  503. 2016-05-20 18:31:07,754 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1463692924309_0002
  504. 2016-05-20 18:31:07,754 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_1463692924309_0002_01_000005
  505. 2016-05-20 18:31:07,754 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1463692924309_0002
  506. 2016-05-20 18:31:07,754 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service spark_shuffle
  507. 2016-05-20 18:31:07,754 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1463692924309_0002
  508. 2016-05-20 18:31:07,754 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000005 transitioned from LOCALIZING to LOCALIZED
  509. 2016-05-20 18:31:07,765 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000005 transitioned from LOCALIZED to RUNNING
  510. 2016-05-20 18:31:07,766 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000005/default_container_executor.sh]
  511. 2016-05-20 18:31:07,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1463692924309_0002_01_000005
  512. 2016-05-20 18:31:07,995 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17621 for container-id container_1463692924309_0002_01_000005: 58.7 MB of 2 GB physical memory used; 2.6 GB of 8 GB virtual memory used
  513. 2016-05-20 18:31:08,000 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17550 for container-id container_1463692924309_0002_01_000004: 337.9 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  514. 2016-05-20 18:31:08,006 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.2 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  515. 2016-05-20 18:31:09,791 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  516. java.lang.NullPointerException
  517. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  518. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  519. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  520. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  521. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  522. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  523. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  524. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  525. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  526. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  527. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  528. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  529. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  530. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  531. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  532. at java.lang.Thread.run(Thread.java:745)
  533. 2016-05-20 18:31:09,792 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0xebc3ec99, /10.228.168.236:38081 => /10.228.168.236:7337]
  534. java.lang.NullPointerException
  535. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  536. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  537. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  538. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  539. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  540. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  541. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  542. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  543. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  544. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  545. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  546. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  547. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  548. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  549. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  550. at java.lang.Thread.run(Thread.java:745)
  551. 2016-05-20 18:31:11,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17621 for container-id container_1463692924309_0002_01_000005: 351.9 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  552. 2016-05-20 18:31:11,017 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17550 for container-id container_1463692924309_0002_01_000004: 326.6 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  553. 2016-05-20 18:31:11,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.2 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  554. 2016-05-20 18:31:11,166 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  555. java.lang.NullPointerException
  556. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  557. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  558. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  559. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  560. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  561. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  562. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  563. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  564. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  565. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  566. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  567. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  568. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  569. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  570. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  571. at java.lang.Thread.run(Thread.java:745)
  572. 2016-05-20 18:31:11,166 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0x77027260, /10.228.168.236:38083 => /10.228.168.236:7337]
  573. java.lang.NullPointerException
  574. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  575. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  576. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  577. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  578. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  579. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  580. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  581. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  582. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  583. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  584. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  585. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  586. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  587. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  588. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  589. at java.lang.Thread.run(Thread.java:745)
  590. 2016-05-20 18:31:14,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17621 for container-id container_1463692924309_0002_01_000005: 329.1 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  591. 2016-05-20 18:31:14,038 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17550 for container-id container_1463692924309_0002_01_000004: 326.6 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  592. 2016-05-20 18:31:14,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.2 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  593. 2016-05-20 18:31:14,811 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  594. java.lang.NullPointerException
  595. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  596. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  597. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  598. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  599. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  600. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  601. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  602. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  603. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  604. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  605. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  606. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  607. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  608. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  609. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  610. at java.lang.Thread.run(Thread.java:745)
  611. 2016-05-20 18:31:14,811 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0xc3f26769, /10.228.168.236:38084 => /10.228.168.236:7337]
  612. java.lang.NullPointerException
  613. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  614. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  615. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  616. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  617. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  618. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  619. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  620. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  621. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  622. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  623. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  624. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  625. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  626. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  627. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  628. at java.lang.Thread.run(Thread.java:745)
  629. 2016-05-20 18:31:16,170 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  630. java.lang.NullPointerException
  631. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  632. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  633. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  634. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  635. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  636. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  637. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  638. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  639. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  640. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  641. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  642. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  643. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  644. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  645. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  646. at java.lang.Thread.run(Thread.java:745)
  647. 2016-05-20 18:31:16,170 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0x0531e2e9, /10.228.168.236:38086 => /10.228.168.236:7337]
  648. java.lang.NullPointerException
  649. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  650. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  651. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  652. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  653. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  654. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  655. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  656. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  657. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  658. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  659. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  660. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  661. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  662. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  663. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  664. at java.lang.Thread.run(Thread.java:745)
  665. 2016-05-20 18:31:16,511 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1463692924309_0002_01_000004 is : 1
  666. 2016-05-20 18:31:16,511 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1463692924309_0002_01_000004 and exit code: 1
  667. ExitCodeException exitCode=1:
  668. at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  669. at org.apache.hadoop.util.Shell.run(Shell.java:455)
  670. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  671. at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  672. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  673. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  674. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  675. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  676. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  677. at java.lang.Thread.run(Thread.java:745)
  678. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.
  679. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1463692924309_0002_01_000004
  680. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 1
  681. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Stack trace: ExitCodeException exitCode=1:
  682. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  683. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.run(Shell.java:455)
  684. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  685. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  686. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  687. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  688. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  689. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  690. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  691. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.lang.Thread.run(Thread.java:745)
  692. 2016-05-20 18:31:16,511 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container exited with a non-zero exit code 1
  693. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000004 transitioned from RUNNING to EXITED_WITH_FAILURE
  694. 2016-05-20 18:31:16,511 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1463692924309_0002_01_000004
  695. 2016-05-20 18:31:16,523 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000004
  696. 2016-05-20 18:31:16,523 WARN org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc OPERATION=Container Finished - Failed TARGET=ContainerImpl RESULT=FAILURE DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000004
  697. 2016-05-20 18:31:16,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000004 transitioned from EXITED_WITH_FAILURE to DONE
  698. 2016-05-20 18:31:16,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1463692924309_0002_01_000004 from application application_1463692924309_0002
  699. 2016-05-20 18:31:16,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1463692924309_0002_01_000004 for log-aggregation
  700. 2016-05-20 18:31:16,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1463692924309_0002
  701. 2016-05-20 18:31:16,523 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_1463692924309_0002_01_000004
  702. 2016-05-20 18:31:17,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1463692924309_0002_01_000004
  703. 2016-05-20 18:31:17,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17621 for container-id container_1463692924309_0002_01_000005: 329.1 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  704. 2016-05-20 18:31:17,054 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  705. 2016-05-20 18:31:19,815 ERROR org.apache.spark.network.TransportContext: Error while initializing Netty pipeline
  706. java.lang.NullPointerException
  707. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  708. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  709. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  710. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  711. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  712. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  713. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  714. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  715. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  716. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  717. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  718. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  719. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  720. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  721. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  722. at java.lang.Thread.run(Thread.java:745)
  723. 2016-05-20 18:31:19,815 WARN io.netty.channel.ChannelInitializer: Failed to initialize a channel. Closing: [id: 0x812c2161, /10.228.168.236:38087 => /10.228.168.236:7337]
  724. java.lang.NullPointerException
  725. at org.apache.spark.network.server.TransportRequestHandler.<init>(TransportRequestHandler.java:77)
  726. at org.apache.spark.network.TransportContext.createChannelHandler(TransportContext.java:159)
  727. at org.apache.spark.network.TransportContext.initializePipeline(TransportContext.java:135)
  728. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:123)
  729. at org.apache.spark.network.server.TransportServer$1.initChannel(TransportServer.java:116)
  730. at io.netty.channel.ChannelInitializer.channelRegistered(ChannelInitializer.java:69)
  731. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRegistered(AbstractChannelHandlerContext.java:133)
  732. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRegistered(AbstractChannelHandlerContext.java:119)
  733. at io.netty.channel.DefaultChannelPipeline.fireChannelRegistered(DefaultChannelPipeline.java:733)
  734. at io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:450)
  735. at io.netty.channel.AbstractChannel$AbstractUnsafe.access$100(AbstractChannel.java:378)
  736. at io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:424)
  737. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  738. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  739. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  740. at java.lang.Thread.run(Thread.java:745)
  741. 2016-05-20 18:31:20,060 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17621 for container-id container_1463692924309_0002_01_000005: 329.3 MB of 2 GB physical memory used; 2.7 GB of 8 GB virtual memory used
  742. 2016-05-20 18:31:20,065 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 16099 for container-id container_1463692924309_0002_01_000001: 259.4 MB of 1 GB physical memory used; 2.2 GB of 4 GB virtual memory used
  743. 2016-05-20 18:31:20,155 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1463692924309_0002_01_000005 is : 1
  744. 2016-05-20 18:31:20,155 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1463692924309_0002_01_000005 and exit code: 1
  745. ExitCodeException exitCode=1:
  746. at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  747. at org.apache.hadoop.util.Shell.run(Shell.java:455)
  748. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  749. at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  750. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  751. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  752. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  753. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  754. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  755. at java.lang.Thread.run(Thread.java:745)
  756. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.
  757. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1463692924309_0002_01_000005
  758. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 1
  759. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Stack trace: ExitCodeException exitCode=1:
  760. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  761. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.run(Shell.java:455)
  762. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  763. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  764. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  765. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  766. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  767. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  768. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  769. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.lang.Thread.run(Thread.java:745)
  770. 2016-05-20 18:31:20,155 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container exited with a non-zero exit code 1
  771. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000005 transitioned from RUNNING to EXITED_WITH_FAILURE
  772. 2016-05-20 18:31:20,155 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1463692924309_0002_01_000005
  773. 2016-05-20 18:31:20,167 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000005
  774. 2016-05-20 18:31:20,167 WARN org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc OPERATION=Container Finished - Failed TARGET=ContainerImpl RESULT=FAILURE DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000005
  775. 2016-05-20 18:31:20,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000005 transitioned from EXITED_WITH_FAILURE to DONE
  776. 2016-05-20 18:31:20,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1463692924309_0002_01_000005 from application application_1463692924309_0002
  777. 2016-05-20 18:31:20,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1463692924309_0002_01_000005 for log-aggregation
  778. 2016-05-20 18:31:20,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1463692924309_0002
  779. 2016-05-20 18:31:20,167 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_1463692924309_0002_01_000005
  780. 2016-05-20 18:31:20,489 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1463692924309_0002_01_000001 is : 11
  781. 2016-05-20 18:31:20,489 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1463692924309_0002_01_000001 and exit code: 11
  782. ExitCodeException exitCode=11:
  783. at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  784. at org.apache.hadoop.util.Shell.run(Shell.java:455)
  785. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  786. at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  787. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  788. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  789. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  790. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  791. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  792. at java.lang.Thread.run(Thread.java:745)
  793. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.
  794. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1463692924309_0002_01_000001
  795. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 11
  796. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Stack trace: ExitCodeException exitCode=11:
  797. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
  798. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell.run(Shell.java:455)
  799. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
  800. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
  801. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  802. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  803. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  804. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  805. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  806. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: at java.lang.Thread.run(Thread.java:745)
  807. 2016-05-20 18:31:20,490 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container exited with a non-zero exit code 11
  808. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000001 transitioned from RUNNING to EXITED_WITH_FAILURE
  809. 2016-05-20 18:31:20,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1463692924309_0002_01_000001
  810. 2016-05-20 18:31:20,501 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_01_000001
  811. 2016-05-20 18:31:20,501 WARN org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc OPERATION=Container Finished - Failed TARGET=ContainerImpl RESULT=FAILURE DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000001
  812. 2016-05-20 18:31:20,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_01_000001 transitioned from EXITED_WITH_FAILURE to DONE
  813. 2016-05-20 18:31:20,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1463692924309_0002_01_000001 from application application_1463692924309_0002
  814. 2016-05-20 18:31:20,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1463692924309_0002_01_000001 for log-aggregation
  815. 2016-05-20 18:31:20,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1463692924309_0002
  816. 2016-05-20 18:31:20,501 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_1463692924309_0002_01_000001
  817. 2016-05-20 18:31:20,588 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1463692924309_0002_000001 (auth:SIMPLE)
  818. 2016-05-20 18:31:20,591 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1463692924309_0002_01_000001
  819. 2016-05-20 18:31:20,591 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc IP=10.228.168.113 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_01_000001
  820. 2016-05-20 18:31:20,591 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1463692924309_0002_01_000004, container_1463692924309_0002_01_000001]
  821. 2016-05-20 18:31:20,596 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1463692924309_0002_000002 (auth:SIMPLE)
  822. 2016-05-20 18:31:20,598 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1463692924309_0002_02_000001 by user weifengc
  823. 2016-05-20 18:31:20,598 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=weifengc IP=10.228.168.113 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1463692924309_0002 CONTAINERID=container_1463692924309_0002_02_000001
  824. 2016-05-20 18:31:20,598 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1463692924309_0002_02_000001 to application application_1463692924309_0002
  825. 2016-05-20 18:31:20,599 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_02_000001 transitioned from NEW to LOCALIZING
  826. 2016-05-20 18:31:20,599 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1463692924309_0002
  827. 2016-05-20 18:31:20,599 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_1463692924309_0002_02_000001
  828. 2016-05-20 18:31:20,599 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_02_000001 transitioned from LOCALIZING to LOCALIZED
  829. 2016-05-20 18:31:20,610 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1463692924309_0002_02_000001 transitioned from LOCALIZED to RUNNING
  830. 2016-05-20 18:31:20,611 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /local_1/data/hadoop/nm-local-dir/usercache/weifengc/appcache/application_1463692924309_0002/container_1463692924309_0002_02_000001/default_container_executor.sh]
  831. 2016-05-20 18:31:22,592 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1463692924309_0002_01_000005]
  832. 2016-05-20 18:31:23,065 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1463692924309_0002_02_000001
  833. 2016-05-20 18:31:23,065 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1463692924309_0002_01_000005
  834. 2016-05-20 18:31:23,065 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1463692924309_0002_01_000001
  835. 2016-05-20 18:31:23,071 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  836. 2016-05-20 18:31:26,076 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  837. 2016-05-20 18:31:29,081 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  838. 2016-05-20 18:31:32,087 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  839. 2016-05-20 18:31:35,092 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  840. 2016-05-20 18:31:38,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  841. 2016-05-20 18:31:41,103 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  842. 2016-05-20 18:31:44,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  843. 2016-05-20 18:31:47,113 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  844. 2016-05-20 18:31:50,119 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  845. 2016-05-20 18:31:53,124 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  846. 2016-05-20 18:31:56,130 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  847. 2016-05-20 18:31:59,135 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  848. 2016-05-20 18:32:02,141 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  849. 2016-05-20 18:32:05,146 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  850. 2016-05-20 18:32:08,151 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  851. 2016-05-20 18:32:11,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  852. 2016-05-20 18:32:14,162 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  853. 2016-05-20 18:32:17,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  854. 2016-05-20 18:32:20,173 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  855. 2016-05-20 18:32:23,178 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  856. 2016-05-20 18:32:26,183 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  857. 2016-05-20 18:32:29,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  858. 2016-05-20 18:32:32,194 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  859. 2016-05-20 18:32:35,199 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  860. 2016-05-20 18:32:38,205 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  861. 2016-05-20 18:32:41,210 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  862. 2016-05-20 18:32:44,215 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  863. 2016-05-20 18:32:47,226 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  864. 2016-05-20 18:32:50,231 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  865. 2016-05-20 18:32:53,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  866. 2016-05-20 18:32:56,241 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.6 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  867. 2016-05-20 18:32:59,247 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  868. 2016-05-20 18:33:02,252 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  869. 2016-05-20 18:33:05,257 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  870. 2016-05-20 18:33:08,262 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  871. 2016-05-20 18:33:11,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  872. 2016-05-20 18:33:14,273 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  873. 2016-05-20 18:33:17,278 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  874. 2016-05-20 18:33:20,283 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  875. 2016-05-20 18:33:23,289 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  876. 2016-05-20 18:33:26,294 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.7 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  877. 2016-05-20 18:33:29,299 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  878. 2016-05-20 18:33:32,304 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  879. 2016-05-20 18:33:35,310 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  880. 2016-05-20 18:33:38,315 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  881. 2016-05-20 18:33:41,321 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  882. 2016-05-20 18:33:44,326 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  883. 2016-05-20 18:33:47,331 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  884. 2016-05-20 18:33:50,336 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  885. 2016-05-20 18:33:53,342 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  886. 2016-05-20 18:33:56,347 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  887. 2016-05-20 18:33:59,352 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  888. 2016-05-20 18:34:02,358 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  889. 2016-05-20 18:34:05,363 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  890. 2016-05-20 18:34:08,368 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  891. 2016-05-20 18:34:11,373 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  892. 2016-05-20 18:34:14,378 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  893. 2016-05-20 18:34:17,383 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  894. 2016-05-20 18:34:20,388 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.8 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  895. 2016-05-20 18:34:23,393 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  896. 2016-05-20 18:34:26,398 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  897. 2016-05-20 18:34:29,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  898. 2016-05-20 18:34:32,407 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  899. 2016-05-20 18:34:35,412 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  900. 2016-05-20 18:34:38,417 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  901. 2016-05-20 18:34:41,422 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  902. 2016-05-20 18:34:44,427 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  903. 2016-05-20 18:34:47,438 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  904. 2016-05-20 18:34:50,442 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  905. 2016-05-20 18:34:53,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  906. 2016-05-20 18:34:56,452 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 220.9 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  907. 2016-05-20 18:34:59,458 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.2 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  908. 2016-05-20 18:35:02,463 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.1 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  909. 2016-05-20 18:35:05,469 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.1 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  910. 2016-05-20 18:35:08,474 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.1 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  911. 2016-05-20 18:35:11,480 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.1 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  912. 2016-05-20 18:35:14,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.2 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  913. 2016-05-20 18:35:17,491 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  914. 2016-05-20 18:35:20,496 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  915. 2016-05-20 18:35:23,502 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  916. 2016-05-20 18:35:26,508 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  917. 2016-05-20 18:35:29,513 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  918. 2016-05-20 18:35:32,518 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  919. 2016-05-20 18:35:35,524 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.3 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  920. 2016-05-20 18:35:38,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  921. 2016-05-20 18:35:41,535 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  922. 2016-05-20 18:35:44,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  923. 2016-05-20 18:35:47,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  924. 2016-05-20 18:35:50,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  925. 2016-05-20 18:35:53,557 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  926. 2016-05-20 18:35:56,562 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  927. 2016-05-20 18:35:59,568 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  928. 2016-05-20 18:36:02,573 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  929. 2016-05-20 18:36:05,579 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  930. 2016-05-20 18:36:08,584 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  931. 2016-05-20 18:36:11,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  932. 2016-05-20 18:36:14,595 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  933. 2016-05-20 18:36:17,600 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  934. 2016-05-20 18:36:20,605 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  935. 2016-05-20 18:36:23,611 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  936. 2016-05-20 18:36:26,616 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  937. 2016-05-20 18:36:29,621 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  938. 2016-05-20 18:36:32,627 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  939. 2016-05-20 18:36:35,632 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  940. 2016-05-20 18:36:38,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.4 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
  941. 2016-05-20 18:36:41,643 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 17721 for container-id container_1463692924309_0002_02_000001: 221.5 MB of 1 GB physical memory used; 2.1 GB of 4 GB virtual memory used
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!