API tools faq
paste
Advertisement
Guest User

Syslog

a guest
Apr 27th, 2015
325
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 35.23 KB | None | 0 0
raw download clone embed print report
  1. 2015-04-27 21:15:06,530 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1430152496212_0015_000001
  2. 2015-04-27 21:15:06,796 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
  3. 2015-04-27 21:15:06,796 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
  4. 2015-04-27 21:15:11,763 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
  5. 2015-04-27 21:15:11,763 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@72a7c7e0)
  6. 2015-04-27 21:15:11,779 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: The specific max attempts: 2 for application: 15. Attempt num: 1 is last retry: false
  7. 2015-04-27 21:15:11,795 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
  8. 2015-04-27 21:15:11,888 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
  9. 2015-04-27 21:15:11,888 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
  10. 2015-04-27 21:15:11,888 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.webhdfs.enabled; Ignoring.
  11. 2015-04-27 21:15:12,451 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
  12. 2015-04-27 21:15:12,545 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
  13. 2015-04-27 21:15:12,576 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
  14. 2015-04-27 21:15:12,576 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
  15. 2015-04-27 21:15:12,576 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
  16. 2015-04-27 21:15:12,576 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
  17. 2015-04-27 21:15:12,576 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
  18. 2015-04-27 21:15:12,592 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
  19. 2015-04-27 21:15:12,592 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
  20. 2015-04-27 21:15:12,592 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
  21. 2015-04-27 21:15:12,717 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
  22. 2015-04-27 21:15:13,045 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
  23. 2015-04-27 21:15:13,123 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
  24. 2015-04-27 21:15:13,123 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
  25. 2015-04-27 21:15:13,138 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1430152496212_0015 to jobTokenSecretManager
  26. 2015-04-27 21:15:13,279 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1430152496212_0015 because: not enabled;
  27. 2015-04-27 21:15:13,295 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1430152496212_0015 = 4544. Number of splits = 1
  28. 2015-04-27 21:15:13,295 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1430152496212_0015 = 1
  29. 2015-04-27 21:15:13,295 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1430152496212_0015Job Transitioned from NEW to INITED
  30. 2015-04-27 21:15:13,295 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1430152496212_0015.
  31. 2015-04-27 21:15:13,342 INFO [Socket Reader #1 for port 60341] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 60341
  32. 2015-04-27 21:15:13,373 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
  33. 2015-04-27 21:15:13,373 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  34. 2015-04-27 21:15:13,373 INFO [IPC Server listener on 60341] org.apache.hadoop.ipc.Server: IPC Server listener on 60341: starting
  35. 2015-04-27 21:15:13,373 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at Piotr-Komputer/192.168.56.1:60341
  36. 2015-04-27 21:15:13,451 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  37. 2015-04-27 21:15:13,451 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined
  38. 2015-04-27 21:15:13,467 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  39. 2015-04-27 21:15:13,482 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
  40. 2015-04-27 21:15:13,482 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
  41. 2015-04-27 21:15:13,482 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
  42. 2015-04-27 21:15:13,482 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
  43. 2015-04-27 21:15:13,498 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 60348
  44. 2015-04-27 21:15:13,498 INFO [main] org.mortbay.log: jetty-6.1.26
  45. 2015-04-27 21:15:13,529 INFO [main] org.mortbay.log: Extract jar:file:/C:/hadoop-2.3.0/share/hadoop/yarn/hadoop-yarn-common-2.3.0.jar!/webapps/mapreduce to C:\Users\Piotr\AppData\Local\Temp\Jetty_0_0_0_0_60348_mapreduce____lzhe58\webapp
  46. 2015-04-27 21:15:13,817 INFO [main] org.mortbay.log: Started [email protected]:60348
  47. 2015-04-27 21:15:13,817 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 60348
  48. 2015-04-27 21:15:14,300 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
  49. 2015-04-27 21:15:14,315 INFO [IPC Server listener on 60351] org.apache.hadoop.ipc.Server: IPC Server listener on 60351: starting
  50. 2015-04-27 21:15:14,315 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  51. 2015-04-27 21:15:14,315 INFO [Socket Reader #1 for port 60351] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 60351
  52. 2015-04-27 21:15:14,315 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE job_1430152496212_0015
  53. 2015-04-27 21:15:14,331 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
  54. 2015-04-27 21:15:14,331 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
  55. 2015-04-27 21:15:14,331 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
  56. 2015-04-27 21:15:14,378 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
  57. 2015-04-27 21:15:14,378 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
  58. 2015-04-27 21:15:14,378 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.webhdfs.enabled; Ignoring.
  59. 2015-04-27 21:15:14,378 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8030
  60. 2015-04-27 21:15:14,456 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: 8192
  61. 2015-04-27 21:15:14,456 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
  62. 2015-04-27 21:15:14,456 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500
  63. 2015-04-27 21:15:14,472 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1430152496212_0015Job Transitioned from INITED to SETUP
  64. 2015-04-27 21:15:14,472 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
  65. 2015-04-27 21:15:14,487 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1430152496212_0015Job Transitioned from SETUP to RUNNING
  66. 2015-04-27 21:15:14,550 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1430152496212_0015, File: hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/Piotr/.staging/job_1430152496212_0015/job_1430152496212_0015_1.jhist
  67. 2015-04-27 21:15:14,550 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Piotr-Komputer to /default-rack
  68. 2015-04-27 21:15:14,565 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1430152496212_0015_m_000000 Task Transitioned from NEW to SCHEDULED
  69. 2015-04-27 21:15:14,565 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1430152496212_0015_r_000000 Task Transitioned from NEW to SCHEDULED
  70. 2015-04-27 21:15:14,565 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
  71. 2015-04-27 21:15:14,565 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_r_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
  72. 2015-04-27 21:15:14,612 INFO [Thread-50] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceReqt:1024
  73. 2015-04-27 21:15:14,628 INFO [Thread-50] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: reduceResourceReqt:1024
  74. 2015-04-27 21:15:15,456 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
  75. 2015-04-27 21:15:15,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1430152496212_0015: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:6144, vCores:0> knownNMs=1
  76. 2015-04-27 21:15:15,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=6144
  77. 2015-04-27 21:15:15,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  78. 2015-04-27 21:15:16,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  79. 2015-04-27 21:15:16,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1430152496212_0015_01_000002 to attempt_1430152496212_0015_m_000000_0
  80. 2015-04-27 21:15:16,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=5120
  81. 2015-04-27 21:15:16,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  82. 2015-04-27 21:15:16,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  83. 2015-04-27 21:15:16,628 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Piotr-Komputer to /default-rack
  84. 2015-04-27 21:15:16,644 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/Piotr/.staging/job_1430152496212_0015/job.jar
  85. 2015-04-27 21:15:16,644 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /tmp/hadoop-yarn/staging/Piotr/.staging/job_1430152496212_0015/job.xml
  86. 2015-04-27 21:15:16,644 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #1 secret keys for NM use for launching container
  87. 2015-04-27 21:15:16,644 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1
  88. 2015-04-27 21:15:16,659 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
  89. 2015-04-27 21:15:16,690 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  90. 2015-04-27 21:15:16,706 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1430152496212_0015_01_000002 taskAttempt attempt_1430152496212_0015_m_000000_0
  91. 2015-04-27 21:15:16,706 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1430152496212_0015_m_000000_0
  92. 2015-04-27 21:15:16,706 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Piotr-Komputer:55726
  93. 2015-04-27 21:15:16,769 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1430152496212_0015_m_000000_0 : 13562
  94. 2015-04-27 21:15:16,784 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1430152496212_0015_m_000000_0] using containerId: [container_1430152496212_0015_01_000002 on NM: [Piotr-Komputer:55726]
  95. 2015-04-27 21:15:16,784 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
  96. 2015-04-27 21:15:16,784 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1430152496212_0015_m_000000
  97. 2015-04-27 21:15:16,784 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1430152496212_0015_m_000000 Task Transitioned from SCHEDULED to RUNNING
  98. 2015-04-27 21:15:17,487 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1430152496212_0015: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:-1> knownNMs=1
  99. 2015-04-27 21:15:24,075 INFO [Socket Reader #1 for port 60351] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1430152496212_0015 (auth:SIMPLE)
  100. 2015-04-27 21:15:24,091 INFO [IPC Server handler 0 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1430152496212_0015_m_000002 asked for a task
  101. 2015-04-27 21:15:24,091 INFO [IPC Server handler 0 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1430152496212_0015_m_000002 given task: attempt_1430152496212_0015_m_000000_0
  102. 2015-04-27 21:15:28,075 INFO [IPC Server handler 12 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1430152496212_0015_m_000000_0
  103. 2015-04-27 21:15:31,075 INFO [IPC Server handler 13 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1430152496212_0015_m_000000_0
  104. 2015-04-27 21:15:34,075 INFO [IPC Server handler 11 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1430152496212_0015_m_000000_0
  105. 2015-04-27 21:15:35,669 INFO [IPC Server handler 10 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1430152496212_0015_m_000000_0
  106. 2015-04-27 21:15:35,669 INFO [IPC Server handler 10 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1430152496212_0015_m_000000_0 is : 0.0
  107. 2015-04-27 21:15:35,763 INFO [IPC Server handler 9 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1430152496212_0015_m_000000_0
  108. 2015-04-27 21:15:35,763 INFO [IPC Server handler 9 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1430152496212_0015_m_000000_0 is : 1.0
  109. 2015-04-27 21:15:35,778 INFO [IPC Server handler 8 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1430152496212_0015_m_000000_0
  110. 2015-04-27 21:15:35,778 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_m_000000_0 TaskAttempt Transitioned from RUNNING to SUCCESS_CONTAINER_CLEANUP
  111. 2015-04-27 21:15:35,778 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1430152496212_0015_01_000002 taskAttempt attempt_1430152496212_0015_m_000000_0
  112. 2015-04-27 21:15:35,778 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1430152496212_0015_m_000000_0
  113. 2015-04-27 21:15:35,794 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
  114. 2015-04-27 21:15:35,825 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1430152496212_0015_m_000000_0
  115. 2015-04-27 21:15:35,825 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1430152496212_0015_m_000000 Task Transitioned from RUNNING to SUCCEEDED
  116. 2015-04-27 21:15:35,825 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
  117. 2015-04-27 21:15:36,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  118. 2015-04-27 21:15:36,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=5120
  119. 2015-04-27 21:15:36,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold reached. Scheduling reduces.
  120. 2015-04-27 21:15:36,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: All maps assigned. Ramping up all remaining reduces:1
  121. 2015-04-27 21:15:36,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:1 AssignedMaps:1 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  122. 2015-04-27 21:15:37,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1430152496212_0015: ask=1 release= 0 newContainers=0 finishedContainers=1 resourcelimit=<memory:5120, vCores:-1> knownNMs=1
  123. 2015-04-27 21:15:37,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1430152496212_0015_01_000002
  124. 2015-04-27 21:15:37,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:1 AssignedMaps:0 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  125. 2015-04-27 21:15:37,528 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1430152496212_0015_m_000000_0: Container killed by the ApplicationMaster.
  126. Container killed on request. Exit code is 137
  127. Container exited with a non-zero exit code 137
  128.  
  129. 2015-04-27 21:15:38,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  130. 2015-04-27 21:15:38,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned to reduce
  131. 2015-04-27 21:15:38,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1430152496212_0015_01_000003 to attempt_1430152496212_0015_r_000000_0
  132. 2015-04-27 21:15:38,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:1 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
  133. 2015-04-27 21:15:38,528 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Piotr-Komputer to /default-rack
  134. 2015-04-27 21:15:38,528 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_r_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  135. 2015-04-27 21:15:38,528 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1430152496212_0015_01_000003 taskAttempt attempt_1430152496212_0015_r_000000_0
  136. 2015-04-27 21:15:38,528 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1430152496212_0015_r_000000_0
  137. 2015-04-27 21:15:38,544 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1430152496212_0015_r_000000_0 : 13562
  138. 2015-04-27 21:15:38,544 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1430152496212_0015_r_000000_0] using containerId: [container_1430152496212_0015_01_000003 on NM: [Piotr-Komputer:55726]
  139. 2015-04-27 21:15:38,544 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_r_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
  140. 2015-04-27 21:15:38,544 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1430152496212_0015_r_000000
  141. 2015-04-27 21:15:38,544 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1430152496212_0015_r_000000 Task Transitioned from SCHEDULED to RUNNING
  142. 2015-04-27 21:15:39,528 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1430152496212_0015: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:-1> knownNMs=1
  143. 2015-04-27 21:15:46,137 INFO [Socket Reader #1 for port 60351] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1430152496212_0015 (auth:SIMPLE)
  144. 2015-04-27 21:15:46,153 INFO [IPC Server handler 7 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1430152496212_0015_r_000003 asked for a task
  145. 2015-04-27 21:15:46,153 INFO [IPC Server handler 7 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1430152496212_0015_r_000003 given task: attempt_1430152496212_0015_r_000000_0
  146. 2015-04-27 21:15:47,184 INFO [IPC Server handler 5 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1430152496212_0015_r_000000_0. startIndex 0 maxEvents 10000
  147. 2015-04-27 21:15:47,403 INFO [IPC Server handler 6 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1430152496212_0015_r_000000_0
  148. 2015-04-27 21:15:47,403 INFO [IPC Server handler 6 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1430152496212_0015_r_000000_0 is : 0.0
  149. 2015-04-27 21:15:47,449 INFO [IPC Server handler 4 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1430152496212_0015_r_000000_0
  150. 2015-04-27 21:15:47,449 INFO [IPC Server handler 4 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1430152496212_0015_r_000000_0 is : 0.0
  151. 2015-04-27 21:15:47,574 INFO [IPC Server handler 3 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1430152496212_0015_r_000000_0
  152. 2015-04-27 21:15:47,574 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_r_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
  153. 2015-04-27 21:15:47,574 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1430152496212_0015_r_000000_0 given a go for committing the task output.
  154. 2015-04-27 21:15:47,574 INFO [IPC Server handler 2 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1430152496212_0015_r_000000_0
  155. 2015-04-27 21:15:47,574 INFO [IPC Server handler 2 on 60351] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1430152496212_0015_r_000000_0:true
  156. 2015-04-27 21:15:47,590 INFO [IPC Server handler 1 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1430152496212_0015_r_000000_0
  157. 2015-04-27 21:15:47,590 INFO [IPC Server handler 1 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1430152496212_0015_r_000000_0 is : 1.0
  158. 2015-04-27 21:15:47,590 INFO [IPC Server handler 18 on 60351] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1430152496212_0015_r_000000_0
  159. 2015-04-27 21:15:47,590 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_r_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
  160. 2015-04-27 21:15:47,590 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1430152496212_0015_01_000003 taskAttempt attempt_1430152496212_0015_r_000000_0
  161. 2015-04-27 21:15:47,590 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1430152496212_0015_r_000000_0
  162. 2015-04-27 21:15:47,606 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430152496212_0015_r_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
  163. 2015-04-27 21:15:47,606 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1430152496212_0015_r_000000_0
  164. 2015-04-27 21:15:47,606 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1430152496212_0015_r_000000 Task Transitioned from RUNNING to SUCCEEDED
  165. 2015-04-27 21:15:47,606 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 2
  166. 2015-04-27 21:15:47,606 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1430152496212_0015Job Transitioned from RUNNING to COMMITTING
  167. 2015-04-27 21:15:47,606 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
  168. 2015-04-27 21:15:47,621 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:1 CompletedReds:1 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
  169. 2015-04-27 21:15:47,809 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent
  170. 2015-04-27 21:15:47,809 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1430152496212_0015Job Transitioned from COMMITTING to SUCCEEDED
  171. 2015-04-27 21:15:47,809 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
  172. 2015-04-27 21:15:47,809 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
  173. 2015-04-27 21:15:47,809 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true
  174. 2015-04-27 21:15:47,809 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
  175. 2015-04-27 21:15:47,809 INFO [Thread-66] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
  176. 2015-04-27 21:15:47,809 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
  177. 2015-04-27 21:15:47,809 INFO [Thread-66] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 1
  178. 2015-04-27 21:15:47,871 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/Piotr/.staging/job_1430152496212_0015/job_1430152496212_0015_1.jhist to hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015-1430162104030-Piotr-Page+Rank+RDF+Hadoop-1430162147715-1-1-SUCCEEDED-default-1430162114472.jhist_tmp
  179. 2015-04-27 21:15:47,965 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015-1430162104030-Piotr-Page+Rank+RDF+Hadoop-1430162147715-1-1-SUCCEEDED-default-1430162114472.jhist_tmp
  180. 2015-04-27 21:15:47,965 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/Piotr/.staging/job_1430152496212_0015/job_1430152496212_0015_1_conf.xml to hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015_conf.xml_tmp
  181. 2015-04-27 21:15:48,012 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015_conf.xml_tmp
  182. 2015-04-27 21:15:48,028 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015.summary_tmp to hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015.summary
  183. 2015-04-27 21:15:48,028 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015_conf.xml_tmp to hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015_conf.xml
  184. 2015-04-27 21:15:48,028 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015-1430162104030-Piotr-Page+Rank+RDF+Hadoop-1430162147715-1-1-SUCCEEDED-default-1430162114472.jhist_tmp to hdfs://127.0.0.1:9000/tmp/hadoop-yarn/staging/history/done_intermediate/Piotr/job_1430152496212_0015-1430162104030-Piotr-Page+Rank+RDF+Hadoop-1430162147715-1-1-SUCCEEDED-default-1430162114472.jhist
  185. 2015-04-27 21:15:48,028 INFO [Thread-66] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
  186. 2015-04-27 21:15:48,043 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to
  187. 2015-04-27 21:15:52,575 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is http://Piotr-Komputer:19888/jobhistory/job/job_1430152496212_0015
  188. 2015-04-27 21:15:52,575 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for application to be successfully unregistered.
  189. 2015-04-27 21:15:53,575 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:1 CompletedReds:1 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
  190. 2015-04-27 21:15:53,575 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://127.0.0.1:9000 /tmp/hadoop-yarn/staging/Piotr/.staging/job_1430152496212_0015
  191. 2015-04-27 21:15:53,575 INFO [Thread-66] org.apache.hadoop.ipc.Server: Stopping server on 60351
  192. 2015-04-27 21:15:53,575 INFO [IPC Server listener on 60351] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 60351
  193. 2015-04-27 21:15:53,575 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
  194. 2015-04-27 21:15:53,575 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!