Guest User

Untitled

a guest
Nov 28th, 2016
513
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. Log Upload Time: Mon Nov 28 14:53:20 -0800 2016
  2.  
  3. Log Length: 83922
  4. 2016-11-28 14:51:53,178 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1480364897609_0003_000001
  5. 2016-11-28 14:51:55,623 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
  6. 2016-11-28 14:51:55,623 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@1041cf19)
  7. 2016-11-28 14:51:58,530 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
  8. 2016-11-28 14:51:58,536 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
  9. 2016-11-28 14:51:58,763 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
  10. 2016-11-28 14:51:58,770 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
  11. 2016-11-28 14:51:58,775 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
  12. 2016-11-28 14:51:58,782 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
  13. 2016-11-28 14:51:58,785 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
  14. 2016-11-28 14:51:58,793 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
  15. 2016-11-28 14:51:58,794 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
  16. 2016-11-28 14:51:58,795 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
  17. 2016-11-28 14:51:58,956 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  18. 2016-11-28 14:51:59,027 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  19. 2016-11-28 14:51:59,114 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  20. 2016-11-28 14:51:59,163 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
  21. 2016-11-28 14:51:59,327 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
  22. 2016-11-28 14:52:00,192 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
  23. 2016-11-28 14:52:00,415 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
  24. 2016-11-28 14:52:00,415 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
  25. 2016-11-28 14:52:00,447 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1480364897609_0003 to jobTokenSecretManager
  26. 2016-11-28 14:52:00,958 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1480364897609_0003 because: not enabled;
  27. 2016-11-28 14:52:01,023 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1480364897609_0003 = 2768169. Number of splits = 1
  28. 2016-11-28 14:52:01,024 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1480364897609_0003 = 1
  29. 2016-11-28 14:52:01,024 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from NEW to INITED
  30. 2016-11-28 14:52:01,034 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1480364897609_0003.
  31. 2016-11-28 14:52:01,244 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  32. 2016-11-28 14:52:01,278 INFO [Socket Reader #1 for port 41812] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 41812
  33. 2016-11-28 14:52:01,342 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
  34. 2016-11-28 14:52:01,349 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  35. 2016-11-28 14:52:01,355 INFO [IPC Server listener on 41812] org.apache.hadoop.ipc.Server: IPC Server listener on 41812: starting
  36. 2016-11-28 14:52:01,362 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at quickstart.cloudera/10.0.2.15:41812
  37. 2016-11-28 14:52:01,735 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  38. 2016-11-28 14:52:01,781 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
  39. 2016-11-28 14:52:01,811 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined
  40. 2016-11-28 14:52:01,906 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  41. 2016-11-28 14:52:01,945 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
  42. 2016-11-28 14:52:01,945 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
  43. 2016-11-28 14:52:01,981 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
  44. 2016-11-28 14:52:01,982 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
  45. 2016-11-28 14:52:02,003 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 43637
  46. 2016-11-28 14:52:02,003 INFO [main] org.mortbay.log: jetty-6.1.26.cloudera.4
  47. 2016-11-28 14:52:02,145 INFO [main] org.mortbay.log: Extract jar:file:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.8.0.jar!/webapps/mapreduce to /tmp/Jetty_0_0_0_0_43637_mapreduce____96defy/webapp
  48. 2016-11-28 14:52:03,564 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:43637
  49. 2016-11-28 14:52:03,564 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 43637
  50. 2016-11-28 14:52:05,008 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
  51. 2016-11-28 14:52:05,025 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  52. 2016-11-28 14:52:05,022 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE job_1480364897609_0003
  53. 2016-11-28 14:52:05,040 INFO [Socket Reader #1 for port 41585] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 41585
  54. 2016-11-28 14:52:05,111 INFO [IPC Server listener on 41585] org.apache.hadoop.ipc.Server: IPC Server listener on 41585: starting
  55. 2016-11-28 14:52:05,112 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  56. 2016-11-28 14:52:05,172 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
  57. 2016-11-28 14:52:05,172 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
  58. 2016-11-28 14:52:05,172 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
  59. 2016-11-28 14:52:05,418 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8030
  60. 2016-11-28 14:52:05,935 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: <memory:8192, vCores:4>
  61. 2016-11-28 14:52:05,935 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: queue: root.cloudera
  62. 2016-11-28 14:52:05,954 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
  63. 2016-11-28 14:52:05,954 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10
  64. 2016-11-28 14:52:05,959 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  65. 2016-11-28 14:52:05,998 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from INITED to SETUP
  66. 2016-11-28 14:52:06,000 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
  67. 2016-11-28 14:52:06,016 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from SETUP to RUNNING
  68. 2016-11-28 14:52:06,128 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_m_000000 Task Transitioned from NEW to SCHEDULED
  69. 2016-11-28 14:52:06,129 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_r_000000 Task Transitioned from NEW to SCHEDULED
  70. 2016-11-28 14:52:06,133 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
  71. 2016-11-28 14:52:06,133 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_r_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
  72. 2016-11-28 14:52:06,138 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:1024, vCores:1>
  73. 2016-11-28 14:52:06,175 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: reduceResourceRequest:<memory:1024, vCores:1>
  74. 2016-11-28 14:52:06,317 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1480364897609_0003, File: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003_1.jhist
  75. 2016-11-28 14:52:06,955 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
  76. 2016-11-28 14:52:07,404 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:6144, vCores:7> knownNMs=1
  77. 2016-11-28 14:52:07,437 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:6144, vCores:7>
  78. 2016-11-28 14:52:07,437 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  79. 2016-11-28 14:52:07,532 INFO [IPC Server handler 0 on 41812] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for MAP job_1480364897609_0003. Report-size will be 1
  80. 2016-11-28 14:52:08,131 INFO [IPC Server handler 0 on 41812] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for REDUCE job_1480364897609_0003. Report-size will be 1
  81. 2016-11-28 14:52:08,550 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  82. 2016-11-28 14:52:08,558 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000002 to attempt_1480364897609_0003_m_000000_0
  83. 2016-11-28 14:52:08,559 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  84. 2016-11-28 14:52:08,559 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  85. 2016-11-28 14:52:08,559 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  86. 2016-11-28 14:52:08,583 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  87. 2016-11-28 14:52:08,688 WARN [DataStreamer for file /tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003.summary] org.apache.hadoop.hdfs.DFSClient: Caught exception
  88. java.lang.InterruptedException
  89. at java.lang.Object.wait(Native Method)
  90. at java.lang.Thread.join(Thread.java:1281)
  91. at java.lang.Thread.join(Thread.java:1355)
  92. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:862)
  93. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:600)
  94. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:789)
  95. 2016-11-28 14:52:09,514 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job.jar
  96. 2016-11-28 14:52:09,549 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job.xml
  97. 2016-11-28 14:52:09,591 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #1 secret keys for NM use for launching container
  98. 2016-11-28 14:52:09,591 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1
  99. 2016-11-28 14:52:09,592 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
  100. 2016-11-28 14:52:09,782 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  101. 2016-11-28 14:52:09,802 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  102. 2016-11-28 14:52:09,807 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  103. 2016-11-28 14:52:09,840 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000002 taskAttempt attempt_1480364897609_0003_m_000000_0
  104. 2016-11-28 14:52:09,842 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_0
  105. 2016-11-28 14:52:09,867 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  106. 2016-11-28 14:52:10,113 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_0 : 13562
  107. 2016-11-28 14:52:10,130 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_0] using containerId: [container_1480364897609_0003_01_000002 on NM: [quickstart.cloudera:34820]
  108. 2016-11-28 14:52:10,133 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
  109. 2016-11-28 14:52:10,137 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  110. 2016-11-28 14:52:10,137 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_m_000000 Task Transitioned from SCHEDULED to RUNNING
  111. 2016-11-28 14:52:19,969 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  112. 2016-11-28 14:52:20,122 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000002 asked for a task
  113. 2016-11-28 14:52:20,122 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000002 given task: attempt_1480364897609_0003_m_000000_0
  114. 2016-11-28 14:52:30,442 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_0 is : 0.0
  115. 2016-11-28 14:52:30,466 FATAL [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_0 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  116. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  117. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  118. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  119. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  120. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  121. at java.security.AccessController.doPrivileged(Native Method)
  122. at javax.security.auth.Subject.doAs(Subject.java:415)
  123. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  124. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  125. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  126. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  127. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  128. ... 8 more
  129. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  130. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  131. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  132. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  133. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  134. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  135. ... 9 more
  136. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  137. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  138. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  139. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  140. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  141. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  142. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  143. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  144. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  145. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  146. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  147. ... 12 more
  148.  
  149. 2016-11-28 14:52:30,466 INFO [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_0: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  150. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  151. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  152. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  153. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  154. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  155. at java.security.AccessController.doPrivileged(Native Method)
  156. at javax.security.auth.Subject.doAs(Subject.java:415)
  157. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  158. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  159. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  160. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  161. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  162. ... 8 more
  163. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  164. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  165. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  166. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  167. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  168. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  169. ... 9 more
  170. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  171. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  172. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  173. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  174. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  175. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  176. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  177. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  178. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  179. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  180. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  181. ... 12 more
  182.  
  183. 2016-11-28 14:52:30,578 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_0: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  184. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  185. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  186. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  187. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  188. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  189. at java.security.AccessController.doPrivileged(Native Method)
  190. at javax.security.auth.Subject.doAs(Subject.java:415)
  191. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  192. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  193. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  194. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  195. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  196. ... 8 more
  197. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  198. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  199. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  200. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  201. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  202. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  203. ... 9 more
  204. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  205. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  206. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  207. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  208. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  209. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  210. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  211. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  212. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  213. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  214. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  215. ... 12 more
  216.  
  217. 2016-11-28 14:52:30,605 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  218. 2016-11-28 14:52:30,694 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node quickstart.cloudera
  219. 2016-11-28 14:52:30,697 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from NEW to UNASSIGNED
  220. 2016-11-28 14:52:30,698 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1480364897609_0003_m_000000_1 to list of failed maps
  221. 2016-11-28 14:52:30,994 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  222. 2016-11-28 14:52:30,997 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  223. 2016-11-28 14:52:30,997 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  224. 2016-11-28 14:52:30,997 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  225. 2016-11-28 14:52:32,008 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1480364897609_0003_01_000002
  226. 2016-11-28 14:52:32,009 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  227. 2016-11-28 14:52:32,009 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_0:
  228. 2016-11-28 14:52:32,009 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  229. 2016-11-28 14:52:32,009 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1480364897609_0003_01_000003, NodeId: quickstart.cloudera:34820, NodeHttpAddress: quickstart.cloudera:8042, Resource: <memory:1024, vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service: 10.0.2.15:34820 }, ] to fast fail map
  230. 2016-11-28 14:52:32,009 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps
  231. 2016-11-28 14:52:32,010 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  232. 2016-11-28 14:52:32,011 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  233. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000003 to attempt_1480364897609_0003_m_000000_1
  234. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  235. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  236. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
  237. 2016-11-28 14:52:32,011 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_COMPLETED for container container_1480364897609_0003_01_000002 taskAttempt attempt_1480364897609_0003_m_000000_0
  238. 2016-11-28 14:52:32,014 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000003 taskAttempt attempt_1480364897609_0003_m_000000_1
  239. 2016-11-28 14:52:32,014 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_1
  240. 2016-11-28 14:52:32,014 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  241. 2016-11-28 14:52:32,039 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_1 : 13562
  242. 2016-11-28 14:52:32,040 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_1] using containerId: [container_1480364897609_0003_01_000003 on NM: [quickstart.cloudera:34820]
  243. 2016-11-28 14:52:32,040 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from ASSIGNED to RUNNING
  244. 2016-11-28 14:52:32,042 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  245. 2016-11-28 14:52:33,018 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  246. 2016-11-28 14:52:38,067 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  247. 2016-11-28 14:52:38,103 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000003 asked for a task
  248. 2016-11-28 14:52:38,103 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000003 given task: attempt_1480364897609_0003_m_000000_1
  249. 2016-11-28 14:52:43,998 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_1 is : 0.0
  250. 2016-11-28 14:52:44,009 FATAL [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_1 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  251. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  252. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  253. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  254. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  255. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  256. at java.security.AccessController.doPrivileged(Native Method)
  257. at javax.security.auth.Subject.doAs(Subject.java:415)
  258. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  259. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  260. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  261. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  262. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  263. ... 8 more
  264. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  265. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  266. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  267. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  268. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  269. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  270. ... 9 more
  271. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  272. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  273. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  274. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  275. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  276. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  277. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  278. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  279. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  280. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  281. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  282. ... 12 more
  283.  
  284. 2016-11-28 14:52:44,009 INFO [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_1: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  285. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  286. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  287. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  288. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  289. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  290. at java.security.AccessController.doPrivileged(Native Method)
  291. at javax.security.auth.Subject.doAs(Subject.java:415)
  292. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  293. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  294. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  295. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  296. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  297. ... 8 more
  298. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  299. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  300. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  301. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  302. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  303. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  304. ... 9 more
  305. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  306. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  307. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  308. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  309. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  310. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  311. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  312. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  313. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  314. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  315. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  316. ... 12 more
  317.  
  318. 2016-11-28 14:52:44,010 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_1: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  319. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  320. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  321. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  322. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  323. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  324. at java.security.AccessController.doPrivileged(Native Method)
  325. at javax.security.auth.Subject.doAs(Subject.java:415)
  326. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  327. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  328. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  329. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  330. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  331. ... 8 more
  332. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  333. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  334. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  335. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  336. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  337. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  338. ... 9 more
  339. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  340. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  341. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  342. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  343. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  344. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  345. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  346. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  347. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  348. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  349. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  350. ... 12 more
  351.  
  352. 2016-11-28 14:52:44,011 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  353. 2016-11-28 14:52:44,037 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 2 failures on node quickstart.cloudera
  354. 2016-11-28 14:52:44,038 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from NEW to UNASSIGNED
  355. 2016-11-28 14:52:44,038 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1480364897609_0003_m_000000_2 to list of failed maps
  356. 2016-11-28 14:52:44,062 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
  357. 2016-11-28 14:52:44,065 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  358. 2016-11-28 14:52:44,065 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  359. 2016-11-28 14:52:44,065 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  360. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1480364897609_0003_01_000003
  361. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  362. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1480364897609_0003_01_000004, NodeId: quickstart.cloudera:34820, NodeHttpAddress: quickstart.cloudera:8042, Resource: <memory:1024, vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service: 10.0.2.15:34820 }, ] to fast fail map
  363. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps
  364. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000004 to attempt_1480364897609_0003_m_000000_2
  365. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  366. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  367. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
  368. 2016-11-28 14:52:45,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  369. 2016-11-28 14:52:45,075 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_1:
  370. 2016-11-28 14:52:45,076 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  371. 2016-11-28 14:52:45,076 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  372. 2016-11-28 14:52:45,078 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_COMPLETED for container container_1480364897609_0003_01_000003 taskAttempt attempt_1480364897609_0003_m_000000_1
  373. 2016-11-28 14:52:45,080 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000004 taskAttempt attempt_1480364897609_0003_m_000000_2
  374. 2016-11-28 14:52:45,080 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_2
  375. 2016-11-28 14:52:45,080 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  376. 2016-11-28 14:52:45,101 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_2 : 13562
  377. 2016-11-28 14:52:45,101 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_2] using containerId: [container_1480364897609_0003_01_000004 on NM: [quickstart.cloudera:34820]
  378. 2016-11-28 14:52:45,102 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from ASSIGNED to RUNNING
  379. 2016-11-28 14:52:45,102 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  380. 2016-11-28 14:52:46,083 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  381. 2016-11-28 14:52:50,637 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  382. 2016-11-28 14:52:50,657 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000004 asked for a task
  383. 2016-11-28 14:52:50,658 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000004 given task: attempt_1480364897609_0003_m_000000_2
  384. 2016-11-28 14:52:55,710 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_2 is : 0.0
  385. 2016-11-28 14:52:55,713 FATAL [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_2 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  386. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  387. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  388. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  389. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  390. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  391. at java.security.AccessController.doPrivileged(Native Method)
  392. at javax.security.auth.Subject.doAs(Subject.java:415)
  393. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  394. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  395. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  396. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  397. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  398. ... 8 more
  399. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  400. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  401. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  402. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  403. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  404. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  405. ... 9 more
  406. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  407. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  408. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  409. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  410. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  411. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  412. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  413. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  414. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  415. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  416. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  417. ... 12 more
  418.  
  419. 2016-11-28 14:52:55,713 INFO [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_2: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  420. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  421. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  422. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  423. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  424. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  425. at java.security.AccessController.doPrivileged(Native Method)
  426. at javax.security.auth.Subject.doAs(Subject.java:415)
  427. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  428. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  429. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  430. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  431. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  432. ... 8 more
  433. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  434. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  435. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  436. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  437. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  438. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  439. ... 9 more
  440. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  441. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  442. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  443. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  444. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  445. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  446. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  447. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  448. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  449. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  450. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  451. ... 12 more
  452.  
  453. 2016-11-28 14:52:55,716 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_2: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  454. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  455. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  456. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  457. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  458. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  459. at java.security.AccessController.doPrivileged(Native Method)
  460. at javax.security.auth.Subject.doAs(Subject.java:415)
  461. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  462. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  463. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  464. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  465. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  466. ... 8 more
  467. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  468. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  469. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  470. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  471. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  472. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  473. ... 9 more
  474. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  475. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  476. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  477. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  478. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  479. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  480. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  481. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  482. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  483. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  484. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  485. ... 12 more
  486.  
  487. 2016-11-28 14:52:55,717 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  488. 2016-11-28 14:52:55,723 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 3 failures on node quickstart.cloudera
  489. 2016-11-28 14:52:55,724 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Blacklisted host quickstart.cloudera
  490. 2016-11-28 14:52:55,726 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from NEW to UNASSIGNED
  491. 2016-11-28 14:52:55,726 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1480364897609_0003_m_000000_3 to list of failed maps
  492. 2016-11-28 14:52:56,115 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
  493. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:0, vCores:0> knownNMs=1
  494. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Update the blacklist for application_1480364897609_0003: blacklistAdditions=1 blacklistRemovals=0
  495. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Ignore blacklisting set to true. Known: 1, Blacklisted: 1, 100%
  496. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:0, vCores:0>
  497. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  498. 2016-11-28 14:52:57,123 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Update the blacklist for application_1480364897609_0003: blacklistAdditions=0 blacklistRemovals=1
  499. 2016-11-28 14:52:57,123 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1480364897609_0003_01_000004
  500. 2016-11-28 14:52:57,124 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  501. 2016-11-28 14:52:57,124 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_2:
  502. 2016-11-28 14:52:57,124 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:6144, vCores:7>
  503. 2016-11-28 14:52:57,124 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  504. 2016-11-28 14:52:57,124 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
  505. 2016-11-28 14:52:57,126 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_COMPLETED for container container_1480364897609_0003_01_000004 taskAttempt attempt_1480364897609_0003_m_000000_2
  506. 2016-11-28 14:52:58,128 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  507. 2016-11-28 14:52:58,129 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1480364897609_0003_01_000005, NodeId: quickstart.cloudera:34820, NodeHttpAddress: quickstart.cloudera:8042, Resource: <memory:1024, vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service: 10.0.2.15:34820 }, ] to fast fail map
  508. 2016-11-28 14:52:58,129 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps
  509. 2016-11-28 14:52:58,130 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  510. 2016-11-28 14:52:58,131 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  511. 2016-11-28 14:52:58,131 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000005 to attempt_1480364897609_0003_m_000000_3
  512. 2016-11-28 14:52:58,132 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  513. 2016-11-28 14:52:58,132 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  514. 2016-11-28 14:52:58,132 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0
  515. 2016-11-28 14:52:58,134 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000005 taskAttempt attempt_1480364897609_0003_m_000000_3
  516. 2016-11-28 14:52:58,134 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_3
  517. 2016-11-28 14:52:58,134 INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  518. 2016-11-28 14:52:58,174 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_3 : 13562
  519. 2016-11-28 14:52:58,175 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_3] using containerId: [container_1480364897609_0003_01_000005 on NM: [quickstart.cloudera:34820]
  520. 2016-11-28 14:52:58,175 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from ASSIGNED to RUNNING
  521. 2016-11-28 14:52:58,175 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  522. 2016-11-28 14:52:59,137 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  523. 2016-11-28 14:53:05,049 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  524. 2016-11-28 14:53:05,094 INFO [IPC Server handler 12 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000005 asked for a task
  525. 2016-11-28 14:53:05,094 INFO [IPC Server handler 12 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000005 given task: attempt_1480364897609_0003_m_000000_3
  526. 2016-11-28 14:53:12,570 INFO [IPC Server handler 13 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_3 is : 0.0
  527. 2016-11-28 14:53:12,576 FATAL [IPC Server handler 3 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_3 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  528. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  529. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  530. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  531. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  532. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  533. at java.security.AccessController.doPrivileged(Native Method)
  534. at javax.security.auth.Subject.doAs(Subject.java:415)
  535. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  536. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  537. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  538. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  539. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  540. ... 8 more
  541. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  542. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  543. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  544. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  545. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  546. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  547. ... 9 more
  548. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  549. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  550. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  551. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  552. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  553. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  554. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  555. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  556. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  557. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  558. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  559. ... 12 more
  560.  
  561. 2016-11-28 14:53:12,576 INFO [IPC Server handler 3 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_3: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  562. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  563. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  564. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  565. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  566. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  567. at java.security.AccessController.doPrivileged(Native Method)
  568. at javax.security.auth.Subject.doAs(Subject.java:415)
  569. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  570. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  571. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  572. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  573. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  574. ... 8 more
  575. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  576. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  577. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  578. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  579. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  580. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  581. ... 9 more
  582. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  583. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  584. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  585. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  586. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  587. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  588. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  589. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  590. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  591. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  592. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  593. ... 12 more
  594.  
  595. 2016-11-28 14:53:12,577 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_3: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  596. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  597. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  598. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  599. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  600. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  601. at java.security.AccessController.doPrivileged(Native Method)
  602. at javax.security.auth.Subject.doAs(Subject.java:415)
  603. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  604. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  605. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  606. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  607. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  608. ... 8 more
  609. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  610. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  611. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  612. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  613. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  614. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  615. ... 9 more
  616. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  617. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  618. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  619. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  620. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  621. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  622. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  623. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  624. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  625. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  626. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  627. ... 12 more
  628.  
  629. 2016-11-28 14:53:12,584 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  630. 2016-11-28 14:53:12,623 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_m_000000 Task Transitioned from RUNNING to FAILED
  631. 2016-11-28 14:53:12,629 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
  632. 2016-11-28 14:53:12,630 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as tasks failed. failedMaps:1 failedReduces:0
  633. 2016-11-28 14:53:12,638 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from RUNNING to FAIL_WAIT
  634. 2016-11-28 14:53:12,639 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_r_000000 Task Transitioned from SCHEDULED to KILL_WAIT
  635. 2016-11-28 14:53:12,659 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_r_000000_0 TaskAttempt Transitioned from UNASSIGNED to KILLED
  636. 2016-11-28 14:53:12,659 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_r_000000 Task Transitioned from KILL_WAIT to KILLED
  637. 2016-11-28 14:53:12,660 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Processing the event EventType: CONTAINER_DEALLOCATE
  638. 2016-11-28 14:53:12,661 ERROR [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Could not deallocate container for task attemptId attempt_1480364897609_0003_r_000000_0
  639. 2016-11-28 14:53:12,664 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from FAIL_WAIT to FAIL_ABORT
  640. 2016-11-28 14:53:12,664 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT
  641. 2016-11-28 14:53:12,671 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from FAIL_ABORT to FAILED
  642. 2016-11-28 14:53:12,676 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
  643. 2016-11-28 14:53:12,676 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
  644. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true
  645. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
  646. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
  647. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
  648. 2016-11-28 14:53:12,692 INFO [Thread-71] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
  649. 2016-11-28 14:53:12,765 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003_1.jhist to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist_tmp
  650. 2016-11-28 14:53:12,852 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist_tmp
  651. 2016-11-28 14:53:12,855 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003_1_conf.xml to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml_tmp
  652. 2016-11-28 14:53:12,913 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml_tmp
  653. 2016-11-28 14:53:12,930 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003.summary_tmp to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003.summary
  654. 2016-11-28 14:53:12,948 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml_tmp to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml
  655. 2016-11-28 14:53:12,982 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist_tmp to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist
  656. 2016-11-28 14:53:12,985 INFO [Thread-71] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
  657. 2016-11-28 14:53:12,985 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1480364897609_0003_m_000000_3
  658. 2016-11-28 14:53:12,985 INFO [Thread-71] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  659. 2016-11-28 14:53:13,046 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  660. 2016-11-28 14:53:13,053 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to Task failed task_1480364897609_0003_m_000000
  661. Job failed as tasks failed. failedMaps:1 failedReduces:0
  662.  
  663. 2016-11-28 14:53:13,091 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is http://quickstart.cloudera:19888/jobhistory/job/job_1480364897609_0003
  664. 2016-11-28 14:53:13,142 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for application to be successfully unregistered.
  665. 2016-11-28 14:53:14,146 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0
  666. 2016-11-28 14:53:14,147 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://quickstart.cloudera:8020 /tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003
  667. 2016-11-28 14:53:14,163 INFO [Thread-71] org.apache.hadoop.ipc.Server: Stopping server on 41585
  668. 2016-11-28 14:53:14,168 INFO [IPC Server listener on 41585] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 41585
  669. 2016-11-28 14:53:14,169 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
  670. 2016-11-28 14:53:14,170 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted
  671. 2016-11-28 14:53:14,176 INFO [Ping Checker] org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: TaskAttemptFinishingMonitor thread interrupted
RAW Paste Data