API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Nov 28th, 2016
575
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 82.65 KB | None | 0 0
raw download clone embed print report
  1. Log Upload Time: Mon Nov 28 14:53:20 -0800 2016
  2.  
  3. Log Length: 83922
  4. 2016-11-28 14:51:53,178 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1480364897609_0003_000001
  5. 2016-11-28 14:51:55,623 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
  6. 2016-11-28 14:51:55,623 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@1041cf19)
  7. 2016-11-28 14:51:58,530 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
  8. 2016-11-28 14:51:58,536 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
  9. 2016-11-28 14:51:58,763 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
  10. 2016-11-28 14:51:58,770 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
  11. 2016-11-28 14:51:58,775 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
  12. 2016-11-28 14:51:58,782 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
  13. 2016-11-28 14:51:58,785 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
  14. 2016-11-28 14:51:58,793 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
  15. 2016-11-28 14:51:58,794 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
  16. 2016-11-28 14:51:58,795 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
  17. 2016-11-28 14:51:58,956 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  18. 2016-11-28 14:51:59,027 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  19. 2016-11-28 14:51:59,114 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  20. 2016-11-28 14:51:59,163 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
  21. 2016-11-28 14:51:59,327 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
  22. 2016-11-28 14:52:00,192 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
  23. 2016-11-28 14:52:00,415 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
  24. 2016-11-28 14:52:00,415 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
  25. 2016-11-28 14:52:00,447 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1480364897609_0003 to jobTokenSecretManager
  26. 2016-11-28 14:52:00,958 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1480364897609_0003 because: not enabled;
  27. 2016-11-28 14:52:01,023 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1480364897609_0003 = 2768169. Number of splits = 1
  28. 2016-11-28 14:52:01,024 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1480364897609_0003 = 1
  29. 2016-11-28 14:52:01,024 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from NEW to INITED
  30. 2016-11-28 14:52:01,034 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1480364897609_0003.
  31. 2016-11-28 14:52:01,244 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  32. 2016-11-28 14:52:01,278 INFO [Socket Reader #1 for port 41812] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 41812
  33. 2016-11-28 14:52:01,342 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
  34. 2016-11-28 14:52:01,349 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  35. 2016-11-28 14:52:01,355 INFO [IPC Server listener on 41812] org.apache.hadoop.ipc.Server: IPC Server listener on 41812: starting
  36. 2016-11-28 14:52:01,362 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at quickstart.cloudera/10.0.2.15:41812
  37. 2016-11-28 14:52:01,735 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  38. 2016-11-28 14:52:01,781 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
  39. 2016-11-28 14:52:01,811 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined
  40. 2016-11-28 14:52:01,906 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  41. 2016-11-28 14:52:01,945 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
  42. 2016-11-28 14:52:01,945 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
  43. 2016-11-28 14:52:01,981 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
  44. 2016-11-28 14:52:01,982 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
  45. 2016-11-28 14:52:02,003 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 43637
  46. 2016-11-28 14:52:02,003 INFO [main] org.mortbay.log: jetty-6.1.26.cloudera.4
  47. 2016-11-28 14:52:02,145 INFO [main] org.mortbay.log: Extract jar:file:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.8.0.jar!/webapps/mapreduce to /tmp/Jetty_0_0_0_0_43637_mapreduce____96defy/webapp
  48. 2016-11-28 14:52:03,564 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:43637
  49. 2016-11-28 14:52:03,564 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 43637
  50. 2016-11-28 14:52:05,008 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
  51. 2016-11-28 14:52:05,025 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  52. 2016-11-28 14:52:05,022 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE job_1480364897609_0003
  53. 2016-11-28 14:52:05,040 INFO [Socket Reader #1 for port 41585] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 41585
  54. 2016-11-28 14:52:05,111 INFO [IPC Server listener on 41585] org.apache.hadoop.ipc.Server: IPC Server listener on 41585: starting
  55. 2016-11-28 14:52:05,112 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  56. 2016-11-28 14:52:05,172 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
  57. 2016-11-28 14:52:05,172 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
  58. 2016-11-28 14:52:05,172 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
  59. 2016-11-28 14:52:05,418 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8030
  60. 2016-11-28 14:52:05,935 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: <memory:8192, vCores:4>
  61. 2016-11-28 14:52:05,935 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: queue: root.cloudera
  62. 2016-11-28 14:52:05,954 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
  63. 2016-11-28 14:52:05,954 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10
  64. 2016-11-28 14:52:05,959 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  65. 2016-11-28 14:52:05,998 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from INITED to SETUP
  66. 2016-11-28 14:52:06,000 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
  67. 2016-11-28 14:52:06,016 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from SETUP to RUNNING
  68. 2016-11-28 14:52:06,128 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_m_000000 Task Transitioned from NEW to SCHEDULED
  69. 2016-11-28 14:52:06,129 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_r_000000 Task Transitioned from NEW to SCHEDULED
  70. 2016-11-28 14:52:06,133 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
  71. 2016-11-28 14:52:06,133 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_r_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
  72. 2016-11-28 14:52:06,138 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:1024, vCores:1>
  73. 2016-11-28 14:52:06,175 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: reduceResourceRequest:<memory:1024, vCores:1>
  74. 2016-11-28 14:52:06,317 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1480364897609_0003, File: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003_1.jhist
  75. 2016-11-28 14:52:06,955 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
  76. 2016-11-28 14:52:07,404 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:6144, vCores:7> knownNMs=1
  77. 2016-11-28 14:52:07,437 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:6144, vCores:7>
  78. 2016-11-28 14:52:07,437 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  79. 2016-11-28 14:52:07,532 INFO [IPC Server handler 0 on 41812] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for MAP job_1480364897609_0003. Report-size will be 1
  80. 2016-11-28 14:52:08,131 INFO [IPC Server handler 0 on 41812] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for REDUCE job_1480364897609_0003. Report-size will be 1
  81. 2016-11-28 14:52:08,550 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  82. 2016-11-28 14:52:08,558 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000002 to attempt_1480364897609_0003_m_000000_0
  83. 2016-11-28 14:52:08,559 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  84. 2016-11-28 14:52:08,559 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  85. 2016-11-28 14:52:08,559 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  86. 2016-11-28 14:52:08,583 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://quickstart.cloudera:8020]
  87. 2016-11-28 14:52:08,688 WARN [DataStreamer for file /tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003.summary] org.apache.hadoop.hdfs.DFSClient: Caught exception
  88. java.lang.InterruptedException
  89. at java.lang.Object.wait(Native Method)
  90. at java.lang.Thread.join(Thread.java:1281)
  91. at java.lang.Thread.join(Thread.java:1355)
  92. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:862)
  93. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:600)
  94. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:789)
  95. 2016-11-28 14:52:09,514 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job.jar
  96. 2016-11-28 14:52:09,549 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job.xml
  97. 2016-11-28 14:52:09,591 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #1 secret keys for NM use for launching container
  98. 2016-11-28 14:52:09,591 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1
  99. 2016-11-28 14:52:09,592 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
  100. 2016-11-28 14:52:09,782 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  101. 2016-11-28 14:52:09,802 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  102. 2016-11-28 14:52:09,807 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  103. 2016-11-28 14:52:09,840 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000002 taskAttempt attempt_1480364897609_0003_m_000000_0
  104. 2016-11-28 14:52:09,842 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_0
  105. 2016-11-28 14:52:09,867 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  106. 2016-11-28 14:52:10,113 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_0 : 13562
  107. 2016-11-28 14:52:10,130 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_0] using containerId: [container_1480364897609_0003_01_000002 on NM: [quickstart.cloudera:34820]
  108. 2016-11-28 14:52:10,133 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
  109. 2016-11-28 14:52:10,137 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  110. 2016-11-28 14:52:10,137 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_m_000000 Task Transitioned from SCHEDULED to RUNNING
  111. 2016-11-28 14:52:19,969 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  112. 2016-11-28 14:52:20,122 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000002 asked for a task
  113. 2016-11-28 14:52:20,122 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000002 given task: attempt_1480364897609_0003_m_000000_0
  114. 2016-11-28 14:52:30,442 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_0 is : 0.0
  115. 2016-11-28 14:52:30,466 FATAL [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_0 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  116. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  117. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  118. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  119. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  120. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  121. at java.security.AccessController.doPrivileged(Native Method)
  122. at javax.security.auth.Subject.doAs(Subject.java:415)
  123. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  124. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  125. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  126. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  127. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  128. ... 8 more
  129. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  130. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  131. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  132. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  133. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  134. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  135. ... 9 more
  136. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  137. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  138. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  139. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  140. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  141. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  142. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  143. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  144. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  145. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  146. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  147. ... 12 more
  148.  
  149. 2016-11-28 14:52:30,466 INFO [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_0: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  150. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  151. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  152. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  153. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  154. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  155. at java.security.AccessController.doPrivileged(Native Method)
  156. at javax.security.auth.Subject.doAs(Subject.java:415)
  157. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  158. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  159. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  160. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  161. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  162. ... 8 more
  163. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  164. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  165. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  166. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  167. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  168. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  169. ... 9 more
  170. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  171. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  172. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  173. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  174. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  175. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  176. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  177. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  178. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  179. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  180. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  181. ... 12 more
  182.  
  183. 2016-11-28 14:52:30,578 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_0: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  184. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  185. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  186. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  187. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  188. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  189. at java.security.AccessController.doPrivileged(Native Method)
  190. at javax.security.auth.Subject.doAs(Subject.java:415)
  191. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  192. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  193. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  194. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  195. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  196. ... 8 more
  197. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  198. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  199. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  200. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  201. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  202. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  203. ... 9 more
  204. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  205. at [Source: java.io.StringReader@64cacf75; line: 1, column: 2]
  206. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  207. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  208. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  209. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  210. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  211. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  212. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  213. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  214. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  215. ... 12 more
  216.  
  217. 2016-11-28 14:52:30,605 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  218. 2016-11-28 14:52:30,694 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node quickstart.cloudera
  219. 2016-11-28 14:52:30,697 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from NEW to UNASSIGNED
  220. 2016-11-28 14:52:30,698 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1480364897609_0003_m_000000_1 to list of failed maps
  221. 2016-11-28 14:52:30,994 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
  222. 2016-11-28 14:52:30,997 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  223. 2016-11-28 14:52:30,997 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  224. 2016-11-28 14:52:30,997 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  225. 2016-11-28 14:52:32,008 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1480364897609_0003_01_000002
  226. 2016-11-28 14:52:32,009 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_0 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  227. 2016-11-28 14:52:32,009 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_0:
  228. 2016-11-28 14:52:32,009 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  229. 2016-11-28 14:52:32,009 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1480364897609_0003_01_000003, NodeId: quickstart.cloudera:34820, NodeHttpAddress: quickstart.cloudera:8042, Resource: <memory:1024, vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service: 10.0.2.15:34820 }, ] to fast fail map
  230. 2016-11-28 14:52:32,009 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps
  231. 2016-11-28 14:52:32,010 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  232. 2016-11-28 14:52:32,011 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  233. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000003 to attempt_1480364897609_0003_m_000000_1
  234. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  235. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  236. 2016-11-28 14:52:32,011 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
  237. 2016-11-28 14:52:32,011 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_COMPLETED for container container_1480364897609_0003_01_000002 taskAttempt attempt_1480364897609_0003_m_000000_0
  238. 2016-11-28 14:52:32,014 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000003 taskAttempt attempt_1480364897609_0003_m_000000_1
  239. 2016-11-28 14:52:32,014 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_1
  240. 2016-11-28 14:52:32,014 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  241. 2016-11-28 14:52:32,039 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_1 : 13562
  242. 2016-11-28 14:52:32,040 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_1] using containerId: [container_1480364897609_0003_01_000003 on NM: [quickstart.cloudera:34820]
  243. 2016-11-28 14:52:32,040 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from ASSIGNED to RUNNING
  244. 2016-11-28 14:52:32,042 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  245. 2016-11-28 14:52:33,018 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  246. 2016-11-28 14:52:38,067 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  247. 2016-11-28 14:52:38,103 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000003 asked for a task
  248. 2016-11-28 14:52:38,103 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000003 given task: attempt_1480364897609_0003_m_000000_1
  249. 2016-11-28 14:52:43,998 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_1 is : 0.0
  250. 2016-11-28 14:52:44,009 FATAL [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_1 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  251. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  252. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  253. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  254. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  255. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  256. at java.security.AccessController.doPrivileged(Native Method)
  257. at javax.security.auth.Subject.doAs(Subject.java:415)
  258. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  259. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  260. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  261. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  262. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  263. ... 8 more
  264. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  265. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  266. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  267. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  268. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  269. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  270. ... 9 more
  271. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  272. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  273. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  274. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  275. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  276. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  277. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  278. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  279. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  280. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  281. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  282. ... 12 more
  283.  
  284. 2016-11-28 14:52:44,009 INFO [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_1: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  285. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  286. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  287. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  288. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  289. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  290. at java.security.AccessController.doPrivileged(Native Method)
  291. at javax.security.auth.Subject.doAs(Subject.java:415)
  292. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  293. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  294. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  295. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  296. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  297. ... 8 more
  298. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  299. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  300. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  301. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  302. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  303. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  304. ... 9 more
  305. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  306. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  307. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  308. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  309. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  310. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  311. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  312. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  313. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  314. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  315. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  316. ... 12 more
  317.  
  318. 2016-11-28 14:52:44,010 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_1: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  319. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  320. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  321. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  322. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  323. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  324. at java.security.AccessController.doPrivileged(Native Method)
  325. at javax.security.auth.Subject.doAs(Subject.java:415)
  326. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  327. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  328. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  329. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  330. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  331. ... 8 more
  332. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  333. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  334. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  335. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  336. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  337. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  338. ... 9 more
  339. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  340. at [Source: java.io.StringReader@11bde071; line: 1, column: 2]
  341. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  342. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  343. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  344. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  345. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  346. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  347. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  348. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  349. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  350. ... 12 more
  351.  
  352. 2016-11-28 14:52:44,011 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  353. 2016-11-28 14:52:44,037 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 2 failures on node quickstart.cloudera
  354. 2016-11-28 14:52:44,038 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from NEW to UNASSIGNED
  355. 2016-11-28 14:52:44,038 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1480364897609_0003_m_000000_2 to list of failed maps
  356. 2016-11-28 14:52:44,062 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
  357. 2016-11-28 14:52:44,065 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  358. 2016-11-28 14:52:44,065 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  359. 2016-11-28 14:52:44,065 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  360. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1480364897609_0003_01_000003
  361. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  362. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1480364897609_0003_01_000004, NodeId: quickstart.cloudera:34820, NodeHttpAddress: quickstart.cloudera:8042, Resource: <memory:1024, vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service: 10.0.2.15:34820 }, ] to fast fail map
  363. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps
  364. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000004 to attempt_1480364897609_0003_m_000000_2
  365. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  366. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  367. 2016-11-28 14:52:45,070 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
  368. 2016-11-28 14:52:45,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_1 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  369. 2016-11-28 14:52:45,075 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_1:
  370. 2016-11-28 14:52:45,076 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  371. 2016-11-28 14:52:45,076 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  372. 2016-11-28 14:52:45,078 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_COMPLETED for container container_1480364897609_0003_01_000003 taskAttempt attempt_1480364897609_0003_m_000000_1
  373. 2016-11-28 14:52:45,080 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000004 taskAttempt attempt_1480364897609_0003_m_000000_2
  374. 2016-11-28 14:52:45,080 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_2
  375. 2016-11-28 14:52:45,080 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  376. 2016-11-28 14:52:45,101 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_2 : 13562
  377. 2016-11-28 14:52:45,101 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_2] using containerId: [container_1480364897609_0003_01_000004 on NM: [quickstart.cloudera:34820]
  378. 2016-11-28 14:52:45,102 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from ASSIGNED to RUNNING
  379. 2016-11-28 14:52:45,102 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  380. 2016-11-28 14:52:46,083 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  381. 2016-11-28 14:52:50,637 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  382. 2016-11-28 14:52:50,657 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000004 asked for a task
  383. 2016-11-28 14:52:50,658 INFO [IPC Server handler 0 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000004 given task: attempt_1480364897609_0003_m_000000_2
  384. 2016-11-28 14:52:55,710 INFO [IPC Server handler 1 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_2 is : 0.0
  385. 2016-11-28 14:52:55,713 FATAL [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_2 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  386. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  387. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  388. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  389. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  390. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  391. at java.security.AccessController.doPrivileged(Native Method)
  392. at javax.security.auth.Subject.doAs(Subject.java:415)
  393. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  394. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  395. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  396. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  397. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  398. ... 8 more
  399. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  400. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  401. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  402. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  403. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  404. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  405. ... 9 more
  406. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  407. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  408. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  409. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  410. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  411. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  412. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  413. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  414. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  415. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  416. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  417. ... 12 more
  418.  
  419. 2016-11-28 14:52:55,713 INFO [IPC Server handler 2 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_2: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  420. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  421. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  422. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  423. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  424. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  425. at java.security.AccessController.doPrivileged(Native Method)
  426. at javax.security.auth.Subject.doAs(Subject.java:415)
  427. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  428. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  429. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  430. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  431. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  432. ... 8 more
  433. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  434. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  435. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  436. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  437. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  438. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  439. ... 9 more
  440. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  441. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  442. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  443. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  444. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  445. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  446. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  447. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  448. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  449. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  450. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  451. ... 12 more
  452.  
  453. 2016-11-28 14:52:55,716 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_2: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  454. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  455. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  456. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  457. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  458. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  459. at java.security.AccessController.doPrivileged(Native Method)
  460. at javax.security.auth.Subject.doAs(Subject.java:415)
  461. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  462. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  463. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  464. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  465. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  466. ... 8 more
  467. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  468. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  469. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  470. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  471. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  472. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  473. ... 9 more
  474. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  475. at [Source: java.io.StringReader@3ff1a5d3; line: 1, column: 2]
  476. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  477. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  478. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  479. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  480. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  481. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  482. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  483. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  484. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  485. ... 12 more
  486.  
  487. 2016-11-28 14:52:55,717 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  488. 2016-11-28 14:52:55,723 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 3 failures on node quickstart.cloudera
  489. 2016-11-28 14:52:55,724 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Blacklisted host quickstart.cloudera
  490. 2016-11-28 14:52:55,726 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from NEW to UNASSIGNED
  491. 2016-11-28 14:52:55,726 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1480364897609_0003_m_000000_3 to list of failed maps
  492. 2016-11-28 14:52:56,115 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
  493. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:0, vCores:0> knownNMs=1
  494. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Update the blacklist for application_1480364897609_0003: blacklistAdditions=1 blacklistRemovals=0
  495. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Ignore blacklisting set to true. Known: 1, Blacklisted: 1, 100%
  496. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:0, vCores:0>
  497. 2016-11-28 14:52:56,119 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  498. 2016-11-28 14:52:57,123 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Update the blacklist for application_1480364897609_0003: blacklistAdditions=0 blacklistRemovals=1
  499. 2016-11-28 14:52:57,123 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1480364897609_0003_01_000004
  500. 2016-11-28 14:52:57,124 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_2 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  501. 2016-11-28 14:52:57,124 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_2:
  502. 2016-11-28 14:52:57,124 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:6144, vCores:7>
  503. 2016-11-28 14:52:57,124 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  504. 2016-11-28 14:52:57,124 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
  505. 2016-11-28 14:52:57,126 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_COMPLETED for container container_1480364897609_0003_01_000004 taskAttempt attempt_1480364897609_0003_m_000000_2
  506. 2016-11-28 14:52:58,128 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
  507. 2016-11-28 14:52:58,129 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1480364897609_0003_01_000005, NodeId: quickstart.cloudera:34820, NodeHttpAddress: quickstart.cloudera:8042, Resource: <memory:1024, vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service: 10.0.2.15:34820 }, ] to fast fail map
  508. 2016-11-28 14:52:58,129 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps
  509. 2016-11-28 14:52:58,130 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
  510. 2016-11-28 14:52:58,131 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
  511. 2016-11-28 14:52:58,131 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1480364897609_0003_01_000005 to attempt_1480364897609_0003_m_000000_3
  512. 2016-11-28 14:52:58,132 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:5120, vCores:6>
  513. 2016-11-28 14:52:58,132 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
  514. 2016-11-28 14:52:58,132 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0
  515. 2016-11-28 14:52:58,134 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1480364897609_0003_01_000005 taskAttempt attempt_1480364897609_0003_m_000000_3
  516. 2016-11-28 14:52:58,134 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1480364897609_0003_m_000000_3
  517. 2016-11-28 14:52:58,134 INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  518. 2016-11-28 14:52:58,174 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1480364897609_0003_m_000000_3 : 13562
  519. 2016-11-28 14:52:58,175 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1480364897609_0003_m_000000_3] using containerId: [container_1480364897609_0003_01_000005 on NM: [quickstart.cloudera:34820]
  520. 2016-11-28 14:52:58,175 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from ASSIGNED to RUNNING
  521. 2016-11-28 14:52:58,175 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1480364897609_0003_m_000000
  522. 2016-11-28 14:52:59,137 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1480364897609_0003: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:5120, vCores:6> knownNMs=1
  523. 2016-11-28 14:53:05,049 INFO [Socket Reader #1 for port 41585] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1480364897609_0003 (auth:SIMPLE)
  524. 2016-11-28 14:53:05,094 INFO [IPC Server handler 12 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1480364897609_0003_m_000005 asked for a task
  525. 2016-11-28 14:53:05,094 INFO [IPC Server handler 12 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1480364897609_0003_m_000005 given task: attempt_1480364897609_0003_m_000000_3
  526. 2016-11-28 14:53:12,570 INFO [IPC Server handler 13 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1480364897609_0003_m_000000_3 is : 0.0
  527. 2016-11-28 14:53:12,576 FATAL [IPC Server handler 3 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1480364897609_0003_m_000000_3 - exited : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  528. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  529. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  530. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  531. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  532. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  533. at java.security.AccessController.doPrivileged(Native Method)
  534. at javax.security.auth.Subject.doAs(Subject.java:415)
  535. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  536. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  537. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  538. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  539. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  540. ... 8 more
  541. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  542. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  543. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  544. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  545. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  546. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  547. ... 9 more
  548. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  549. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  550. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  551. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  552. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  553. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  554. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  555. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  556. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  557. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  558. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  559. ... 12 more
  560.  
  561. 2016-11-28 14:53:12,576 INFO [IPC Server handler 3 on 41585] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_3: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  562. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  563. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  564. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  565. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  566. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  567. at java.security.AccessController.doPrivileged(Native Method)
  568. at javax.security.auth.Subject.doAs(Subject.java:415)
  569. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  570. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  571. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  572. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  573. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  574. ... 8 more
  575. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  576. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  577. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  578. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  579. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  580. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  581. ... 9 more
  582. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  583. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  584. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  585. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  586. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  587. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  588. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  589. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  590. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  591. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  592. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  593. ... 12 more
  594.  
  595. 2016-11-28 14:53:12,577 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1480364897609_0003_m_000000_3: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  596. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
  597. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
  598. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
  599. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  600. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  601. at java.security.AccessController.doPrivileged(Native Method)
  602. at javax.security.auth.Subject.doAs(Subject.java:415)
  603. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  604. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  605. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable Objavro.schema�
  606. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:505)
  607. at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:170)
  608. ... 8 more
  609. Caused by: org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  610. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  611. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:128)
  612. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:136)
  613. at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$200(MapOperator.java:100)
  614. at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:496)
  615. ... 9 more
  616. Caused by: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
  617. at [Source: java.io.StringReader@7aee0989; line: 1, column: 2]
  618. at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
  619. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
  620. at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
  621. at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:630)
  622. at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:364)
  623. at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2439)
  624. at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2396)
  625. at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602)
  626. at com.cloudera.hive.serde.JSONSerDe.deserialize(JSONSerDe.java:126)
  627. ... 12 more
  628.  
  629. 2016-11-28 14:53:12,584 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from RUNNING to FAIL_FINISHING_CONTAINER
  630. 2016-11-28 14:53:12,623 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_m_000000 Task Transitioned from RUNNING to FAILED
  631. 2016-11-28 14:53:12,629 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
  632. 2016-11-28 14:53:12,630 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as tasks failed. failedMaps:1 failedReduces:0
  633. 2016-11-28 14:53:12,638 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from RUNNING to FAIL_WAIT
  634. 2016-11-28 14:53:12,639 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_r_000000 Task Transitioned from SCHEDULED to KILL_WAIT
  635. 2016-11-28 14:53:12,659 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_r_000000_0 TaskAttempt Transitioned from UNASSIGNED to KILLED
  636. 2016-11-28 14:53:12,659 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1480364897609_0003_r_000000 Task Transitioned from KILL_WAIT to KILLED
  637. 2016-11-28 14:53:12,660 INFO [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Processing the event EventType: CONTAINER_DEALLOCATE
  638. 2016-11-28 14:53:12,661 ERROR [Thread-53] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Could not deallocate container for task attemptId attempt_1480364897609_0003_r_000000_0
  639. 2016-11-28 14:53:12,664 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from FAIL_WAIT to FAIL_ABORT
  640. 2016-11-28 14:53:12,664 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT
  641. 2016-11-28 14:53:12,671 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1480364897609_0003Job Transitioned from FAIL_ABORT to FAILED
  642. 2016-11-28 14:53:12,676 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
  643. 2016-11-28 14:53:12,676 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
  644. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true
  645. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
  646. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
  647. 2016-11-28 14:53:12,677 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
  648. 2016-11-28 14:53:12,692 INFO [Thread-71] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
  649. 2016-11-28 14:53:12,765 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003_1.jhist to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist_tmp
  650. 2016-11-28 14:53:12,852 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist_tmp
  651. 2016-11-28 14:53:12,855 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003/job_1480364897609_0003_1_conf.xml to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml_tmp
  652. 2016-11-28 14:53:12,913 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml_tmp
  653. 2016-11-28 14:53:12,930 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003.summary_tmp to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003.summary
  654. 2016-11-28 14:53:12,948 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml_tmp to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003_conf.xml
  655. 2016-11-28 14:53:12,982 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist_tmp to hdfs://quickstart.cloudera:8020/tmp/hadoop-yarn/staging/history/done_intermediate/cloudera/job_1480364897609_0003-1480373507142-cloudera-SELECT+count%28*%29+FROM+tweets%28Stage%2D1%29-1480373592630-0-0-FAILED-root.cloudera-1480373525979.jhist
  656. 2016-11-28 14:53:12,985 INFO [Thread-71] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
  657. 2016-11-28 14:53:12,985 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1480364897609_0003_m_000000_3
  658. 2016-11-28 14:53:12,985 INFO [Thread-71] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : quickstart.cloudera:34820
  659. 2016-11-28 14:53:13,046 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1480364897609_0003_m_000000_3 TaskAttempt Transitioned from FAIL_FINISHING_CONTAINER to FAILED
  660. 2016-11-28 14:53:13,053 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to Task failed task_1480364897609_0003_m_000000
  661. Job failed as tasks failed. failedMaps:1 failedReduces:0
  662.  
  663. 2016-11-28 14:53:13,091 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is http://quickstart.cloudera:19888/jobhistory/job/job_1480364897609_0003
  664. 2016-11-28 14:53:13,142 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for application to be successfully unregistered.
  665. 2016-11-28 14:53:14,146 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0
  666. 2016-11-28 14:53:14,147 INFO [Thread-71] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://quickstart.cloudera:8020 /tmp/hadoop-yarn/staging/cloudera/.staging/job_1480364897609_0003
  667. 2016-11-28 14:53:14,163 INFO [Thread-71] org.apache.hadoop.ipc.Server: Stopping server on 41585
  668. 2016-11-28 14:53:14,168 INFO [IPC Server listener on 41585] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 41585
  669. 2016-11-28 14:53:14,169 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
  670. 2016-11-28 14:53:14,170 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted
  671. 2016-11-28 14:53:14,176 INFO [Ping Checker] org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: TaskAttemptFinishingMonitor thread interrupted
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!