API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jul 27th, 2011
170
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 29.13 KB | None | 0 0
raw download clone embed print report
  1. Look at job job_201107211831_0013 for an example of an unsuccessful run:
  2.  
  3. -----------
  4.  
  5. $cat /usr/local/dp/logs/hadoop/hadoop_jobtracker.log (only posting the relevant portions for job_201107211831_0013)
  6.  
  7. ...
  8. 2011-07-27 15:04:12,954 INFO org.apache.hadoop.mapreduce.jobhistory.JobHistory: Moving file:/usr/local/dp/logs/hadoop/history/job_201107211831_0012_conf.xml to file:/usr/local/dp/logs/hadoop/history/done/job_201107211831_0012_conf.xml
  9. 2011-07-27 15:04:12,959 INFO org.apache.hadoop.mapred.JobInProgress: Deleting localized job conf at /usr/local/dp/logs/hadoop/job_201107211831_0012_conf.xml
  10. 2011-07-27 15:04:12,959 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0012_m_000005_0'
  11. 2011-07-27 15:04:12,959 INFO org.apache.hadoop.mapred.JobTracker: Retired job with id: 'job_201107211831_0012' of user 'root'
  12. 2011-07-27 15:04:49,026 INFO org.apache.hadoop.mapred.JobTracker: Job job_201107211831_0013 added successfully for user 'root' to queue 'default'
  13. 2011-07-27 15:04:49,026 INFO org.apache.hadoop.mapred.JobTracker: Initializing job_201107211831_0013
  14. 2011-07-27 15:04:49,027 INFO org.apache.hadoop.mapred.JobInProgress: Initializing job_201107211831_0013
  15. 2011-07-27 15:04:49,033 INFO org.apache.hadoop.mapreduce.jobhistory.JobHistory: SetupWriter, creating file file:/usr/local/dp/logs/hadoop/history/job_201107211831_0013_root
  16. 2011-07-27 15:04:49,037 INFO org.apache.hadoop.mapreduce.jobhistory.JobHistory: LogDirConfPath is file:/usr/local/dp/logs/hadoop/history/job_201107211831_0013_conf.xml
  17. 2011-07-27 15:04:49,070 INFO org.apache.hadoop.mapred.JobInProgress: jobToken generated and stored with users keys in /mapred/system/job_201107211831_0013/jobToken
  18. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: Input size for job job_201107211831_0013 = 156. Number of splits = 4
  19. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000000 has split on node:/default-rack/xx.xx.xx.10
  20. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000000 has split on node:/default-rack/10.26.181.11
  21. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000000 has split on node:/default-rack/xx.xx.xx.13
  22. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000001 has split on node:/default-rack/xx.xx.xx.10
  23. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000001 has split on node:/default-rack/xx.xx.xx.12
  24. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000001 has split on node:/default-rack/xx.xx.xx.13
  25. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000002 has split on node:/default-rack/xx.xx.xx.10
  26. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000002 has split on node:/default-rack/xx.xx.xx.12
  27. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000002 has split on node:/default-rack/xx.xx.xx.13
  28. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000003 has split on node:/default-rack/xx.xx.xx.10
  29. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000003 has split on node:/default-rack/xx.xx.xx.11
  30. 2011-07-27 15:04:49,074 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201107211831_0013_m_000003 has split on node:/default-rack/xx.xx.xx.13
  31. 2011-07-27 15:04:49,075 INFO org.apache.hadoop.mapred.JobInProgress: Job job_201107211831_0013 initialized successfully with 4 map tasks and 1 reduce tasks.
  32. 2011-07-27 15:04:49,120 INFO org.apache.hadoop.mapred.JobTracker: Adding task (JOB_SETUP) 'attempt_201107211831_0013_m_000005_0' to tip task_201107211831_0013_m_000005, for tracker 'tracker_xx.xx.xx.10:localhost/127.0.0.1:36694'
  33. 2011-07-27 15:04:52,123 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201107211831_0013_m_000005_0' has completed task_201107211831_0013_m_000005 successfully.
  34. 2011-07-27 15:04:52,126 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000000_0' to tip task_201107211831_0013_m_000000, for tracker 'tracker_xx.xx.xx.10:localhost/127.0.0.1:36694'
  35. 2011-07-27 15:04:52,126 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000000
  36. 2011-07-27 15:04:52,440 INFO org.apache.hadoop.mapred.JobTracker: attempt_201107211831_0013_m_000000_0 is 314 ms debug.
  37. 2011-07-27 15:04:54,022 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000003_0' to tip task_201107211831_0013_m_000003, for tracker 'tracker_xx.xx.xx.11:localhost/127.0.0.1:43761'
  38. 2011-07-27 15:04:54,023 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000003
  39. 2011-07-27 15:04:54,213 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000001_0' to tip task_201107211831_0013_m_000001, for tracker 'tracker_xx.xx.xx.12:localhost/127.0.0.1:44115'
  40. 2011-07-27 15:04:54,213 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000001
  41. 2011-07-27 15:04:54,483 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000002_0' to tip task_201107211831_0013_m_000002, for tracker 'tracker_xx.xx.xx.13:localhost/127.0.0.1:37879'
  42. 2011-07-27 15:04:54,484 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000002
  43. 2011-07-27 15:04:55,129 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000000_0 on tracker_xx.xx.xx.10:localhost/127.0.0.1:36694: java.io.IOException: pipe child exception
  44. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  45. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  46. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  47. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  48. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  49. at java.security.AccessController.doPrivileged(Native Method)
  50. at javax.security.auth.Subject.doAs(Subject.java:396)
  51. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  52. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  53. Caused by: java.lang.NullPointerException
  54. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  55. ... 7 more
  56.  
  57. 2011-07-27 15:04:57,026 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000003_0 on tracker_xx.xx.xx.11:localhost/127.0.0.1:43761: java.io.IOException: pipe child exception
  58. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  59. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  60. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  61. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  62. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  63. at java.security.AccessController.doPrivileged(Native Method)
  64. at javax.security.auth.Subject.doAs(Subject.java:396)
  65. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  66. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  67. Caused by: java.lang.NullPointerException
  68. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  69. ... 7 more
  70.  
  71. 2011-07-27 15:04:57,216 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000001_0 on tracker_xx.xx.xx.12:localhost/127.0.0.1:44115: java.io.IOException: pipe child exception
  72. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  73. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  74. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  75. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  76. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  77. at java.security.AccessController.doPrivileged(Native Method)
  78. at javax.security.auth.Subject.doAs(Subject.java:396)
  79. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  80. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  81. Caused by: java.lang.NullPointerException
  82. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  83. ... 7 more
  84.  
  85. 2011-07-27 15:04:57,487 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000002_0 on tracker_xx.xx.xx.13:localhost/127.0.0.1:37879: java.io.IOException: pipe child exception
  86. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  87. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  88. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  89. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  90. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  91. at java.security.AccessController.doPrivileged(Native Method)
  92. at javax.security.auth.Subject.doAs(Subject.java:396)
  93. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  94. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  95. Caused by: java.lang.NullPointerException
  96. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  97. ... 7 more
  98.  
  99. 2011-07-27 15:05:01,134 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000000_0'
  100. 2011-07-27 15:05:03,033 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000000_1' to tip task_201107211831_0013_m_000000, for tracker 'tracker_xx.xx.xx.11:localhost/127.0.0.1:43761'
  101. 2011-07-27 15:05:03,033 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000000
  102. 2011-07-27 15:05:03,033 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000003_0'
  103. 2011-07-27 15:05:03,222 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000003_1' to tip task_201107211831_0013_m_000003, for tracker 'tracker_xx.xx.xx.12:localhost/127.0.0.1:44115'
  104. 2011-07-27 15:05:03,222 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201107211831_0013_m_000003
  105. 2011-07-27 15:05:03,222 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000001_0'
  106. 2011-07-27 15:05:03,494 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000001_1' to tip task_201107211831_0013_m_000001, for tracker 'tracker_xx.xx.xx.13:localhost/127.0.0.1:37879'
  107. 2011-07-27 15:05:03,494 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000001
  108. 2011-07-27 15:05:03,494 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000002_0'
  109. 2011-07-27 15:05:04,138 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000002_1' to tip task_201107211831_0013_m_000002, for tracker 'tracker_xx.xx.xx.10:localhost/127.0.0.1:36694'
  110. 2011-07-27 15:05:04,138 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000002
  111. 2011-07-27 15:05:06,037 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000000_1 on tracker_xx.xx.xx.11:localhost/127.0.0.1:43761: java.io.IOException: pipe child exception
  112. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  113. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  114. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  115. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  116. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  117. at java.security.AccessController.doPrivileged(Native Method)
  118. at javax.security.auth.Subject.doAs(Subject.java:396)
  119. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  120. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  121. Caused by: java.lang.NullPointerException
  122. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  123. ... 7 more
  124.  
  125. 2011-07-27 15:05:06,226 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000003_1 on tracker_xx.xx.xx.12:localhost/127.0.0.1:44115: java.io.IOException: pipe child exception
  126. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  127. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  128. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  129. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  130. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  131. at java.security.AccessController.doPrivileged(Native Method)
  132. at javax.security.auth.Subject.doAs(Subject.java:396)
  133. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  134. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  135. Caused by: java.lang.NullPointerException
  136. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  137. ... 7 more
  138.  
  139. 2011-07-27 15:05:06,498 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000001_1 on tracker_xx.xx.xx.13:localhost/127.0.0.1:37879: java.io.IOException: pipe child exception
  140. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  141. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  142. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  143. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  144. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  145. at java.security.AccessController.doPrivileged(Native Method)
  146. at javax.security.auth.Subject.doAs(Subject.java:396)
  147. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  148. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  149. Caused by: java.lang.NullPointerException
  150. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  151. ... 7 more
  152.  
  153. 2011-07-27 15:05:07,140 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000002_1 on tracker_xx.xx.xx.10:localhost/127.0.0.1:36694: java.io.IOException: pipe child exception
  154. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  155. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  156. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  157. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  158. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  159. at java.security.AccessController.doPrivileged(Native Method)
  160. at javax.security.auth.Subject.doAs(Subject.java:396)
  161. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  162. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  163. Caused by: java.lang.NullPointerException
  164. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  165. ... 7 more
  166.  
  167. 2011-07-27 15:05:12,043 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000000_1'
  168. 2011-07-27 15:05:12,231 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000000_2' to tip task_201107211831_0013_m_000000, for tracker 'tracker_xx.xx.xx.12:localhost/127.0.0.1:44115'
  169. 2011-07-27 15:05:12,232 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201107211831_0013_m_000000
  170. 2011-07-27 15:05:12,232 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000003_1'
  171. 2011-07-27 15:05:12,503 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000003_2' to tip task_201107211831_0013_m_000003, for tracker 'tracker_xx.xx.xx.13:localhost/127.0.0.1:37879'
  172. 2011-07-27 15:05:12,503 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000003
  173. 2011-07-27 15:05:12,504 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000001_1'
  174. 2011-07-27 15:05:13,146 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000001_2' to tip task_201107211831_0013_m_000001, for tracker 'tracker_xx.xx.xx.10:localhost/127.0.0.1:36694'
  175. 2011-07-27 15:05:13,146 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000001
  176. 2011-07-27 15:05:13,146 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000002_1'
  177. 2011-07-27 15:05:15,046 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000002_2' to tip task_201107211831_0013_m_000002, for tracker 'tracker_xx.xx.xx.11:localhost/127.0.0.1:43761'
  178. 2011-07-27 15:05:15,046 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201107211831_0013_m_000002
  179. 2011-07-27 15:05:15,235 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000000_2 on tracker_xx.xx.xx.12:localhost/127.0.0.1:44115: java.io.IOException: pipe child exception
  180. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  181. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  182. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  183. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  184. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  185. at java.security.AccessController.doPrivileged(Native Method)
  186. at javax.security.auth.Subject.doAs(Subject.java:396)
  187. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  188. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  189. Caused by: java.lang.NullPointerException
  190. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  191. ... 7 more
  192.  
  193. 2011-07-27 15:05:15,507 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000003_2 on tracker_xx.xx.xx.13:localhost/127.0.0.1:37879: java.io.IOException: pipe child exception
  194. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  195. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  196. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  197. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  198. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  199. at java.security.AccessController.doPrivileged(Native Method)
  200. at javax.security.auth.Subject.doAs(Subject.java:396)
  201. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  202. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  203. Caused by: java.lang.NullPointerException
  204. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  205. ... 7 more
  206.  
  207. 2011-07-27 15:05:16,150 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000001_2 on tracker_xx.xx.xx.10:localhost/127.0.0.1:36694: java.io.IOException: pipe child exception
  208. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  209. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  210. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  211. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  212. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  213. at java.security.AccessController.doPrivileged(Native Method)
  214. at javax.security.auth.Subject.doAs(Subject.java:396)
  215. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  216. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  217. Caused by: java.lang.NullPointerException
  218. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  219. ... 7 more
  220.  
  221. 2011-07-27 15:05:18,050 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000002_2 on tracker_xx.xx.xx.11:localhost/127.0.0.1:43761: java.io.IOException: pipe child exception
  222. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  223. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  224. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  225. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  226. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  227. at java.security.AccessController.doPrivileged(Native Method)
  228. at javax.security.auth.Subject.doAs(Subject.java:396)
  229. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  230. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  231. Caused by: java.lang.NullPointerException
  232. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  233. ... 7 more
  234.  
  235. 2011-07-27 15:05:21,242 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000000_2'
  236. 2011-07-27 15:05:21,514 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000000_3' to tip task_201107211831_0013_m_000000, for tracker 'tracker_xx.xx.xx.13:localhost/127.0.0.1:37879'
  237. 2011-07-27 15:05:21,514 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000000
  238. 2011-07-27 15:05:21,514 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000003_2'
  239. 2011-07-27 15:05:22,155 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000003_3' to tip task_201107211831_0013_m_000003, for tracker 'tracker_xx.xx.xx.10:localhost/127.0.0.1:36694'
  240. 2011-07-27 15:05:22,155 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000003
  241. 2011-07-27 15:05:22,156 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000001_2'
  242. 2011-07-27 15:05:24,056 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000001_3' to tip task_201107211831_0013_m_000001, for tracker 'tracker_xx.xx.xx.11:localhost/127.0.0.1:43761'
  243. 2011-07-27 15:05:24,056 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201107211831_0013_m_000001
  244. 2011-07-27 15:05:24,056 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000002_2'
  245. 2011-07-27 15:05:24,244 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201107211831_0013_m_000002_3' to tip task_201107211831_0013_m_000002, for tracker 'tracker_xx.xx.xx.12:localhost/127.0.0.1:44115'
  246. 2011-07-27 15:05:24,244 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201107211831_0013_m_000002
  247. 2011-07-27 15:05:24,516 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000000_3 on tracker_xx.xx.xx.13:localhost/127.0.0.1:37879: java.io.IOException: pipe child exception
  248. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  249. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  250. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  251. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  252. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  253. at java.security.AccessController.doPrivileged(Native Method)
  254. at javax.security.auth.Subject.doAs(Subject.java:396)
  255. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  256. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  257. Caused by: java.lang.NullPointerException
  258. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  259. ... 7 more
  260.  
  261. 2011-07-27 15:05:25,159 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000003_3 on tracker_xx.xx.xx.10:localhost/127.0.0.1:36694: java.io.IOException: pipe child exception
  262. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  263. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  264. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  265. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  266. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  267. at java.security.AccessController.doPrivileged(Native Method)
  268. at javax.security.auth.Subject.doAs(Subject.java:396)
  269. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  270. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  271. Caused by: java.lang.NullPointerException
  272. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  273. ... 7 more
  274.  
  275. 2011-07-27 15:05:27,060 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000001_3 on tracker_xx.xx.xx.11:localhost/127.0.0.1:43761: java.io.IOException: pipe child exception
  276. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  277. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  278. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  279. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  280. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  281. at java.security.AccessController.doPrivileged(Native Method)
  282. at javax.security.auth.Subject.doAs(Subject.java:396)
  283. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  284. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  285. Caused by: java.lang.NullPointerException
  286. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  287. ... 7 more
  288.  
  289. 2011-07-27 15:05:27,248 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201107211831_0013_m_000002_3 on tracker_xx.xx.xx.12:localhost/127.0.0.1:44115: java.io.IOException: pipe child exception
  290. at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
  291. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
  292. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
  293. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  294. at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
  295. at java.security.AccessController.doPrivileged(Native Method)
  296. at javax.security.auth.Subject.doAs(Subject.java:396)
  297. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
  298. at org.apache.hadoop.mapred.Child.main(Child.java:211)
  299. Caused by: java.lang.NullPointerException
  300. at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
  301. ... 7 more
  302.  
  303. 2011-07-27 15:05:30,523 INFO org.apache.hadoop.mapred.TaskInProgress: TaskInProgress task_201107211831_0013_m_000000 has failed 4 times.
  304. 2011-07-27 15:05:30,523 INFO org.apache.hadoop.mapred.JobInProgress: TaskTracker at 'xx.xx.xx.13' turned 'flaky'
  305. 2011-07-27 15:05:30,524 INFO org.apache.hadoop.mapred.JobInProgress: Aborting job job_201107211831_0013
  306. 2011-07-27 15:05:30,524 INFO org.apache.hadoop.mapred.JobInProgress: Killing job 'job_201107211831_0013'
  307. 2011-07-27 15:05:30,524 INFO org.apache.hadoop.mapred.JobTracker: Adding task (JOB_CLEANUP) 'attempt_201107211831_0013_m_000004_0' to tip task_201107211831_0013_m_000004, for tracker 'tracker_xx.xx.xx.13:localhost/127.0.0.1:37879'
  308. 2011-07-27 15:05:30,524 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000000_3'
  309. 2011-07-27 15:05:31,163 INFO org.apache.hadoop.mapred.TaskInProgress: TaskInProgress task_201107211831_0013_m_000003 has failed 4 times.
  310. 2011-07-27 15:05:31,164 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000003_3'
  311. 2011-07-27 15:05:33,065 INFO org.apache.hadoop.mapred.TaskInProgress: TaskInProgress task_201107211831_0013_m_000001 has failed 4 times.
  312. 2011-07-27 15:05:33,066 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000001_3'
  313. 2011-07-27 15:05:33,254 INFO org.apache.hadoop.mapred.TaskInProgress: TaskInProgress task_201107211831_0013_m_000002 has failed 4 times.
  314. 2011-07-27 15:05:33,254 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000002_3'
  315. 2011-07-27 15:05:33,529 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201107211831_0013_m_000004_0' has completed task_201107211831_0013_m_000004 successfully.
  316. 2011-07-27 15:05:33,529 INFO org.apache.hadoop.mapred.JobInProgress$JobSummary: jobId=job_201107211831_0013,submitTime=1311779088967,launchTime=1311779089074,finishTime=1311779133529,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=root,queue=default,status=FAILED,mapSlotSeconds=141,reduceSlotsSeconds=0,clusterMapCapacity=32,clusterReduceCapacity=32
  317. 2011-07-27 15:05:33,552 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000004_0'
  318. 2011-07-27 15:05:33,552 INFO org.apache.hadoop.mapreduce.jobhistory.JobHistory: Moving file:/usr/local/dp/logs/hadoop/history/job_201107211831_0013_root to file:/usr/local/dp/logs/hadoop/history/done/job_201107211831_0013_root
  319. 2011-07-27 15:05:33,557 INFO org.apache.hadoop.mapreduce.jobhistory.JobHistory: Moving file:/usr/local/dp/logs/hadoop/history/job_201107211831_0013_conf.xml to file:/usr/local/dp/logs/hadoop/history/done/job_201107211831_0013_conf.xml
  320. 2011-07-27 15:05:33,563 INFO org.apache.hadoop.mapred.JobInProgress: Deleting localized job conf at /usr/local/dp/logs/hadoop/job_201107211831_0013_conf.xml
  321. 2011-07-27 15:05:33,563 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201107211831_0013_m_000005_0'
  322. 2011-07-27 15:05:33,563 INFO org.apache.hadoop.mapred.JobTracker: Retired job with id: 'job_201107211831_0013' of user 'root'
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!