API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Mar 24th, 2019
98
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 61.75 KB | None | 0 0
raw download clone embed print report
  1. Running with gitlab-runner 11.9.0 (692ae235)
  2. on bigdata 81bbd4d3
  3. Using Shell executor...
  4. Running on gitlab.atp-fivt.org...
  5. DEPRECATION: this GitLab server doesn't support refspecs, gitlab-runner 12.0 will no longer work with this version of GitLab
  6. Fetching changes...
  7. Clean repository
  8. Checking out 599735cf as hobmrtask1...
  9. Skipping Git submodules setup
  10. $ if [ `grep -v '#' run.sh | wc -l` -gt 0 ]; then (cd ~/code; ./gitlab_ci_runner.py); else exit 1; fi
  11. Job submitted: 5c97543c43000029b0366e6b
  12. Job 5c97543c43000029b0366e6b state: RUNNING
  13. Job 5c97543c43000029b0366e6b state: DONE
  14. +++++++ LOGS OF TESTING +++++++
  15. hjudge.conf found outside of conf directory.
  16. Please, move it to /etc/hjudge/
  17.  
  18. ===== Testing (num. 125): STARTING =====
  19. Testing (num. 125): test HOB125_3 failed!
  20. HOB125_3 description: Not documented yet.
  21. Testing (num. 125): test HOB125_4 failed!
  22. HOB125_4 description: Not documented yet.
  23. Testing (num. 125): test HOB125_7 failed!
  24. HOB125_7 description: Only top-2 threads have more than 10 occurrences
  25. Testing (num. 125): test MRB17 failed!
  26. MRB17 description: Your output is empty. Maybe your code contains some errors.
  27. Please, check that you haven't got errors in the logs and try to view the Application Master or Spark History UI.
  28. Testing (num. 125): test SP7_10 failed!
  29. SP7_10 description: Check that resulting output has exactly 10 records.
  30. Hint: try to redirect all extra output from jobs to /dev/null because
  31. it may contain the output from the framework
  32.  
  33. ===== Testing (num. 125): SUMMARY =====
  34. Tests passed: hob125_1 hob125_2 hob125_6 hob125_5 hob125_8 res0_1 res1 res1_5
  35. Tests failed: hob125_3 hob125_4 hob125_7 mrb17 sp7_10
  36. ==================================================
  37. Duration: 8.0 sec
  38. VCoreSeconds: 57 sec
  39. +++++++ LOGS OF THE TASK +++++++
  40. === Task's top output ===
  41. === Task's logs ===
  42. 19/03/24 09:56:26 INFO client.RMProxy: Connecting to ResourceManager at cloudtest-master/192.168.0.6:8032
  43. 19/03/24 09:56:26 INFO client.RMProxy: Connecting to ResourceManager at cloudtest-master/192.168.0.6:8032
  44. 19/03/24 09:56:26 INFO mapred.FileInputFormat: Total input paths to process : 42
  45. 19/03/24 09:56:27 INFO mapreduce.JobSubmitter: number of splits:42
  46. 19/03/24 09:56:27 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1552861958636_0316
  47. 19/03/24 09:56:27 INFO impl.YarnClientImpl: Submitted application application_1552861958636_0316
  48. 19/03/24 09:56:27 INFO mapreduce.Job: The url to track the job: http://cloudtest-master:8088/proxy/application_1552861958636_0316/
  49. 19/03/24 09:56:27 INFO mapreduce.Job: Running job: job_1552861958636_0316
  50. 19/03/24 09:56:32 INFO mapreduce.Job: Job job_1552861958636_0316 running in uber mode : false
  51. 19/03/24 09:56:32 INFO mapreduce.Job: map 0% reduce 0%
  52. 19/03/24 09:56:40 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000003_0, Status : FAILED
  53. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  54. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  55. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  56. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  57. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  58. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  59. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  60. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  61. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  62. at java.security.AccessController.doPrivileged(Native Method)
  63. at javax.security.auth.Subject.doAs(Subject.java:422)
  64. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  65. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  66.  
  67. 19/03/24 09:56:40 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000000_0, Status : FAILED
  68. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  69. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  70. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  71. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  72. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  73. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  74. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  75. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  76. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  77. at java.security.AccessController.doPrivileged(Native Method)
  78. at javax.security.auth.Subject.doAs(Subject.java:422)
  79. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  80. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  81.  
  82. 19/03/24 09:56:40 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000001_0, Status : FAILED
  83. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  84. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  85. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  86. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  87. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  88. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  89. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  90. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  91. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  92. at java.security.AccessController.doPrivileged(Native Method)
  93. at javax.security.auth.Subject.doAs(Subject.java:422)
  94. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  95. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  96.  
  97. 19/03/24 09:56:40 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000002_0, Status : FAILED
  98. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  99. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  100. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  101. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  102. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  103. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  104. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  105. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  106. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  107. at java.security.AccessController.doPrivileged(Native Method)
  108. at javax.security.auth.Subject.doAs(Subject.java:422)
  109. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  110. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  111.  
  112. 19/03/24 09:56:41 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000007_0, Status : FAILED
  113. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  114. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  115. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  116. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  117. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  118. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  119. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  120. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  121. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  122. at java.security.AccessController.doPrivileged(Native Method)
  123. at javax.security.auth.Subject.doAs(Subject.java:422)
  124. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  125. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  126.  
  127. 19/03/24 09:56:41 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000008_0, Status : FAILED
  128. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  129. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  130. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  131. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  132. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  133. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  134. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  135. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  136. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  137. at java.security.AccessController.doPrivileged(Native Method)
  138. at javax.security.auth.Subject.doAs(Subject.java:422)
  139. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  140. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  141.  
  142. 19/03/24 09:56:41 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000011_0, Status : FAILED
  143. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  144. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  145. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  146. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  147. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  148. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  149. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  150. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  151. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  152. at java.security.AccessController.doPrivileged(Native Method)
  153. at javax.security.auth.Subject.doAs(Subject.java:422)
  154. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  155. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  156.  
  157. 19/03/24 09:56:41 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000005_0, Status : FAILED
  158. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  159. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  160. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  161. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  162. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  163. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  164. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  165. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  166. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  167. at java.security.AccessController.doPrivileged(Native Method)
  168. at javax.security.auth.Subject.doAs(Subject.java:422)
  169. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  170. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  171.  
  172. 19/03/24 09:56:41 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000010_0, Status : FAILED
  173. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  174. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  175. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  176. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  177. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  178. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  179. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  180. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  181. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  182. at java.security.AccessController.doPrivileged(Native Method)
  183. at javax.security.auth.Subject.doAs(Subject.java:422)
  184. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  185. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  186.  
  187. 19/03/24 09:56:41 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000004_0, Status : FAILED
  188. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  189. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  190. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  191. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  192. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  193. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  194. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  195. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  196. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  197. at java.security.AccessController.doPrivileged(Native Method)
  198. at javax.security.auth.Subject.doAs(Subject.java:422)
  199. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  200. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  201.  
  202. 19/03/24 09:56:42 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000009_0, Status : FAILED
  203. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  204. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  205. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  206. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  207. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  208. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  209. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  210. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  211. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  212. at java.security.AccessController.doPrivileged(Native Method)
  213. at javax.security.auth.Subject.doAs(Subject.java:422)
  214. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  215. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  216.  
  217. 19/03/24 09:56:42 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000006_0, Status : FAILED
  218. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  219. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  220. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  221. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  222. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  223. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  224. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  225. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  226. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  227. at java.security.AccessController.doPrivileged(Native Method)
  228. at javax.security.auth.Subject.doAs(Subject.java:422)
  229. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  230. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  231.  
  232. 19/03/24 09:56:42 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000012_0, Status : FAILED
  233. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  234. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  235. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  236. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  237. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  238. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  239. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  240. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  241. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  242. at java.security.AccessController.doPrivileged(Native Method)
  243. at javax.security.auth.Subject.doAs(Subject.java:422)
  244. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  245. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  246.  
  247. 19/03/24 09:56:42 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000016_0, Status : FAILED
  248. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  249. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  250. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  251. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  252. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  253. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  254. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  255. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  256. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  257. at java.security.AccessController.doPrivileged(Native Method)
  258. at javax.security.auth.Subject.doAs(Subject.java:422)
  259. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  260. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  261.  
  262. 19/03/24 09:56:43 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000018_0, Status : FAILED
  263. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  264. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  265. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  266. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  267. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  268. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  269. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  270. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  271. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  272. at java.security.AccessController.doPrivileged(Native Method)
  273. at javax.security.auth.Subject.doAs(Subject.java:422)
  274. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  275. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  276.  
  277. 19/03/24 09:56:45 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000015_0, Status : FAILED
  278. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  279. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  280. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  281. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  282. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  283. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  284. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  285. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  286. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  287. at java.security.AccessController.doPrivileged(Native Method)
  288. at javax.security.auth.Subject.doAs(Subject.java:422)
  289. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  290. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  291.  
  292. 19/03/24 09:56:45 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000014_0, Status : FAILED
  293. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  294. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  295. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  296. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  297. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  298. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  299. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  300. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  301. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  302. at java.security.AccessController.doPrivileged(Native Method)
  303. at javax.security.auth.Subject.doAs(Subject.java:422)
  304. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  305. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  306.  
  307. 19/03/24 09:56:46 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000013_0, Status : FAILED
  308. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  309. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  310. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  311. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  312. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  313. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  314. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  315. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  316. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  317. at java.security.AccessController.doPrivileged(Native Method)
  318. at javax.security.auth.Subject.doAs(Subject.java:422)
  319. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  320. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  321.  
  322. 19/03/24 09:56:48 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000001_1, Status : FAILED
  323. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  324. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  325. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  326. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  327. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  328. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  329. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  330. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  331. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  332. at java.security.AccessController.doPrivileged(Native Method)
  333. at javax.security.auth.Subject.doAs(Subject.java:422)
  334. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  335. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  336.  
  337. 19/03/24 09:56:48 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000000_1, Status : FAILED
  338. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  339. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  340. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  341. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  342. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  343. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  344. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  345. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  346. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  347. at java.security.AccessController.doPrivileged(Native Method)
  348. at javax.security.auth.Subject.doAs(Subject.java:422)
  349. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  350. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  351.  
  352. 19/03/24 09:56:48 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000003_1, Status : FAILED
  353. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  354. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  355. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  356. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  357. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  358. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  359. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  360. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  361. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  362. at java.security.AccessController.doPrivileged(Native Method)
  363. at javax.security.auth.Subject.doAs(Subject.java:422)
  364. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  365. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  366.  
  367. 19/03/24 09:56:49 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000002_1, Status : FAILED
  368. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  369. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  370. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  371. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  372. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  373. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  374. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  375. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  376. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  377. at java.security.AccessController.doPrivileged(Native Method)
  378. at javax.security.auth.Subject.doAs(Subject.java:422)
  379. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  380. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  381.  
  382. 19/03/24 09:56:49 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000008_1, Status : FAILED
  383. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  384. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  385. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  386. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  387. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  388. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  389. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  390. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  391. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  392. at java.security.AccessController.doPrivileged(Native Method)
  393. at javax.security.auth.Subject.doAs(Subject.java:422)
  394. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  395. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  396.  
  397. 19/03/24 09:56:49 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000005_1, Status : FAILED
  398. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  399. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  400. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  401. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  402. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  403. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  404. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  405. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  406. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  407. at java.security.AccessController.doPrivileged(Native Method)
  408. at javax.security.auth.Subject.doAs(Subject.java:422)
  409. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  410. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  411.  
  412. 19/03/24 09:56:49 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000011_1, Status : FAILED
  413. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  414. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  415. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  416. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  417. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  418. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  419. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  420. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  421. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  422. at java.security.AccessController.doPrivileged(Native Method)
  423. at javax.security.auth.Subject.doAs(Subject.java:422)
  424. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  425. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  426.  
  427. 19/03/24 09:56:49 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000020_0, Status : FAILED
  428. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  429. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  430. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  431. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  432. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  433. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  434. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  435. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  436. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  437. at java.security.AccessController.doPrivileged(Native Method)
  438. at javax.security.auth.Subject.doAs(Subject.java:422)
  439. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  440. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  441.  
  442. 19/03/24 09:56:49 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000007_1, Status : FAILED
  443. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  444. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  445. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  446. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  447. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  448. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  449. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  450. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  451. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  452. at java.security.AccessController.doPrivileged(Native Method)
  453. at javax.security.auth.Subject.doAs(Subject.java:422)
  454. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  455. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  456.  
  457. 19/03/24 09:56:50 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000004_1, Status : FAILED
  458. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  459. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  460. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  461. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  462. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  463. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  464. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  465. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  466. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  467. at java.security.AccessController.doPrivileged(Native Method)
  468. at javax.security.auth.Subject.doAs(Subject.java:422)
  469. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  470. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  471.  
  472. 19/03/24 09:56:50 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000009_1, Status : FAILED
  473. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  474. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  475. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  476. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  477. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  478. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  479. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  480. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  481. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  482. at java.security.AccessController.doPrivileged(Native Method)
  483. at javax.security.auth.Subject.doAs(Subject.java:422)
  484. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  485. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  486.  
  487. 19/03/24 09:56:50 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000010_1, Status : FAILED
  488. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  489. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  490. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  491. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  492. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  493. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  494. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  495. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  496. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  497. at java.security.AccessController.doPrivileged(Native Method)
  498. at javax.security.auth.Subject.doAs(Subject.java:422)
  499. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  500. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  501.  
  502. 19/03/24 09:56:52 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000012_1, Status : FAILED
  503. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  504. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  505. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  506. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  507. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  508. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  509. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  510. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  511. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  512. at java.security.AccessController.doPrivileged(Native Method)
  513. at javax.security.auth.Subject.doAs(Subject.java:422)
  514. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  515. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  516.  
  517. 19/03/24 09:56:52 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000006_1, Status : FAILED
  518. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  519. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  520. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  521. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  522. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  523. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  524. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  525. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  526. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  527. at java.security.AccessController.doPrivileged(Native Method)
  528. at javax.security.auth.Subject.doAs(Subject.java:422)
  529. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  530. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  531.  
  532. 19/03/24 09:56:53 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000016_1, Status : FAILED
  533. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  534. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  535. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  536. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  537. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  538. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  539. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  540. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  541. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  542. at java.security.AccessController.doPrivileged(Native Method)
  543. at javax.security.auth.Subject.doAs(Subject.java:422)
  544. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  545. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  546.  
  547. 19/03/24 09:56:55 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000015_1, Status : FAILED
  548. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  549. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  550. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  551. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  552. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  553. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  554. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  555. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  556. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  557. at java.security.AccessController.doPrivileged(Native Method)
  558. at javax.security.auth.Subject.doAs(Subject.java:422)
  559. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  560. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  561.  
  562. 19/03/24 09:56:55 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000014_1, Status : FAILED
  563. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  564. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  565. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  566. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  567. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  568. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  569. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  570. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  571. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  572. at java.security.AccessController.doPrivileged(Native Method)
  573. at javax.security.auth.Subject.doAs(Subject.java:422)
  574. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  575. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  576.  
  577. 19/03/24 09:56:55 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000018_1, Status : FAILED
  578. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  579. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  580. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  581. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  582. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  583. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  584. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  585. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  586. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  587. at java.security.AccessController.doPrivileged(Native Method)
  588. at javax.security.auth.Subject.doAs(Subject.java:422)
  589. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  590. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  591.  
  592. 19/03/24 09:56:56 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000013_1, Status : FAILED
  593. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  594. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  595. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  596. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  597. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  598. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  599. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  600. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  601. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  602. at java.security.AccessController.doPrivileged(Native Method)
  603. at javax.security.auth.Subject.doAs(Subject.java:422)
  604. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  605. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  606.  
  607. 19/03/24 09:56:57 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000008_2, Status : FAILED
  608. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  609. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  610. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  611. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  612. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  613. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  614. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  615. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  616. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  617. at java.security.AccessController.doPrivileged(Native Method)
  618. at javax.security.auth.Subject.doAs(Subject.java:422)
  619. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  620. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  621.  
  622. 19/03/24 09:56:57 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000001_2, Status : FAILED
  623. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  624. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  625. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  626. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  627. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  628. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  629. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  630. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  631. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  632. at java.security.AccessController.doPrivileged(Native Method)
  633. at javax.security.auth.Subject.doAs(Subject.java:422)
  634. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  635. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  636.  
  637. 19/03/24 09:56:57 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000003_2, Status : FAILED
  638. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  639. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  640. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  641. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  642. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  643. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  644. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  645. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  646. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  647. at java.security.AccessController.doPrivileged(Native Method)
  648. at javax.security.auth.Subject.doAs(Subject.java:422)
  649. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  650. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  651.  
  652. 19/03/24 09:56:57 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000002_2, Status : FAILED
  653. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  654. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  655. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  656. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  657. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  658. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  659. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  660. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  661. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  662. at java.security.AccessController.doPrivileged(Native Method)
  663. at javax.security.auth.Subject.doAs(Subject.java:422)
  664. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  665. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  666.  
  667. 19/03/24 09:56:58 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000000_2, Status : FAILED
  668. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  669. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  670. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  671. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  672. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  673. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  674. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  675. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  676. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  677. at java.security.AccessController.doPrivileged(Native Method)
  678. at javax.security.auth.Subject.doAs(Subject.java:422)
  679. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  680. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  681.  
  682. 19/03/24 09:56:59 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000011_2, Status : FAILED
  683. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  684. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  685. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  686. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  687. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  688. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  689. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  690. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  691. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  692. at java.security.AccessController.doPrivileged(Native Method)
  693. at javax.security.auth.Subject.doAs(Subject.java:422)
  694. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  695. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  696.  
  697. 19/03/24 09:56:59 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000005_2, Status : FAILED
  698. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  699. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  700. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  701. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  702. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  703. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  704. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  705. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  706. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  707. at java.security.AccessController.doPrivileged(Native Method)
  708. at javax.security.auth.Subject.doAs(Subject.java:422)
  709. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  710. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  711.  
  712. 19/03/24 09:56:59 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000020_1, Status : FAILED
  713. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  714. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  715. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  716. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  717. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  718. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  719. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  720. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  721. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  722. at java.security.AccessController.doPrivileged(Native Method)
  723. at javax.security.auth.Subject.doAs(Subject.java:422)
  724. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  725. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  726.  
  727. 19/03/24 09:56:59 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000009_2, Status : FAILED
  728. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  729. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  730. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  731. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  732. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  733. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  734. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  735. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  736. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  737. at java.security.AccessController.doPrivileged(Native Method)
  738. at javax.security.auth.Subject.doAs(Subject.java:422)
  739. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  740. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  741.  
  742. 19/03/24 09:57:00 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000007_2, Status : FAILED
  743. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  744. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  745. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  746. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  747. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  748. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  749. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  750. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  751. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  752. at java.security.AccessController.doPrivileged(Native Method)
  753. at javax.security.auth.Subject.doAs(Subject.java:422)
  754. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  755. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  756.  
  757. 19/03/24 09:57:00 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000004_2, Status : FAILED
  758. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  759. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  760. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  761. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  762. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  763. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  764. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  765. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  766. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  767. at java.security.AccessController.doPrivileged(Native Method)
  768. at javax.security.auth.Subject.doAs(Subject.java:422)
  769. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  770. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  771.  
  772. 19/03/24 09:57:02 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000010_2, Status : FAILED
  773. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  774. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  775. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  776. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  777. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  778. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  779. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  780. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  781. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  782. at java.security.AccessController.doPrivileged(Native Method)
  783. at javax.security.auth.Subject.doAs(Subject.java:422)
  784. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  785. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  786.  
  787. 19/03/24 09:57:03 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000006_2, Status : FAILED
  788. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  789. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  790. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  791. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  792. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  793. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  794. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  795. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  796. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  797. at java.security.AccessController.doPrivileged(Native Method)
  798. at javax.security.auth.Subject.doAs(Subject.java:422)
  799. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  800. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  801.  
  802. 19/03/24 09:57:03 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000012_2, Status : FAILED
  803. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  804. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  805. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  806. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  807. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  808. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  809. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  810. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  811. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  812. at java.security.AccessController.doPrivileged(Native Method)
  813. at javax.security.auth.Subject.doAs(Subject.java:422)
  814. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  815. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  816.  
  817. 19/03/24 09:57:03 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000016_2, Status : FAILED
  818. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  819. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  820. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  821. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  822. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  823. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  824. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  825. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  826. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  827. at java.security.AccessController.doPrivileged(Native Method)
  828. at javax.security.auth.Subject.doAs(Subject.java:422)
  829. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  830. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  831.  
  832. 19/03/24 09:57:06 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000018_2, Status : FAILED
  833. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  834. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  835. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  836. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  837. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  838. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  839. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  840. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  841. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  842. at java.security.AccessController.doPrivileged(Native Method)
  843. at javax.security.auth.Subject.doAs(Subject.java:422)
  844. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  845. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  846.  
  847. 19/03/24 09:57:06 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000015_2, Status : FAILED
  848. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  849. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  850. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  851. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  852. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  853. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  854. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  855. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  856. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  857. at java.security.AccessController.doPrivileged(Native Method)
  858. at javax.security.auth.Subject.doAs(Subject.java:422)
  859. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  860. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  861.  
  862. 19/03/24 09:57:06 INFO mapreduce.Job: Task Id : attempt_1552861958636_0316_m_000013_2, Status : FAILED
  863. Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
  864. at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
  865. at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)
  866. at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
  867. at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
  868. at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
  869. at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
  870. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
  871. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  872. at java.security.AccessController.doPrivileged(Native Method)
  873. at javax.security.auth.Subject.doAs(Subject.java:422)
  874. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
  875. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  876.  
  877. 19/03/24 09:57:07 INFO mapreduce.Job: map 100% reduce 100%
  878. 19/03/24 09:57:08 INFO mapreduce.Job: Job job_1552861958636_0316 failed with state FAILED due to: Task failed task_1552861958636_0316_m_000008
  879. Job failed as tasks failed. failedMaps:1 failedReduces:0
  880.  
  881. 19/03/24 09:57:08 INFO mapreduce.Job: Counters: 14
  882. Job Counters
  883. Failed map tasks=56
  884. Killed map tasks=41
  885. Killed reduce tasks=8
  886. Launched map tasks=67
  887. Other local map tasks=48
  888. Data-local map tasks=19
  889. Total time spent by all maps in occupied slots (ms)=2494860
  890. Total time spent by all reduces in occupied slots (ms)=0
  891. Total time spent by all map tasks (ms)=415810
  892. Total vcore-milliseconds taken by all map tasks=415810
  893. Total megabyte-milliseconds taken by all map tasks=1277368320
  894. Map-Reduce Framework
  895. CPU time spent (ms)=0
  896. Physical memory (bytes) snapshot=0
  897. Virtual memory (bytes) snapshot=0
  898. 19/03/24 09:57:08 ERROR streaming.StreamJob: Job not successful!
  899. Streaming Command Failed!
  900. 19/03/24 09:57:10 INFO client.RMProxy: Connecting to ResourceManager at cloudtest-master/192.168.0.6:8032
  901. 19/03/24 09:57:10 INFO client.RMProxy: Connecting to ResourceManager at cloudtest-master/192.168.0.6:8032
  902. 19/03/24 09:57:11 INFO mapred.FileInputFormat: Total input paths to process : 0
  903. 19/03/24 09:57:11 INFO mapreduce.JobSubmitter: number of splits:0
  904. 19/03/24 09:57:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1552861958636_0317
  905. 19/03/24 09:57:11 INFO impl.YarnClientImpl: Submitted application application_1552861958636_0317
  906. 19/03/24 09:57:11 INFO mapreduce.Job: The url to track the job: http://cloudtest-master:8088/proxy/application_1552861958636_0317/
  907. 19/03/24 09:57:11 INFO mapreduce.Job: Running job: job_1552861958636_0317
  908. 19/03/24 09:57:18 INFO mapreduce.Job: Job job_1552861958636_0317 running in uber mode : false
  909. 19/03/24 09:57:18 INFO mapreduce.Job: map 0% reduce 0%
  910. 19/03/24 09:57:24 INFO mapreduce.Job: map 0% reduce 38%
  911. 19/03/24 09:57:25 INFO mapreduce.Job: map 0% reduce 63%
  912. 19/03/24 09:57:26 INFO mapreduce.Job: map 0% reduce 100%
  913. 19/03/24 09:57:26 INFO mapreduce.Job: Job job_1552861958636_0317 completed successfully
  914. 19/03/24 09:57:26 INFO mapreduce.Job: Counters: 38
  915. File System Counters
  916. FILE: Number of bytes read=0
  917. FILE: Number of bytes written=1216264
  918. FILE: Number of read operations=0
  919. FILE: Number of large read operations=0
  920. FILE: Number of write operations=0
  921. HDFS: Number of bytes read=0
  922. HDFS: Number of bytes written=0
  923. HDFS: Number of read operations=24
  924. HDFS: Number of large read operations=0
  925. HDFS: Number of write operations=16
  926. Job Counters
  927. Launched reduce tasks=8
  928. Total time spent by all maps in occupied slots (ms)=0
  929. Total time spent by all reduces in occupied slots (ms)=233632
  930. Total time spent by all reduce tasks (ms)=33376
  931. Total vcore-milliseconds taken by all reduce tasks=33376
  932. Total megabyte-milliseconds taken by all reduce tasks=119619584
  933. Map-Reduce Framework
  934. Combine input records=0
  935. Combine output records=0
  936. Reduce input groups=0
  937. Reduce shuffle bytes=0
  938. Reduce input records=0
  939. Reduce output records=0
  940. Spilled Records=0
  941. Shuffled Maps =0
  942. Failed Shuffles=0
  943. Merged Map outputs=0
  944. GC time elapsed (ms)=1371
  945. CPU time spent (ms)=4890
  946. Physical memory (bytes) snapshot=2038030336
  947. Virtual memory (bytes) snapshot=38752931840
  948. Total committed heap usage (bytes)=3672637440
  949. Shuffle Errors
  950. BAD_ID=0
  951. CONNECTION=0
  952. IO_ERROR=0
  953. WRONG_LENGTH=0
  954. WRONG_MAP=0
  955. WRONG_REDUCE=0
  956. File Output Format Counters
  957. Bytes Written=0
  958. 19/03/24 09:57:26 INFO streaming.StreamJob: Output directory: /tmp/hob201905/raw_result
  959. ERROR: Job failed: exit status 1
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!