API tools faq
paste
Advertisement
kntreadway

mapred error 3/17/2011

kntreadway
Mar 17th, 2011
177
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 52.48 KB | None | 0 0
raw download clone embed print report
  1. 2011-03-17 11:51:35,666 WARN org.apache.hadoop.conf.Configuration: /tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201103151859_0066/attempt_201103151859_0066_r_000000_0/job.xml:a attempt to override final parameter: mapred.job.reuse.jvm.num.tasks;  Ignoring.
  2. 2011-03-17 11:51:35,672 WARN org.apache.hadoop.conf.Configuration: /tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201103151859_0066/attempt_201103151859_0066_r_000000_0/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum;  Ignoring.
  3. 2011-03-17 11:51:35,677 WARN org.apache.hadoop.conf.Configuration: /tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201103151859_0066/attempt_201103151859_0066_r_000000_0/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum;  Ignoring.
  4. 2011-03-17 11:51:38,185 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId=
  5. 2011-03-17 11:51:38,903 WARN org.apache.hadoop.conf.Configuration: /tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201103151859_0066/attempt_201103151859_0066_r_000000_0/job.xml:a attempt to override final parameter: mapred.job.reuse.jvm.num.tasks;  Ignoring.
  6. 2011-03-17 11:51:38,906 WARN org.apache.hadoop.conf.Configuration: /tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201103151859_0066/attempt_201103151859_0066_r_000000_0/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum;  Ignoring.
  7. 2011-03-17 11:51:38,914 WARN org.apache.hadoop.conf.Configuration: /tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201103151859_0066/attempt_201103151859_0066_r_000000_0/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum;  Ignoring.
  8. 2011-03-17 11:51:39,153 INFO com.hadoop.compression.lzo.GPLNativeCodeLoader: Loaded native gpl library
  9. 2011-03-17 11:51:39,157 INFO com.hadoop.compression.lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev /home/hadoop/installers/toddlipcon-hadoop-lzo-0e70051/src/get_build_revision.sh: line 4: git: command not found]
  10. 2011-03-17 11:51:42,427 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=140699232, MaxSingleShuffleLimit=35174808
  11. 2011-03-17 11:51:42,440 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
  12. 2011-03-17 11:51:42,497 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
  13. 2011-03-17 11:51:42,499 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
  14. 2011-03-17 11:51:42,561 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
  15. 2011-03-17 11:51:42,592 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
  16. 2011-03-17 11:51:42,703 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Thread started: Thread for merging on-disk files
  17. 2011-03-17 11:51:42,703 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Thread waiting: Thread for merging on-disk files
  18. 2011-03-17 11:51:42,966 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Thread started: Thread for merging in memory files
  19. 2011-03-17 11:51:43,033 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Need another 67 map output(s) where 0 is already in progress
  20. 2011-03-17 11:51:43,078 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Thread started: Thread for polling Map Completion Events
  21. 2011-03-17 11:51:43,095 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
  22. 2011-03-17 11:51:43,411 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 29 new map-outputs
  23. 2011-03-17 11:51:46,444 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 3 new map-outputs
  24. 2011-03-17 11:51:48,119 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 4 outputs (0 slow hosts and0 dup hosts)
  25. 2011-03-17 11:51:57,726 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000031_0, compressed len: 18, decompressed len: 2
  26. 2011-03-17 11:51:57,726 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000031_0
  27. 2011-03-17 11:51:57,728 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000001_0, compressed len: 18, decompressed len: 2
  28. 2011-03-17 11:51:57,728 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000001_0
  29. 2011-03-17 11:51:57,728 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000013_0, compressed len: 18, decompressed len: 2
  30. 2011-03-17 11:51:57,728 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000013_0
  31. 2011-03-17 11:51:57,728 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000006_0, compressed len: 18, decompressed len: 2
  32. 2011-03-17 11:51:57,729 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000006_0
  33. 2011-03-17 11:51:57,961 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000006_0
  34. 2011-03-17 11:51:57,962 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000006_0 -> (-1, -1) from box2
  35. 2011-03-17 11:51:57,962 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000013_0
  36. 2011-03-17 11:51:57,962 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000013_0 -> (-1, -1) from box3
  37. 2011-03-17 11:51:57,981 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000001_0
  38. 2011-03-17 11:51:57,981 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000001_0 -> (-1, -1) from box4
  39. 2011-03-17 11:51:57,981 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000031_0
  40. 2011-03-17 11:51:57,981 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000031_0 -> (-1, -1) from box1
  41. 2011-03-17 11:51:58,048 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 4 outputs (0 slow hosts and0 dup hosts)
  42. 2011-03-17 11:51:58,193 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000018_0, compressed len: 18, decompressed len: 2
  43. 2011-03-17 11:51:58,193 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000018_0
  44. 2011-03-17 11:51:58,194 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000018_0
  45. 2011-03-17 11:51:58,194 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000018_0 -> (-1, -1) from box3
  46. 2011-03-17 11:51:58,195 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and18 dup hosts)
  47. 2011-03-17 11:51:58,197 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000021_0, compressed len: 18, decompressed len: 2
  48. 2011-03-17 11:51:58,197 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000021_0
  49. 2011-03-17 11:51:58,198 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000021_0
  50. 2011-03-17 11:51:58,198 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000021_0 -> (-1, -1) from box3
  51. 2011-03-17 11:51:58,198 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and18 dup hosts)
  52. 2011-03-17 11:51:58,215 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000032_0, compressed len: 18, decompressed len: 2
  53. 2011-03-17 11:51:58,216 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000032_0
  54. 2011-03-17 11:51:58,216 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000032_0
  55. 2011-03-17 11:51:58,216 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000032_0 -> (-1, -1) from box1
  56. 2011-03-17 11:51:58,217 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and16 dup hosts)
  57. 2011-03-17 11:52:00,720 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000011_0, compressed len: 18, decompressed len: 2
  58. 2011-03-17 11:52:00,720 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000011_0
  59. 2011-03-17 11:52:00,721 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000011_0
  60. 2011-03-17 11:52:00,721 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000011_0 -> (-1, -1) from box4
  61. 2011-03-17 11:52:00,722 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000002_0, compressed len: 18, decompressed len: 2
  62. 2011-03-17 11:52:00,722 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000002_0
  63. 2011-03-17 11:52:00,723 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000002_0
  64. 2011-03-17 11:52:00,723 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000002_0 -> (-1, -1) from box2
  65. 2011-03-17 11:52:00,726 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000034_0, compressed len: 18, decompressed len: 2
  66. 2011-03-17 11:52:00,726 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000034_0
  67. 2011-03-17 11:52:00,727 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000034_0
  68. 2011-03-17 11:52:00,727 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000034_0 -> (-1, -1) from box1
  69. 2011-03-17 11:52:00,727 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000023_0, compressed len: 18, decompressed len: 2
  70. 2011-03-17 11:52:00,727 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000023_0
  71. 2011-03-17 11:52:00,728 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000023_0
  72. 2011-03-17 11:52:00,728 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000023_0 -> (-1, -1) from box3
  73. 2011-03-17 11:52:00,824 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 4 outputs (0 slow hosts and0 dup hosts)
  74. 2011-03-17 11:52:00,852 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000039_0, compressed len: 18, decompressed len: 2
  75. 2011-03-17 11:52:00,852 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000039_0
  76. 2011-03-17 11:52:00,853 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000003_0, compressed len: 18, decompressed len: 2
  77. 2011-03-17 11:52:00,853 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000003_0
  78. 2011-03-17 11:52:00,853 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000039_0
  79. 2011-03-17 11:52:00,853 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000039_0 -> (-1, -1) from box1
  80. 2011-03-17 11:52:00,853 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000003_0
  81. 2011-03-17 11:52:00,853 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000003_0 -> (-1, -1) from box2
  82. 2011-03-17 11:52:00,853 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 2 outputs (0 slow hosts and8 dup hosts)
  83. 2011-03-17 11:52:00,857 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000004_0, compressed len: 18, decompressed len: 2
  84. 2011-03-17 11:52:00,857 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000027_0, compressed len: 18, decompressed len: 2
  85. 2011-03-17 11:52:00,857 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000004_0
  86. 2011-03-17 11:52:00,857 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000004_0
  87. 2011-03-17 11:52:00,857 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000004_0 -> (-1, -1) from box2
  88. 2011-03-17 11:52:00,858 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and11 dup hosts)
  89. 2011-03-17 11:52:00,860 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000007_0, compressed len: 18, decompressed len: 2
  90. 2011-03-17 11:52:00,860 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000007_0
  91. 2011-03-17 11:52:00,861 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000007_0
  92. 2011-03-17 11:52:00,861 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000007_0 -> (-1, -1) from box2
  93. 2011-03-17 11:52:00,861 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and11 dup hosts)
  94. 2011-03-17 11:52:00,891 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000010_0, compressed len: 18, decompressed len: 2
  95. 2011-03-17 11:52:00,891 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000010_0
  96. 2011-03-17 11:52:00,892 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000010_0
  97. 2011-03-17 11:52:00,892 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000010_0 -> (-1, -1) from box3
  98. 2011-03-17 11:52:00,893 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and10 dup hosts)
  99. 2011-03-17 11:52:00,895 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000000_0, compressed len: 18, decompressed len: 2
  100. 2011-03-17 11:52:00,895 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000000_0
  101. 2011-03-17 11:52:00,896 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000000_0
  102. 2011-03-17 11:52:00,896 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000000_0 -> (-1, -1) from box2
  103. 2011-03-17 11:52:00,896 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and10 dup hosts)
  104. 2011-03-17 11:52:00,857 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000027_0
  105. 2011-03-17 11:52:01,398 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000027_0
  106. 2011-03-17 11:52:01,398 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000027_0 -> (-1, -1) from box1
  107. 2011-03-17 11:52:01,434 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000019_0, compressed len: 18, decompressed len: 2
  108. 2011-03-17 11:52:01,434 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000019_0
  109. 2011-03-17 11:52:01,434 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000019_0
  110. 2011-03-17 11:52:01,434 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000019_0 -> (-1, -1) from box3
  111. 2011-03-17 11:52:01,436 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000005_0, compressed len: 18, decompressed len: 2
  112. 2011-03-17 11:52:01,436 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000005_0
  113. 2011-03-17 11:52:01,436 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000005_0
  114. 2011-03-17 11:52:01,436 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000005_0 -> (-1, -1) from box2
  115. 2011-03-17 11:52:01,437 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and10 dup hosts)
  116. 2011-03-17 11:52:01,446 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and8 dup hosts)
  117. 2011-03-17 11:52:01,447 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and6 dup hosts)
  118. 2011-03-17 11:52:01,450 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000008_0, compressed len: 18, decompressed len: 2
  119. 2011-03-17 11:52:01,450 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000008_0
  120. 2011-03-17 11:52:01,450 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000008_0
  121. 2011-03-17 11:52:01,450 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000008_0 -> (-1, -1) from box2
  122. 2011-03-17 11:52:01,451 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000020_0, compressed len: 18, decompressed len: 2
  123. 2011-03-17 11:52:01,451 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000020_0
  124. 2011-03-17 11:52:01,452 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000020_0
  125. 2011-03-17 11:52:01,452 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000020_0 -> (-1, -1) from box3
  126. 2011-03-17 11:52:01,452 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and7 dup hosts)
  127. 2011-03-17 11:52:01,453 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000028_0, compressed len: 18, decompressed len: 2
  128. 2011-03-17 11:52:01,453 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000028_0
  129. 2011-03-17 11:52:01,454 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000028_0
  130. 2011-03-17 11:52:01,454 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000028_0 -> (-1, -1) from box1
  131. 2011-03-17 11:52:01,454 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and5 dup hosts)
  132. 2011-03-17 11:52:01,457 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000022_0, compressed len: 18, decompressed len: 2
  133. 2011-03-17 11:52:01,457 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000022_0
  134. 2011-03-17 11:52:01,458 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000022_0
  135. 2011-03-17 11:52:01,458 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000022_0 -> (-1, -1) from box3
  136. 2011-03-17 11:52:01,461 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000035_0, compressed len: 18, decompressed len: 2
  137. 2011-03-17 11:52:01,461 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000035_0
  138. 2011-03-17 11:52:01,461 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000035_0
  139. 2011-03-17 11:52:01,461 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000035_0 -> (-1, -1) from box1
  140. 2011-03-17 11:52:01,461 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and5 dup hosts)
  141. 2011-03-17 11:52:01,464 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000036_0, compressed len: 18, decompressed len: 2
  142. 2011-03-17 11:52:01,464 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000036_0
  143. 2011-03-17 11:52:01,464 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000036_0
  144. 2011-03-17 11:52:01,464 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000036_0 -> (-1, -1) from box1
  145. 2011-03-17 11:52:06,281 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000014_0, compressed len: 18, decompressed len: 2
  146. 2011-03-17 11:52:06,281 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000014_0
  147. 2011-03-17 11:52:06,282 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000014_0
  148. 2011-03-17 11:52:06,282 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000014_0 -> (-1, -1) from box4
  149. 2011-03-17 11:52:06,284 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  150. 2011-03-17 11:52:07,001 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000015_0, compressed len: 18, decompressed len: 2
  151. 2011-03-17 11:52:07,001 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000015_0
  152. 2011-03-17 11:52:07,002 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000015_0
  153. 2011-03-17 11:52:07,002 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000015_0 -> (-1, -1) from box4
  154. 2011-03-17 11:52:07,003 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  155. 2011-03-17 11:52:07,026 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000016_0, compressed len: 18, decompressed len: 2
  156. 2011-03-17 11:52:07,026 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000016_0
  157. 2011-03-17 11:52:07,027 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000016_0
  158. 2011-03-17 11:52:07,027 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000016_0 -> (-1, -1) from box4
  159. 2011-03-17 11:52:07,028 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  160. 2011-03-17 11:52:07,029 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000009_0, compressed len: 18, decompressed len: 2
  161. 2011-03-17 11:52:07,029 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000009_0
  162. 2011-03-17 11:52:07,030 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000009_0
  163. 2011-03-17 11:52:07,030 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000009_0 -> (-1, -1) from box4
  164. 2011-03-17 11:52:07,031 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  165. 2011-03-17 11:52:07,033 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000012_0, compressed len: 18, decompressed len: 2
  166. 2011-03-17 11:52:07,033 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000012_0
  167. 2011-03-17 11:52:07,033 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000012_0
  168. 2011-03-17 11:52:07,033 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000012_0 -> (-1, -1) from box4
  169. 2011-03-17 11:52:07,034 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  170. 2011-03-17 11:52:07,036 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000017_0, compressed len: 18, decompressed len: 2
  171. 2011-03-17 11:52:07,036 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000017_0
  172. 2011-03-17 11:52:07,036 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000017_0
  173. 2011-03-17 11:52:07,036 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000017_0 -> (-1, -1) from box4
  174. 2011-03-17 11:52:11,834 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 1 new map-outputs
  175. 2011-03-17 11:52:12,039 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  176. 2011-03-17 11:52:12,043 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000024_0, compressed len: 18, decompressed len: 2
  177. 2011-03-17 11:52:12,043 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000024_0
  178. 2011-03-17 11:52:12,043 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000024_0
  179. 2011-03-17 11:52:12,044 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000024_0 -> (-1, -1) from box2
  180. 2011-03-17 11:52:14,844 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 1 new map-outputs
  181. 2011-03-17 11:52:17,049 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  182. 2011-03-17 11:52:17,053 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000053_0, compressed len: 18, decompressed len: 2
  183. 2011-03-17 11:52:17,054 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000053_0
  184. 2011-03-17 11:52:17,054 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000053_0
  185. 2011-03-17 11:52:17,054 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000053_0 -> (-1, -1) from box2
  186. 2011-03-17 11:52:17,854 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 3 new map-outputs
  187. 2011-03-17 11:52:20,866 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 11 new map-outputs
  188. 2011-03-17 11:52:22,057 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 4 outputs (0 slow hosts and0 dup hosts)
  189. 2011-03-17 11:52:22,065 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000054_0, compressed len: 18, decompressed len: 2
  190. 2011-03-17 11:52:22,066 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000054_0
  191. 2011-03-17 11:52:22,067 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000054_0
  192. 2011-03-17 11:52:22,067 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000054_0 -> (-1, -1) from box3
  193. 2011-03-17 11:52:22,067 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000044_0, compressed len: 18, decompressed len: 2
  194. 2011-03-17 11:52:22,067 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000038_0, compressed len: 18, decompressed len: 2
  195. 2011-03-17 11:52:22,067 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000044_0
  196. 2011-03-17 11:52:22,068 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000044_0
  197. 2011-03-17 11:52:22,068 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000044_0 -> (-1, -1) from box1
  198. 2011-03-17 11:52:22,067 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and8 dup hosts)
  199. 2011-03-17 11:52:22,067 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000038_0
  200. 2011-03-17 11:52:22,069 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and4 dup hosts)
  201. 2011-03-17 11:52:22,069 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000038_0
  202. 2011-03-17 11:52:22,069 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000038_0 -> (-1, -1) from box4
  203. 2011-03-17 11:52:22,070 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000033_0, compressed len: 18, decompressed len: 2
  204. 2011-03-17 11:52:22,070 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000033_0
  205. 2011-03-17 11:52:22,070 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and7 dup hosts)
  206. 2011-03-17 11:52:22,070 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000033_0
  207. 2011-03-17 11:52:22,070 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000033_0 -> (-1, -1) from box2
  208. 2011-03-17 11:52:22,071 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and5 dup hosts)
  209. 2011-03-17 11:52:22,072 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000055_0, compressed len: 18, decompressed len: 2
  210. 2011-03-17 11:52:22,073 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000055_0
  211. 2011-03-17 11:52:22,074 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000055_0
  212. 2011-03-17 11:52:22,074 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000055_0 -> (-1, -1) from box3
  213. 2011-03-17 11:52:22,075 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and5 dup hosts)
  214. 2011-03-17 11:52:22,077 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000046_0, compressed len: 18, decompressed len: 2
  215. 2011-03-17 11:52:22,077 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000046_0
  216. 2011-03-17 11:52:22,078 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000046_0
  217. 2011-03-17 11:52:22,078 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000046_0 -> (-1, -1) from box1
  218. 2011-03-17 11:52:22,078 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000056_0, compressed len: 18, decompressed len: 2
  219. 2011-03-17 11:52:22,078 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000056_0
  220. 2011-03-17 11:52:22,078 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000040_0, compressed len: 18, decompressed len: 2
  221. 2011-03-17 11:52:22,078 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and1 dup hosts)
  222. 2011-03-17 11:52:22,079 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000056_0
  223. 2011-03-17 11:52:22,079 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000056_0 -> (-1, -1) from box3
  224. 2011-03-17 11:52:22,078 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000040_0
  225. 2011-03-17 11:52:22,080 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000052_0, compressed len: 18, decompressed len: 2
  226. 2011-03-17 11:52:22,080 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000052_0
  227. 2011-03-17 11:52:22,080 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000040_0
  228. 2011-03-17 11:52:22,081 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000040_0 -> (-1, -1) from box4
  229. 2011-03-17 11:52:22,081 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000052_0
  230. 2011-03-17 11:52:22,081 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000052_0 -> (-1, -1) from box2
  231. 2011-03-17 11:52:22,082 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and3 dup hosts)
  232. 2011-03-17 11:52:22,083 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000043_0, compressed len: 18, decompressed len: 2
  233. 2011-03-17 11:52:22,083 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000043_0
  234. 2011-03-17 11:52:22,083 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000043_0
  235. 2011-03-17 11:52:22,083 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000043_0 -> (-1, -1) from box1
  236. 2011-03-17 11:52:22,084 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  237. 2011-03-17 11:52:22,085 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000058_0, compressed len: 18, decompressed len: 2
  238. 2011-03-17 11:52:22,085 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000058_0
  239. 2011-03-17 11:52:22,085 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000058_0
  240. 2011-03-17 11:52:22,085 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000058_0 -> (-1, -1) from box2
  241. 2011-03-17 11:52:22,087 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000045_0, compressed len: 18, decompressed len: 2
  242. 2011-03-17 11:52:22,087 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000045_0
  243. 2011-03-17 11:52:22,087 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000045_0
  244. 2011-03-17 11:52:22,088 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000045_0 -> (-1, -1) from box1
  245. 2011-03-17 11:52:22,088 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  246. 2011-03-17 11:52:22,090 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000047_0, compressed len: 18, decompressed len: 2
  247. 2011-03-17 11:52:22,090 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000047_0
  248. 2011-03-17 11:52:22,091 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000047_0
  249. 2011-03-17 11:52:22,091 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000047_0 -> (-1, -1) from box1
  250. 2011-03-17 11:52:22,092 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  251. 2011-03-17 11:52:22,094 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000050_0, compressed len: 18, decompressed len: 2
  252. 2011-03-17 11:52:22,094 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000050_0
  253. 2011-03-17 11:52:22,094 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000050_0
  254. 2011-03-17 11:52:22,094 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000050_0 -> (-1, -1) from box1
  255. 2011-03-17 11:52:23,878 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 5 new map-outputs
  256. 2011-03-17 11:52:26,890 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 4 new map-outputs
  257. 2011-03-17 11:52:27,097 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 4 outputs (0 slow hosts and0 dup hosts)
  258. 2011-03-17 11:52:27,108 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000057_0, compressed len: 18, decompressed len: 2
  259. 2011-03-17 11:52:27,109 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000057_0
  260. 2011-03-17 11:52:27,109 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000057_0
  261. 2011-03-17 11:52:27,109 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000057_0 -> (-1, -1) from box3
  262. 2011-03-17 11:52:27,110 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and3 dup hosts)
  263. 2011-03-17 11:52:27,110 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000051_0, compressed len: 18, decompressed len: 2
  264. 2011-03-17 11:52:27,110 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000051_0
  265. 2011-03-17 11:52:27,111 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000051_0
  266. 2011-03-17 11:52:27,112 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000051_0 -> (-1, -1) from box2
  267. 2011-03-17 11:52:27,112 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and2 dup hosts)
  268. 2011-03-17 11:52:27,114 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000060_0, compressed len: 18, decompressed len: 2
  269. 2011-03-17 11:52:27,114 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000060_0
  270. 2011-03-17 11:52:27,115 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000060_0
  271. 2011-03-17 11:52:27,115 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000060_0 -> (-1, -1) from box4
  272. 2011-03-17 11:52:27,117 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000041_0, compressed len: 18, decompressed len: 2
  273. 2011-03-17 11:52:27,118 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000041_0
  274. 2011-03-17 11:52:27,119 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000041_0
  275. 2011-03-17 11:52:27,119 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000041_0 -> (-1, -1) from box1
  276. 2011-03-17 11:52:27,119 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000025_0, compressed len: 18, decompressed len: 2
  277. 2011-03-17 11:52:27,120 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and2 dup hosts)
  278. 2011-03-17 11:52:27,120 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000025_0
  279. 2011-03-17 11:52:27,121 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000025_0
  280. 2011-03-17 11:52:27,121 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000025_0 -> (-1, -1) from box3
  281. 2011-03-17 11:52:27,122 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and1 dup hosts)
  282. 2011-03-17 11:52:27,126 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000049_0, compressed len: 18, decompressed len: 2
  283. 2011-03-17 11:52:27,126 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000063_0, compressed len: 18, decompressed len: 2
  284. 2011-03-17 11:52:27,127 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000063_0
  285. 2011-03-17 11:52:27,127 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000026_0, compressed len: 18, decompressed len: 2
  286. 2011-03-17 11:52:27,127 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000026_0
  287. 2011-03-17 11:52:27,127 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000063_0
  288. 2011-03-17 11:52:27,128 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000063_0 -> (-1, -1) from box2
  289. 2011-03-17 11:52:27,128 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000026_0
  290. 2011-03-17 11:52:27,128 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000026_0 -> (-1, -1) from box3
  291. 2011-03-17 11:52:27,127 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000049_0
  292. 2011-03-17 11:52:27,129 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000049_0
  293. 2011-03-17 11:52:27,129 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000049_0 -> (-1, -1) from box1
  294. 2011-03-17 11:52:27,132 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  295. 2011-03-17 11:52:27,135 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000059_0, compressed len: 18, decompressed len: 2
  296. 2011-03-17 11:52:27,135 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000059_0
  297. 2011-03-17 11:52:27,136 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000059_0
  298. 2011-03-17 11:52:27,136 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000059_0 -> (-1, -1) from box2
  299. 2011-03-17 11:52:29,900 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 4 new map-outputs
  300. 2011-03-17 11:52:32,138 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 2 outputs (0 slow hosts and0 dup hosts)
  301. 2011-03-17 11:52:32,145 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000037_0, compressed len: 18, decompressed len: 2
  302. 2011-03-17 11:52:32,145 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000037_0
  303. 2011-03-17 11:52:32,145 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000037_0
  304. 2011-03-17 11:52:32,146 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000037_0 -> (-1, -1) from box4
  305. 2011-03-17 11:52:32,146 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  306. 2011-03-17 11:52:32,149 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000029_0, compressed len: 18, decompressed len: 2
  307. 2011-03-17 11:52:32,149 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000029_0
  308. 2011-03-17 11:52:32,150 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000042_0, compressed len: 18, decompressed len: 2
  309. 2011-03-17 11:52:32,150 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000042_0
  310. 2011-03-17 11:52:32,150 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000029_0
  311. 2011-03-17 11:52:32,150 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000029_0 -> (-1, -1) from box3
  312. 2011-03-17 11:52:32,151 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000042_0
  313. 2011-03-17 11:52:32,151 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000042_0 -> (-1, -1) from box4
  314. 2011-03-17 11:52:32,152 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
  315. 2011-03-17 11:52:32,160 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000048_0, compressed len: 18, decompressed len: 2
  316. 2011-03-17 11:52:32,160 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000048_0
  317. 2011-03-17 11:52:32,161 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000048_0
  318. 2011-03-17 11:52:32,161 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000048_0 -> (-1, -1) from box4
  319. 2011-03-17 11:52:32,911 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 2 new map-outputs
  320. 2011-03-17 11:52:37,164 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 2 outputs (0 slow hosts and0 dup hosts)
  321. 2011-03-17 11:52:37,169 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000061_0, compressed len: 18, decompressed len: 2
  322. 2011-03-17 11:52:37,170 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000061_0
  323. 2011-03-17 11:52:37,170 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000061_0
  324. 2011-03-17 11:52:37,171 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000061_0 -> (-1, -1) from box4
  325. 2011-03-17 11:52:37,171 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000030_0, compressed len: 18, decompressed len: 2
  326. 2011-03-17 11:52:37,171 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000030_0
  327. 2011-03-17 11:52:37,172 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000030_0
  328. 2011-03-17 11:52:37,172 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000030_0 -> (-1, -1) from box3
  329. 2011-03-17 11:52:38,930 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 2 new map-outputs
  330. 2011-03-17 11:52:42,175 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 2 outputs (0 slow hosts and0 dup hosts)
  331. 2011-03-17 11:52:42,180 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000062_0, compressed len: 18, decompressed len: 2
  332. 2011-03-17 11:52:42,180 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000062_0
  333. 2011-03-17 11:52:42,181 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000062_0
  334. 2011-03-17 11:52:42,181 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000062_0 -> (-1, -1) from box4
  335. 2011-03-17 11:52:42,182 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000066_0, compressed len: 18, decompressed len: 2
  336. 2011-03-17 11:52:42,182 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000066_0
  337. 2011-03-17 11:52:42,182 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000066_0
  338. 2011-03-17 11:52:42,183 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000066_0 -> (-1, -1) from box2
  339. 2011-03-17 11:52:44,952 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0: Got 2 new map-outputs
  340. 2011-03-17 11:52:47,185 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Need another 2 map output(s) where 0 is already in progress
  341. 2011-03-17 11:52:47,186 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201103151859_0066_r_000000_0 Scheduled 2 outputs (0 slow hosts and0 dup hosts)
  342. 2011-03-17 11:52:47,190 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000064_0, compressed len: 18, decompressed len: 2
  343. 2011-03-17 11:52:47,190 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000064_0
  344. 2011-03-17 11:52:47,191 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000064_0
  345. 2011-03-17 11:52:47,191 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000064_0 -> (-1, -1) from box2
  346. 2011-03-17 11:52:47,192 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201103151859_0066_m_000065_0, compressed len: 18, decompressed len: 2
  347. 2011-03-17 11:52:47,192 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2 bytes (18 raw bytes) into RAM from attempt_201103151859_0066_m_000065_0
  348. 2011-03-17 11:52:47,192 INFO org.apache.hadoop.mapred.ReduceTask: Read 2 bytes from map-output for attempt_201103151859_0066_m_000065_0
  349. 2011-03-17 11:52:47,193 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201103151859_0066_m_000065_0 -> (-1, -1) from box1
  350. 2011-03-17 11:52:47,961 INFO org.apache.hadoop.mapred.ReduceTask: GetMapEventsThread exiting
  351. 2011-03-17 11:52:47,962 INFO org.apache.hadoop.mapred.ReduceTask: getMapsEventsThread joined.
  352. 2011-03-17 11:52:47,962 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager
  353. 2011-03-17 11:52:47,964 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 0 files left.
  354. 2011-03-17 11:52:47,965 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 67 files left.
  355. 2011-03-17 11:52:48,010 INFO org.apache.hadoop.mapred.Merger: Merging 67 sorted segments
  356. 2011-03-17 11:52:48,011 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
  357. 2011-03-17 11:52:48,022 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor
  358. 2011-03-17 11:52:48,032 INFO org.apache.hadoop.mapred.ReduceTask: Merged 67 segments, 134 bytes to disk to satisfy reduce memory limit
  359. 2011-03-17 11:52:48,033 INFO org.apache.hadoop.mapred.ReduceTask: Merging 1 files, 22 bytes from disk
  360. 2011-03-17 11:52:48,034 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce
  361. 2011-03-17 11:52:48,035 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments
  362. 2011-03-17 11:52:48,045 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
  363. 2011-03-17 11:52:48,095 WARN org.apache.hadoop.mapred.TaskTracker: Error running child
  364. java.io.FileNotFoundException: File does not exist: hdfs://10.20.40.20:9000/awardsData/_temporary/_attempt_201103151859_0066_r_000000_0
  365.     at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:468)
  366.     at org.apache.hadoop.hbase.regionserver.StoreFile.getUniqueFile(StoreFile.java:580)
  367.     at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat$1.writeMetaData(HFileOutputFormat.java:186)
  368.     at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat$1.close(HFileOutputFormat.java:247)
  369.     at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:567)
  370.     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
  371.     at org.apache.hadoop.mapred.Child.main(Child.java:170)
  372. 2011-03-17 11:52:48,100 INFO org.apache.hadoop.mapred.TaskRunner: Runnning cleanup for the task
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!