API tools faq
paste
Advertisement
Guest User

Namenode log

a guest
Dec 4th, 2012
36
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 14.96 KB | None | 0 0
raw download clone embed print report
  1. 2012-12-04 09:54:48,632 INFO org.apache.hadoop.mapred.JobTracker: Job job_201212040948_0005 added successfully for user 'vagrant' to queue 'default'
  2. 2012-12-04 09:54:48,823 INFO org.apache.hadoop.mapred.JobTracker: Initializing job_201212040948_0005
  3. 2012-12-04 09:54:48,826 INFO org.apache.hadoop.mapred.JobInProgress: Initializing job_201212040948_0005
  4. 2012-12-04 09:54:51,428 INFO org.apache.hadoop.mapred.JobInProgress: jobToken generated and stored with users keys in /tmp/hadoop-mapred/mapred/system/job_20121204
  5. 0948_0005/jobToken
  6. 2012-12-04 09:54:51,502 INFO org.apache.hadoop.mapred.JobInProgress: Input size for job job_201212040948_0005 = 62. Number of splits = 2
  7. 2012-12-04 09:54:51,532 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201212040948_0005_m_000000 has split on node:/default-rack/namenode
  8. 2012-12-04 09:54:51,745 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201212040948_0005_m_000000 has split on node:/default-rack/datanode1
  9. 2012-12-04 09:54:51,745 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201212040948_0005_m_000001 has split on node:/default-rack/namenode
  10. 2012-12-04 09:54:51,746 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201212040948_0005_m_000001 has split on node:/default-rack/datanode1
  11. 2012-12-04 09:54:51,746 INFO org.apache.hadoop.mapred.JobInProgress: job_201212040948_0005 LOCALITY_WAIT_FACTOR=0.5
  12. 2012-12-04 09:54:51,748 INFO org.apache.hadoop.mapred.JobInProgress: Job job_201212040948_0005 initialized successfully with 2 map tasks and 0 reduce tasks.
  13. 2012-12-04 09:54:51,782 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  14. 2012-12-04 09:54:51,783 INFO org.apache.hadoop.mapred.JobTracker: Adding task (JOB_SETUP) 'attempt_201212040948_0005_m_000003_0' to tip task_201212040948_0005_m_00
  15. 0003, for tracker 'tracker_namenode:localhost/127.0.0.1:40537'
  16. 2012-12-04 09:55:12,607 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.JobInProgress$Counter is deprecated. Use org.apache.hadoop.mapreduce.JobCounter ins
  17. tead
  18. 2012-12-04 09:55:12,608 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201212040948_0005_m_000003_0' has completed task_201212040948_0005_m_000003 succ
  19. essfully.
  20. 2012-12-04 09:55:12,650 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  21. 2012-12-04 09:55:12,650 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000000_0' to tip task_201212040948_0005_m_000000,
  22. for tracker 'tracker_namenode:localhost/127.0.0.1:40537'
  23. 2012-12-04 09:55:12,661 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201212040948_0005_m_000000
  24. 2012-12-04 09:55:12,664 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  25. 2012-12-04 09:55:12,665 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000001_0' to tip task_201212040948_0005_m_000001,
  26. for tracker 'tracker_datanode3:localhost/127.0.0.1:54269'
  27. 2012-12-04 09:55:12,734 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201212040948_0005_m_000001
  28. 2012-12-04 10:05:24,159 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201212040948_0005_m_000001_0: Task attempt_201212040948_0005_m_000001_0 fa
  29. iled to report status for 600 seconds. Killing!
  30. 2012-12-04 10:05:24,160 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000001_0'
  31. 2012-12-04 10:05:24,175 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  32. 2012-12-04 10:05:24,191 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201212040948_0005_m_000001_0' to tip task_201212040948_0005_m_000001, for tracker 'tracker_datanode3:localhost/127.0.0.1:54269'
  33. 2012-12-04 10:05:25,374 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201212040948_0005_m_000000_0: Task attempt_201212040948_0005_m_000000_0 failed to report status for 600 seconds. Killing!
  34. 2012-12-04 10:05:25,374 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_0'
  35. 2012-12-04 10:05:25,375 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  36. 2012-12-04 10:05:25,376 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201212040948_0005_m_000000_0' to tip task_201212040948_0005_m_000000, for tracker 'tracker_namenode:localhost/127.0.0.1:40537'
  37. 2012-12-04 10:05:30,292 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000001_0'
  38. 2012-12-04 10:05:30,497 INFO org.apache.hadoop.mapred.JobInProgress: Choosing a failed task task_201212040948_0005_m_000001
  39. 2012-12-04 10:05:30,498 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  40. 2012-12-04 10:05:30,499 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000001_1' to tip task_201212040948_0005_m_000001, for tracker 'tracker_datanode1:localhost/127.0.0.1:35316'
  41. 2012-12-04 10:05:30,499 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201212040948_0005_m_000001
  42. 2012-12-04 10:05:34,789 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_0'
  43. 2012-12-04 10:05:35,030 INFO org.apache.hadoop.mapred.JobInProgress: Choosing a failed task task_201212040948_0005_m_000000
  44. 2012-12-04 10:05:35,031 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  45. 2012-12-04 10:05:35,031 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000000_1' to tip task_201212040948_0005_m_000000, for tracker 'tracker_datanode2:localhost/127.0.0.1:51183'
  46. 2012-12-04 10:05:35,031 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201212040948_0005_m_000000
  47. 2012-12-04 10:15:43,817 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201212040948_0005_m_000001_1: Task attempt_201212040948_0005_m_000001_1 failed to report status for 600 seconds. Killing!
  48. 2012-12-04 10:15:43,817 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000001_1'
  49. 2012-12-04 10:15:43,817 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  50. 2012-12-04 10:15:43,817 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201212040948_0005_m_000001_1' to tip task_201212040948_0005_m_000001, for tracker 'tracker_datanode1:localhost/127.0.0.1:35316'
  51. 2012-12-04 10:15:46,193 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201212040948_0005_m_000000_1: Task attempt_201212040948_0005_m_000000_1 failed to report status for 600 seconds. Killing!
  52. 2012-12-04 10:15:46,193 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_1'
  53. 2012-12-04 10:15:46,194 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  54. 2012-12-04 10:15:46,194 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201212040948_0005_m_000000_1' to tip task_201212040948_0005_m_000000, for tracker 'tracker_datanode2:localhost/127.0.0.1:51183'
  55. 2012-12-04 10:15:48,746 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000001_1'
  56. 2012-12-04 10:15:48,770 INFO org.apache.hadoop.mapred.JobInProgress: Choosing a failed task task_201212040948_0005_m_000001
  57. 2012-12-04 10:15:48,771 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  58. 2012-12-04 10:15:48,771 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000001_2' to tip task_201212040948_0005_m_000001, for tracker 'tracker_namenode:localhost/127.0.0.1:40537'
  59. 2012-12-04 10:15:48,771 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201212040948_0005_m_000001
  60. 2012-12-04 10:15:51,114 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_1'
  61. 2012-12-04 10:15:51,200 INFO org.apache.hadoop.mapred.JobInProgress: Choosing a failed task task_201212040948_0005_m_000000
  62. 2012-12-04 10:15:51,200 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  63. 2012-12-04 10:15:51,200 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000000_2' to tip task_201212040948_0005_m_000000, for tracker 'tracker_datanode1:localhost/127.0.0.1:35316'
  64. 2012-12-04 10:15:51,201 INFO org.apache.hadoop.mapred.JobInProgress: Choosing data-local task task_201212040948_0005_m_000000
  65. 2012-12-04 10:26:01,980 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201212040948_0005_m_000000_2: Task attempt_201212040948_0005_m_000000_2 failed to report status for 600 seconds. Killing!
  66. 2012-12-04 10:26:02,014 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_2'
  67. 2012-12-04 10:26:02,028 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  68. 2012-12-04 10:26:02,031 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201212040948_0005_m_000000_2' to tip task_201212040948_0005_m_000000, for tracker 'tracker_datanode1:localhost/127.0.0.1:35316'
  69. 2012-12-04 10:26:05,770 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_2'
  70. 2012-12-04 10:26:06,028 INFO org.apache.hadoop.mapred.JobInProgress: Choosing a failed task task_201212040948_0005_m_000000
  71. 2012-12-04 10:26:06,041 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  72. 2012-12-04 10:26:06,042 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000000_3' to tip task_201212040948_0005_m_000000, for tracker 'tracker_datanode3:localhost/127.0.0.1:54269'
  73. 2012-12-04 10:26:06,042 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201212040948_0005_m_000000
  74. 2012-12-04 10:26:06,682 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201212040948_0005_m_000001_2: Task attempt_201212040948_0005_m_000001_2 failed to report status for 600 seconds. Killing!
  75. 2012-12-04 10:26:06,709 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000001_2'
  76. 2012-12-04 10:26:06,709 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  77. 2012-12-04 10:26:06,710 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201212040948_0005_m_000001_2' to tip task_201212040948_0005_m_000001, for tracker 'tracker_namenode:localhost/127.0.0.1:40537'
  78. 2012-12-04 10:26:19,414 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000001_2'
  79. 2012-12-04 10:26:19,434 INFO org.apache.hadoop.mapred.JobInProgress: Choosing a failed task task_201212040948_0005_m_000001
  80. 2012-12-04 10:26:19,436 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  81. 2012-12-04 10:26:19,436 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201212040948_0005_m_000001_3' to tip task_201212040948_0005_m_000001, for tracker 'tracker_datanode2:localhost/127.0.0.1:51183'
  82. 2012-12-04 10:26:19,436 INFO org.apache.hadoop.mapred.JobInProgress: Choosing rack-local task task_201212040948_0005_m_000001
  83. 2012-12-04 10:36:18,637 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201212040948_0005_m_000000_3: Task attempt_201212040948_0005_m_000000_3 failed to report status for 600 seconds. Killing!
  84. 2012-12-04 10:36:18,638 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_3'
  85. 2012-12-04 10:36:18,641 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  86. 2012-12-04 10:36:18,642 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201212040948_0005_m_000000_3' to tip task_201212040948_0005_m_000000, for tracker 'tracker_datanode3:localhost/127.0.0.1:54269'
  87. 2012-12-04 10:36:24,277 INFO org.apache.hadoop.mapred.TaskInProgress: TaskInProgress task_201212040948_0005_m_000000 has failed 4 times.
  88. 2012-12-04 10:36:24,278 INFO org.apache.hadoop.mapred.JobInProgress: Aborting job job_201212040948_0005
  89. 2012-12-04 10:36:24,278 INFO org.apache.hadoop.mapred.JobInProgress: Killing job 'job_201212040948_0005'
  90. 2012-12-04 10:36:24,286 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
  91. 2012-12-04 10:36:24,286 INFO org.apache.hadoop.mapred.JobTracker: Adding task (JOB_CLEANUP) 'attempt_201212040948_0005_m_000002_0' to tip task_201212040948_0005_m_000002, for tracker 'tracker_datanode3:localhost/127.0.0.1:54269'
  92. 2012-12-04 10:36:24,287 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000000_3'
  93. 2012-12-04 10:36:24,723 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000001_3'
  94. 2012-12-04 10:36:29,173 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201212040948_0005_m_000002_0' has completed task_201212040948_0005_m_000002 successfully.
  95. 2012-12-04 10:36:29,197 INFO org.apache.hadoop.mapred.JobInProgress$JobSummary: jobId=job_201212040948_0005,submitTime=1354614883273,launchTime=1354614891746,firstMapTaskLaunchTime=1354614912650,firstJobSetupTaskLaunchTime=1354614891779,firstJobCleanupTaskLaunchTime=1354617384285,finishTime=1354617389197,numMaps=2,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=vagrant,queue=default,status=FAILED,mapSlotSeconds=674,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8
  96. 2012-12-04 10:36:29,464 INFO org.apache.hadoop.mapred.JobHistory: Moving file:/var/log/hadoop-0.20-mapreduce/history/job_201212040948_0005_1354614883273_vagrant_lower.py to file:/var/log/hadoop-0.20-mapreduce/history/done/namenode_1354614524230_/2012/11/04/000000
  97. 2012-12-04 10:36:29,500 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000002_0'
  98. 2012-12-04 10:36:29,501 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201212040948_0005_m_000003_0'
  99. 2012-12-04 10:36:29,569 INFO org.apache.hadoop.mapred.JobHistory: Moving file:/var/log/hadoop-0.20-mapreduce/history/namenode_1354614524230_job_201212040948_0005_conf.xml to file:/var/log/hadoop-0.20-mapreduce/history/done/namenode_1354614524230_/2012/11/04/000000
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!