Guest User

Shell job exectuion log

a guest
Apr 27th, 2015
356
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 3.72 KB | None | 0 0
  1. PS C:\hadoop-2.6.0\bin> hadoop jar 'C:\hwork\pr14.jar' PageRankHadoop /in /output33 --all
  2. starting the job
  3. 15/04/27 21:15:02 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
  4. 15/04/27 21:15:03 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool inte
  5. rface and execute your application with ToolRunner to remedy this.
  6. 15/04/27 21:15:03 INFO input.FileInputFormat: Total input paths to process : 1
  7. 15/04/27 21:15:03 INFO mapreduce.JobSubmitter: number of splits:1
  8. 15/04/27 21:15:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1430152496212_0015
  9. 15/04/27 21:15:04 INFO impl.YarnClientImpl: Submitted application application_1430152496212_0015
  10. 15/04/27 21:15:04 INFO mapreduce.Job: The url to track the job: http://Piotr-Komputer:8088/proxy/application_14301524962
  11. 12_0015/
  12. 15/04/27 21:15:04 INFO mapreduce.Job: Running job: job_1430152496212_0015
  13. 15/04/27 21:15:16 INFO mapreduce.Job: Job job_1430152496212_0015 running in uber mode : false
  14. 15/04/27 21:15:16 INFO mapreduce.Job: map 0% reduce 0%
  15. 15/04/27 21:15:37 INFO mapreduce.Job: map 100% reduce 0%
  16. 15/04/27 21:15:49 INFO mapreduce.Job: map 100% reduce 100%
  17. 15/04/27 21:15:54 INFO mapreduce.Job: Job job_1430152496212_0015 completed successfully
  18. 15/04/27 21:15:54 INFO mapreduce.Job: Counters: 49
  19. File System Counters
  20. FILE: Number of bytes read=6
  21. FILE: Number of bytes written=172837
  22. FILE: Number of read operations=0
  23. FILE: Number of large read operations=0
  24. FILE: Number of write operations=0
  25. HDFS: Number of bytes read=4641
  26. HDFS: Number of bytes written=0
  27. HDFS: Number of read operations=7
  28. HDFS: Number of large read operations=0
  29. HDFS: Number of write operations=2
  30. Job Counters
  31. Launched map tasks=1
  32. Launched reduce tasks=1
  33. Data-local map tasks=1
  34. Total time spent by all maps in occupied slots (ms)=19010
  35. Total time spent by all reduces in occupied slots (ms)=9046
  36. Total time spent by all map tasks (ms)=19010
  37. Total time spent by all reduce tasks (ms)=9046
  38. Total vcore-seconds taken by all map tasks=19010
  39. Total vcore-seconds taken by all reduce tasks=9046
  40. Total megabyte-seconds taken by all map tasks=19466240
  41. Total megabyte-seconds taken by all reduce tasks=9263104
  42. Map-Reduce Framework
  43. Map input records=0
  44. Map output records=0
  45. Map output bytes=0
  46. Map output materialized bytes=6
  47. Input split bytes=97
  48. Combine input records=0
  49. Combine output records=0
  50. Reduce input groups=0
  51. Reduce shuffle bytes=6
  52. Reduce input records=0
  53. Reduce output records=0
  54. Spilled Records=0
  55. Shuffled Maps =1
  56. Failed Shuffles=0
  57. Merged Map outputs=1
  58. GC time elapsed (ms)=170
  59. CPU time spent (ms)=1499
  60. Physical memory (bytes) snapshot=365215744
  61. Virtual memory (bytes) snapshot=479444992
  62. Total committed heap usage (bytes)=300417024
  63. Shuffle Errors
  64. BAD_ID=0
  65. CONNECTION=0
  66. IO_ERROR=0
  67. WRONG_LENGTH=0
  68. WRONG_MAP=0
  69. WRONG_REDUCE=0
  70. File Input Format Counters
  71. Bytes Read=4544
  72. File Output Format Counters
  73. Bytes Written=0
Advertisement
Add Comment
Please, Sign In to add comment