Guest User

Main Console - PageRankBenchmark Reducer stuck at 0%

a guest
Mar 24th, 2015
276
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.21 KB | None | 0 0
  1. SLF4J: Class path contains multiple SLF4J bindings.
  2. SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  3. SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  4. SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
  5. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
  6. 15/03/24 12:32:15 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  7. 15/03/24 12:32:15 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
  8. 15/03/24 12:32:15 INFO Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb
  9. 15/03/24 12:32:15 INFO Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated. Instead, use mapreduce.reduce.memory.mb
  10. 15/03/24 12:32:15 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
  11. 15/03/24 12:32:15 INFO Configuration.deprecation: mapreduce.user.classpath.first is deprecated. Instead, use mapreduce.job.user.classpath.first
  12. 15/03/24 12:32:15 INFO Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
  13. 15/03/24 12:32:15 INFO job.GiraphJob: run: Since checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts = 0, old value = 4)
  14. 15/03/24 12:32:16 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
  15. 15/03/24 12:32:16 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8050
  16. 15/03/24 12:32:16 WARN bsp.BspOutputFormat: checkOutputSpecs: ImmutableOutputCommiter will not check anything
  17. 15/03/24 12:32:18 INFO mapreduce.JobSubmitter: number of splits:2
  18. 15/03/24 12:32:19 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1427210597337_0001
  19. 15/03/24 12:32:19 INFO impl.YarnClientImpl: Submitted application application_1427210597337_0001
  20. 15/03/24 12:32:19 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1427210597337_0001/
  21. 15/03/24 12:32:19 INFO job.GiraphJob: Tracking URL: http://localhost:8088/proxy/application_1427210597337_0001/
  22. 15/03/24 12:32:19 INFO job.GiraphJob: Waiting for resources... Job will start only when it gets all 2 mappers
  23. 15/03/24 12:32:42 INFO job.HaltApplicationUtils$DefaultHaltInstructionsWriter: writeHaltInstructions: To halt after next superstep execute: 'bin/halt-application --zkServer localhost:22181 --zkNode /_hadoopBsp/job_1427210597337_0001/_haltComputation'
  24. 15/03/24 12:32:42 INFO mapreduce.Job: Running job: job_1427210597337_0001
  25. 15/03/24 12:32:43 INFO mapreduce.Job: Job job_1427210597337_0001 running in uber mode : false
  26. 15/03/24 12:32:43 INFO mapreduce.Job: map 100% reduce 0%
  27. 15/03/24 12:32:58 INFO mapreduce.Job: Job job_1427210597337_0001 completed successfully
  28. 15/03/24 12:32:58 INFO mapreduce.Job: Counters: 55
  29. File System Counters
  30. FILE: Number of bytes read=0
  31. FILE: Number of bytes written=188770
  32. FILE: Number of read operations=0
  33. FILE: Number of large read operations=0
  34. FILE: Number of write operations=0
  35. HDFS: Number of bytes read=88
  36. HDFS: Number of bytes written=0
  37. HDFS: Number of read operations=19
  38. HDFS: Number of large read operations=0
  39. HDFS: Number of write operations=11
  40. Job Counters
  41. Launched map tasks=2
  42. Other local map tasks=2
  43. Total time spent by all maps in occupied slots (ms)=45142
  44. Total time spent by all reduces in occupied slots (ms)=0
  45. Total time spent by all map tasks (ms)=45142
  46. Total vcore-seconds taken by all map tasks=45142
  47. Total megabyte-seconds taken by all map tasks=46225408
  48. Map-Reduce Framework
  49. Map input records=2
  50. Map output records=0
  51. Input split bytes=88
  52. Spilled Records=0
  53. Failed Shuffles=0
  54. Merged Map outputs=0
  55. GC time elapsed (ms)=182
  56. CPU time spent (ms)=6230
  57. Physical memory (bytes) snapshot=377528320
  58. Virtual memory (bytes) snapshot=1769377792
  59. Total committed heap usage (bytes)=196083712
  60. Giraph Stats
  61. Aggregate edges=1000
  62. Aggregate finished vertices=1000
  63. Aggregate sent message message bytes=40125
  64. Aggregate sent messages=5000
  65. Aggregate vertices=1000
  66. Current master task partition=0
  67. Current workers=1
  68. Last checkpointed superstep=0
  69. Sent message bytes=0
  70. Sent messages=0
  71. Superstep=6
  72. Giraph Timers
  73. Initialize (ms)=2953
  74. Input superstep (ms)=949
  75. Setup (ms)=152
  76. Shutdown (ms)=8436
  77. Superstep 0 PageRankComputation (ms)=722
  78. Superstep 1 PageRankComputation (ms)=895
  79. Superstep 2 PageRankComputation (ms)=456
  80. Superstep 3 PageRankComputation (ms)=964
  81. Superstep 4 PageRankComputation (ms)=1470
  82. Superstep 5 PageRankComputation (ms)=697
  83. Total (ms)=14766
  84. Zookeeper base path
  85. /_hadoopBsp/job_1427210597337_0001=0
  86. Zookeeper halt node
  87. /_hadoopBsp/job_1427210597337_0001/_haltComputation=0
  88. Zookeeper server:port
  89. localhost:22181=0
  90. File Input Format Counters
  91. Bytes Read=0
  92. File Output Format Counters
  93. Bytes Written=0
Add Comment
Please, Sign In to add comment