hadoop output forpagerank

[mahmood@tiger PageRank]$ stop-all.sh
Warning: $HADOOP_HOME is deprecated.
stopping jobtracker
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: stopping tasktracker
stopping namenode
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: stopping datanode
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: stopping secondarynamenode





[mahmood@tiger PageRank]$ rm -rf /data/apache/hadoop-1.0.2/folders/*
[mahmood@tiger PageRank]$ rm -rf /home/mahmood/bigdatabench/apache/hadoop-1.0.2/logs/*
[mahmood@tiger PageRank]$ hadoop  namenode -format
Warning: $HADOOP_HOME is deprecated.
15/05/04 13:49:53 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = tiger/192.168.1.5
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 1.0.2
STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0.2 -r 1304954; compiled by 'hortonfo' on Sat Mar 24 23:58:21 UTC 2012
************************************************************/
15/05/04 13:49:53 INFO util.GSet: VM type       = 64-bit
15/05/04 13:49:53 INFO util.GSet: 2% max memory = 19.17 MB
15/05/04 13:49:53 INFO util.GSet: capacity      = 2^21 = 2097152 entries
15/05/04 13:49:53 INFO util.GSet: recommended=2097152, actual=2097152
15/05/04 13:49:53 INFO namenode.FSNamesystem: fsOwner=mahmood
15/05/04 13:49:53 INFO namenode.FSNamesystem: supergroup=supergroup
15/05/04 13:49:53 INFO namenode.FSNamesystem: isPermissionEnabled=true
15/05/04 13:49:53 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100
15/05/04 13:49:53 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
15/05/04 13:49:53 INFO namenode.NameNode: Caching file names occuring more than 10 times
15/05/04 13:49:53 INFO common.Storage: Image file of size 113 saved in 0 seconds.
15/05/04 13:49:54 INFO common.Storage: Storage directory /data/apache/hadoop-1.0.2/folders/name has been successfully formatted.
15/05/04 13:49:54 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at tiger/192.168.1.5
************************************************************/






[mahmood@tiger PageRank]$ start-all.sh
Warning: $HADOOP_HOME is deprecated.
starting namenode, logging to /home/mahmood/bigdatabench/apache/hadoop-1.0.2/libexec/../logs/hadoop-mahmood-namenode-tiger.out
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: starting datanode, logging to /home/mahmood/bigdatabench/apache/hadoop-1.0.2/libexec/../logs/hadoop-mahmood-datanode-tiger.out
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: starting secondarynamenode, logging to /home/mahmood/bigdatabench/apache/hadoop-1.0.2/libexec/../logs/hadoop-mahmood-secondarynamenode-tiger.out
starting jobtracker, logging to /home/mahmood/bigdatabench/apache/hadoop-1.0.2/libexec/../logs/hadoop-mahmood-jobtracker-tiger.out
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: starting tasktracker, logging to /home/mahmood/bigdatabench/apache/hadoop-1.0.2/libexec/../logs/hadoop-mahmood-tasktracker-tiger.out





[mahmood@tiger PageRank]$ hadoop dfsadmin -report
Warning: $HADOOP_HOME is deprecated.
Configured Capacity: 2953524240384 (2.69 TB)
Present Capacity: 602299076623 (560.93 GB)
DFS Remaining: 602299047936 (560.93 GB)
DFS Used: 28687 (28.01 KB)
DFS Used%: 0%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
-------------------------------------------------
Datanodes available: 1 (1 total, 0 dead)
Name: 127.0.0.1:50010
Decommission Status : Normal
Configured Capacity: 2953524240384 (2.69 TB)
DFS Used: 28687 (28.01 KB)
Non DFS Used: 2351225163761 (2.14 TB)
DFS Remaining: 602299047936(560.93 GB)
DFS Used%: 0%
DFS Remaining%: 20.39%
Last contact: Mon May 04 13:50:15 IRDT 2015







[mahmood@tiger PageRank]$ ./genData_PageRank.sh
Generate PageRank data
Please Enter The Iterations of GenGragh: 1
WORK_DIR=/home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/SearchEngine/PageRank data will be generated in /home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/SearchEngine/PageRank/data-PageRank
Kronecker graphs. build: 10:42:53, Apr 21 2014. Time: 13:50:36 [Mar 20 2014]
============================================================================
Output graph file name (-o:)=/home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/SearchEngine/PageRank/data-PageRank/Google_genGraph_1.txt
Matrix (in Maltab notation) (-m:)=0.8305 0.5573; 0.4638 0.3021
Iterations of Kronecker product (-i:)=1
Random seed (0 - time seed) (-s:)=0
*** Seed matrix:
      0.8305      0.5573
      0.4638      0.3021
 (sum:2.1537)
*** Kronecker:
  FastKronecker: 2 nodes, 2 edges, Directed...
run time: 0.00s (13:50:36)
Warning: $HADOOP_HOME is deprecated.
rmr: cannot remove /home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/SearchEngine/PageRank/data-PageRank/Google_genGraph_1.txt: No such file or directory.
copyFromLocal To HDFS!
/home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/SearchEngine/PageRank/data-PageRank
Warning: $HADOOP_HOME is deprecated.






[mahmood@tiger PageRank]$ ./run_PageRank.sh 1
[#_of_nodes] : number of nodes in the graph is 2
[#_of_reducers] : number of reducers to use in hadoop is 16
[makesym or nosym] : makesym-duplicate reverse edges, nosym-use original edge file makesym
[#_Iterations_of_GenGragh] : Iterations_of_GenGragh is 1
Warning: $HADOOP_HOME is deprecated.
rmr: cannot remove /user/root/pr_tempmv: No such file or directory.
Warning: $HADOOP_HOME is deprecated.
rmr: cannot remove /user/root/pr_output: No such file or directory.
Warning: $HADOOP_HOME is deprecated.
rmr: cannot remove /user/root/pr_minmax: No such file or directory.
Warning: $HADOOP_HOME is deprecated.
rmr: cannot remove /user/root/pr_distr: No such file or directory.
Warning: $HADOOP_HOME is deprecated.
rmr: cannot remove /user/root/pr_vector: No such file or directory.
Warning: $HADOOP_HOME is deprecated.
-----===[PEGASUS: A Peta-Scale Graph Mining System]===-----
[PEGASUS] Computing PageRank. Max iteration = 1024, threshold = 0.05, cur_iteration=1
Creating initial pagerank vectors.....
15/05/04 13:50:52 INFO mapred.FileInputFormat: Total input paths to process : 2
15/05/04 13:50:53 INFO mapred.JobClient: Running job: job_201505041350_0001
15/05/04 13:50:54 INFO mapred.JobClient:  map 0% reduce 0%
15/05/04 13:51:09 INFO mapred.JobClient:  map 50% reduce 0%
15/05/04 13:51:12 INFO mapred.JobClient:  map 100% reduce 0%
15/05/04 13:51:21 INFO mapred.JobClient:  map 100% reduce 6%
15/05/04 13:51:24 INFO mapred.JobClient:  map 100% reduce 12%
15/05/04 13:51:27 INFO mapred.JobClient:  map 100% reduce 18%
15/05/04 13:51:30 INFO mapred.JobClient:  map 100% reduce 25%
....
15/05/04 14:04:32 INFO mapred.JobClient:     Reduce input groups=2
15/05/04 14:04:32 INFO mapred.JobClient:     Combine output records=2
15/05/04 14:04:32 INFO mapred.JobClient:     Physical memory (bytes) snapshot=3779358720
15/05/04 14:04:32 INFO mapred.JobClient:     Reduce output records=2
15/05/04 14:04:32 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=75018313728
15/05/04 14:04:32 INFO mapred.JobClient:     Map output records=2

[PEGASUS] PageRank computed.
[PEGASUS] The final PageRanks are in the HDFS pr_vector.
[PEGASUS] The minium and maximum PageRanks are in the HDFS pr_minmax.
[PEGASUS] The histogram of PageRanks in 1000 bins between min_PageRank and max_PageRank are in the HDFS pr_distr.


real    9m44.657s
user    0m7.234s
sys     0m0.775s