yeyicheng

Untitled

Apr 24th, 2014
87
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 0.54 KB | None | 0 0
  1. cd ~/hadoop-1.2.1
  2. cp hadoop-env.sh core-site.xml hdfs-site.xml mapred-site.xml masters slaves ${NUTCH_HOME}/conf/
  3.  
  4. ant runtime
  5. export CLASSPATH=$CLASSPATH:$NUTCH_HOME/runtime/local/lib
  6.  
  7. cd ~/hadoop-1.2.1
  8. bin/hadoop dfs namenode -format
  9.  
  10. bin/start-all.sh
  11.  
  12. xxx Jps
  13. xxx JobTracker
  14. xxx SecondaryNameNode
  15. xxx NameNode
  16.  
  17. cd $HADOOP_HOME
  18. bin/hadoop dfs -put $NUTCH_HOME/runtime/local/urls urls
  19.  
  20. bin/hadoop dfs -ls
  21. bin/hadoop dfs -cat urls/seed.txt
  22.  
  23. cd $NUTCH_HOME/runtime/deploy
  24. bin/crawl urls/seed.txt Crawl http://master:8080/solr
Advertisement
Add Comment
Please, Sign In to add comment