SHARE
TWEET

hadoopAyoub

a guest Dec 5th, 2019 86 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. 1).bashrc
  2.  
  3. export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
  4. export HADOOP_HOME=/usr/local/hadoop
  5. export PATH=$PATH:$HADOOP_HOME/bin
  6. export PATH=$PATH:$HADOOP_HOME/sbin
  7. export HADOOP_MAPRED_HOME=$HADOOP_HOME
  8. export HADOOP_COMMON_HOME=$HADOOP_HOME
  9. export HADOOP_HDFS_HOME=$HADOOP_HOME
  10. export YARN_HOME=$HADOOP_HOME
  11. export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
  12. export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"
  13.  
  14. 2)hadoop-env.sh
  15.  
  16. export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
  17.  
  18. 3)core-site.xml
  19.  
  20. <property>
  21. <name>fs.default.name</name>
  22. <value>hdfs://localhost:9000</value>
  23. </property>
  24.  
  25. 4)hdfs-site.xml
  26.  
  27. <property>
  28. <name>dfs.replication</name>
  29. <value>1</value>
  30. </property>
  31. <property>
  32. <name>dfs.namenode.name.dir</name>
  33. <value>file:/usr/local/hadoop_tmp/hdfs/namenode</value>
  34. </property>
  35. <property>
  36. <name>dfs.datanode.data.dir</name>
  37. <value>file:/usr/local/hadoop_tmp/hdfs/datanode</value>
  38. </property>
  39.  
  40. 5)yarn-site.xml
  41.  
  42. <property>
  43.  
  44. <name>yarn.nodemanager.aux-services</name>
  45. <value>mapreduce_shuffle</value>
  46. </property>
  47. <property>
  48. <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
  49. <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  50. </property>
  51.  
  52. 6)mapred-site.xml
  53.  
  54. <property>
  55. <name>mapreduce.framework.name</name>
  56. <value>yarn</value>
  57. </property>
RAW Paste Data
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy. OK, I Understand
 
Top