spark-学习笔记--4 hadoop-2.4.1集群安装

spark-学习笔记--4   hadoop-2.4.1集群安装

 

vi core-site.xml

 

<property>

      <name>fs.default.name</name>

     <value>hdfs://master:9000</value>

</property>

 

 

 

 

 

 

 vi hdfs-site.xml

 

 

<property>

      <name>dfs.name.dir</name>

      <value>/usr/local/hadoop-2.4.1/data/namenode</value>

</property>

<property>

      <name>dfs.data.dir</name>

      <value>/usr/local/hadoop-2.4.1/data/datanode</value>

</property>

<property>

      <name>dfs.tmp.dir</name>

      <value>/usr/local/hadoop-2.4.1/data/tmp</value>

</property>

<property>

      <name>dfs.replication</name>

      <value>3</value>

</property>

 

 

<property>

  <name>dfs.http.address</name>

  <value>0.0.0.0:50070</value>

</property>

 

 

 

 

 

vi mapred-site.xml

 

<property>

      <name>mapreduce.framework.name</name>

      <value>yarn</value>

</property>

 

 

 

 

 vi  yarn-site.xml

 

<property>

      <name>yarn.resourcemanager.hostname</name>

      <value>master</value>

</property>

<property>

      <name>yarn.nodemanager.aux-services</name>

      <value>mapreduce_shuffle</value>

</property>

 

 

 配置 slaves

 

格式化 namenode

 

hdfs namenode -format 

 

启动hdfs

 

访问hdfs控制台

http://192.168.250.120:50070

 

 

 

 

启动yarn 集群

 

 

 start-yarn.sh   

 

 访问控制台

 http://192.168.250.120:8088