hadoop伪分布式配置

修改core-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

 

<!-- Put site-specific property overrides in this file. -->

 

<configuration>

    <property> 

        <name>fs.default.name</name> 

        <value>hdfs://localhost/</value>

    </property>

</configuration>

 

修改hdfs-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

 

<!-- Put site-specific property overrides in this file. -->

 

<configuration>

    <property> 

        <name>dfs.replication</name>

        <value>1</value>

    </property>

</configuration>

 

修改mapred-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

 

<!-- Put site-specific property overrides in this file. -->

 

<configuration>

    <property>

        <name>mapred.job.tracker</name>

        <value>localhost:8021</value>

    </property>

</configuration>

 

然后将SSH设置成不用输入密码就能登录：

ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

测试修改是否生效：

ssh localhost

 

格式化HDFS：

hadoop namenode -format

 

启动HDFS和MapReduce

start-dfs.sh

start-mapred.sh

验证HDFS是否启动成功：

http://localhost:50070/

 

验证MapReduce是否启动成功：

http://localhost:50030/

 

也可查看后台进程，如果namenode,secondary namenode,datanode.这3个进程表示HDFS启动成功，如果有JobTracker和TaskTracker进程表示MapReduce启动成功