hadoop2.x集群部署一种一个datanode无法启动

0 0

hadoop2.x集群部署一种一个datanode无法启动10

2015-01-16 09:08:54,145 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.net.UnknownHostException: node1: node1
at java.net.InetAddress.getLocalHost(InetAddress.java:1473)
at org.apache.hadoop.security.SecurityUtil.getLocalHostName(SecurityUtil.java:187)
at org.apache.hadoop.security.SecurityUtil.login(SecurityUtil.java:207)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2153)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2202)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2378)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2402)
Caused by: java.net.UnknownHostException: node1
at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
at java.net.InetAddress.getLocalHost(InetAddress.java:1469)
... 6 more
2015-01-16 09:08:54,152 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
2015-01-16 09:08:54,164 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at java.net.UnknownHostException: node1: node1
************************************************************/
环境ubuntu,hadoop2.6,jdk7
部署三台虚拟机一台namenode,两台datanode;/etc/hostname 都已经配置分布为master,node1,node2
/etc/hosts配置为：
27.0.0.1 localhost
127.0.1.1 ubuntu.localdomain ubuntu

# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
192.168.184.129 master
192.168.184.130 node1
192.168.184.131 node2

hadoop/etc/hadoo/slaves配置为：
node1
node2
core-site.xml配置为：
<configuration>
<property> <name>fs.defaultFS</name>
<value>hdfs://master:9000/</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/yangwq/hadoop-2.6.0/temp</value>
<description>A base for other temporary directories.</description>
</property>
</configuration>
hdfs-site.xml配置为：
<configuration>

<property>
    <name>dfs.replication</name>
    <value>2</value>
    </property>
<property>
    <name>dfs.namenode.name.dir</name>
    <value>file:/home/yangwq/hadoop-2.6.0/dfs/name</value>
    <final>true</final>
</property>
<property>
    <name>dfs.datanode.data.dir</name>
    <value>file:/home/yangwq/hadoop-2.6.0/dfs/data</value>
</property>
</configuration>
mapred-site.xml配置为：
<configuration>
<property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
        <final>true</final>
</property>
</configuration>
yarn-site.xml配置为：
<configuration>


<property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
</property>
<property>
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>

<property>
    <name>yarn.resourcemanager.hostname</name>
    <value>master</value>
</property>
</configuration>
在启动的时候node1节点的datanode一直无法启动，同时通过ssh登录各节点都是正常。