hadoop2.2.0 搭建时错误提示
You have loaded library /usr/local/hdfs/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 错误。
我的错误提示:
hduser@ubuntu:/usr/local/hdfs/hadoop-2.2.0/etc/hadoop$ start-dfs.sh 14/10/19 23:16:20 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /usr/local/hdfs/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. master.Hadoop] sed: -e expression #1, char 6: unknown option to `s' -c: Unknown cipher type 'cd' The authenticity of host 'master.hadoop (192.168.0.100)' can't be established. ECDSA key fingerprint is e9:54:fe:7f:10:ed:31:0b:f0:34:cb:59:87:9a:06:d4. Are you sure you want to continue connecting (yes/no)? The authenticity of host '64-bit (202.106.199.36)' can't be established. RSA key fingerprint is cd:7e:30:33:b7:b0:75:b1:bd:cb:22:3b:b4:ba:d7:4b. Are you sure you want to continue connecting (yes/no)? The authenticity of host 'you (202.106.199.36)' can't be established. RSA key fingerprint is cd:7e:30:33:b7:b0:75:b1:bd:cb:22:3b:b4:ba:d7:4b. Are you sure you want to continue connecting (yes/no)? The authenticity of host 'have (202.106.199.36)' can't be established. RSA key fingerprint is cd:7e:30:33:b7:b0:75:b1:bd:cb:22:3b:b4:ba:d7:4b. Are you sure you want to continue connecting (yes/no)? ^C64-Bit: Host key verification failed. master.Hadoop: Host key verification failed. have: Host key verification failed. You: Host key verification failed. hduser@ubuntu:/usr/local/hdfs/hadoop-2.2.0/etc/hadoop$ The authenticity of host 'guard. (202.106.199.36)' can't be established. RSA key fingerprint is cd:7e:30:33:b7:b0:75:b1:bd:cb:22:3b:b4:ba:d7:4b. Are you sure you want to continue connecting (yes/no)? guard.: Host key verification failed. The authenticity of host 'guard (202.106.199.36)' can't be established. RSA key fingerprint is cd:7e:30:33:b7:b0:75:b1:bd:cb:22:3b:b4:ba:d7:4b. Are you sure you want to continue connecting (yes/no)? guard: Host key verification failed. now.: ssh: Could not resolve hostname now.: Name or service not known noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or service not known
最后在github上找到解决方案。
最后因为环境变量的问题。后面两个链接也挺不错。
You add a variable on hadoop-env.sh and yarn-env.sh.
export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_PREFIX}/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib"
And.. starting!!
$ start-all.sh
Thanks. :D
Reference
http://www.yongbok.net/blog/how-to-install-hadoop-2-2-0-pseudo-distributed-mode
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/NativeLibraries.html
相关推荐
Hadoop 2.2.0 是 Apache Hadoop 的一个关键版本,它包含了众多改进和优化,使得这个分布式计算框架在处理大数据集时更加高效和稳定。在这个配置文件中,我们将会探讨Hadoop 2.2.0 在4台CentOS 6.4系统上运行所需的...
Hadoop2.2.0安装配置手册!完全分布式Hadoop集群搭建过程 按照文档中的操作步骤,一步步操作就可以完全实现hadoop2.2.0版本的完全分布式集群搭建过程
【Hadoop 2.2.0 知识点详解】 Hadoop是Apache软件基金会开发的一个开源框架,专门设计用于处理和存储大规模数据。Hadoop 2.2.0是其一个重要版本,它在Hadoop 1.x的基础上进行了大量的优化和改进,增强了系统的稳定...
- **功能增强**:Hadoop 2.2.0 版本中的HDFS进行了多项改进,例如支持更多的元数据操作、增强了HA(High Availability)功能,使得集群在出现故障时能够更快地恢复。 - **性能提升**:通过对HDFS内部机制的优化,...
如果在64位Linux系统上直接使用32位的Hadoop安装包,可能会遇到兼容性问题,例如缺少32位库,导致运行时错误。因此,为了确保Hadoop在64位环境中正常工作,我们需要对源代码进行编译,生成与系统匹配的64位版本。 ...
当在64位Linux系统上运行Hadoop 2.2.0时,如果遇到如性能下降、无法启动或者错误提示需要特定的native库,这时就需要使用这个预编译好的native文件夹。将这个文件夹替换到Hadoop安装目录下的相应位置,可以确保...
Hadoop2.2.0安装配置手册,新手安装和配置
资源名称:hadoop2.2.0集群搭建 资源太大,传百度网盘了,链接在附件中,有需要的同学自取。
hadoop2.2.0/2.6.0/2.7.0/2.7.1 64位安装包。
Hadoop2.2.0安装配置手册!完全分布式Hadoop集群搭建过程.
Hadoop2.2.0完全分布式集群平台安装设置 HDFS HA架构: 1、先设定电脑的IP为静态地址: 2、设置各个主机的hostname 3、在所有电脑的/etc/hosts添加以下配置: 4、设置SSH无密码登陆 5、下载解压hadoop-2.2.0.tar.gz...
Hadoop2.2.0版本 - 虚拟机VMWare - Linux(ubuntu) ,多节点伪分布环境搭建详细操作手册,可以直接用于完全分布。每一步都有自己详细操作记录和相关说明,几夜风雨的辛劳搭建和测试。 此操作手册搭建的集群详细说明: ...
资源名称:CentOS 6.5 x64下安装19实体节点Hadoop 2.2.0集群配置指南内容简介: CentOS 6.5 x64下安装19实体节点Hadoop 2.2.0集群配置指南主要讲述的是CentOS 6.5 x64下安装19实体节点Hadoop 2.2.0集群配置指南;...
在CentSO_64bit集群搭建,hadoop2.2(64位)编译 新版亮点: 基于yarn计算框架和高可用性DFS的第一个稳定版本。 注1:官网只提供32位release版本, 若机器为64位,需要手动编译。 环境配置是个挺烦人的活,麻烦不说还...
标题中的“Hadoop2.2.0环境测试详细傻瓜说明”表明了本文将要讨论的是关于Hadoop 2.2.0版本的环境配置和简单的应用测试,特别是针对新手的指南。描述中的“配置以后的一些测试,wordcount啥的,有信心的就不用下了”...
hadoop2.2.0 eclipse插件-重新编译过。hadoop用的是hadoop2.2.0版本,eclipse用的是 eclipse-kepler。 插件 eclipse-kepler
### Hadoop 2.2.0 部署详尽指南 #### 一、安装Linux **1. 安装wmware11** - **待补充:** 这部分需要更详细的说明来指导用户如何顺利安装wmware11,包括系统的最低配置要求、安装过程中需要注意的关键步骤等。 **...