`
kfcman
  • 浏览: 395562 次
  • 性别: Icon_minigender_1
  • 来自: 上海
社区版块
存档分类
最新评论

Unable to load native-hadoop library for your platform... using builtin-java cl

 
阅读更多

Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

在配置的时候,频繁出现这个问题,在网上找了相关资料,都是说libray包没找到。

检查所有配置,一切都正常。都配置正常。

修改过:etc/profile

问题还是没解决。

 

之后尝试如下步骤:

1, 开启调试日志 export HADOOP_ROOT_LOGGER=DEBUG,console

2,/data/server/hadoop-2.6.0/bin 

   ./hadoop checknative -a

查看日志,报如下错误:

[hadoop@DEV-NEW-HADOOP-01 bin]$ ./hadoop checknative

18/09/28 09:55:34 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...

18/09/28 09:55:34 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path

18/09/28 09:55:34 DEBUG util.NativeCodeLoader: java.library.path=:/data/server/hadoop-2.6.0/lib/native/Linux-amd64-64/

18/09/28 09:55:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

18/09/28 09:55:35 DEBUG util.Shell: setsid exited with exit code 0

Native library checking:

hadoop:  false 

zlib:    false 

snappy:  false 

lz4:     false 

bzip2:   false 

openssl: false 

18/09/28 09:55:35 INFO util.ExitUtil: Exiting with status 1

 

查看环境变量,并没有配置 java.library.path=:/data/server/hadoop-2.6.0/lib/native/Linux-amd64-64/。

之后,尝试使用:export JAVA_LIBRARY_PATH=$JAVA_LIBRARY_PATH:/data/server/hadoop-2.6.0/lib/native/

然后在检查:./hadoop checknative

恢复正常,问题解决

[hadoop@DEV-NEW-HADOOP-02 bin]$ ./hadoop checknative

18/09/28 09:57:14 WARN bzip2.Bzip2Factory: Failed to load/initialize native-bzip2 library system-native, will use pure-Java version

18/09/28 09:57:14 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library

Native library checking:

hadoop:  true /data/server/hadoop-2.6.0/lib/native/libhadoop.so

zlib:    true /lib64/libz.so.1

snappy:  true /data/server/hadoop-2.6.0/lib/native/Linux-amd64-64/libsnappy.so.1

lz4:     true revision:99

bzip2:   false 

openssl: true /usr/lib64/libcrypto.so

 

分享到:
评论

相关推荐

    Unable to load native-hadoop library for your platform...

    Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 1. 下载文件native.rar 并解压 2. 用SecureFX 上传, 替换native目录下文件,选择二进制文件上传。 3. ...

    Hadoop 启动WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using

    搭建hadoop 环境时遇到启动异常告警问题 “WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable” 上来不多说,百度收集些相关...

    hadoop2.8.1 native for macOS10

    WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Found 2 items 解决方法是下载hadoop源代码重新编译, 但中间需要下载安装...

    hadoop-native-64-2.6.0.zip

    Hadoop使用过程报错:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...解决 下载过后把tar包解压在hdoop的lib/native下即可

    win10-hadoop3.0.0或其他版本 Unable to load native-hadoop library 缺失文件

    hadoop 3.0.0 或者其他版本 报错Unable to load native-hadoop library时,放到c:/system32就可以

    hadoop-core-1.1.1.jar

    原错误提示为:12/04/24 15:32:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 12/04/24 15:32:44 ERROR security....

    hadoop-native-64-2.7.0.tar

    解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...

    flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar.tar.gz

    在这个特定的兼容包中,我们可以看到两个文件:flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar(实际的兼容库)和._flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar(可能是Mac OS的元数据文件,通常...

    hadoop-native-64-2.8.1.tar.7z

    用这个64位替换了官方的32位的native Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    hadoop 2.8.0 macOS native library

    安装hadoop启动之后总有警告:Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题...

    hadoop-2.4.1 64位 libhadoop.so.1.0.0

    WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [Java HotSpot(TM) Client VM warning: You have ...

    haddop-2.6.4 native 64位

    为了解决执行hadoop 命令时总有警告: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    hadoop各版本--hadoop.dll,以及winutils.exe,亲测

    Could not locate executable null \bin\winutils.exe in the hadoop binaries 缺少hadoop.dll 错误如下: Unable to load native-hadoop library for your platform… using builtin-java classes where ...

    hadoop-2.6.0编译好的64bit的native库

    14/01/27 10:52:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [Java HotSpot(TM) 64-Bit ...

    hadoop-native-64-2.5.0.tar

    解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...

    hadoop-native-64-2.6.0.tar

    解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...

    hadoop-native-64-2.5.2.tar

    解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...

    parquet-hadoop-1.8.2-API文档-中文版.zip

    赠送jar包:parquet-hadoop-1.8.2.jar; 赠送原API文档:parquet-hadoop-1.8.2-javadoc.jar; 赠送源代码:parquet-hadoop-1.8.2-sources.jar; 赠送Maven依赖信息文件:parquet-hadoop-1.8.2.pom; 包含翻译后的API...

    jdk7+ubuntu14.04_32位下编译的hadoop2.6.0的libhadoop.so.1.0.0

    jdk7+ubuntu14.04_32位下编译的hadoop2.6.0的libhadoop....14/10/10 08:35:56 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Global site tag (gtag.js) - Google Analytics