环境:
Eclipse: eclipse-jee-indigo-SR1-linux-gtk.tar.gz
Hadoop: hadoop-0.20.203.0
1、在使用Hadoop的压缩输出流时,发现总是报这隔错误:
Unable to load native-hadoop library for your platform
找了很多资料,都没能解决,最后终于发现是自己将文件名多加了个空格,导致本地库路径错误。
实际的路径是:
/home/hadoop/hadoop-0.20.203.0/lib/native/Linux-i386-32
另外要注意的是,Eclipse 运行配置的VM变量要加上一句:
-Djava.library.path=/home/hadoop/hadoop-0.20.203.0/lib/native/Linux-i386-32
并在程序中输出该变量值,以保证设置正确:
2、如果用org.apache.hadoop.io.compress.DefaultCodec,则不需要lzo库,以免花费很多不必要的时间在编译安装lzo库上面,因为你可能根本用不着。
3、将日志设置为DEBUG级别,能获得更多的关于错误的信息。
log4j.properties日志配置文件:
4、可能需要编译本地库,在RedHat AS4 上不编译本地库会报错:
[hadoop@hdp0 hadoop-0.20.203.0]$ more hs_err_pid8895.log
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGFPE (0x8) at pc=0x003d947c, pid=8895, tid=3074153392
#
# JRE version: 6.0_25-b06
# Java VM: Java HotSpot(TM) Server VM (20.0-b11 mixed mode linux-x86 )
# Problematic frame:
# C [ld-linux.so.2+0x847c]
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
--------------- T H R E A D ---------------
Current thread (0x0805a000): JavaThread "main" [_thread_in_native, id=8921, sta
ck(0xb736d000,0xb73be000)]
siginfo:si_signo=SIGFPE: si_errno=0, si_code=1 (FPE_INTDIV), si_addr=0x003d947c
Registers:
EAX=0x0f4d007f, EBX=0x003e6fd4, ECX=0x00000000, EDX=0x00000000
ESP=0xb73bb02c, EBP=0xb73bb074, ESI=0x08304800, EDI=0x70984e4c
EIP=0x003d947c, EFLAGS=0x00010246, CR2=0x00000004
Top of Stack: (sp=0xb73bb02c)
0xb73bb02c: b73d7cce 70984619 b73bb0e8 b73bb000
0xb73bb03c: 00000000 00000000 00000000 70984e4c
0xb73bb04c: 70984618 70984218 00000007 08304b08
0xb73bb05c: 00000000 0f4d007f 70984619 003e6fd4
0xb73bb06c: 083049b0 70984619 b73bb148 003d9822
0xb73bb07c: 70984258 b73bb104 08304958 00000000
0xb73bb08c: 00000000 00000001 00000000 00000000
0xb73bb09c: 00511820 0000003c 003e6fd4 003e7650
. . .
分享到:
相关推荐
Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 1. 下载文件native.rar 并解压 2. 用SecureFX 上传, 替换native目录下文件,选择二进制文件上传。 3. ...
搭建hadoop 环境时遇到启动异常告警问题 “WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable” 上来不多说,百度收集些相关...
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Found 2 items 解决方法是下载hadoop源代码重新编译, 但中间需要下载安装...
Hadoop使用过程报错:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...解决 下载过后把tar包解压在hdoop的lib/native下即可
解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...
安装hadoop启动之后总有警告:Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题...
升级glib解决Hadoop WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... 和 SequenceFile doesn't work with GzipCodec without native-hadoop code 问题, 具体请参见博文:...
14/01/27 10:52:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [Java HotSpot(TM) 64-Bit ...
原错误提示为:12/04/24 15:32:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 12/04/24 15:32:44 ERROR security....
用这个64位替换了官方的32位的native Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...
解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...
解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...
为了解决执行hadoop 命令时总有警告: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...
在安装hadoop时如果遇到WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform这个错误,请下载该文件放到hadoop目录下,Mac中放到libexec目录下。
缺少winutils.exe回报如下错误: Could not locate executable null \bin\winutils.exe in the hadoop binaries 缺少hadoop.dll 错误如下: Unable to load native-hadoop library for your platform… using ...
解决:Unable to load native-hadoop library for your platform 问题 原因: Apache提供的hadoop本地库是32位的,而在64位的服务器上就会有问题,因此需要自己编译64位的版本。 将准备好的64位的lib包解压到已经...
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [Java HotSpot(TM) Client VM warning: You have ...