Cygwin运行nutch报错：Failed to set permissions of path

错误信息：

Exception in thread "main" java.io.IOException:Failed to set permissions of path:\tmp\hadoop-ysc\mapred\staging\ysc-2036315919\.staging to 0700

 

官方BUG参考：

https://issues.apache.org/jira/browse/HADOOP-7682

 

解决方法：

1、下载并解压http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-1.1.2/hadoop-1.1.2.tar.gz

2、修改hadoop-1.1.2\src\core\org\apache\hadoop\fs\FileUtil.java，搜索 Failed to set permissions of path，找到689行，把throw new IOException改为LOG.warn

3、修改hadoop-1.1.2\build.xml，搜索autoreconf，移除匹配的6个executable="autoreconf"的exec配置

4、下载解压ant，将ant目录下的bin目录加入环境变量path

5、在Cygwin命令下行切换到hadoop-1.1.2目录，执行ant

6、用新生成的hadoop-1.1.2\build\hadoop-core-1.1.3-SNAPSHOT.jar替换nutch的hadoop-core-1.0.3.jar

7、对于eclipse开发来说，替换C:\Users\ysc\.ivy2\cache\org.apache.hadoop\hadoop-core\jars\hadoop-core-1.1.2.jar

 

附件中的JAR是对hadoop1.2.1修改后的JAR，可用于Nutch1.7，其他Nutch版本没测试过。

 

 

 

 

 

评论

6 楼 liutaochn 2017-06-07  

可以用，thanks

5 楼 fsxdxh 2015-10-23  

请教一下，我已经注释FileUtil.java中的代码了，而且编译成功了，生成了hadoop-core-1.2.2-SNAPSHOT.jar文件，我改名成hadoop-core-1.2.1.jar并且覆盖了原来hadoop目录下的文件。
但是，在启动TaskTracker时还是报相同的错误。
请问这是怎么回事？

另外，即使我不改名，将hadoop-core-1.2.2-SNAPSHOT.jar直接复制到原来hadoop目录下，并删除hadoop-core-1.2.1.jar文件，还是相同的错误。
请问这是怎么回事？

4 楼 fsxdxh 2015-09-28  

我安装了2.7.1版本，提示：

$ start-dfs.sh
15/09/28 12:04:36 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.
Starting namenodes on []
orange: starting namenode, logging to /cygdrive/c/cygwin64/home/fusx/hadoop2/logs/hadoop-fusx-namenode-Orange.out
orange: starting datanode, logging to /cygdrive/c/cygwin64/home/fusx/hadoop2/logs/hadoop-fusx-datanode-Orange.out
]tarting secondary namenodes [Orange
: Name or service not knownstname orange
15/09/28 12:05:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

我查看了一下配置，这些配置应该是不需要的吧。我只是单机版本呢。

其余配置：
<property>
  <name>fs.default.name</name>
  <value>/cygwin64/home/sysdata2/name</value>
  <description>Deprecated. Use (fs.defaultFS) property
  instead</description>
</property>
<property>
  <name>fs.defaultFS</name>
  <value>hdfs://orange:9000</value>
</property>

3 楼 fsxdxh 2015-09-28  

请教一下，博主怎样解决？
目前，只有TaskTracker一个进程起不来，其余进程都启动了。

2 楼 yangshangchuan 2015-09-26  

fsxdxh 写道

还是不行啊，我在cygwin下启动，报错：
2015-09-26 11:54:11,887 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Failed to set permissions of path: \cygwin64\home\sysdata\mapred\local\taskTracker to 0755
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:691)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:672)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:349)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:193)
at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:823)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1573)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3937)

2015-09-26 11:54:11,895 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at Orange/192.168.5.107
************************************************************/

This version is very old, you should use the latest version: Hadoop 2.7.1. Have a nice day!

1 楼 fsxdxh 2015-09-26  

还是不行啊，我在cygwin下启动，报错：
2015-09-26 11:54:11,887 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Failed to set permissions of path: \cygwin64\home\sysdata\mapred\local\taskTracker to 0755
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:691)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:672)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:349)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:193)
at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:823)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1573)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3937)

2015-09-26 11:54:11,895 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at Orange/192.168.5.107
************************************************************/