我试图从源代码安装Hadoop 2.7.2,我得到了以下错误,我已经google了但找不到任何解决方案。
请帮忙。
问候
Mac:10.11.2(64位); Java:java版“1.8.0_60”; protoc -version:libprotoc 2.5.0; maven3.3.9
命令:mvn包-Pdist,native -DskipTests -Dtar -X
错误信息:
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [ 2.565 s]
[INFO] hadoop-mapreduce ................................... SUCCESS [ 2.230 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [ 2.199 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [ 4.951 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [ 1.168 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [ 3.008 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [ 1.990 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [ 1.228 s]
[INFO] Apache Hadoop Ant Tasks ............................ SUCCESS [ 1.143 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [ 1.574 s]
[INFO] Apache Hadoop Pipes ................................ FAILURE [ 0.627 s]
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Azure support ........................ SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] -------------------------------------------------------------- ----------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:05 min
[INFO] Finished at: 2016-04-24T11:10:13+08:00
[INFO] Final Memory: 154M/1709M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-
plugin:1.7:run (make) on project hadoop-pipes: An Ant BuildException
has occured: exec returned: 1
[ERROR] around Ant part ...<exec failonerror="true"
dir="/Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-
pipes/target/native" executable="cmake">... @ 5:135 in
/Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-
pipes/target/antrun/build-main.xml
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debuglogging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
我曾尝试安装libssl-dev,但brew install找不到libssl-dev
我在macOS上编译Hadoop本机lib时也遇到了这个问题。解:
vim /Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-
pipes/target/antrun/build-main.xml
cmake /Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-pipes/src/ -DJVM_ARCH_DATA_MODEL = 64
然后您将看到错误的具体原因:
Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the System variable OPENSSL_ROOT_DIR (missing: OPENSSL_INCLUDE_DIR), suggesting that not found openssl suggested that the need to add environment variables
export OPENSSL_ROOT_DIR=/usr/local/Cellar/openssl/1.0.2k
(注意这是openssl安装目录,我使用brew安装openssl)
export OPENSSL_INCLUDE_DIR=/usr/local/Cellar/openssl/1.0.2k/include
然后再次执行:
cmake /Users/wanwenqing/Hadoop/hadoop-2.7.2-src/hadoop-tools/hadoop-pipes/src/ -DJVM_ARCH_DATA_MODEL = 6
如果没有错误,您可以重新运行maven编译器命令来构建hadoop native lib。