在Windows 10或Windows 7中的Apache Zeppelin中运行spark程序时出错

问题描述 投票:0回答:1

我是Apache Zeppelin的新手。安装0.8.0并使用7000端口访问Zeppelin。配置几个路径,如下所述。

JAVA_HOME:C:\ Program Files \ Java \ jdk1.8.0_144 HADOOP_HOME:C:\ winutils ZEPPELIN_HOME:C:\ zeppelin \ zeppelin-0.8.0-bin-all \ zeppelin-0.8.0-bin-all

所有这些变量都包含在路径变量和相应的bin文件夹中

试图运行spark程序并得到以下错误。尝试了多个选项来修复它,但无法解决。请帮忙。

Spark程序:%spark println(sc.appName)

错误:DEBUG [2018-07-29 00:06:05,371]({pool-2-thread-2} RemoteInterpreterManagedProcess.java [start]:153) - callbackServer现在正在服务INFO [2018-07-29 00:06: 05,380]({pool-2-thread-2} RemoteInterpreterManagedProcess.java [start]:190) - 运行解释器进程[C:\ zeppelin \ zeppelin-0.8.0-bin-all \ zeppelin-0.8.0-bin-all \ bin \ interpreter.cmd,-d,C:\ zeppelin \ zeppelin-0.8.0-bin-all \ zeppelin-0.8.0-bin-all / interpreter / spark,-c,10.120.44.23,-p,57136 ,-r,:, - l,C:\ zeppelin \ zeppelin-0.8.0-bin-all \ zeppelin-0.8.0-bin-all / local-repo / spark,-g,spark] DEBUG [2018-07 -29 00:06:09,625]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 警告:本地jar C:\ Users \ vvellabo \ 57136不存在,正在跳过。 DEBUG [2018-07-29 00:06:09,626]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 警告:本地jar C:\ Users \ vvellabo \ 10.120.44.23不存在,正在跳过。 DEBUG [2018-07-29 00:06:09,627]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - java.lang.ClassNotFoundException:org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer DEBUG [2018- 07-29 00:06:09,628]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 在java.net.URLClassLoader.findClass(URLClassLoader.java:381)DEBUG [2018-07-29 00:06 :[09,630]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 在java.lang.ClassLoader.loadClass(ClassLoader.java:424)DEBUG [2018-07-29 00:06:09,632]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 在java.lang.ClassLoader.loadClass(ClassLoader.java:357)DEBUG [2018-07-29 00:06:09,633]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 在java.lang.Class.forName0(本机方法)DEBUG [2018-07-29 00:06:09,634]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 在java .lang.Class .forName(Class.java:348)DEBUG [2018-07-29 00:06:09,635]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - at org.apache.spark.util.Utils $。 classForName(Utils.scala:238)DEBUG [2018-07-29 00:06:09,641]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - at org.apache.spark.deploy.SparkSubmit $ .org $ apache $ spark $ deploy $ SparkSubmit $$ runMain(SparkSubmit.scala:851)DEBUG [2018-07-29 00:06:09,642]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - at org。 apache.spark.deploy.SparkSubmit $ .doRunMain $ 1(SparkSubmit.scala:198)DEBUG [2018-07-29 00:06:09,644]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - at org。 apache.spark.deploy.SparkSubmit $ .submit(SparkSubmit.scala:228)DEBUG [2018-07-29 00:06:09,645]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - at org.apache .spark.deploy.SparkSubmit $ .main(SparkSubmit.scala:137)DEBUG [2018-07-29 00:06:09,647]({Exe c Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)DEBUG [2018-07-29 00:06:09,656]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 2018-07-29 00:06:09 INFO ShutdownHookManager:54 - 名为DEBUG的关闭钩子[2018-07-29 00:06:09,659]({Exec Stream Pumper} RemoteInterpreterManagedProcess.java [processLine]:298) - 2018-07-29 00:06:09 INFO ShutdownHookManager:54 - 删除目录C:\ Users \ vvellabo \ AppData \ Local \ Temp \ spark-427c3202-c243-4761-86ce-ea51a27a881c INFO [ 2018-07-29 00:06:09,747]({Exec Default Executor} RemoteInterpreterManagedProcess.java [onProcessFailed]:250) - 解释器进程失败{} org.apache.commons.exec.ExecuteException:进程退出并显示错误:101(退出值:101)org.apache.com上的org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)org.apache.com上的org.apache.commons.exec .DefaultExecutor.access $ 200(DefaultExecutor.java:48) mmons.exec.DefaultExecutor $ 1.run(DefaultExecutor.java:200)at java.lang.Thread.run(Thread.java:748)ERROR [2018-07-29 00:07:05,382]({pool-2-thread -2} Job.java [run]:190) - 作业失败java.lang.RuntimeException:警告:本地jar C:\ Users \ vvellabo \ 57136不存在,正在跳过。警告:本地jar C:\ Users \ vvellabo \ 10.120.44.23不存在,正在跳过。

谢谢vvell

apache-zeppelin
1个回答
1
投票

我遇到了类似的问题。如果有人解决了这个问题,请继续回答这个问题。 This link will help you!

如果您不想完成这些步骤,只需删除SPARK_HOME环境变量即可。 Zeppelin拥有自己的火花罐库。接下来去

%Zeppelin_HOME%\的conf \

并重命名

zeppelin-env.cmd.template到zeppelin-env.cmd

并添加以下行:

set JAVA="C:\Program Files\Java\jdk1.8.0_181"
set JAVA_HOME="%JAVA%"

确保输入正确的jdk路径。保存它并使用命令bin\zeppelin.cmd启动zepplin 你的齐柏林飞艇已准备就绪!通过运行任何简单代码来确认:例如,sc.version 希望这可以帮助!

© www.soinside.com 2019 - 2024. All rights reserved.