我正在使用hadoop 2.7.3在EMR上运行mapreduce / hadoop。从AWS进行库存安装，并且该罐是使用maven shade插件构建的。等待ResourceManager时，它会无限卡住，但我在日志文件或在线中绝对找不到任何东西。
在job.waitForCompletion中，出现以下一行：
020-01-25 05:52:41,346 INFO org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl (main): Timeline service address: http://ip-172-31-13-41.us-west-2.compute.internal:8188/ws/v1/timeline/
2020-01-25 05:52:41,356 INFO org.apache.hadoop.yarn.client.RMProxy (main): Connecting to ResourceManager at ip-172-31-13-41.us-west-2.compute.internal/172.31.13.41:8032
然后，它只是坐在那里...永远不会取得进展，必须关闭集群或手动终止任务。
有趣的是，通过运行hadoop jar <arguments>，我可以在本地重现此步骤，但是我不知道是什么原因造成的。
[大约25分钟后，在打开罐子时失败：
After 25 minutes or so, the job produces output of the form:
AM Container for appattempt_1580058321574_0005_000001 exited with exitCode: -1000
For more detailed output, check application tracking page:http://192.168.2.21:8088/cluster/app/application_1580058321574_0005Then, click on links to logs of each attempt.
Diagnostics: /Users/gbronner/hadoopdata/yarn/local/usercache/gbronner/appcache/application_1580058321574_0005/filecache/11_tmp/tmp_job.jar (Is a directory)
java.io.FileNotFoundException: /Users/gbronner/hadoopdata/yarn/local/usercache/gbronner/appcache/application_1580058321574_0005/filecache/11_tmp/tmp_job.jar (Is a directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:225)
at java.util.zip.ZipFile.<init>(ZipFile.java:155)
at java.util.jar.JarFile.<init>(JarFile.java:166)
at java.util.jar.JarFile.<init>(JarFile.java:130)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:94)
at org.apache.hadoop.yarn.util.FSDownload.unpack(FSDownload.java:297)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:364)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Failing this attempt
这同时在AWS EMR和本地发生。从未见过此错误，并且直接使用EMR。
关于为什么会发生这种情况的任何想法？坏罐子？可能与another unanswered question here相关>
我正在使用hadoop 2.7.3在EMR上运行mapreduce / hadoop。从AWS进行库存安装，并且该罐是使用maven shade插件构建的。等待ResourceManager时，它无限卡住，但是我已经...
经过数百次实验的详尽尝试之后，看来有违规行了