yarn安装MapReduce框架JAR上传的时候报错处理

千金一刻莫空度,老大无成空自伤。这篇文章主要讲述yarn安装MapReduce框架JAR上传的时候报错处理相关的知识,希望能为你提供帮助。


【yarn安装MapReduce框架JAR上传的时候报错处理】

22/03/03 18:14:04 INFO uploader.FrameworkUploader: Adding /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./hadoop-yarn-server-common-3.0.0-cdh6.3.0.jar
22/03/03 18:14:04 INFO uploader.FrameworkUploader: Adding /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar
22/03/03 18:14:05 ERROR uploader.FrameworkUploader: Error in execution /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.< init> (FileInputStream.java:138)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.buildPackage(FrameworkUploader.java:334)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:126)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.main(FrameworkUploader.java:612)
Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:136)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.main(FrameworkUploader.java:612)
Caused by: java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.< init> (FileInputStream.java:138)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.buildPackage(FrameworkUploader.java:334)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:126)
... 1 more

报错最明显的位置错误如下:
ERROR uploader.FrameworkUploader: Error in execution /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)

解决方案:
每台yarn节点上去执行
cd /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/
rm -rf./jindofs-sdk.jar(此文件只是一个软链接,并非文件夹和文件,只能删除)
重新上传jindofs-sdk.jar到此目录


然后执行成功

    推荐阅读