千金一刻莫空度,老大无成空自伤。这篇文章主要讲述yarn安装MapReduce框架JAR上传的时候报错处理相关的知识,希望能为你提供帮助。
【yarn安装MapReduce框架JAR上传的时候报错处理】
22/03/03 18:14:04 INFO uploader.FrameworkUploader: Adding /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./hadoop-yarn-server-common-3.0.0-cdh6.3.0.jar
22/03/03 18:14:04 INFO uploader.FrameworkUploader: Adding /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar
22/03/03 18:14:05 ERROR uploader.FrameworkUploader: Error in execution /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<
init>
(FileInputStream.java:138)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.buildPackage(FrameworkUploader.java:334)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:126)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.main(FrameworkUploader.java:612)
Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:136)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.main(FrameworkUploader.java:612)
Caused by: java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<
init>
(FileInputStream.java:138)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.buildPackage(FrameworkUploader.java:334)
at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:126)
... 1 more
报错最明显的位置错误如下:
ERROR uploader.FrameworkUploader: Error in execution /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
解决方案:
每台yarn节点上去执行
cd /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/
rm -rf./jindofs-sdk.jar(此文件只是一个软链接,并非文件夹和文件,只能删除)
重新上传jindofs-sdk.jar到此目录
然后执行成功
推荐阅读
- nginx虚拟主机#yyds干货盘点#
- Go语言ioutil包详解
- 带你掌握Redis数据类型(string和Hash)
- #yyds干货盘点# Kubernetes 如何根据需求自定义你的 API((26))
- 生成对抗网络(GAN)
- 跟k8s工作负载Deployments的缘起缘灭
- LAMP实战案例: 在一台服务器上实现 wordpress 应用部署
- #yyds干货盘点# 1.2 Web前端开发相关技术
- #yyds干货盘点# 图解MySQL索引下推