flinkOnYarn 启动报错NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException

最新推荐文章于 2023-04-23 20:56:24 发布

原创最新推荐文章于 2023-04-23 20:56:24 发布 · 6.1k 阅读

6 ·

CC 4.0 BY-SA版权

大数据专栏收录该内容

29 篇文章

订阅专栏

本文解决Apache Flink 1.9.0在启动YARN会话时遇到的NoClassDefFoundError和ClassNotFoundException错误。问题在于未正确配置预捆绑的Hadoop 2.7.5包，解决方案包括下载匹配版本的Hadoop并将其放置在Flink的lib目录下，或设置HADOOP_CLASSPATH环境变量。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

[root@hadoop-01 flink-1.9.0]# bin/yarn-session.sh 
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException
	at java.lang.Class.getDeclaredMethods0(Native Method)
	at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
	at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
	at java.lang.Class.getMethod0(Class.java:3018)
	at java.lang.Class.getMethod(Class.java:1784)
	at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
	at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

原因：没有将官方指定Pre-bundled Hadoop 2.7.5包放到flink的lib目录下

Apache Flink® 1.9.0 is our latest stable release.

If you plan to use Apache Flink together with Apache Hadoop (run Flink on YARN, connect to HDFS, connect to HBase, or use some Hadoop-based file system connector) then select the download that bundles the matching Hadoop version, download the optional pre-bundled Hadoop that matches your version and place it in the lib folder of Flink, or export your HADOOP_CLASSPATH

https://flink.apache.org/downloads.html