flink java.lang.RuntimeException:null异常

最新推荐文章于 2025-06-20 21:52:54 发布

guangyingposuo

最新推荐文章于 2025-06-20 21:52:54 发布

阅读量5.4k

点赞数

CC 4.0 BY-SA版权

分类专栏： flink

本文链接：https://blog.csdn.net/guangyingposuo/article/details/103287870

flink 专栏收录该内容

2 篇文章

订阅专栏

本文解析了在华为云上运行的Flink程序出现NullPointerException异常的原因，并提供了详细的解决方案。异常发生在KeyGroupRangeAssignment.assignToKeyGroup方法中，通过检查发现是由于key为null导致。在代码中对plateNo字段进行null检查，避免了异常的发生。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

flink程序在华为云上运行一段时间后，程序突然有问题，抛出异常了。

一、异常：

java.lang.RuntimeException: null
	at org.apache.flink.streaming.runtime.io.RecordWriterOutput.pushToRecordWriter(RecordWriterOutput.java:110)
	at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:89)
	at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:45)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:683)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:661)
	at org.apache.flink.streaming.api.operators.StreamSourceContexts$NonTimestampContext.collect(StreamSourceContexts.java:104)
	at org.apache.flink.streaming.api.operators.StreamSourceContexts$NonTimestampContext.collectWithTimestamp(StreamSourceContexts.java:111)
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.emitRecordWithTimestamp(AbstractFetcher.java:398)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.emitRecord(Kafka010Fetcher.java:89)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.runFetchLoop(Kafka09Fetcher.java:154)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:738)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:306)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException: null
	at org.apache.flink.runtime.state.KeyGroupRangeAssignment.assignToKeyGroup(KeyGroupRangeAssignment.java:59)
	at org.apache.flink.runtime.state.KeyGroupRangeAssignment.assignKeyToParallelOperator(KeyGroupRangeAssignment.java:48)
	at org.apache.flink.streaming.runtime.partitioner.KeyGroupStreamPartitioner.selectChannels(KeyGroupStreamPartitioner.java:63)
	at org.apache.flink.streaming.runtime.partitioner.KeyGroupStreamPartitioner.selectChannels(KeyGroupStreamPartitioner.java:32)
	at org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:106)
	at org.apache.flink.streaming.runtime.io.StreamRecordWriter.emit(StreamRecordWriter.java:81)
	at org.apache.flink.streaming.runtime.io.RecordWriterOutput.pushToRecordWriter(RecordWriterOutput.java:107)
	... 16 common frames omitted

二、解决思路

查看异常报告，发现

java.lang.NullPointerException: null
at org.apache.flink.runtime.state.KeyGroupRangeAssignment.assignToKeyGroup(KeyGroupRangeAssignment.java:59)

发现异常出现在这一行，查看源码，发现：

发现24行能报null的只有key.hashCode()；判断应该是key是null，到这里发现是我们的flink程序key可能为null。

查看程序：我们将plateNo设为flink的key

应该是flink消费kafka数据中的plateNo 属性有为null的数据。

解决：

if(plateNo ==null ||plateNo.equals("")){
     value.setPlateNo("null");
 }

修改后发现程序没有问题了。问题定位准确。