Flink结合Mysql读写Doris数据

for your wish

已于 2023-07-28 16:57:46 修改

阅读量1.3k

点赞数

CC 4.0 BY-SA版权

文章标签： java maven 开发语言

于 2022-08-12 11:31:33 首次发布

本文链接：https://blog.csdn.net/someInNeed/article/details/126300857

Flink 专栏收录该内容

42 篇文章 ¥29.90 ¥99.00

订阅专栏

超级会员免费看

本文介绍了使用Flink1.4结合Doris1.1进行数据读写的实践，遇到的问题及解决方案。在Doris数据写入过程中，由于checkpoint未设置成功导致数据无法写入。通过设置执行环境并调整Doris的建表和视图配置，最终实现每秒20条数据的稳定获取。上线时，需将部分依赖改为`provided`，如maven的log4j。通过指定程序入口并提交任务，实现了Flink作业的顺利上线和在线运行。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Flink14+Doris1.1

上线的时候需要provided 本地的时候注释掉provided

<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.  See the NOTICE file
distributed with this work for additional information
regarding copyright ownership.  The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License.  You may obtain a copy of the License at

  http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND,

了解本专栏