Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug][Flink]: Read duplicated data from keyed table, even though the upsert mode is enabled. #592

Closed
1 task done
zstraw opened this issue Nov 11, 2022 · 0 comments · Fixed by #594
Closed
1 task done

[Bug][Flink]: Read duplicated data from keyed table, even though the upsert mode is enabled. #592

zstraw opened this issue Nov 11, 2022 · 0 comments · Fixed by #594
Labels
module:mixed-flink Flink moduel for Mixed Format type:bug Something isn't working
Milestone
Release 0.4.0

Comments

@zstraw
Copy link
Contributor

zstraw commented Nov 11, 2022

What happened?

Read duplicated data from keyed table, even though the upsert mode is enabled.
Write to keyed table by flink.

Affects Versions

all

What engines are you seeing the problem on?

Flink

How to reproduce

No response

Relevant log output

No response

Anything else

The cause of this bug is that the shuffle policy is none before arctic writer operator. It leads to sending the records with same key to different subtask. Then the reader will read data in random order.

Code of Conduct

  • I agree to follow this project's Code of Conduct
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
module:mixed-flink Flink moduel for Mixed Format type:bug Something isn't working
Projects
None yet
Milestone
Release 0.4.0
1 participant
@zstraw