Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Segment file first binpack strategy leads to inability to optimize SplitTasks #1866

Closed
1 task done
Tracked by #1930
XBaith opened this issue Aug 22, 2023 · 2 comments · Fixed by #1867
Closed
1 task done
Tracked by #1930

[Bug]: Segment file first binpack strategy leads to inability to optimize SplitTasks #1866

XBaith opened this issue Aug 22, 2023 · 2 comments · Fixed by #1867
Labels
type:bug Something isn't working

Comments

@XBaith
Copy link
Contributor

XBaith commented Aug 22, 2023

What happened?

image
OptimizeEvalutor found some partitions that need to optimize, but Planer didn't get any tasks.

Affects Versions

master

What engines are you seeing the problem on?

AMS

How to reproduce

  1. enable self-optimizing for the Iceberg table which has a certain number of segment files
  2. write some fragment files

Relevant log output

No response

Anything else

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@majin1102
Copy link
Contributor

Thanks for feeding back.
Is there any more conditions to reproduce this situation?

@XBaith
Copy link
Contributor Author

XBaith commented Aug 22, 2023

Thanks for feeding back. Is there any more conditions to reproduce this situation?

I believe this case would happen if there are a certain number of segment data files in the table

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:bug Something isn't working
Projects
None yet
2 participants