Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improvement]: Configure iceberg.worker.num-threads in the configuration file #2386

Closed
2 of 3 tasks
Tracked by #2176
zhongqishang opened this issue Nov 30, 2023 · 1 comment · Fixed by #2393
Closed
2 of 3 tasks
Tracked by #2176

[Improvement]: Configure iceberg.worker.num-threads in the configuration file #2386

zhongqishang opened this issue Nov 30, 2023 · 1 comment · Fixed by #2393

Comments

@zhongqishang
Copy link
Contributor

zhongqishang commented Nov 30, 2023

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

When Runtime.getRuntime().availableProcessors() is not obtained correctly or the obtained value is less than or equal to 2, the default value of iceberg is 2, AMS is congested in thread iceberg-work-pool-xx.

How should we improve?

Add parameters in config.yaml to overwrite the value of iceberg.worker.num-threads.

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Subtasks

No response

Code of Conduct

@HuangFru
Copy link
Contributor

This is a java property used by the Iceberg and it can be set in ams.sh like '-Diceberg.worker.num-threads=xxx'.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants