-
Notifications
You must be signed in to change notification settings - Fork 65
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Optimize snapshots storage #234
base: main
Are you sure you want to change the base?
Conversation
The remaining work to do here is:
|
When checking pause on some bigger snapshots (around 3 GB total) the post-processing of memory took most of the time—when we work on the outlines optimizations we should take into account how they might slow down this further+optimize this speed also. |
This PR will probably be cherry picked for the actual changes after we add tests/benchmarks to the code that would be affected. Otherwise this could result in regression. |
Optimize snapshot storage in preparation to enable the automatic pausing of snapshots.
Subtasks: