Skip to content

Commit 8f554b1

Browse files
committed
[AMORO-1935] Change the default value of Self-Optimizing split task size to 128MB (#2073)
change default value of self-optimizing.max-task-size-bytes to 128MB
1 parent 828e407 commit 8f554b1

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

core/src/main/java/com/netease/arctic/table/TableProperties.java

+1-1
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,7 @@ private TableProperties() {
8888
public static final int SELF_OPTIMIZING_MAX_FILE_CNT_DEFAULT = 10000;
8989

9090
public static final String SELF_OPTIMIZING_MAX_TASK_SIZE = "self-optimizing.max-task-size-bytes";
91-
public static final long SELF_OPTIMIZING_MAX_TASK_SIZE_DEFAULT = 1073741824L; // 1 GB
91+
public static final long SELF_OPTIMIZING_MAX_TASK_SIZE_DEFAULT = 134217728; // 128 MB
9292

9393
public static final String SELF_OPTIMIZING_FRAGMENT_RATIO = "self-optimizing.fragment-ratio";
9494
public static final int SELF_OPTIMIZING_FRAGMENT_RATIO_DEFAULT = 8;

docs/user-guides/configurations.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ Self-optimizing configurations are applicable to both Iceberg Format and Mixed s
3535
| self-optimizing.execute.num-retries | 5 | Number of retries after failure of Self-optimizing |
3636
| self-optimizing.target-size | 134217728(128MB) | Target size for Self-optimizing |
3737
| self-optimizing.max-file-count | 10000 | Maximum number of files processed by a Self-optimizing process | |
38-
| self-optimizing.max-task-size-bytes | 1073741824(1GB) | Maximum file size bytes in a single task for splitting tasks | |
38+
| self-optimizing.max-task-size-bytes | 134217728(128MB) | Maximum file size bytes in a single task for splitting tasks | |
3939
| self-optimizing.fragment-ratio | 8 | The fragment file size threshold. We could divide self-optimizing.target-size by this ratio to get the actual fragment file size |
4040
| self-optimizing.minor.trigger.file-count | 12 | The minimum numbers of fragment files to trigger minor optimizing |
4141
| self-optimizing.minor.trigger.interval | 3600000(1 hour) | The time interval in milliseconds to trigger minor optimizing |

0 commit comments

Comments
 (0)