Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Support managing iceberg tables already existed #260

Closed
1 of 2 tasks
zhoujinsong opened this issue Aug 31, 2022 · 0 comments
Closed
1 of 2 tasks

[Feature]: Support managing iceberg tables already existed #260

zhoujinsong opened this issue Aug 31, 2022 · 0 comments
Labels
module:core Core module type:feature Feature Requests
Milestone
Release 0.4.0

Comments

@zhoujinsong
Copy link
Contributor

zhoujinsong commented Aug 31, 2022 •
edited
Loading

Description

Support manage already existed iceberg tables

Use case/motivation

Arctic support create new iceberg table now but not support manage exsited iceberg table.

Describe the solution

  • Support add existed iceberg catalog to arctic
  • Support all kinds of iceberg catalog type, like hadoop 、hive
  • Support manage existed iceberg tables in ams
  • Support optimize existed iceberg tables

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@zhoujinsong zhoujinsong added the type:feature Feature Requests label Aug 31, 2022
@zhoujinsong zhoujinsong added this to the Release 0.4.0 milestone Aug 31, 2022
@zhoujinsong zhoujinsong added the module:core Core module label Sep 21, 2022
@zhoujinsong zhoujinsong pinned this issue Oct 18, 2022
@zhoujinsong zhoujinsong changed the title [Feature]: Supporting manage already existed iceberg table [Feature]: Support manage already existed iceberg tables Oct 18, 2022
@majin1102 majin1102 changed the title [Feature]: Support manage already existed iceberg tables [Feature]: Support managing iceberg tables already existed Oct 20, 2022
@zhoujinsong zhoujinsong mentioned this issue Nov 1, 2022
Merged
3 tasks
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 8, 2022
feature apache#260 Support optimize existed iceberg tables
76a09fd
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 9, 2022
feature apache#260 adapt iceberg 0.13.2
40af0b1
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 9, 2022
feature apache#260 fix local test
cb747d7
@hzluting hzluting mentioned this issue Nov 9, 2022
Merged
3 tasks
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 11, 2022
feature apache#260 support expire clean and orphan clean for native i…
b524d27 
…ceberg table
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 14, 2022
feature apache#260 fix review
ea97621
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 fix local test
8897ab6
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 remove static
6a0d07d
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 fix derby sql
bbd4493
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 fix unit test
84447e7
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 fix unit test
b271f0a
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 optimize unit test for support hive
b93641f
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 unit test
78fc035
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 unit test
01bbda1
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 16, 2022
feature apache#260 unit test
4329383
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 move ignore error to debug
b0b8ed5
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix SupportHiveCommit
afdb053
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 unit test
f2bd750
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix unit test
21dd126
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix unit test
f0d452c
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix unit test
220e573
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix unit test
b1ee511
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix unit test
47bb87d
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix unit test
7ca4247
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 merge master
827a14f
hzluting pushed a commit to hzluting/arctic that referenced this issue Nov 17, 2022
feature apache#260 fix checkstyle
3f9dc31
wangtaohz added a commit that referenced this issue Nov 17, 2022
@hzluting @wangtaohz
[ARCTIC-260][Optimizer] Support optimize existed iceberg tables (#581)
b3e281e 
* feature #260 Support optimize existed iceberg tables

* feature #260 adapt iceberg 0.13.2

* feature #260 fix local test

* feature #260 support expire clean and orphan clean for native iceberg table

* merge master

* feature #260 fix review

* remove useless comment

* refactor change isNativeIceberg to isIcebergTableFormat in TableTypeUtil

* refactor NativeExecutor to IcebergExecutor

* add docs for optimize

* feature #260 fix local test

* feature #260 remove static

* doc add optimize for table-management

* improve #614 reduce unit test file count

* merge master

* feature #260 fix derby sql

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 optimize unit test for support hive

* feature #260 unit test

* feature #260 unit test

* feature #260 unit test

* feature #260 move ignore error to debug

* feature #260 fix SupportHiveCommit

* feature #260 unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 merge master

* feature #260 fix checkstyle

Co-authored-by: luting <[email protected]>
Co-authored-by: wangtao <[email protected]>
@zhoujinsong zhoujinsong unpinned this issue Nov 30, 2022
zhoujinsong pushed a commit that referenced this issue May 31, 2023
@hzluting @wangtaohz
[ARCTIC-260][Optimizer] Support optimize existed iceberg tables (#581)
5f1c3cc 
* feature #260 Support optimize existed iceberg tables

* feature #260 adapt iceberg 0.13.2

* feature #260 fix local test

* feature #260 support expire clean and orphan clean for native iceberg table

* merge master

* feature #260 fix review

* remove useless comment

* refactor change isNativeIceberg to isIcebergTableFormat in TableTypeUtil

* refactor NativeExecutor to IcebergExecutor

* add docs for optimize

* feature #260 fix local test

* feature #260 remove static

* doc add optimize for table-management

* improve #614 reduce unit test file count

* merge master

* feature #260 fix derby sql

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 optimize unit test for support hive

* feature #260 unit test

* feature #260 unit test

* feature #260 unit test

* feature #260 move ignore error to debug

* feature #260 fix SupportHiveCommit

* feature #260 unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 fix unit test

* feature #260 merge master

* feature #260 fix checkstyle

Co-authored-by: luting <[email protected]>
Co-authored-by: wangtao <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
module:core Core module type:feature Feature Requests
Projects
None yet
Milestone
Release 0.4.0
Development

No branches or pull requests
2 participants
@hzluting @zhoujinsong