We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
None
I was trying to make PyIceberg rely solely on Iceberg-rust for the partition transforms, but I ran into the following:
def _transform(array: "ArrayLike") -> "ArrayLike": if isinstance(array, pa.Array): return transform_func(array, *args) elif isinstance(array, pa.ChunkedArray): result_chunks = [] for arr in array.iterchunks(): > result_chunks.append(transform_func(arr, *args)) E ValueError: Unexpected => Parser error: Invalid timezone "UTC": only offset based timezones supported without chrono-tz feature
We initialize the datetime as:
datetime
datetime(2023, 12, 31, 0, 0, 0, tzinfo=timezone.utc)
In test_transform.py:
test_transform.py
def test_year_transform_datetime(): arr = pa.array([ datetime(1970, 1, 1, 0, 0, 0, tzinfo=timezone.utc), datetime(2000, 1, 1, 0, 0, 0, tzinfo=timezone.utc) ]) result = transform.year(arr) expected = pa.array([0, 30], type=pa.int32()) assert result == expected
Able to just parse these. I'm not sure if we need to fix this in Arrow, or if we can import chrono-tz package.
chrono-tz
I cannot contribute a fix for this bug at this time
The text was updated successfully, but these errors were encountered:
Seems this is cause by arrow, see https://github.com/apache/arrow-rs/blob/d5339f31a60a4bd8a4256e7120fe32603249d88e/Cargo.toml#L98C51-L98C56 .
arrow
The temporal transforms are using arrow to do the transform:
iceberg-rust/crates/iceberg/src/transform/temporal.rs
Line 68 in dff4e5a
Sorry, something went wrong.
No branches or pull requests
Apache Iceberg Rust version
None
Describe the bug
I was trying to make PyIceberg rely solely on Iceberg-rust for the partition transforms, but I ran into the following:
We initialize the
datetime
as:To Reproduce
In
test_transform.py
:Expected behavior
Able to just parse these. I'm not sure if we need to fix this in Arrow, or if we can import
chrono-tz
package.Willingness to contribute
I cannot contribute a fix for this bug at this time
The text was updated successfully, but these errors were encountered: