enhancement(s3 sink): S3 Sink Fails with Express One Zone Due to aws-sdk-s3 Version Compatibility

[johnmafly]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Problem

It appears that Vector.dev’s S3 sink does not work correctly with Express One Zone configurations. After investigating, I discovered that the underlying AWS SDK for S3 requires version 1.18.0 or later to support Express One Zone. The current implementation in Vector.dev seems to use an earlier version of the library, which lacks this support.

Steps to Reproduce:

Configure Vector.dev’s S3 sink to target an Express One Zone bucket.
Run the Vector.dev service.
Observe that the S3 sink fails to interact correctly with the Express One Zone bucket.

Expected Behavior:
The S3 sink should properly support Express One Zone buckets, which is available in aws-sdk-s3 version 1.18.0 and later.

Observed Behavior:
The sink fails to work with Express One Zone buckets, likely because the version of aws-sdk-s3 used does not support this configuration.

Suggested Fix:
Upgrade the aws-sdk-s3 dependency to at least version 1.18.0 to ensure compatibility with Express One Zone bucket configurations. This change should allow Vector.dev’s S3 sink to function correctly in this environment.

Configuration

Version

0.45.0

Debug Output

Example Data

No response

Additional Context

No response

References

https://github.com/awslabs/aws-sdk-rust/releases/tag/release-2024-03-13

[pront]

Hello @johnmafly, the latest version on https://crates.io/crates/aws-sdk-s3/versions is 1.77