Skip to content
This repository was archived by the owner on Mar 12, 2026. It is now read-only.

feat: Implement multipart upload of object store#913

Merged
ShiKaiWi merged 20 commits into
apache:mainfrom
MichaelLeeHZ:feat-object-store-multipart
May 24, 2023
Merged

feat: Implement multipart upload of object store#913
ShiKaiWi merged 20 commits into
apache:mainfrom
MichaelLeeHZ:feat-object-store-multipart

Conversation

@MichaelLeeHZ

@MichaelLeeHZ MichaelLeeHZ commented May 22, 2023

Copy link
Copy Markdown
Contributor

Related Issues

Closes #912

Detailed Changes

Define a trait CloudMultiPartUploadImpl that can be implemented by cloud-based object stores, which refers to object_store in arrow_rs.

Test Plan

Test in #887

@MichaelLeeHZ MichaelLeeHZ marked this pull request as ready for review May 22, 2023 13:19

@chunshao90 chunshao90 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it better to implement ObjectStorage trait?

Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
MichaelLeeHZ and others added 5 commits May 23, 2023 17:41
Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs
Comment thread components/object_store/src/multipart.rs
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs Outdated
Comment thread components/object_store/src/multipart.rs
Comment thread components/object_store/src/multipart.rs Outdated
MichaelLeeHZ and others added 10 commits May 24, 2023 15:08
Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>

@ShiKaiWi ShiKaiWi left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good Job!

@ShiKaiWi ShiKaiWi merged commit 391ea85 into apache:main May 24, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Implement object store on Obkv

3 participants