Implement partition writer

[ZENOTME]

Implement two partition writers:

• fanout partition writer: partition in writer
• partition writer: write the data already partitioned

[gupteaj]

@liurenjie1024 , I can look into one of this task , can you please assign me ?

[ZENOTME]

There are rust implementation in icelake can as a reference:

• fanout partition writer: https://github.com/icelake-io/icelake/blob/main/icelake/src/io_v2/functional_writer/partition_writer.rs
• partition writer: https://github.com/icelake-io/icelake/blob/main/icelake/src/io_v2/functional_writer/precompute_partition_writer.rs

[hackintoshrao]

Hey folks, curious to know the status of partition write in Iceberg Rust?

[ZENOTME]

Hey folks, curious to know the status of partition write in Iceberg Rust?

I'm working on this and we should complete #731 first.

[jonathanc-n]

@ZENOTME are you currently working on this? I can look to work on this.

[ZENOTME]

@ZENOTME are you currently working on this? I can look to work on this.

Thanks @jonathanc-n! I have completed it and will send PR later. Feel free for any suggestions.

[Kyle-Cooley]

Hello. I've gone through ZENOTME's PR and experimented with getting a fanout partition writer working. It is not too much more effort. I was wondering if I could help out with adding this feature.

[ZENOTME]

Hello. I've gone through ZENOTME's PR and experimented with getting a fanout partition writer working. It is not too much more effort. I was wondering if I could help out with adding this feature.

Thanks @Kyle-Cooley! I have the PR to implement partition splitter in #1040. Feel free to complete this feature after #1040 merged. And I will pay attention to make progress for #1040 recently.