Skip to content

Fluss x Iceberg: Table maintenance operations  #232

@Shekharrajak

Description

@Shekharrajak

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

Roadmap 2026 Fluss x Iceberg :

Pillar 6: Maintenance Operations
Lifecycle management for Iceberg metadata and files.

  • Snapshot Expiration: Configurable (default: disabled)
  • Orphan File Deletion: Configurable (default: disabled)

To achieve this goal with efficiency and with good performance. We can brainstorm/discuss to have fluss-rust + iceberg-rust integration - As per some of the benchmark rust implementation have better performance for all iceberg table maintenance operations .

Solution

No response

Anything else?

Ref apache/fluss#2342 (comment)

Also medium blog compaction with datafusion + rust : https://medium.com/@amitgil87/building-a-distributed-compaction-engine-for-apache-iceberg-with-rust-datafusion-09faa63c1438

Some old discussion to refer : apache/iceberg-rust#624

Willingness to contribute

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions