Skip to content

Home

Jump to bottom
Tushar Choudhary edited this page Sep 18, 2024 · 1 revision

Welcome to the local-data-platform wiki!

How to contribute

Hi iceberg community,

Then goal of this issue is to create a sandbox platform for open source enthusiasts to learn how to contribute to apache projects like python-iceberg. We get to learn new libraries and share that learning with the community.

Data Lake House format have a huge impact on cloud cost and understanding optimization are very important to scale at production.

I believe if we use a real world use case to break down the problem it will become easy to solve.

Explain the problem better

Who is facing the problem?

The python developer who is facing this problem is probably working for some data product company on a production environment.

What is the problem?

Interacting with Iceberg tables programmatically using Python

When does the problem occur?

Accessing the Iceberg table while a Spark Job is updating the underlying Table.

Where does the user encounter the problem ?

To replicate the cloud on local we can use tabular spark docker container

Why is the problem existing?

Iceberg tables being managed by python makes it very friendly

Clone this wiki locally