Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Nov 15, 2025

What changes were proposed in this pull request?

This PR aims to add free_disk_space_container step to K8s integration test GitHub Action job.

Why are the changes needed?

The CI is flaky due to No space left on device error.

[info]   25/11/14 21:27:02 ERROR TaskSchedulerImpl: Lost executor 4 on 10.244.0.67: Unable to create executor due to /var/data/spark-163899dd-08da-4b76-b71d-c428207a3bdf/spark-1e9d976f-69b3-4274-af03-300cfc4d6fd5/-14621403551763155568738_cache
-> ./software.amazon.awssdk_bundle-2.29.52.jar:
No space left on device

Like the other four GitHub Action jobs, free_disk_space_container will mitigate this situation in this job.

$ git grep ./dev/free_disk_space_container
.github/workflows/build_and_test.yml:      run: ./dev/free_disk_space_container
.github/workflows/build_and_test.yml:      run: ./dev/free_disk_space_container
.github/workflows/build_and_test.yml:      run: ./dev/free_disk_space_container
.github/workflows/build_and_test.yml:      run: ./dev/free_disk_space_container

Does this PR introduce any user-facing change?

No, this is a test infra change.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the INFRA label Nov 15, 2025
@dongjoon-hyun dongjoon-hyun marked this pull request as draft November 15, 2025 06:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant