Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Improve Kubernetes System Tests Iteration Experience #47595

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

jason810496
Copy link
Contributor

@jason810496 jason810496 commented Mar 11, 2025

related: #44508

Why

Improving the Kubernetes development experience, as described in #44508.

How

  • Introduce dev mode in the Helm chart
    • Add airflow-code-pvc PVC
    • Mount airflow-code-pvc as $AIRFLOW_HOME/airflow to include the source code
  • Introduce the breeze k8s reload command
    • Copy the current source code from the local machine to airflow-code-pvc
    • Roll out a restart for all Airflow components

What

  • Significantly improves the k8s test iteration process
    • Don't need to rebuild image and upload to kind cluster repeatedly.
  • Could potentially speed up CI in k8s system tests
    • Eliminates the need to rebuild the k8s image with breeze k8s build-k8s-image --rebuild-base-image for every change (only required when dependencies change)
    • Allows loading the latest code changes using breeze k8s reload

@boring-cyborg boring-cyborg bot added the area:helm-chart Airflow Helm Chart label Mar 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:helm-chart Airflow Helm Chart
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant