Skip to content

Conversation

@sundarshankar89
Copy link
Collaborator

@sundarshankar89 sundarshankar89 commented Sep 26, 2025

Changes

This PR addresses broken tests following blueprint bug fixes by updating test configurations to include six new required boolean configuration fields. It ensures compatibility with recent blueprint changes that added new boolean configuration parameters.

Linked issues

databrickslabs/blueprint#268

Resolves #..
Resolves a Lakebridge bug which doesn't store boolean value in workspace config.yml when set to False.

Functionality

  • added relevant user documentation
  • added new CLI command
  • modified existing command: databricks labs ucx ...
  • added a new workflow
  • modified existing workflow: ...
  • added a new table
  • modified existing table: ...

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • verified on staging environment (screenshot attached)

Copilot AI review requested due to automatic review settings September 26, 2025 05:52
@sundarshankar89 sundarshankar89 requested a review from a team as a code owner September 26, 2025 05:52
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes broken tests after blueprint bug fixes by updating test configurations to include new required boolean configuration fields. The changes ensure test compatibility with blueprint changes that added new boolean configuration parameters.

  • Added six new boolean configuration fields to test fixtures
  • Updated dependency to use a patched version of databricks-labs-blueprint
  • Added configuration for direct Git references in pyproject.toml

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File Description
tests/unit/install/test_install.py Added new boolean configuration fields to test fixtures
tests/unit/hive_metastore/test_mapping.py Added 'compare_rows' field to mapping test data
pyproject.toml Updated blueprint dependency to Git reference and enabled direct references

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Comment on lines +50 to +51
#"databricks-labs-blueprint>=0.11.0,<0.12.0",
"databricks-labs-blueprint @ git+https://github.com/databrickslabs/blueprint@patch/bool_type",
Copy link

Copilot AI Sep 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using a Git branch reference instead of a versioned release creates instability and makes builds non-reproducible. Consider releasing a proper version of the blueprint library with the boolean type fixes and reverting to semantic versioning.

Suggested change
#"databricks-labs-blueprint>=0.11.0,<0.12.0",
"databricks-labs-blueprint @ git+https://github.com/databrickslabs/blueprint@patch/bool_type",
"databricks-labs-blueprint>=0.11.0,<0.12.0",

Copilot uses AI. Check for mistakes.
@sundarshankar89 sundarshankar89 added the pr/do-not-merge this pull request is not ready to merge label Sep 26, 2025
if len(groups) == 1:
return groups[0].display_name
group_names = [group.display_name for group in groups]
group_names = [group.display_name for group in groups if group.display_name is not None]
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was done for fmt fixes

@github-actions
Copy link

github-actions bot commented Sep 26, 2025

❌ 75/77 passed, 2 failed, 6 skipped, 3h52m23s total

❌ test_installation_with_dependency_upload: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task failing_task failed with message: Workload failed, see run output for details. (1m49.381s)
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task failing_task failed with message: Workload failed, see run output for details.
[gw2] linux -- Python 3.10.19 /home/runner/work/ucx/ucx/.venv/bin/python
09:24 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yr6K/config.yml) doesn't exist.
09:24 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
09:24 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
09:24 INFO [databricks.labs.ucx.install] Fetching installations...
09:24 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
09:24 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:24 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:24 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+820260129092425
09:24 INFO [databricks.labs.ucx.install] Creating ucx schemas...
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
09:24 INFO [databricks.labs.ucx.install] Creating dashboards...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
09:24 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yr6K/README for the next steps.
09:24 DEBUG [databricks.labs.ucx.installer.workflows] starting failing job: https://DATABRICKS_HOST#job/127610943973724
09:24 INFO [databricks.labs.ucx.installer.workflows] Named parameters for failing job: None
09:24 INFO [databricks.labs.ucx.installer.workflows] Started failing job: https://DATABRICKS_HOST#job/127610943973724/runs/174206482177379
09:24 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of failing job: https://DATABRICKS_HOST#job/127610943973724/runs/174206482177379
09:25 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS --------------
09:25 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yr6K/logs/failing does not exist
09:25 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ----------
09:25 INFO [databricks.labs.ucx.installer.workflows] The status for the latest run is FAILED
09:25 DEBUG [databricks.labs.ucx.installer.workflows] Repairing failing job: https://DATABRICKS_HOST#job/127610943973724/run/174206482177379
09:25 DEBUG [databricks.labs.ucx.installer.workflows] Validating failing workflow: https://DATABRICKS_HOST#job/127610943973724
09:25 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
09:24 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yr6K/config.yml) doesn't exist.
09:24 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
09:24 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
09:24 INFO [databricks.labs.ucx.install] Fetching installations...
09:24 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
09:24 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:24 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:24 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+820260129092425
09:24 INFO [databricks.labs.ucx.install] Creating ucx schemas...
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
09:24 INFO [databricks.labs.ucx.install] Creating dashboards...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
09:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
09:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
09:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
09:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
09:24 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yr6K/README for the next steps.
09:24 DEBUG [databricks.labs.ucx.installer.workflows] starting failing job: https://DATABRICKS_HOST#job/127610943973724
09:24 INFO [databricks.labs.ucx.installer.workflows] Named parameters for failing job: None
09:24 INFO [databricks.labs.ucx.installer.workflows] Started failing job: https://DATABRICKS_HOST#job/127610943973724/runs/174206482177379
09:24 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of failing job: https://DATABRICKS_HOST#job/127610943973724/runs/174206482177379
09:25 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS --------------
09:25 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yr6K/logs/failing does not exist
09:25 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ----------
09:25 INFO [databricks.labs.ucx.installer.workflows] The status for the latest run is FAILED
09:25 DEBUG [databricks.labs.ucx.installer.workflows] Repairing failing job: https://DATABRICKS_HOST#job/127610943973724/run/174206482177379
09:25 DEBUG [databricks.labs.ucx.installer.workflows] Validating failing workflow: https://DATABRICKS_HOST#job/127610943973724
09:25 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
09:25 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+820260129092425 from https://DATABRICKS_HOST
09:25 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_suxzybynx
09:25 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=301443943294328, as it is no longer needed
09:25 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=207178622789463, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1122754395024008, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=535354506918607, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=321591213698463, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=237327173368171, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=799548722266030, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=849705484865063, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=539259922027304, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=127610943973724, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=738608798200170, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=292103982651312, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=4854273531182, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=41669788799557, as it is no longer needed
09:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=867595432688254, as it is no longer needed
09:26 INFO [databricks.labs.ucx.install] Deleting cluster policy
09:26 INFO [databricks.labs.ucx.install] Deleting secret scope
09:26 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw2] linux -- Python 3.10.19 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_table_migration_convert_manged_to_external: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task parse_logs failed with message: Workload failed, see run output for details. (10m43.991s)
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task parse_logs failed with message: Workload failed, see run output for details.
[gw8] linux -- Python 3.10.19 /home/runner/work/ucx/ucx/.venv/bin/python
09:17 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.gUVG/config.yml) doesn't exist.
09:17 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
09:17 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
09:17 INFO [databricks.labs.ucx.install] Fetching installations...
09:17 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.gUVG is corrupted. Skipping...
09:17 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
09:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:17 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+820260129091713
09:17 INFO [databricks.labs.ucx.install] Creating ucx schemas...
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
09:17 INFO [databricks.labs.ucx.install] Creating dashboards...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.gUVG/README for the next steps.
09:17 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
09:17 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/932297035312352
09:17 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
09:17 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/932297035312352/runs/897486745850556
09:17 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/932297035312352
09:17 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
09:21 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/743681757769200
09:21 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
09:21 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/743681757769200/runs/124512766749753
09:21 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/743681757769200
09:21 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
09:17 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.gUVG/config.yml) doesn't exist.
09:17 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
09:17 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
09:17 INFO [databricks.labs.ucx.install] Fetching installations...
09:17 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.gUVG is corrupted. Skipping...
09:17 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
09:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
09:17 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+820260129091713
09:17 INFO [databricks.labs.ucx.install] Creating ucx schemas...
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
09:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
09:17 INFO [databricks.labs.ucx.install] Creating dashboards...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
09:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
09:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
09:17 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.gUVG/README for the next steps.
09:17 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
09:17 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/932297035312352
09:17 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
09:17 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/932297035312352/runs/897486745850556
09:17 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/932297035312352
09:17 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
09:21 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/743681757769200
09:21 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
09:21 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/743681757769200/runs/124512766749753
09:21 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/743681757769200
09:21 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
09:26 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+820260129091713 from https://DATABRICKS_HOST
09:26 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_ssqwtekya
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=743681757769200, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=865407541361714, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=932297035312352, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=800620067423706, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=824652922574173, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=720724242060287, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=127084244383907, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1007181021125935, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=222984650605988, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1073936287975743, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=153424190799283, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=880015655728638, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1034545342279442, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=81350065550077, as it is no longer needed
09:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=102009721108664, as it is no longer needed
09:27 INFO [databricks.labs.ucx.install] Deleting cluster policy
09:27 INFO [databricks.labs.ucx.install] Deleting secret scope
09:27 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw8] linux -- Python 3.10.19 /home/runner/work/ucx/ucx/.venv/bin/python

Running from acceptance #8963

@codecov
Copy link

codecov bot commented Jan 29, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 87.78%. Comparing base (d7a1c55) to head (98a5d9f).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #4442      +/-   ##
==========================================
- Coverage   87.95%   87.78%   -0.18%     
==========================================
  Files         123      123              
  Lines       17570    17570              
  Branches     3714     3714              
==========================================
- Hits        15453    15423      -30     
- Misses       1425     1458      +33     
+ Partials      692      689       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr/do-not-merge this pull request is not ready to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants