Skip to content

feat(data-platform): complete phase 2.1 hardening#5

Merged
Flames4fun merged 2 commits intomainfrom
feature/phase-2-1-hardening
Mar 12, 2026
Merged

feat(data-platform): complete phase 2.1 hardening#5
Flames4fun merged 2 commits intomainfrom
feature/phase-2-1-hardening

Conversation

@Flames4fun
Copy link
Owner

Summary

Complete Phase 2.1 hardening for local reproducibility and CI.

Changes

  • add warehouse path configuration via env vars
  • make dbt profiles portable for dev/test
  • add direct dependencies, lockfile, and project metadata
  • add minimal CI for clean-environment validation
  • document core business metrics
  • update docs to reflect WAREHOUSE_PATH

Validation

  • python scripts/ingest_raw.py
  • pytest -q
  • dbt deps
  • dbt build

@Flames4fun
Copy link
Owner Author

Fix

CI could not find the dataops_ecommerce dbt profile because dbt/profiles.yml is gitignored and was not available in the GitHub runner.

Change

  • define DBT_PROFILES_DIR=.ci_dbt_profiles
  • generate temporary profiles.yml during the workflow
  • run dbt deps and dbt build with --profiles-dir "${DBT_PROFILES_DIR}"

Validation

  • reproduced locally with a temporary CI-style profile
  • dbt build passed: PASS=235 WARN=0 ERROR=0 SKIP=0 TOTAL=235

@Flames4fun Flames4fun merged commit 2bf1aac into main Mar 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant