[SET-1211] Create Seqera Resources for the first set of projects

[rameshka]

This PR integrates IaC logic to manage Seqera resources into the CPG-infra.

To manage Seqera resources;

• We implement Pulumi Dynamic Resources and
• The lifecycle steps (create, update, delete) are custom-written to fulfil our requirements.

See documentation: Managing Seqera resources with Pulumi Dynamic Providers

Additionally:

• For each dataset, create new GCS buckets as work directories for compute environments in main and test workspaces.
• In the current implementation
  • The compute environment created for each dataset has the same compute config
  • The service account created for the WIF is used as the compute environment's runtime SA.

Corresponding CPG infra private PR: https://github.com/populationgenomics/cpg-infrastructure-private/pull/763

TODO Before merging

• Create and add the Seqera machine user token to the secret manager.
• Add this Seqera machine user to all the workspaces with its role
• Make sure the users are onboarded to the Seqera platform.

[github-actions]

Test Results

29 tests  +29   29 ✅ +29   3s ⏱️ +3s
 1 suites + 1    0 💤 ± 0 
 1 files   + 1    0 ❌ ± 0 

Results for commit 839a1b3. ± Comparison against base commit b95aaf8.

♻️ This comment has been updated with latest results.

[codecov-commenter]

Codecov Report

❌ Patch coverage is 63.33333% with 220 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (set-1258-create-seqera-resources@b95aaf8). Learn more about missing BASE report.

Files with missing lines	Patch %	Lines
cpg_infra/driver/dataset_seqera_infrastructure.py	22.61%	65 Missing ⚠️
...ers/seqera/resources/seqera_compute_environment.py	31.03%	60 Missing ⚠️
...s/seqera/resources/seqera_workspace_participant.py	32.14%	38 Missing ⚠️
...mic_providers/seqera/resources/seqera_workspace.py	43.58%	22 Missing ⚠️
cpg_infra/driver/infrastructure.py	28.57%	15 Missing ⚠️
...mic_providers/seqera/inputs/compute_environment.py	88.97%	14 Missing ⚠️
...river/dynamic_providers/seqera/inputs/workspace.py	82.60%	4 Missing ⚠️
cpg_infra/driver/dataset_cloud_infrastructure.py	66.66%	2 Missing ⚠️

Additional details and impacted files

@@                         Coverage Diff                         @@
##             set-1258-create-seqera-resources     #387   +/-   ##
===================================================================
  Coverage                                    ?   44.80%           
===================================================================
  Files                                       ?       29           
  Lines                                       ?     3417           
  Branches                                    ?        0           
===================================================================
  Hits                                        ?     1531           
  Misses                                      ?     1886           
  Partials                                    ?        0           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[rameshka]

Filter out correct users to add (Final list pending).

[rameshka]

We decided to provide the highest permissions (except for deleting workspaces) in the test environment for the users.
But one caveat is that admin permissions allow creating/updating/deleting resources in a workspace.
So there is a chance that the pulumi state and the live resources can drift.