Added make targets to run E2E tests on ephemeral clusters

[shanduur]

This PR introduces Makefile targets to improve tool management and to enable streamlined execution of end-to-end (E2E) tests. It enhances the setup for managing dependencies and testing within the CI pipeline.

Key Changes:

1. Tool Management:

   • Introduced new Makefile targets to manage development tools, including:
     • golangci-lint
     • ctlptl
     • kind
     • kustomize
     • chainsaw
   • Defined versions for these tools in a hack/tools/go.mod file to ensure consistent versions across environments.
   • Added a reusable go-install-tool helper function to facilitate tool installation, reducing manual setup steps.

2. Cluster and Deployment Management:

   • Added targets to automate cluster setup and teardown with ctlptl and kind, including cluster and cluster-reset targets.
   • Created deploy and undeploy targets for simplified Kubernetes deployment, using kubectl and kustomize.

3. E2E Test Execution:

   • Updated the Makefile to run E2E tests using chainsaw with a dedicated test-e2e target.
   • Configured chainsaw to use test/e2e/values.yaml for test values, ensuring tests are executed with predefined settings.

4. Kustomization and Resource Changes:

   • Updated various controller resources for consistency in naming and structure:
     • Modified namespaces, name prefixes, and resource names to align with container-object-storage-system.
   • Added a new namespace.yaml resource under controller/resources.

5. Additional Updates:

   • Minor syntax and path adjustments in resource files.

[k8s-ci-robot]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[shanduur]

/ok-to-test

[BlaineEXE]

I have found that go mod vendor seems to be a simpler way of downloading tools to a local cache. I used that method with the client generator and found it worked well. Then we can get rid of go-install-tool entirely for something like

tools:
  cd hack/tools && go mod vendor -o $(TOOLBIN)

WDYT?

[shanduur]

I don't like the fact that go run <tool> does not cache, and always rebuilds the binary. While not an issue in CI, this is not the best for local development.

[BlaineEXE]

It sounds like you plan to make a small change or two, so I will hold off on adding the approve/lgtm labels for now. Thanks for doing this work and answering my questions about the methods!

[BlaineEXE]

/approve
/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: BlaineEXE, shanduur

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [BlaineEXE,shanduur]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment