Return validation errors after all fields are verified

[tenzen-y]

/kind feature

Describe the solution you'd like
[A clear and concise description of what you want to happen.]
Currently, the katib validator returns errors once the error is found:

katib/pkg/webhook/v1beta1/experiment/validation_webhook.go

Line 95 in 7df05c2

return admission.Errored(http.StatusBadRequest, err)

As we discussed here, to improve UX, we should return errors after all fields are verified like the training-operator: https://github.com/kubeflow/training-operator/blob/b5e23d0325005dd0ecae7d41ad6a80ba1459b275/pkg/webhooks/pytorch/pytorchjob_webhook.go#L66-L67

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

---

Love this feature? Give it a 👍 We prioritize the features with the most 👍

[ckcd]

@tenzen-y may I take this issue please?

[tenzen-y]

@tenzen-y may I take this issue please?

Sure, feel free to assign yourself with /assign.

[ckcd]

/assign