Specify nodes for gpu metrics collection and split data to each rank#320

hemildesai merged 2 commits intoNVIDIA-NeMo:mainNVIDIA-NeMo/Run:mainfrom

ashbhandare:abhandare/llmbashbhandare/NeMo-Run:abhandare/llmbCopy head branch name to clipboard