GPUUtil-0 remains 0 during the process loading a 72B model

[NivinaNull]

deepspeed3-cpuoffload，GPUUtil-0 remains quite low during loading the model, is that normal ？and it occured to all the other workers

[tjruwase]

@NivinaNull, it would be helpful if you provided more context such as screenshots, logs, or repro steps. Otherwise, it is hard to understand the question.

[NivinaNull]

@NivinaNull, it would be helpful if you provided more context such as screenshots, logs, or repro steps. Otherwise, it is hard to understand the question.

Thanks for your kind reminder

[NivinaNull]

@NivinaNull, it would be helpful if you provided more context such as screenshots, logs, or repro steps. Otherwise, it is hard to understand the question.

Thanks for your kind reminder

[tjruwase]

Thanks for sharing the screenshots. Memory usage of 34GB per GPU could be reasonable for a 72B model on 8 GPUs. What are your expectations?