MFU tracking for inference#3856

tdene wants to merge 6 commits intoNVIDIA:mainNVIDIA/Megatron-LM:mainfrom

tdene:tde/mfu_trackingtdene/Megatron-LM:tde/mfu_trackingCopy head branch name to clipboard