Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MLPerf default config version with bert & 3d-unet benchmarks #392

Merged
merged 20 commits into from
Nov 11, 2024
Merged

MLPerf default config version with bert & 3d-unet benchmarks #392

merged 20 commits into from
Nov 11, 2024

Conversation

saibulusu
Copy link
Contributor

@saibulusu saibulusu commented Oct 24, 2024 •
edited
Loading

Updating to use MLPerf inference results v4.1 & CUDA 12.4.

Benchmarks:

  • bert
  • 3d-unet

Config versions:

  • default

Tested on:

  • Ubuntu
  • Standard ND96asr v4 (96 vcpus, 900 GiB memory)

@saibulusu saibulusu changed the title MLPerf changes MLPerf default config version with bert & 3d-unet benchmarks Nov 4, 2024
@saibulusu saibulusu marked this pull request as ready for review November 5, 2024 06:33
yangpanMS
yangpanMS reviewed Nov 5, 2024
View reviewed changes
Copy link
Contributor

@yangpanMS yangpanMS left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please see if we still need nvidia fabric manager changes and test it on a new vm

src/VirtualClient/VirtualClient.Actions/MLPerf/GPUConfigFiles/bert/Offline/__init__.py Outdated Show resolved Hide resolved
src/VirtualClient/VirtualClient.Actions/MLPerf/GPUConfigFiles/3d-unet/Offline/__init__.py Outdated Show resolved Hide resolved
...alClient/VirtualClient.Actions.UnitTests/Examples/MLPerf/Example_bert_accuracy_summary1.json Outdated Show resolved Hide resolved
src/VirtualClient/VirtualClient.Main/profiles/PERF-GPU-MLPERF.json Show resolved Hide resolved
src/VirtualClient/VirtualClient.Actions.UnitTests/MLPerf/MLPerfMetricsParserTests.cs Outdated Show resolved Hide resolved
@saibulusu saibulusu requested a review from yangpanMS November 11, 2024 18:10
@yangpanMS yangpanMS merged commit 112f990 into main Nov 11, 2024
4 checks passed
@yangpanMS yangpanMS deleted the users/saibulusu/mlperf-changes branch November 11, 2024 19:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@brdeyo brdeyo brdeyo left review comments

@yangpanMS yangpanMS yangpanMS approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@saibulusu @yangpanMS @brdeyo