Skip to content

Issues: mlcommons/mlperf-automations

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

62 Open 58 Closed
62 Open 58 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

TestScenario.Server failed to run: mlcr run-mlperf,inference,_full,_r5.0-dev --model=resnet50 --implementation=reference --framework=tensorflow --category=datacenter --scenario=server --execution_mode=valid --device=cpu --quiet
#308 opened Mar 13, 2025 by jhsiao1948
2
Got error when running "mlcr run-mlperf,inference,_find-performance,_full,_r5.0-dev --model=llama2-70b-99.9 ... "
#306 opened Mar 10, 2025 by jhsiao1948
19
"--thread=n" switch does not seem to work
#293 opened Mar 7, 2025 by PapperYZ
11
Add self hosted GitHub actions for calibration dataset which are larger in size
#288 opened Mar 4, 2025 by anandhu-eng
3 tasks
Portable CM script failed (name = benchmark-program, return code = 35072 bug Something isn't working
#283 opened Feb 28, 2025 by PapperYZ
11
.tmp-run.sh not such file or directory
#281 opened Feb 28, 2025 by kingjuno
2
Error in mlc find cache --tags=get,mlperf,inference,results,dir | xargs tree command in Windows
#278 opened Feb 26, 2025 by KathpaliaChirag
2
Error in Submission folder generation
#276 opened Feb 25, 2025 by sujik18
2
cnndm calibration dataset download error
#273 opened Feb 25, 2025 by anandhu-eng
1
Llama2 70B Benchmark bug Something isn't working
#248 opened Feb 20, 2025 by ninano1208
3
Add resnet50 closed division github action enhancement New feature or request github-actions mlperf-work
#247 opened Feb 20, 2025 by anandhu-eng
2
Missing github actions github-actions mlperf-work Task
#226 opened Feb 15, 2025 by arjunsuresh
4 tasks
Cudnn version mismatch - resnet50 tensorflow - mlc
#215 opened Feb 12, 2025 by anandhu-eng
Script execution failure during submission of results of offline scenario for ResNet50 bug Something isn't working mlc-on-windows
#206 opened Feb 10, 2025 by KathpaliaChirag
5
Use of Docker Hub images when using docker for running benchmarks
#196 opened Feb 7, 2025 by anandhu-eng
Add github tests for RHEL enhancement New feature or request testing
#194 opened Feb 6, 2025 by arjunsuresh
Clean the boolean usage in MLCFlow enhancement New feature or request good first issue Good for newcomers
#177 opened Feb 3, 2025 by arjunsuresh
1
Use mlc logger in scripts instead of print statements enhancement New feature or request good first issue Good for newcomers
#165 opened Jan 28, 2025 by arjunsuresh
4
Missing git config is causing the below failure on MLC docker runs bug Something isn't working
#149 opened Jan 25, 2025 by arjunsuresh
MLPerf Submission Automation Tasks mlperf-work
#140 opened Jan 24, 2025 by arjunsuresh
4 of 20 tasks
Better naming for github action runs enhancement New feature or request good first issue Good for newcomers
#134 opened Jan 23, 2025 by arjunsuresh
Streamline the CLI argument parsing for Script automation enhancement New feature or request
#213 opened Jan 17, 2025 by arjunsuresh
4 tasks
@arjunsuresh
Configure self hosted github runners to run on MLCommons server (8xH100) github-actions testing
#67 opened Dec 22, 2024 by arjunsuresh
Update all MLPerf inference benchmark READMEs to include MLC commands for downloading model and datasets documentation Improvements or additions to documentation enhancement New feature or request mlperf-work
#62 opened Dec 21, 2024 by arjunsuresh
11 tasks done
1
Script features to be added to MLC testing
#48 opened Dec 12, 2024 by anandhu-eng
5 tasks
@arjunsuresh
ProTip! Add no:assignee to see everything that’s not assigned.