Skip to content

Issues: mlcommons/mlperf-automations

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

59 Open 29 Closed
59 Open 29 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Cudnn version mismatch - resnet50 tensorflow - mlc
#215 opened Feb 12, 2025 by anandhu-eng
Connection broken issue bug Something isn't working
#210 opened Feb 11, 2025 by csemasthan
2
Script execution failure during submission of results of offline scenario for ResNet50 bug Something isn't working mlc-on-windows
#206 opened Feb 10, 2025 by KathpaliaChirag
3
FIle not Found error bug Something isn't working mlc-on-windows
#204 opened Feb 9, 2025 by csemasthan
@arjunsuresh
1
Docker Container path error bug Something isn't working
#200 opened Feb 8, 2025 by csemasthan
@arjunsuresh
1
Image fIle started downloading on every run
#199 opened Feb 8, 2025 by csemasthan
1
Automation failing when pulling from huggingface
#197 opened Feb 7, 2025 by stopiamwarren
5
Use of Docker Hub images when using docker for running benchmarks
#196 opened Feb 7, 2025 by anandhu-eng
Add github tests for RHEL enhancement New feature or request testing
#194 opened Feb 6, 2025 by arjunsuresh
Fail the inference tests in MLC when the accuracy value is empty. bug Something isn't working
#190 opened Feb 6, 2025 by anandhu-eng
1
Clean the boolean usage in MLCFlow enhancement New feature or request good first issue Good for newcomers
#177 opened Feb 3, 2025 by arjunsuresh
Use mlc logger in scripts instead of print statements enhancement New feature or request good first issue Good for newcomers
#165 opened Jan 28, 2025 by arjunsuresh
4
Missing git config is causing the below failure on MLC docker runs bug Something isn't working
#149 opened Jan 25, 2025 by arjunsuresh
Support Automotive 3d Object Detection Benchmark Automation mlperf-work reference-implementation
#142 opened Jan 24, 2025 by arjunsuresh
4 of 11 tasks
@anandhu-eng
Support Reference models for MLPerf Inference v5.0 mlperf-work
#141 opened Jan 24, 2025 by arjunsuresh
2 of 3 tasks
MLPerf Submission Automation Tasks mlperf-work
#140 opened Jan 24, 2025 by arjunsuresh
4 of 20 tasks
Better naming for github action runs enhancement New feature or request good first issue Good for newcomers
#134 opened Jan 23, 2025 by arjunsuresh
Streamline the CLI argument parsing for Script automation enhancement New feature or request
#213 opened Jan 17, 2025 by arjunsuresh
4 tasks
@arjunsuresh
Configure self hosted github runners to run on MLCommons server (8xH100) github-actions testing
#67 opened Dec 22, 2024 by arjunsuresh
Update all MLPerf inference benchmark READMEs to include MLC commands for downloading model and datasets documentation Improvements or additions to documentation enhancement New feature or request mlperf-work
#62 opened Dec 21, 2024 by arjunsuresh
11 tasks
Script features to be added to MLC testing
#48 opened Dec 12, 2024 by anandhu-eng
5 tasks
@arjunsuresh
Sharing of meta data among CM scripts enhancement New feature or request
#46 opened Dec 12, 2024 by anandhu-eng
Adding validation check for meta files enhancement New feature or request
#45 opened Dec 12, 2024 by anandhu-eng
3
Running mlperf inference benchmarks on systems without internet connectivity
#44 opened Dec 12, 2024 by anandhu-eng
2
Adding support for multi-level organization enhancement New feature or request
#43 opened Dec 12, 2024 by anandhu-eng
ProTip! Mix and match filters to narrow down what you’re looking for.