Skip to content

Enable E2E test for the torchvision vit model #12723

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Juntian777
Copy link
Contributor

Summary: This PR introduces an end-to-end test framework for ExecuTorch's XNNPACK backend. It adds utilities to generate ETRecord and ETDump files with debug buffers for models, enabling numerical gap checks between runtime and AOT outputs. The PR also includes a test for the Vision Transformer (ViT) model to verify numeric gap thresholds. Additionally, it adds necessary build targets and runtime support for the new event tracer feature. This improves testing and debugging capabilities for ExecuTorch's XNNPACK backend.

Differential Revision: D78380933

@Juntian777 Juntian777 requested a review from Gasoonjia as a code owner July 22, 2025 19:24
Copy link

pytorch-bot bot commented Jul 22, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12723

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

❌ 5 New Failures

As of commit 639ad2c with merge base 6c4f934 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 22, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78380933

@Juntian777
Copy link
Contributor Author

@pytorchbot label "release notes: none"

@pytorch-bot pytorch-bot bot added the release notes: none Do not include this in the release notes label Jul 22, 2025
Juntian777 added a commit to Juntian777/executorch that referenced this pull request Jul 22, 2025
…K. (pytorch#12723)

Summary:

This PR introduces an end-to-end test framework for ExecuTorch's XNNPACK backend. It adds utilities to generate ETRecord and ETDump files with debug buffers for models, enabling numerical gap checks between runtime and AOT outputs. The PR also includes a test for the Vision Transformer (ViT) model to verify numeric gap thresholds. Additionally, it adds necessary build targets and runtime support for the new event tracer feature. This improves testing and debugging capabilities for ExecuTorch's XNNPACK backend.

Differential Revision: D78380933
Juntian777 added a commit to Juntian777/executorch that referenced this pull request Jul 22, 2025
…K. (pytorch#12723)

Summary:

This PR introduces an end-to-end test framework for ExecuTorch's XNNPACK backend. It adds utilities to generate ETRecord and ETDump files with debug buffers for models, enabling numerical gap checks between runtime and AOT outputs. The PR also includes a test for the Vision Transformer (ViT) model to verify numeric gap thresholds. Additionally, it adds necessary build targets and runtime support for the new event tracer feature. This improves testing and debugging capabilities for ExecuTorch's XNNPACK backend.

Differential Revision: D78380933
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78380933

…K. (pytorch#12723)

Summary:
Pull Request resolved: pytorch#12723

This PR introduces an end-to-end test framework for ExecuTorch's XNNPACK backend. It adds utilities to generate ETRecord and ETDump files with debug buffers for models, enabling numerical gap checks between runtime and AOT outputs. The PR also includes a test for the Vision Transformer (ViT) model to verify numeric gap thresholds. Additionally, it adds necessary build targets and runtime support for the new event tracer feature. This improves testing and debugging capabilities for ExecuTorch's XNNPACK backend.

Differential Revision: D78380933
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78380933

@facebook-github-bot
Copy link
Contributor

Hi @Juntian777!

Thank you for your pull request.

We require contributors to sign our Contributor License Agreement, and yours needs attention.

You currently have a record in our system, but the CLA is no longer valid, and will need to be resubmitted.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at [email protected]. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported release notes: none Do not include this in the release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants