Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dotnet-watch tests failing #40006

Open
dsplaisted opened this issue Apr 4, 2024 · 12 comments
Open

dotnet-watch tests failing #40006

dsplaisted opened this issue Apr 4, 2024 · 12 comments
Assignees
Labels
Milestone

Comments

@dsplaisted
Copy link
Member

dsplaisted commented Apr 4, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=629827
Build error leg or test failing: dotnet-watch.Tests.dll.1.WorkItemExecution
Pull request: #39888

Error Message

##[error].packages/microsoft.dotnet.helix.sdk/8.0.0-beta.24177.1/tools/Microsoft.DotNet.Helix.Sdk.MultiQueue.targets(89,5): error : (NETCORE_ENGINEERING_TELEMETRY=Test) Work item dotnet-watch.Tests.dll.1 in job 82728a56-9430-4356-ab82-1c21670792a7 has failed

{
  "ErrorMessage": "",
  "ErrorPattern": "Work item dotnet-watch\\.Tests\\.dll\\.1 in job [a-z0-9\\-]+ has failed",
  "BuildRetry": true,
  "ExcludeConsoleLog": true
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=629827
Error message validated: [Work item dotnet-watch\.Tests\.dll\.1 in job [a-z0-9\-]+ has failed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/4/2024 9:51:10 AM UTC

Report

Build Definition Step Name Console log Pull Request
962168 dotnet/sdk 🟣 Run TestBuild Tests Log #47081
962109 dotnet/sdk 🟣 Run TestBuild Tests Log #47069
961905 dotnet/sdk 🟣 Run FullFramework Tests Log #46967
961915 dotnet/sdk 🟣 Run TestBuild Tests Log #47002
961908 dotnet/sdk 🟣 Run TestBuild Tests Log #47086
961850 dotnet/sdk 🟣 Run FullFramework Tests Log #47032
961810 dotnet/sdk Run TestBuild Tests Log #47082
961609 dotnet/sdk 🟣 Run TestBuild Tests Log #47076
961456 dotnet/sdk 🟣 Run FullFramework Tests Log #46967
961388 dotnet/sdk 🟣 Run TestBuild Tests Log #47032
961129 dotnet/sdk 🟣 Run TestBuild Tests Log #46967
961268 dotnet/sdk 🟣 Run TestBuild Tests Log #47067
961216 dotnet/sdk 🟣 Run TestBuild Tests Log #47064
961193 dotnet/sdk 🟣 Run FullFramework Tests Log #47015
960086 dotnet/sdk 🟣 Run TestBuild Tests Log #47035
960955 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
960748 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
960718 dotnet/sdk 🟣 Run TestBuild Tests Log #47056
960708 dotnet/sdk 🟣 Run TestBuild Tests Log #47055
960644 dotnet/sdk Run TestBuild Tests Log #47033
960675 dotnet/sdk 🟣 Run TestBuild Tests Log #47025
960133 dotnet/sdk 🟣 Run TestBuild Tests Log #47026
960156 dotnet/sdk Run TestBuild Tests Log #46931
959746 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
959668 dotnet/sdk 🟣 Run TestBuild Tests Log #47001
959727 dotnet/sdk 🟣 Run TestBuild Tests Log #47032
959676 dotnet/sdk 🟣 Run TestBuild Tests Log #47003
959119 dotnet/sdk 🟣 Run TestBuild Tests Log #46991
959171 dotnet/sdk 🟣 Run FullFramework Tests Log #47002
959006 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
959023 dotnet/sdk Run FullFramework Tests Log #46920
959063 dotnet/sdk Run TestBuild Tests Log #47021
959076 dotnet/sdk 🟣 Run TestBuild Tests Log #47023
959003 dotnet/sdk 🟣 Run FullFramework Tests Log #47019
958956 dotnet/sdk 🟣 Run TestBuild Tests Log #47013
958941 dotnet/sdk Run TestBuild Tests Log #46920
958812 dotnet/sdk 🟣 Run TestBuild Tests Log #46988
958903 dotnet/sdk 🟣 Run TestBuild Tests Log #47013
958860 dotnet/sdk 🟣 Run TestBuild Tests Log #47011
958752 dotnet/sdk Run FullFramework Tests Log #47010
958676 dotnet/sdk 🟣 Run TestBuild Tests Log #46998
958621 dotnet/sdk 🟣 Run TestBuild Tests Log #46997
958601 dotnet/sdk Run FullFramework Tests Log #47006
958540 dotnet/sdk 🟣 Run TestBuild Tests Log #46998
958534 dotnet/sdk Run FullFramework Tests Log #46931
958488 dotnet/sdk 🟣 Run TestBuild Tests Log #46965
958384 dotnet/sdk 🟣 Run TestBuild Tests Log #46973
958118 dotnet/sdk Run FullFramework Tests Log #46989
957939 dotnet/sdk 🟣 Run FullFramework Tests Log #46983
957745 dotnet/sdk 🟣 Run TestBuild Tests Log #46915
957614 dotnet/sdk 🟣 Run TestBuild Tests Log #46981
957581 dotnet/sdk 🟣 Run TestBuild Tests Log #46954
957549 dotnet/sdk 🟣 Run TestBuild Tests Log #46972
957414 dotnet/sdk 🟣 Run TestBuild Tests Log #46968
957373 dotnet/sdk 🟣 Run TestBuild Tests Log #46965
957429 dotnet/sdk 🟣 Run TestBuild Tests Log #46971
957416 dotnet/sdk 🟣 Run TestBuild Tests Log #46970
2646299 dotnet-sdk Run FullFramework Tests Log #47785
957206 dotnet/sdk 🟣 Run TestBuild Tests Log #46963
957160 dotnet/sdk 🟣 Run FullFramework Tests Log #46927
957064 dotnet/sdk 🟣 Run TestBuild Tests Log #46961
957033 dotnet/sdk 🟣 Run TestBuild Tests Log #46959
956955 dotnet/sdk 🟣 Run TestBuild Tests Log #45872
956893 dotnet/sdk 🟣 Run TestBuild Tests Log #46954
956885 dotnet/sdk 🟣 Run TestBuild Tests Log #46926
956868 dotnet/sdk 🟣 Run TestBuild Tests Log #46949
956484 dotnet/sdk Run TestBuild Tests Log #46920
956347 dotnet/sdk Run FullFramework Tests Log #46920
956314 dotnet/sdk 🟣 Run TestBuild Tests Log #46233
956325 dotnet/sdk 🟣 Run TestBuild Tests Log #46926
956101 dotnet/sdk 🟣 Run TestBuild Tests Log #46933
956116 dotnet/sdk 🟣 Run TestBuild Tests Log #46935
956125 dotnet/sdk Run FullFramework Tests Log #46939
956205 dotnet/sdk 🟣 Run TestBuild Tests Log #46942
956051 dotnet/sdk 🟣 Run TestBuild Tests Log #46926
955520 dotnet/sdk 🟣 Run TestBuild Tests Log #46917
955397 dotnet/sdk Run FullFramework Tests Log #46920
955551 dotnet/sdk 🟣 Run TestBuild Tests Log #46796
955517 dotnet/sdk 🟣 Run TestBuild Tests Log #46916
955514 dotnet/sdk 🟣 Run TestBuild Tests Log #46924
955483 dotnet/sdk 🟣 Run TestBuild Tests Log #46921
955445 dotnet/sdk 🟣 Run TestBuild Tests Log #45637
955221 dotnet/sdk 🟣 Run TestBuild Tests Log #46908
955262 dotnet/sdk 🟣 Run TestBuild Tests Log #46913
955224 dotnet/sdk 🟣 Run TestBuild Tests Log #46233
955178 dotnet/sdk 🟣 Run TestBuild Tests Log #46911
955101 dotnet/sdk 🟣 Run TestBuild Tests Log #46908
955098 dotnet/sdk 🟣 Run TestBuild Tests Log #46909
954882 dotnet/sdk Run FullFramework Tests Log #46901
954942 dotnet/sdk 🟣 Run TestBuild Tests Log #46907
954887 dotnet/sdk Run FullFramework Tests Log #46903
954891 dotnet/sdk Run TestBuild Tests Log #46904
954890 dotnet/sdk 🟣 Run TestBuild Tests Log #46759
954885 dotnet/sdk 🟣 Run TestBuild Tests Log #46900
954714 dotnet/sdk Run TestBuild Tests Log #46833
954659 dotnet/sdk 🟣 Run TestBuild Tests Log #46896
954651 dotnet/sdk 🟣 Run TestBuild Tests Log #46895
954233 dotnet/sdk Run TestBuild Tests Log #46870
954172 dotnet/sdk 🟣 Run TestBuild Tests Log #46883
953844 dotnet/sdk 🟣 Run TestBuild Tests Log #46863
Displaying 100 of 406 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
15 86 406
@marcpopMSFT
Copy link
Member

@tmat
Copy link
Member

tmat commented Jun 26, 2024

No luck yet. This might help: https://github.com/dotnet/sdk/blob/d45e40d665e647804de03d2b4eec2aae9c488cb5/test/dotnet-watch.Tests/xunit.runner.json

It will print out test info every 20 seconds a test is running.

@marcpopMSFT
Copy link
Member

@tmat another failure this morning shows a bunch of build processes for watch apps still running... https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-sdk-refs-pull-41958-merge-84357342ee154a5088/dotnet-watch.Tests.dll.2/1/console.3dddc463.log?helixlogtype=result

@tmat
Copy link
Member

tmat commented Jul 3, 2024

Looks like that's in 8.0 branch. Porting test diagnostics from 9: #41963

@Forgind
Copy link
Member

Forgind commented Aug 26, 2024

This has been making one of my PRs fail today, so I looked into it a bit. Based on when this issue was created and which tests are failing, I suspect this PR:
#39618

I asked jasonmalinowski whether the MSBuildWorkspace is supposed to support F# because I'd found a code snippet that suggested that it shouldn't, and he said it doesn't and never did. Did that PR make us use MSBuildWorkspace in a different way than we had before?

@Forgind
Copy link
Member

Forgind commented Aug 26, 2024

The changes to HotReloadDotNetWatcher look most suspicious to me. It looks like a substantial change to how we call MSBuild.

@Forgind
Copy link
Member

Forgind commented Jan 18, 2025

Ping @tmat
This is still a serious pain point, currently preventing MSBuild from merging their code flow to 9.0.2xx. I already clicked rerun twice. I pointed to a PR that I think is likely to blame.

@tmat
Copy link
Member

tmat commented Jan 19, 2025

Fixes targeting 9.0.3xx: #45999, #46141

@nagilson
Copy link
Member

@tmat Thank you for making some PRs to try to remedy this -- we are still seeing this in 9.0.2xx, 9.0.1xx, and main, 10 preview 2. Do your changes need to be ported?

@tmat
Copy link
Member

tmat commented Feb 20, 2025

They don't flow automatically to main?

Re 9.0.2xx, 9.0.1xx - these are product changes. Do they meet the servicing bar?

@nagilson
Copy link
Member

nagilson commented Feb 20, 2025

They should flow to main, but either something went wrong and it didn't for those PRs, or the fix did not work, since it is still showing up in .net 10 preview 2: #46983

I dont think they would meet the bar that, so good point. 9.0.3xx though, they probably do.

@tmat
Copy link
Member

tmat commented Feb 21, 2025

Might be something else causing failure in 10 P2. Do you have a link to the failed run? The PR is merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants