[Known Build Error] AssemblyLoading_MultipleVersions_AnalyzerDependency set difference

[jjonescz]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1389495
Build error leg or test failing: Microsoft.CodeAnalysis.UnitTests.AnalyzerAssemblyLoaderTests.AssemblyLoading_MultipleVersions_AnalyzerDependency
Pull request: #83272

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": ["AssemblyLoading_MultipleVersions_AnalyzerDependency", "at Roslyn.Test.Utilities.AssertEx.SetEqual", "at Microsoft.CodeAnalysis.UnitTests.InvokeUtil.Exec"],
  "ErrorPattern": "",
  "BuildRetry": true,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1389495
Error message validated: [AssemblyLoading_MultipleVersions_AnalyzerDependency at Roslyn.Test.Utilities.AssertEx.SetEqual at Microsoft.CodeAnalysis.UnitTests.InvokeUtil.Exec]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/22/2026 9:23:22 AM UTC

Report

Build	Definition	Test	Pull Request
1412857	dotnet/roslyn	workitem_3.WorkItemExecution
1412725	dotnet/roslyn	workitem_10.WorkItemExecution
1412554	dotnet/roslyn	workitem_12.WorkItemExecution	#83603
1411283	dotnet/roslyn	workitem_4.WorkItemExecution	#83517
1411149	dotnet/roslyn	workitem_11.WorkItemExecution	#83517
1411087	dotnet/roslyn	workitem_6.WorkItemExecution	#82964
1410906	dotnet/roslyn	workitem_16.WorkItemExecution	#83493
1409921	dotnet/roslyn	workitem_8.WorkItemExecution
1409863	dotnet/roslyn	workitem_8.WorkItemExecution	#83577
1409815	dotnet/roslyn	workitem_6.WorkItemExecution
1409793	dotnet/roslyn	workitem_9.WorkItemExecution	#83575
1409710	dotnet/roslyn	workitem_7.WorkItemExecution	#83573
1409707	dotnet/roslyn	workitem_7.WorkItemExecution	#83572
1409571	dotnet/roslyn	workitem_3.WorkItemExecution	#83510
1408806	dotnet/roslyn	workitem_6.WorkItemExecution	#83543
1408654	dotnet/roslyn	workitem_10.WorkItemExecution
1408497	dotnet/roslyn	workitem_6.WorkItemExecution	#83480
1408484	dotnet/roslyn	workitem_8.WorkItemExecution	#83418
1408414	dotnet/roslyn	workitem_8.WorkItemExecution	#83559
1408180	dotnet/roslyn	workitem_8.WorkItemExecution	#83556
1407858	dotnet/roslyn	workitem_8.WorkItemExecution
1407287	dotnet/roslyn	workitem_3.WorkItemExecution	#83548
1406488	dotnet/roslyn	workitem_8.WorkItemExecution	#83543
1406081	dotnet/roslyn	workitem_7.WorkItemExecution
1406030	dotnet/roslyn	workitem_8.WorkItemExecution	#83514
1405288	dotnet/roslyn	workitem_3.WorkItemExecution
1404981	dotnet/roslyn	workitem_7.WorkItemExecution	#83468
1404961	dotnet/roslyn	workitem_3.WorkItemExecution
1404756	dotnet/roslyn	workitem_7.WorkItemExecution	#83491
1404728	dotnet/roslyn	workitem_10.WorkItemExecution	#83475
1404634	dotnet/roslyn	workitem_3.WorkItemExecution	#83519
1404344	dotnet/roslyn	workitem_7.WorkItemExecution	#83326
1404317	dotnet/roslyn	workitem_3.WorkItemExecution	#83510
1404257	dotnet/roslyn	workitem_8.WorkItemExecution	#83509
1404005	dotnet/roslyn	workitem_7.WorkItemExecution
1403374	dotnet/roslyn	workitem_9.WorkItemExecution	#83270
1402973	dotnet/roslyn	workitem_3.WorkItemExecution
1402909	dotnet/roslyn	workitem_4.WorkItemExecution	#83493
1402488	dotnet/roslyn	workitem_15.WorkItemExecution	#83485
1402276	dotnet/roslyn	workitem_12.WorkItemExecution
1401313	dotnet/roslyn	workitem_3.WorkItemExecution
1401043	dotnet/roslyn	workitem_10.WorkItemExecution
1400407	dotnet/roslyn	workitem_8.WorkItemExecution
1399244	dotnet/roslyn	workitem_12.WorkItemExecution
1399065	dotnet/roslyn	workitem_4.WorkItemExecution	#83444
1398931	dotnet/roslyn	workitem_8.WorkItemExecution	#83440
1397169	dotnet/roslyn	workitem_6.WorkItemExecution	#83414
1397102	dotnet/roslyn	workitem_7.WorkItemExecution	#83348
1397008	dotnet/roslyn	workitem_6.WorkItemExecution	#83348
1396956	dotnet/roslyn	workitem_8.WorkItemExecution	#83370
1396949	dotnet/roslyn	workitem_8.WorkItemExecution	#83397
1396449	dotnet/roslyn	workitem_6.WorkItemExecution	#82591
1396405	dotnet/roslyn	workitem_12.WorkItemExecution
1395094	dotnet/roslyn	workitem_4.WorkItemExecution	#83236
1395087	dotnet/roslyn	workitem_10.WorkItemExecution	#83233
1394374	dotnet/roslyn	workitem_8.WorkItemExecution
1394167	dotnet/roslyn	workitem_7.WorkItemExecution	#83213
1394125	dotnet/roslyn	workitem_4.WorkItemExecution	#83120
1393387	dotnet/roslyn	workitem_3.WorkItemExecution	#83301
1393410	dotnet/roslyn	workitem_7.WorkItemExecution	#83087
1393254	dotnet/roslyn	workitem_3.WorkItemExecution	#83317
1392787	dotnet/roslyn	workitem_3.WorkItemExecution	#83270
1392722	dotnet/roslyn	workitem_132.WorkItemExecution	#83203
1392382	dotnet/roslyn	workitem_8.WorkItemExecution	#83311
1392331	dotnet/roslyn	workitem_6.WorkItemExecution
1391043	dotnet/roslyn	workitem_3.WorkItemExecution	#83270
1389495	dotnet/roslyn	workitem_8.WorkItemExecution	#83272

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	25	67

[MihuBot]

I'm a bot. Here is a possible related and/or duplicate issue (I may be wrong):

• Disabled Test: Analyzers loading extra assemblies #79352

[jjonescz]

@jaredpar FYI

[chsienki]

Hit again on #83457:

• Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1413803
• Leg: Test_Windows_CoreClr_IOperation_Debug
• Helix workitem: https://helix.dot.net/api/2019-06-17/jobs/dcafe6e5-3eb7-4ac2-be44-96a27cd518bb/workitems/workitem_6/console
• Failed test: Microsoft.CodeAnalysis.UnitTests.AnalyzerAssemblyLoaderTests.AssemblyLoading_MultipleVersions_AnalyzerDependency(kind: ShadowLoad, normalOrder: False)
• Helix queue: Windows.10.Amd64.Open
• Pull request: Add support for writing HTML literals using UTF-8 strings #83457

Same set-difference symptom as the original report -- expected vs actual diverge in the loaded-assembly list. Test ran in 127 ms before failing.

(Tagging on top of @jjonescz's ping above -- this is a fresh occurrence ~2 weeks after #83286 was opened, so the flake is still active.)