The active test run was aborted. Reason: Test host process crashed

[fanyang-mono]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
981759	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77619
981463	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
981467	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
981450	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77624
981270	dotnet/roslyn	Run Integration Tests	Log
981245	dotnet/roslyn	Run Integration Tests	Log
2663627	dotnet-roslyn	Run Unit Tests	Log
980960	dotnet/roslyn	Run Unit Tests	Log
979872	dotnet/roslyn	Run Integration Tests	Log
979797	dotnet/roslyn	Run Integration Tests	Log
979673	dotnet/roslyn	Run Unit Tests	Log
979599	dotnet/roslyn	Run Unit Tests	Log
979481	dotnet/roslyn	Run Unit Tests	Log
2662664	dotnet-roslyn	Run Unit Tests	Log
2662662	dotnet-roslyn	Run Unit Tests	Log
979473	dotnet/roslyn	Run Unit Tests	Log
2662637	dotnet-roslyn	Run Unit Tests	Log
979442	dotnet/roslyn	Run Unit Tests	Log
979438	dotnet/roslyn	Run Unit Tests	Log
979391	dotnet/roslyn	Run Integration Tests	Log
2662065	dotnet-roslyn	Run Unit Tests	Log
2662063	dotnet-roslyn	Run Unit Tests	Log
978411	dotnet/roslyn	Run Unit Tests	Log
978410	dotnet/roslyn	Run Unit Tests	Log
2661985	dotnet-roslyn	Run Unit Tests	Log
978330	dotnet/roslyn	Run Unit Tests	Log
2661936	dotnet-roslyn	Run Unit Tests	Log
978269	dotnet/roslyn	Run Unit Tests	Log
978260	dotnet/roslyn	Run Unit Tests	Log
2661921	dotnet-roslyn	Run Unit Tests	Log
978261	dotnet/roslyn	Run Integration Tests	Log
2661916	dotnet-roslyn	Run Unit Tests	Log
978251	dotnet/roslyn	Run Unit Tests	Log
2661833	dotnet-roslyn	Run Unit Tests	Log
978133	dotnet/roslyn	Run Unit Tests	Log
978023	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77570
2661742	dotnet-roslyn	Run Unit Tests	Log
977887	dotnet/roslyn	Run Unit Tests	Log
2661744	dotnet-roslyn	Run Unit Tests	Log
977886	dotnet/roslyn	Run Unit Tests	Log
2661731	dotnet-roslyn	Run Unit Tests	Log
977848	dotnet/roslyn	Run Unit Tests	Log
977811	dotnet/roslyn	Run Unit Tests	Log
2661703	dotnet-roslyn	Run Unit Tests	Log
2661670	dotnet-roslyn	Run Unit Tests	Log
977714	dotnet/roslyn	Run Unit Tests	Log
977715	dotnet/roslyn	Run Integration Tests	Log
2661649	dotnet-roslyn	Run Unit Tests	Log
977670	dotnet/roslyn	Run Unit Tests	Log
976811	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77519
976651	dotnet/roslyn	Run Integration Tests	Log
976524	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77299
975807	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77524
975426	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77519
975359	dotnet/roslyn	Run Integration Tests	Log
975086	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77516
975019	dotnet/roslyn	Run Integration Tests	Log
975012	dotnet/roslyn	Run Integration Tests	Log
974813	dotnet/roslyn	Run Integration Tests	Log
974734	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77507
974710	dotnet/roslyn	Run Integration Tests	Log
974380	dotnet/roslyn	Run Integration Tests	Log
974216	dotnet/roslyn	Run Integration Tests	Log
2659306	dotnet-fsharp	CmdLine@2	Log
2659274	dotnet-fsharp	CmdLine@2	Log
972596	dotnet/roslyn	Run Integration Tests	Log
972256	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77462
971375	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77299
971363	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77444
969954	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77299
969937	dotnet/roslyn	Run Integration Tests	Log
969891	dotnet/roslyn	Run Integration Tests	Log
969895	dotnet/roslyn	Run Integration Tests	Log
969677	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77437
969661	dotnet/roslyn	Run Integration Tests	Log
969530	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77431
969528	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77430
969393	dotnet/roslyn	Run Integration Tests	Log
968719	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77415
968529	dotnet/roslyn	Run Integration Tests	Log
967815	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77368
967718	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#74353
967674	dotnet/roslyn	Run Integration Tests	Log
967583	dotnet/roslyn	Run Integration Tests	Log
967515	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#76863
966149	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77368
965179	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77368
964933	dotnet/roslyn	Run Integration Tests	Log
964352	dotnet/roslyn	Run Integration Tests	Log
964291	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77359
964211	dotnet/roslyn	Run Integration Tests	Log
964141	dotnet/roslyn	Run Integration Tests	Log
964125	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77353
962984	dotnet/roslyn	Run Integration Tests	Log
962925	dotnet/roslyn	Run Integration Tests	Log
962875	dotnet/roslyn	Run Integration Tests	Log
962147	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77337
962143	dotnet/roslyn	Run Integration Tests	Log
962101	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77202
962022	dotnet/roslyn	Run Integration Tests	Log
Displaying 100 of 132 results

Build	Definition	Test	Pull Request
981526	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#47616
981459	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47631
981239	dotnet/aspnetcore	Microsoft.AspNetCore.Routing.Tests--net10.0.WorkItemExecution
980937	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
980722	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47586
980698	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47606
980433	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
980050	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47587
980141	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47552
979988	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47575
979909	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47572
979790	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
978175	dotnet/aspnetcore	Microsoft.AspNetCore.Identity.EntityFrameworkCore.Test--net10.0.WorkItemExecution	dotnet/aspnetcore#60905
979699	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#47565
2662777	dotnet-roslyn	workitem_272.WorkItemExecution
979701	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	dotnet/sdk#45419
2662730	dotnet-roslyn	workitem_272.WorkItemExecution
979396	dotnet/roslyn	workitem_1.WorkItemExecution
979340	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47528
979343	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47537
979036	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#47551
979037	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47552
978733	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47528
977843	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47519
978584	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47532
978471	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47538
978359	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47512
978381	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47528
977841	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47514
977642	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47508
976823	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47490
976824	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47465
976561	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#47480
976415	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47465
975976	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47465
975942	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47463
975813	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47456
975581	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
2660291	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#48211
975056	dotnet/aspnetcore	Templates.Test.BaselineTest.Template_Produces_The_Right_Set_Of_FilesAsync
975039	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47431
2659849	dotnet-sdk	Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.MauiBlazor	#47785
974763	dotnet/roslyn	workitem_200.WorkItemExecution
974464	dotnet/roslyn	workitem_0.WorkItemExecution
974481	dotnet/roslyn	workitem_5.WorkItemExecution	dotnet/roslyn#77496
974015	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47021
974004	dotnet/roslyn	workitem_98.WorkItemExecution
973755	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Results.Tests--net8.0.WorkItemExecution
973738	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#60714
973104	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47391
972964	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47385
972767	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47383
2658066	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
972436	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47321
972248	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47328
971996	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47226
971606	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#47342
971502	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#47235
971497	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#46844
971347	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
971031	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47326
970868	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#47317
970588	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47308
970729	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47305
970387	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47304
970391	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47305
970349	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47299
970298	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#47226
969738	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
969703	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#47291
969669	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47289
969678	dotnet/aspire	Aspire.Hosting.Milvus.Tests.WorkItemExecution
2655943	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
969492	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#46915
969323	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
969258	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#47272
969246	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47271
2655550	dotnet-aspnetcore	Mvc.Api.Analyzers.Test--net8.0.WorkItemExecution
969000	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47263
968834	dotnet/roslyn	workitem_12.WorkItemExecution	dotnet/roslyn#77420
2655074	dotnet-roslyn	workitem_227.WorkItemExecution
968399	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#60337
968265	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47245
968347	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#46425
968264	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47244
968222	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47237
967261	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47220
967172	dotnet/aspnetcore	Microsoft.AspNetCore.SignalR.StackExchangeRedis.Tests--net8.0.WorkItemExecution
966308	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#47181
965524	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47021
965388	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47184
965182	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47175
965175	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47174
965066	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47169
964829	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47159
964710	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47146
964688	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47157
2651913	dotnet-aspnetcore	Microsoft.AspNetCore.App.Analyzers.Test--net9.0.WorkItemExecution
964593	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#47119
964231	dotnet/aspnetcore	Microsoft.AspNetCore.Components.Endpoints.Tests--net10.0.WorkItemExecution
Displaying 100 of 251 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
1	114	359

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

[andriipatsula]

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

[fanyang-mono]

Updated.

[pavelsavara]

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

[dougbu]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

[pavelsavara]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

• are there crash dump files on the machine ?
• are there some hints on what's going on in the log files before crash ?
• is this OOM or stack overflow in disguise ?
• did we run out of disk space or number of inodes ?
• hit some limit in docker container ?
• is this always the same OS, version, image ?
• could this be hardware issue ?

[fanyang-mono]

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

[mitchdenny]

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

[nagilson]

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.