The active test run was aborted. Reason: Test host process crashed

[fanyang-mono]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
1103814	dotnet/roslyn	Run Integration Tests	Log
1103780	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79522
1102386	dotnet/roslyn	Run Integration Tests	Log
1102319	dotnet/roslyn	Run Integration Tests	Log
1101383	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79347
1101052	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79485
1100981	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79491
1100252	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79479
1099627	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79475
1099491	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79450
1098019	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79431
1097065	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79431
1095599	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79297
1095021	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79377
1094797	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79385
1094444	dotnet/roslyn	Run Integration Tests	Log
1094345	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79377
1094331	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79386
1093958	dotnet/roslyn	Run Integration Tests	Log
2748850	dotnet-orleans	Test	Log
2748851	dotnet-orleans	Test	Log
1092711	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79348
1091880	dotnet/roslyn	Run Integration Tests	Log
1091742	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79334
1091721	dotnet/roslyn	Run Integration Tests	Log
1090547	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78941
1088715	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78886
1088384	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79287
1087066	dotnet/roslyn	Run Integration Tests	Log
2743126	dotnet-fsharp	CmdLine@2	Log
1085255	dotnet/roslyn	Run Integration Tests	Log
1084589	dotnet/roslyn	Run Integration Tests	Log
1084463	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78975
1084286	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79235
1083843	dotnet/roslyn	Run Integration Tests	Log
1082069	dotnet/roslyn	Run Integration Tests	Log
1080766	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78975
1080755	dotnet/roslyn	Run Unit Tests	Log
1080629	dotnet/roslyn	Run Integration Tests	Log
1079369	dotnet/roslyn	Run Integration Tests	Log
1078219	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#79047
1078163	dotnet/roslyn	Run Integration Tests	Log

Build	Definition	Test	Pull Request
1104397	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1104194	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#62895
2756421	dotnet-roslyn	workitem_207.WorkItemExecution
1103101	dotnet/aspnetcore	Microsoft.AspNetCore.OutputCaching.Tests--net8.0.WorkItemExecution
2756149	dotnet-roslyn	workitem_207.WorkItemExecution
1102797	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.RequestTests.Request_MultiplePrefixes	dotnet/aspnetcore#62870
1102544	dotnet/roslyn	workitem_11.WorkItemExecution	dotnet/roslyn#79523
1101555	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49847
1101651	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49891
2755032	dotnet-roslyn	workitem_273.WorkItemExecution
1101273	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.GracefulTermination	dotnet/sdk#49847
1099431	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49544
1101366	dotnet/roslyn	workitem_1.WorkItemExecution
1101297	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#49740
1100776	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#62824
1100564	dotnet/roslyn	workitem_7.WorkItemExecution	dotnet/roslyn#78867
1100577	dotnet/roslyn	Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests_113.WorkItemExecution	dotnet/roslyn#78713
1099618	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.GracefulTermination	dotnet/sdk#49847
1099454	dotnet/aspire	Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution	dotnet/aspire#10542
1099251	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49847
1099241	dotnet/roslyn	workitem_25.WorkItemExecution	dotnet/roslyn#79431
1099122	dotnet/aspnetcore	Sockets.FunctionalTests--net10.0.WorkItemExecution
1099035	dotnet/aspnetcore	Microsoft.AspNetCore.Components.Endpoints.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#62806
1098929	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution
1098299	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#49847
1098179	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.Listener.ResponseHeaderTests.AddingControlCharactersToHeadersThrows	dotnet/aspnetcore#62531
1098239	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Extensions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#62304
1098234	dotnet/roslyn	workitem_25.WorkItemExecution	dotnet/roslyn#79431
1097871	dotnet/aspnetcore	Sockets.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#62635
1098049	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.Core.Test--net10.0.WorkItemExecution	dotnet/aspnetcore#62780
1098018	dotnet/roslyn	workitem_24.WorkItemExecution	dotnet/roslyn#79431
1097911	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49841
1097859	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#49800
1097831	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49838
1097882	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49634
1097433	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49798
1097605	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#49635
1097489	dotnet/aspnetcore	Microsoft.AspNetCore.Server.IIS.FunctionalTests.HttpBodyControlFeatureTests.ThrowsOnSyncReadOrWrite	dotnet/aspnetcore#62765
1097064	dotnet/roslyn	workitem_24.WorkItemExecution	dotnet/roslyn#79431
1097427	dotnet/roslyn	workitem_15.WorkItemExecution	dotnet/roslyn#79402
1097318	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49832
1096992	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#49531
2751601	dotnet-sdk	dotnet-watch.Tests.dll.5.WorkItemExecution
1096421	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49800
1096224	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49756
1096042	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49798
1095979	dotnet/roslyn	workitem_22.WorkItemExecution	dotnet/roslyn#79410
1095977	dotnet/roslyn	workitem_18.WorkItemExecution	dotnet/roslyn#79411
1095745	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49611
1095865	dotnet/roslyn	workitem_18.WorkItemExecution	dotnet/roslyn#79343
1095844	dotnet/roslyn	workitem_22.WorkItemExecution	dotnet/roslyn#79406
1095711	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#49761
1095426	dotnet/roslyn	workitem_18.WorkItemExecution	dotnet/roslyn#79343
1095281	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#49619
1094870	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution
1094698	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49739
1094697	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49738
1094688	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49780
1094612	dotnet/roslyn	workitem_18.WorkItemExecution	dotnet/roslyn#79397
1094537	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#49737
1094509	dotnet/roslyn	workitem_22.WorkItemExecution	dotnet/roslyn#79381
2750017	dotnet-aspnetcore	Microsoft.AspNetCore.OutputCaching.Tests--net8.0.WorkItemExecution
1094406	dotnet/roslyn	workitem_18.WorkItemExecution	dotnet/roslyn#79381
1094275	dotnet/roslyn	workitem_26.WorkItemExecution	dotnet/roslyn#79381
1094058	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#49737
1093488	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49743
1093258	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49761
1093157	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
2748835	dotnet-sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	#51488
2748837	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#51489
1092933	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.ResponseTests.Response_OnStartingThrows_StillCallsOnCompleted
2748350	dotnet-aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests.ResponseCachingTests.Caching_VariousStatusCodes_Cached
1092265	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#49664
1092018	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#49737
1091905	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49619
1091873	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49726
1091871	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49619
1091803	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49724
1091843	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution	dotnet/sdk#49740
1091816	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#49737
1091580	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49726
1091689	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#117192
2747476	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution
1091457	dotnet/runtime	HostActivation.Tests.WorkItemExecution
2747409	dotnet-sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution
1091397	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#117435
1091303	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49417
1088788	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#117434
1091213	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#116821
1090830	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#117494
1090810	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1090717	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49535
1090506	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.BrowserLaunchTests.Microsoft.DotNet.Watch.UnitTests.BrowserLaunchTests.LaunchesBrowserOnStart	dotnet/sdk#49589
1090611	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#117492
1090248	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49697
1090189	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#117428
1090098	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#117466
1089752	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#116769
1089687	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#116772
1089538	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49576
Displaying 100 of 152 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
5	47	194

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

[andriipatsula]

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

[fanyang-mono]

Updated.

[pavelsavara]

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

[dougbu]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

[pavelsavara]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

• are there crash dump files on the machine ?
• are there some hints on what's going on in the log files before crash ?
• is this OOM or stack overflow in disguise ?
• did we run out of disk space or number of inodes ?
• hit some limit in docker container ?
• is this always the same OS, version, image ?
• could this be hardware issue ?

[fanyang-mono]

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

[mitchdenny]

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

[nagilson]

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.