Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
1206740	dotnet/sdk	Build	Log	#51648
2842007	dotnet-sdk	Build (azureLinux30fpm)	Log
1206632	dotnet/sdk	🟣 Build	Log	#51794
1206385	dotnet/sdk	🟣 Run dotnet-format on dotnet/efcore All.sln	Log	#51790
1205965	dotnet/sdk	🟣 Run dotnet-format on dotnet/aspnetcore AspNetCore.sln	Log	#51765
1205533	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51728
1205092	dotnet/sdk	Run TestBuild Tests	Log	#51698
1204784	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51765
1203962	dotnet/sdk	🟣 Prepare dotnet/msbuild for formatting	Log	#51747
2838853	dotnet-sdk	🟣 Build	Log
2838830	dotnet-sdk	Build	Log	#54875
1203070	dotnet/sdk	Run Tests in Helix	Log	#51729
1203067	dotnet/sdk	Build	Log
2838731	dotnet-sdk	Build	Log	#55218
2838625	dotnet-sdk	Run dotnet-format on dotnet/razor Razor.sln	Log	#55236
2838574	dotnet-sdk	Build	Log	#55231
2838354	dotnet-sdk	Build	Log	#55220
2838266	dotnet-sdk	Build	Log
2838241	dotnet-sdk	Build (ubuntu2204DebPkg)	Log	#54875
2838159	dotnet-sdk	Run Tests in Helix	Log	#55195
1200198	dotnet/sdk	Build	Log	#51659
1201818	dotnet/sdk	Build	Log	#51712
1201514	dotnet/sdk	Run Tests in Helix	Log	#51703
2837704	dotnet-sdk	🟣 Build	Log
1201372	dotnet/sdk	Run TestBuild Tests	Log	#51648
2837393	dotnet-sdk	Build	Log	#54878
2837217	dotnet-sdk	Build	Log
2837224	dotnet-sdk	Build	Log	#55160
2837175	dotnet-sdk	Build (ubuntu2204DebPkg)	Log	#55161
2837133	dotnet-sdk	Build	Log	#55161
2837127	dotnet-sdk	Build	Log
2836645	dotnet-sdk	Build	Log	#54875
2836626	dotnet-sdk	Build	Log	#54878
2836614	dotnet-sdk	Run Tests in Helix	Log	#54878
2836613	dotnet-sdk	Run Tests in Helix	Log	#54880
1199716	dotnet/sdk	🟣 Build	Log	#51633
1199569	dotnet/sdk	Run Tests in Helix	Log	#51292
1196954	dotnet/sdk	Run Tests in Helix	Log	#51613
1196524	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51567
2833445	dotnet-sdk	Build	Log	#54879
2832565	dotnet-sdk	Build	Log	#54878
2832592	dotnet-sdk	Build	Log	#54875
2832591	dotnet-sdk	Build (centosStream9)	Log	#54959
2832566	dotnet-sdk	Build	Log	#54879
1194771	dotnet/sdk	🟣 Build	Log	#50468
1194015	dotnet/sdk	🟣 Build	Log	#51223
2831351	dotnet-sdk	Build	Log	#54876
1193545	dotnet/sdk	Build	Log	#51509
1193320	dotnet/sdk	Build	Log	#51547
1192952	dotnet/sdk	Build	Log	#51509
1192912	dotnet/sdk	🟣 Build	Log	#51540
1192892	dotnet/sdk	Sync repo into VMR (Unix)	Log	#51509
1192854	dotnet/sdk	🟣 Build	Log	#51402
1192581	dotnet/sdk	🔍 Test Windows	Log	#51446
1191972	dotnet/sdk	Sync repo into VMR (Unix)	Log	#51509
1190441	dotnet/sdk	🟣 Run FullFramework Tests	Log	#51512
2828123	dotnet-sdk	Install MicroBuild plugin (Windows)	Log
1188641	dotnet/sdk	🟣 Build	Log	#50685
1188640	dotnet/sdk	🟣 Run FullFramework Tests	Log	#51462
2827215	dotnet-sdk	🍱 Bootstrap toolset (Windows)	Log
1187980	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51207
2826545	dotnet-sdk	📦 Package dnup library (arcade)	Log
2826516	dotnet-sdk	📦 Package dnup library (arcade)	Log
2826290	dotnet-sdk	Build	Log	#54679
2826215	dotnet-sdk	Build	Log	#54679
2826114	dotnet-sdk	Build	Log	#54669
1187261	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51456
1187226	dotnet/sdk	🟣 Build	Log	#51425
1187000	dotnet/sdk	🟣 Run FullFramework Tests	Log	#51462
1186342	dotnet/sdk	🟣 Build	Log	#51425
1186167	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51207
2823644	dotnet-sdk	Build	Log	#54637
1183902	dotnet/sdk	🟣 Run FullFramework Tests	Log	#51373
1183118	dotnet/sdk	🟣 Build	Log	#51425
1182320	dotnet/sdk	🟣 Build	Log	#51414
2821880	dotnet-sdk	Build (fedora41)	Log	#54567
2821854	dotnet-sdk	Build (ubuntu2204DebPkg)	Log	#54568
2821852	dotnet-sdk	Build	Log	#54567
2821435	dotnet-sdk	Run Tests in Helix	Log	#54551
1180825	dotnet/sdk	Run TestBuild Tests	Log	#51394
2820896	dotnet-sdk	Initialize job	Log	#54528
1180500	dotnet/sdk	Build	Log
1180315	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51052
2820084	dotnet-sdk	Build (azureLinux30CrossArm)	Log

Build	Definition	Test	Pull Request
1198942	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	#51307
1194108	dotnet/sdk	dotnet-watch.Tests.dll.7.WorkItemExecution	#51567
1189177	dotnet/sdk	Microsoft.NET.Sdk.StaticWebAssets.Tests.dll.7.WorkItemExecution	#50468
1183612	dotnet/sdk	dotnet.Tests.dll.18.WorkItemExecution	#51373
2821436	dotnet-sdk	Microsoft.DotNet.Cli.Sln.Add.Tests.GivenDotnetSlnAdd.WhenValidProjectIsPassedTheSlnBuilds	#54550

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
5	35	89

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.