Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Repository	Step Name	Console log	Pull Request
1488443	dotnet/sdk	🟣 Run dotnet-format on dotnet/project-system ProjectSystem.sln	Log	#55000
1488398	dotnet/sdk	🟣 Build	Log
1486966	dotnet/sdk	🟣 Run dotnet-format on dotnet/efcore EFCore.sln	Log
1486708	dotnet/sdk	🟣 Run dotnet-format on dotnet/aspnetcore AspNetCore.sln	Log	#55061
1486586	dotnet/sdk	🟣 Build	Log	#55059
1485523	dotnet/sdk	Monitor Helix Jobs	Log	#55033
1485018	dotnet/sdk	Build	Log	#55032
3009822	dotnet-sdk	🟣 Build	Log
1483820	dotnet/sdk	🟣 Run dotnet-format on dotnet/aspnetcore AspNetCore.sln	Log	#54987
3009026	dotnet-sdk	🟣 Build	Log
1482901	dotnet/sdk	🟣 Build	Log	#55008
3008314	dotnet-sdk	Run Tests in Helix and non Helix in parallel	Log	#61763
1481405	dotnet/sdk	🟣 Build	Log	#54976
3007439	dotnet-sdk	Run Tests in Helix and non Helix in parallel	Log	#62381
1478796	dotnet/sdk	Monitor Helix Jobs	Log	#54871
1478574	dotnet/sdk	🟣 Build	Log	#54945
1478480	dotnet/sdk	🟣 Build	Log	#54955
1478464	dotnet/sdk	🟣 Build	Log	#54941
3006743	dotnet-sdk	Run Tests in Helix	Log	#62354
3006733	dotnet-sdk	🟣 Queue Tests	Log
3006675	dotnet-sdk	Prepare dotnet/msbuild for formatting	Log	#62350
1478078	dotnet/sdk	Monitor Helix Jobs	Log	#54949
1478024	dotnet/sdk	🟣 Build	Log	#54883
3006554	dotnet-sdk	🟣 Queue Tests	Log
3006396	dotnet-sdk	Run TestBuild Tests	Log	#62328
1477514	dotnet/sdk	🟣 Build	Log	#54883
1477388	dotnet/sdk	🟣 Build	Log	#54855
1477036	dotnet/sdk	🟣 Build	Log	#54856
1476935	dotnet/sdk	🟣 Build	Log	#54932
1476260	dotnet/sdk	🟣 Build	Log	#54930
3005789	dotnet-sdk	🟣 Build	Log
1475907	dotnet/sdk	🟣 Build	Log
3005765	dotnet-sdk	🟣 Build	Log
1475766	dotnet/sdk	🟣 Build	Log	#54855
1475760	dotnet/sdk	🟣 Build	Log	#54848
3002837	dotnet-sdk	Checkout dotnet-sdk@refs/pull/62207/merge to s	Log	#62207
3002725	dotnet-sdk	Run TestBuild Tests	Log	#62198
1467970	dotnet/sdk	🟣 Build	Log	#52302
1468733	dotnet/sdk	Build	Log	#54498
1467971	dotnet/sdk	🟣 Build	Log
1467885	dotnet/sdk	🟣 Build	Log	#54730
1467817	dotnet/sdk	🟣 Build	Log	#54172
1467624	dotnet/sdk	🟣 Build	Log	#54762
1467189	dotnet/sdk	🟣 Build	Log	#54782
1467119	dotnet/sdk	🟣 Build	Log	#54729
1467110	dotnet/sdk	🟣 Build	Log	#54723
1467115	dotnet/sdk	🟣 Build	Log	#54787
1467109	dotnet/sdk	🟣 Build	Log	#54785
3001725	dotnet-sdk	🟣 Queue Tests	Log
1466921	dotnet/sdk	🟣 Build	Log	#54719
1466775	dotnet/sdk	🟣 Build	Log	#54801
3001746	dotnet-sdk	Build	Log
1466849	dotnet/sdk	🟣 Build	Log	#54621
1466783	dotnet/sdk	🟣 Build	Log	#54729
1466784	dotnet/sdk	🟣 Build	Log	#54730
1466744	dotnet/sdk	🟣 Run NativeAOT CLI Tests	Log	#54719
3001691	dotnet-sdk	🟣 Build	Log
3001223	dotnet-sdk	🛡 Guardian: BinSkim 4.4.9	Log
1465623	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54776
3001057	dotnet-sdk	Build	Log	#61867
1464104	dotnet/sdk	Monitor Helix Jobs	Log	#54766
1462794	dotnet/sdk	Monitor Helix Jobs	Log	#54725
1461453	dotnet/sdk	🟣 Build	Log	#54724
1461340	dotnet/sdk	🟣 Build	Log	#54724
1460906	dotnet/sdk	🟣 Queue Tests	Log	#54734
1459066	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54657
1457893	dotnet/sdk	🟣 Build	Log	#54681
1456872	dotnet/sdk	Run FullFramework Tests	Log	#54592
2996353	dotnet-sdk	Run Tests in Helix	Log	#61981
2995034	dotnet-sdk	🟣 Build	Log
1453929	dotnet/sdk	🟣 Build	Log	#54633
1453590	dotnet/sdk	Run TestBuild Tests	Log	#54570
1453492	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54524
1447373	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54513
1451961	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54625
1451777	dotnet/sdk	🟣 Run TestBuild Tests	Log
1451558	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54617
1451351	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54615
1450996	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54602
1450659	dotnet/sdk	Run TestBuild Tests	Log	#54054
1450693	dotnet/sdk	🟣 Build	Log	#54584
2992527	dotnet-sdk	NuGetAuthenticate@1	Log	#61852
1449901	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54591
2991969	dotnet-sdk	Download secrets: HelixProdKV	Log
2991803	dotnet-sdk	Build (alpine322)	Log	#61742
1448656	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54544
1448556	dotnet/sdk	🟣 Build	Log	#54578
1447667	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54529
2990849	dotnet-sdk	Run FullFramework Tests	Log	#61742
2990850	dotnet-sdk	Download secrets: EngKeyVault	Log	#61743
2990751	dotnet-sdk	Download Release Configs	Log
2990454	dotnet-sdk	🟣 Build	Log
2990250	dotnet-sdk	Download secrets: HelixProdKV	Log
1444468	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54501
2989324	dotnet-sdk	🟣 Build	Log
2989344	dotnet-sdk	🟣 Build	Log
2989188	dotnet-sdk	🟣 Build	Log
2989143	dotnet-sdk	🟣 Build	Log
1443472	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54528

Build	Repository	Test	Pull Request
1486903	dotnet/sdk	dotnet-watch.Tests.dll.9.WorkItemExecution	#54995
1477257	dotnet/sdk	FeaturesSupport	#54904
1473794	dotnet/sdk	Microsoft.DotNet.Cli.New.IntegrationTests.PostActionTests.AddProjectToSolution_Basic	#54905
1463218	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.AspireLauncherIntegrationTests.ServerAndResources	#54725
1463037	dotnet/sdk	Microsoft.DotNet.Cli.New.IntegrationTests.McpServerTemplateTests.AllMcpServerProjectsRestoreAndBuild	#54726
1450240	dotnet/sdk	dotnet-new.IntegrationTests.dll.2.WorkItemExecution	#54596
1449238	dotnet/sdk	dotnet.Tests.dll.13.WorkItemExecution	#53943

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
5	22	106

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.

[tmat]

@baronfel @jaredpar should this issue be closed?

[baronfel]

I don't think so - the tracker is still making recent edits, which impliies it's still being hit.

[tmat]

So the fix above didn't fix it?