Skip to content

[release/11.0.1xx] Update dependencies from microsoft/testfx - #56490

Open
dotnet-maestro[bot] wants to merge 8 commits into
release/11.0.1xxfrom
darc-release/11.0.1xx-6f3f02b6-3ef3-48bd-977f-6790625eebab
Open

dotnet-maestro[bot] wants to merge 8 commits into
release/11.0.1xxfrom
darc-release/11.0.1xx-6f3f02b6-3ef3-48bd-977f-6790625eebab

Conversation

@dotnet-maestro

@dotnet-maestro dotnet-maestro Bot commented Oct 5, 2026 •

Copy link
Copy Markdown
Contributor

This pull request updates the following dependencies

From https://github.com/microsoft/testfx

…261003.3

On relative base path root
Microsoft.Testing.Platform From Version 2.5.0-preview.26477.3 -> To Version 2.5.0-preview.26503.3
MSTest , MSTest.Sdk From Version 4.5.0-preview.26477.3 -> To Version 4.5.0-preview.26503.3
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
2 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Evangelink and others added 4 commits October 9, 2026 10:08
…261009.15

On relative base path root
Microsoft.Testing.Platform From Version 2.5.0-preview.26477.3 -> To Version 2.6.0-preview.26509.15
MSTest , MSTest.Sdk From Version 4.5.0-preview.26477.3 -> To Version 4.6.0-preview.26509.15
…261015.10

On relative base path root
Microsoft.Testing.Platform From Version 2.5.0-preview.26477.3 -> To Version 2.6.0-preview.26515.10
MSTest , MSTest.Sdk From Version 4.5.0-preview.26477.3 -> To Version 4.6.0-preview.26515.10
@nagilson

Copy link
Copy Markdown
Member

Once #56590 is green, a similar fix should be applied here

dotnet-maestro Bot and others added 3 commits October 26, 2026 05:05
…261024.1

On relative base path root
Microsoft.Testing.Platform From Version 2.5.0-preview.26477.3 -> To Version 2.6.0-preview.26524.1
MSTest , MSTest.Sdk From Version 4.5.0-preview.26477.3 -> To Version 4.6.0-preview.26524.1
…261031.5

On relative base path root
Microsoft.Testing.Platform From Version 2.5.0-preview.26477.3 -> To Version 2.6.0-preview.26531.5
MSTest , MSTest.Sdk From Version 4.5.0-preview.26477.3 -> To Version 4.6.0-preview.26531.5
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@Evangelink
Evangelink requested a review from a team as a code owner November 5, 2026 11:01
@Evangelink

Copy link
Copy Markdown
Member

Fixed in a1e8f074aef49b017ec5ec1b6961c30b31d55c75.

All four failures reported by build 1659237 are the same stale MTPHelpSnapshotTests.VerifyMTPHelpOutput snapshot. I confirmed the identical two-line diff in the Linux x64, Windows x64, Windows FullFramework, and macOS arm64 Helix logs. The test application successfully returns help with exit 0, but its output now includes --coverage-threshold-branch and --coverage-threshold-line.

These are intentional MTP additions from microsoft/testfx#11814. I checked their definitions and descriptions at this PR's exact testfx commit, 2a8ebadb17a3b388b62bbb0cedd407999e3ce10a. The fix adds only those two lines to the verified snapshot, matching the generated release-branch output. It does not change product code, dependency versions, analyzer settings, assertions, or test selection.

Release-branch validation: Windows x64, complete built SDK layout 11.0.100-dev, bootstrap SDK 11.0.100-rc.1.26425.128, MSTest/MSTest.Sdk 4.6.0-preview.26531.5, and Microsoft.Testing.Platform 2.6.0-preview.26531.5. The actual built test application's dependency manifest confirms the MSTest and MTP versions.

Run Exit Result
Full SDK build, including Native AOT layout 0 Complete release SDK layout built.
Original snapshot on 5e1a1113fb8ba37e45af714311dfc2b40c8abec8 2 Reproduced the exact CI mismatch.
Corrected snapshot and help integration classes, repeated twice 0 14/14 passed, no skips.

The passing cases cover the snapshot, single-module and multi-module help, Debug and Release test applications, unavailable extension options, duplicate-option prevention, and successful parent exit codes. The updated snapshot also matches the full generated output, not merely the presence of the two option names.

Commands used:

$env:DOTNET_ADD_GLOBAL_TOOLS_TO_PATH = '0'
$env:DOTNET_CLI_TELEMETRY_OPTOUT = '1'

# The installed preview C++ toolchain and Windows system tools must be on PATH.
cmd /d /c 'set "PATH=C:\Windows\System32;C:\Windows;C:\Windows\System32\WindowsPowerShell\v1.0;%PATH%" && call "C:\Program Files\Microsoft Visual Studio\18\Insiders\VC\Auxiliary\Build\vcvars64.bat" >nul && call build.cmd -c Debug -bl'

# Before the snapshot correction: expected reproduction, exit 2.
.\.dotnet\dotnet.exe scripts\RunTests.cs -- --project test\dotnet.Tests\dotnet.Tests.csproj --filter 'FullyQualifiedName~MTPHelpSnapshotTests'

# After the correction: exit 0, seven cases per iteration.
.\.dotnet\dotnet.exe scripts\RunTests.cs -- --project test\dotnet.Tests\dotnet.Tests.csproj --filter 'FullyQualifiedName~MTPHelpSnapshotTests|FullyQualifiedName~GivenDotnetTestBuildsAndRunsHelp' --repeat 2

This release branch predates the centralized runner, so I used an unmodified temporary copy of scripts/RunTests.cs from SDK commit 64bb526f36a4537da9993214be583894180e5fee, then removed the temporary checkout copy. The runner is not part of this fix.

Retained local evidence: the before-fix TRX/binlog under artifacts\log\test-runs\dotnet.Tests\20261105-105605-77972, and both passing TRX files plus their build binlog under artifacts\log\test-runs\dotnet.Tests\20261105-105728-71536. The full build binlog is artifacts\log\Debug\Build.binlog. Existing NuGet audit warnings were not suppressed.

This verifies the correction locally on the shipping release branch; it is not a claim that the newly triggered cross-platform CI run has finished.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants