Skip to content

Enable live output for MSTest tests#55418

Open
Evangelink wants to merge 6 commits into
dotnet:mainfrom
Evangelink:dev/amauryleve/upgrade-mstest-live-output
Open

Enable live output for MSTest tests#55418
Evangelink wants to merge 6 commits into
dotnet:mainfrom
Evangelink:dev/amauryleve/upgrade-mstest-live-output

Conversation

@Evangelink

@Evangelink Evangelink commented Jul 22, 2026

Copy link
Copy Markdown
Member

Summary

  • update MSTest/MSTest.Sdk to 4.4.0-preview.26373.11 and Microsoft.Testing.Platform to 2.4.0-preview.26373.11 from coherent TestFX build 324182
  • configure SDK repository MSTest runs to capture test output in results and stream it live, including on CI
  • consume the live-output lock inversion fix from Fix MSTest live output deadlock microsoft/testfx#10169
  • document the repository-wide MSTest output behavior

Validation

  • built Microsoft.NET.Build.Containers.UnitTests successfully with no warnings or errors
  • verified the generated <AssemblyName>.testconfig.json contains captureTrace: Live
  • verified CI evaluation includes the live-output configuration
  • verified MSTest, MSTest.Sdk, and Microsoft.Testing.Platform resolve to build 26373.11 at the same TestFX SHA
  • upstream deadlock regressions cover concurrent TestContext/trace and console output and passed across TestFX CI

Update MSTest and Microsoft.Testing.Platform to the latest coherent TestFX build, then configure SDK repository tests to capture and stream output live.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8bf6402b-2114-4555-97d4-9708f64b60da
Copilot AI review requested due to automatic review settings July 22, 2026 21:22
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 2 pipeline(s).
1 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Enables live streaming and result-capture of MSTest output across the test/ tree by standardizing a TestFX test configuration file and updating to a coherent TestFX build.

Changes:

  • Bump MSTest/MSTest.Sdk and Microsoft.Testing.Platform to *-preview.26370.11 (coherent TestFX build/SHA).
  • Add test/testconfig.json and MSBuild wiring to copy it next to MSTest outputs as <AssemblyName>.testconfig.json.
  • Document the repository-wide MSTest live-output behavior in test/AGENTS.md.
Show a summary per file
File Description
test/testconfig.json Introduces the MSTest output configuration (capture trace live).
test/Directory.Build.props Copies the config next to MSTest outputs as <AssemblyName>.testconfig.json.
test/AGENTS.md Documents the new repo-default MSTest live output behavior for contributors/agents.
global.json Updates the MSTest.Sdk MSBuild SDK version to the coherent TestFX build.
eng/Version.Details.xml Updates TestFX dependency versions and SHAs to keep MSTest + MTP coherent.
eng/Version.Details.props Updates the flowing package version properties for TestFX packages.

Copilot's findings

  • Files reviewed: 6/6 changed files
  • Comments generated: 2

Comment thread test/Directory.Build.props Outdated
Comment thread eng/Version.Details.props
Avoid copying testconfig.json into shared MSTest.Sdk library outputs where IsTestApplication is false.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8bf6402b-2114-4555-97d4-9708f64b60da
Helix shards can stop making progress when high-volume parallel test output uses MSTest live capture. Keep live output for local runs and retain MSTest's default result capture in CI.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8bf6402b-2114-4555-97d4-9708f64b60da
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8bf6402b-2114-4555-97d4-9708f64b60da
@Evangelink Evangelink closed this Jul 23, 2026
@Evangelink Evangelink reopened this Jul 23, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 2 pipeline(s).
1 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

@Evangelink

Copy link
Copy Markdown
Member Author

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 3 pipeline(s).
1 pipeline(s) were filtered out due to trigger conditions.

@Evangelink

Copy link
Copy Markdown
Member Author

The original CI failures exposed an MSTest Live output lock inversion, confirmed from the Helix hang dump. The product fix is in microsoft/testfx#10169 with a deterministic deadlock regression. This SDK PR temporarily excludes the live config on CI only while that fix builds; once a fixed TestFX build is available, I will flow it here and remove the exclusion.

@Evangelink

Copy link
Copy Markdown
Member Author

@copilot resolve the merge conflicts in this pull request

@Evangelink
Evangelink enabled auto-merge July 23, 2026 14:37
Resolve the TestFX dependency conflicts using main's newer coherent MSTest and Microsoft.Testing.Platform build.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8bf6402b-2114-4555-97d4-9708f64b60da
Update MSTest and Microsoft.Testing.Platform to TestFX build 324182, which includes microsoft/testfx#10169, and re-enable live capture in CI.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8bf6402b-2114-4555-97d4-9708f64b60da
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants