testing

IMPORTANT: This repository uses xUnit v3 with Microsoft.Testing.Platform (MTP v2). Traditional VSTest --filter syntax does NOT work. Use the options below instead.

• There should generally be one test project (under the test directory) per shipping project (under the src directory). Test projects are named after the project being tested with a .Tests suffix.
• Tests use xUnit v3 with Microsoft.Testing.Platform (MTP v2).

Running Tests

There may be unstable tests that are attributed as such. Running the dotnet-test-cloud.ps1 script will execute all previously built tests except the unstable ones. The commands below will not automatically exclude unstable tests, but you may do so by adding a parameter to filter out those that set their TestCategory property to FailsInCloudTest.

Run all tests (from the root of the repository):

dotnet test --no-build -c Release

To run a specific test project, change to that project's directory first; the commands below then target it without hard-coding its path.

Run tests for a specific test project (within that test project's directory):

dotnet test --no-build -c Release

Run a single test method:

dotnet test --no-build -c Release -- --filter-method ClassName.MethodName

Run all tests in a test class:

dotnet test --no-build -c Release -- --filter-class ClassName

Run tests with wildcard matching (supports wildcards at beginning and/or end):

dotnet test --no-build -c Release -- --filter-method "*Pattern*"

Run tests with a specific trait:

dotnet test --no-build -c Release -- --filter-trait "TraitName=value"

Exclude tests with a specific trait:

dotnet test --no-build -c Release -- --filter-not-trait "TestCategory=FailsInCloudTest"

Run tests for a specific framework only:

dotnet test --no-build -c Release --framework net10.0

List all available tests without running them:

cd test/Microsoft.VisualStudio.Composition.Tests
dotnet run --no-build -c Release --framework net10.0 -- --list-tests

Key points about test filtering with xUnit v3 / MTP v2:

• Options after -- are passed to the test runner, not to dotnet test
• Use --filter-method, --filter-class, and --filter-namespace for simple filtering
• Use --filter-trait and --filter-not-trait for trait-based filtering
• Traditional VSTest --filter expressions do NOT work
• Wildcards * are supported at the beginning and/or end of filter values
• See --help for the query filter language for advanced scenarios