Run manual tests

Last Update: 4/7/2017

Team Services | TFS 2017

Run your manual tests and record the test results for each test step using Microsoft Test Runner. If you find an issue when testing, use Test Runner to create a bug. Test steps, screenshots, and comments are automatically included in the bug.

You just need Basic access to run tests that have been assigned to you with Visual Studio Team Services. Learn more about the access that you need for more advanced testing features.

Run tests for web apps

  1. If you haven't already, create your manual tests.

  2. Select a test from a test suite and run it.

    Select and run a specific test

    Microsoft Test Runner opens and runs in a new browser.

  3. Start the app that you want to test. Your app doesn't have to run on the same computer as Test Runner. You just use Test Runner to record which test steps pass or fail while you manually run a test. For example, you might run Test Runner on a desktop computer and run your Windows 8 store app that you are testing on a Windows 8 tablet.

    Use Microsoft Test Runner to record your test results

  4. Mark each test step as either passed or failed based on the expected results. If a test step fails, you can enter a comment on why it failed.

    Mark test steps

  5. Create a bug to describe what failed.

    Submit a bug

    The steps and your comments are automatically added to the bug. Also, the test case is linked to the bug.

    If Test Runner is running in a web browser window, you can copy a screenshot from the clipboard directly into the bug.

  6. You can see any bugs that you have reported during your test session.

    Bugs logged

  7. When you've run all your tests, save the results and close Test Runner. All the test results are stored in Visual Studio Team Services. How do I resume testing, or run one or more tests again?

  8. View the testing status for your test suite. You see the most recent results for each test.

    View test results

  9. Open a test and choose the test case in the Related Work section. Then use the Child links in the Related Work section of that work item to view the bugs filed by the tester.

    View bugs filed

Run tests for desktop apps

If the only data you want to collect from your desktop app is screen recordings, use the web-based Microsoft Test Runner in the same way as described above for web apps.

However, if you want to collect more types of data, run your tests using Microsoft Test Manager client.

  1. Launch the test runner client from the Test hub by choosing Run with options from the Run menu.

    Launching the test runner client

  2. In the Run with options dialog, select Microsoft Test Runner 2017 or later, choose the data collectors you want to enable, and optionally select a build to associate with your test run.

    Selecting the Test Runner and options

  3. Choose OK to start testing.

For more information, see Collect diagnostic data.

Try this next

Q&A

Q: How do I rerun a test?

A: Just select any test and choose Run.

Q: Can I run all the tests in a test suite together?

A: Yes, select a test suite and choose Run. This runs all the active tests in the test suite. If you haven't run a test yet, its state is active. You can reset the state of a test to active if you want to rerun it.

Select and run all active tests in a test suite

Q: Can I choose a build to run tests against?

A: Yes, Choose Run and then select Run with options.

Starting a test with options

Select the build you want from the drop-down list.

Selecting the build to include a link to in the results

Any bug filed during the run will automatically be associated with the selected build, and the test outcome will be published against that build.

Q: Can I fix my test steps while I'm running a test?

A: Yes, if you have the Test Manager for Visual Studio Team Services. You can insert, move, or delete steps. Or you can edit the text itself. Use the edit icon next to the test step number to do this.

Select the edit icon to edit test steps

The tool to edit the test steps is shown.

Fix test steps when you run a test

Q: Can I add a screenshot to the test results when I am running a test?

A: If you are using Google Chrome, you can use the web runner to take screenshots of the web app while testing.

Capturing a screenshot from the app

For more information, see Collect diagnostic data.

Q: Can I capture my actions on the app as a log?

A: If you are using Google Chrome, you can use the web runner capture your actions on the web app as image logs while testing.

Capturing an image action log from the app

For more information, see Collect diagnostic data.

Q: Can I capture screen recordings of my app?

A: If you are using Google Chrome, you can use the web runner to capture screen recordings of your web and desktop apps while testing.

Capturing a screen recording from the app

For more information, see Collect diagnostic data.

Q: How do I control how long I keep my test data?

A: Learn more here.

Help and support

Submit bugs through Connect, make suggestions on Uservoice, and send quick thoughts using the Send-a-Smile icon link in the Visual Studio, Team Services, or TFS title bar. We look forward to your feedback.