Collect diagnostic data while testing

Last Update: 4/7/2017

Team Services | TFS 2017

Collect diagnostic data while testing your apps. This data will be included in the bugs you file during the test. You can collect diagnostic data from web apps and from desktop apps, and view it in Team Services or Team Foundation Server.

Collect diagnostic data from web apps

For web apps under test, you can use web-based Microsoft Test Runner to collect the following data on demand:

The following diagnostic data collection features currently work only with the web-based Microsoft Test runner. See Exploratory test and submit feedback directly from your browser

Screen capture

Capture annotated screenshots from your web app.

  1. Ensure that the tab of the app from which you want to capture data is the active tab.

  2. Open Test Runner and choose the Capture screenshot icon.

    Capturing a screenshot from the app

  3. Choose the title of the tab containing the app you are testing.

    Selecting the active app tab title

    If the tab title you want is not shown in the list, switch to the app and activate it by tapping on the title bar, or on a child window if the app has opened one.

  4. Drag to select the area of the screen you want to capture, or just capture the full screen.

    Selecting the area of the screen to capture

  5. If required, edit the title of the screenshot and add annotations and text to it using the icons in the toolbar.

    Annotating the screenshot

  6. Save your screenshot.

    Saving the screenshot

Image action log

Capture your interactions with the web app as an image action log that provides context.

  1. Ensure that the tab of the app from which you want to capture data is the active tab.

  2. Open or switch to the Test Runner and choose the Capture user actions... icon.

    Capturing an image action log from the app

  3. Choose the title of the tab containing the app you are testing.

    Selecting the active app tab title

    If the tab title you want is not shown in the list, switch to the app and activate it by tapping on the title bar, or on a child window if the app has opened one.

  4. The Test Runner will now record all the actions you take on the app's browser tab.

    Recording in progress for a web app

    If you create a bug while recording your actions, all the data collected up to that point will be included in the bug.

  5. Finish capturing your actions by choosing the Stop button. The action log is added to the test results as an attachment.

    Stopping a recording for a web app

  6. Choose the ActionLog... link at the bottom of the window to view the data captured in the action log.

    Opening the image action log

    The log opens in your web browser.

    Viewing the data captured in the image action log

Screen recording

Capture screen recordings from your web apps.

  1. Ensure that the tab of the app from which you want to capture data is the active tab.

  2. Open or switch to the Test Runner and choose the Record screen icon.

    Capturing a screen recording from the app

  3. Choose the entire screen, or choose an app to start recording.

    Choosing the screen or app to record

    If you create a bug while recording your screen, the recording automatically stops and is added to the bug.

  4. Finish recording your actions by choosing the Stop button. The recording is added to the test results as an attachment.

    Stopping a screen recording

    If you do not stop the recording after ten minutes, it stops automatically and is saved as an attachment to your test results. Restart the recording the Record screen icon if required.

  5. Choose the ScreenRecording... link at the bottom of the window to view the captured recording.

    Viewing the screen recording

View the diagnostic data

When you create a bug while capturing diagnostic data, all the data captured up to that point is included in the bug that is created. You can view it before you save the bug.

Viewing the diagnostic data in the bug yu are creating

Collect diagnostic data from desktop apps

At present you can collect only screen recordings and system information when testing desktop apps using the web-based Microsoft Test Runner. Instead, use Microsoft Test Manager client to collect additional diagnostic from desktop apps.

  1. In the Test hub in Team Services or Team Foundation Server, select a test case, test suite, or test plan to execute.

  2. Open the Run menu and choose Run with options.

    Starting a test with options

  3. In the Run with options dialog, select Microsoft Test Runner 2017 or later in the first drop-down list.

    Selecting the test runner

  4. Choose the data collectors you want to enable. Options include Event log, Action log, Screen and voice recorder, and System information.

    Selecting the additional diagnostic data to collect

    By default, the test runner client lets you to capture screenshots of your desktop app during testing.

  5. If you wish, select a build to associate with your test run. A link to this build will be included automatically in all the bugs you create during the test run.

    Selecting the build to include a link to in the results

  6. Choose OK to start testing.

If you want to collect advanced diagnostic data such as code coverage, IntelliTrace, and Test Impact data in addition to the data items listed above, you must configure the data collectors and other run settings in Microsoft Test Manager (MTM) and run your tests using MTM. For more details, see Run manual tests with Microsoft Test Manager.

Q&A

Q: I have an older version of Microsoft Test Manager. Can I launch the test runner from test hub?

A: We recommend you upgrade to the latest version of Microsoft Test Manager. However, if you have Microsoft Test Manager 2015 or an earlier version installed, you can choose Microsoft Test Runner 2015 and earlier when you launch the test runner from Test hub using Run with options. You must configure the data collectors and other run settings in Microsoft Test Manager (MTM) and specify these as the default settings for the test plan. For more details, see Run manual tests with Microsoft Test Manager.

See also

Help and support

Submit bugs through Connect, make suggestions on Uservoice, and send quick thoughts using the Send-a-Smile icon link in the Visual Studio, Team Services, or TFS title bar. We look forward to your feedback.