Table of contents
TOC
Collapse the table of content
Expand the table of content

Performance test your app before release

Last Updated: 8/4/2016

Team Services | Visual Studio 2015 | Previous version

Find performance issues before you release your app by running load tests with with Visual Studio Enterprise. Don't want to use your resources and set up your own machines to create load? You can use Cloud-based Load Testing to provide virtual machines in the cloud that generate the load of many users accessing your web site at the same time. All you need is a Visual Studio Team Services account. Learn more about the Cloud-based Load Testing service.

To load test your app with on-premises resources or using Cloud-based Load Testing, you first create web performance tests. These tests are used in your load tests to simulate multiple users performing actions in your app at the same time.

Create a web performance and load test project

  1. If you don't have Visual Studio Enterprise, get it here.

  2. Create a web performance and load test project.

    Create Web Performance and Load Test project

Record a web performance test

  1. Create a web performance test.

    Create web performance test

    Your web browser opens.

  2. Enter the URL for the website that you want to test.

    Enter url - web test recorder automatically starts

  3. Use your application like you expect your customers to use it. For example, search for items and add them to the shopping cart.

    The recorder will capture the HTTP requests and responses.

  4. When you're done, stop recording.

    Use your application as user would, stop recording

    Now, Visual Studio looks for dynamic parameters for the HTTP responses to each of your HTTP requests. A progress bar appears while this happens.

    If dynamic parameters are found, a table appears. You can assign constant values to each dynamic parameter.

  5. Rename your test. For example, ShoppingCart.webtest.

    Rename web performance test

  6. Edit test properties to specify performance goals. For example, you can set a page response time goal to 1 second.

    Edit page response time goal property to 1 second

  7. Save the test.

Create a load test

  1. Create a new load test in the web performance and load test project.

    Create new load test

  2. When the load test wizard appears, choose the kind of load test that you'd like to run.

    Choose which kind of load test to run

  3. Change the load pattern to step load. This gradually adds users over time.

    Configure the step pattern

  4. Choose the test mix step.

    New Load Test Wizard - Test Mix page

  5. Add the web performance test you created.

    Add tests to the test mix

  6. Move the web performance test to the list of tests to run.

    Select which tests to include in the test mix

    When you run cloud-based load tests using your Visual Studio Team Services account, you can run those tests and generate load in an Azure datacenter that's closer to your users. That way, you reduce latency and simulate local conditions.

  7. Select the location where you want to run your load test.

    Select load test location

  8. When you finish the wizard, the web performance test is added to the load test and appears in the load test editor.

    Load test editor

Run and analyze your load test

You can run your load test locally, or you can run it in the cloud using Visual Studio Team Services. All you need is a Visual Studio Team Services account. If you run the load test in the cloud, you can generate more load without setting up test controllers and test agents. To learn how easy it is to use Cloud-based Load Testing to run your load tests, go here.

Follow these steps to run your load test on your local machine.

  1. Run the load test.

    Run a load test from toolbar

  2. While the test runs, you discover that the shopping cart page response time exceeds the value you set.

    Analyzing page response time issue

  3. Add an analysis note to track the issue.

    Add an analysis note during test

  4. After the load test is finished, the summary is displayed.

    The results for the completed test include performance counter data, threshold violations, and error information.

    Load test summary

  5. Choose the detail view. By analyzing the step load pattern for users, you can identify the user count where your performance fails to meet your requirements.

    Detail view with step load pattern

  6. Fix any performance issues in your application's code and rerun the test.

Improve your load tests

You can improve your test to better simulate real-world loads by specifying various load test scenario properties and run settings properties. For example, you can specify the number of new users that will use web cache data in your load test.

Percentage of new users property

Q & A

Q: How can I increase the capacity of my load tests?

A: You can use the Cloud-based Load Testing service, so you can run your tests across multiple virtual machines in the cloud.

Q: How many virtual users can I configure in my load test?

A: In the full version of Visual Studio Enterprise, the number of virtual users is unlimited. In Visual Studio Enterprise trial version, the virtual user count is limited to 250.

Q: Can I analyze load tests that ran previously?

A: Yes, to open and manage those results, click Manage results toolbar button in the load test editor. You can have multiple tests open at the same time to compare runs, and create trend analysis reports to compare them.

Q: Is there a difference between what I can analyze during a running test versus a completed test?

A: Yes, these are the differences:

  • Performance counters A smaller subset of the performance counter data is available while a test is running.

  • Views When the load test run has completed, the Summary View and Details View are available.

Q: Can load tests use other test types in their test mix besides web performance tests?

A: Yes, you can include unit tests and coded UI tests.

Q: Can virtual users simulate pausing between test steps?

A: Yes, you can specify think times to simulate the time spent by a user on a web page.

Q: Why should I use Cloud-based Load Testing?

A: If you don't want to set up machines for load testing, or you don’t have available resources, you can use the Cloud-based Load Testing service. It sets up virtual machines in the cloud that will run your load test. Note that your web site must be publicly available on the internet for load testing using Visual Studio Team Services to access it.

See also

Help and support

Submit bugs through Connect, make suggestions on Uservoice, and send quick thoughts using the Send-a-Smile icon link in the Visual Studio, Team Services, or TFS title bar. We look forward to your feedback.

© 2016 Microsoft