Test: Xamarin Test Cloud

Last Update: 3/6/2017

Team Services | TFS 2017 | TFS 2015 | Previous versions (XAML builds)

Test mobile apps with Xamarin Test Cloud using Xamarin.UITest




Argument Description
App File

If you want to test a single app, click the ... button and select the .apk file.

If you want to test multiple apps, specify a match pattern filter. You can use a single-folder wildcard (*) and recursive wildcards (**). For example, **/*.apk searches for all .apk files in all subdirectories.

dSYM File To make crash logs easier to read, upload a .dSYM file that is associated with your app. Specify a path relative to the .ipa file. You can use a match pattern filter. For example: *.dSYM
Note: This argument applies only to iOS apps.
Team API Key Your Xamarin Test Cloud Team API key. To get it, go to your Xamarin Test Cloud account, and then to Teams & Apps.
Important: Use a secret variable to avoid exposing this value.
User Email Email address of your Xamarin Test Cloud account.

The devices string generated by Xamarin Test Cloud. To get this string:

  • Go to your Xamarin Test Cloud account.
  • Click New Test Run.
  • Step through the wizard. When you reach the final page, copy the ID that follows the --devices option.
Series Series name for the test run. For example, master, production, or beta. See Xamarin: Creating A Test Run for a Team.
Test Assembly Directory Relative path to the folder that contains the test assemblies. For example: SolutionName/TestsProjectName/bin/Release.
Parallelization Select None, By test fixture, or By test method.
System Language Select your language. If it isn't displayed, select Other and then enter its locale below. For example: en_AU.
test-cloud.exe Location Location of test-cloud.exe. In most cases leave this set to the default value.
Optional Arguments (Optional) Arguments passed to test-cloud.exe. See Submitting UITests at the Command Line.
Publish results to VSO/TFS Select if you want to pass the --nunit-xml option to test-cloud.exe so that results from the NUnit xml file are be published to Team Foundation Server or Visual Studio Team Services.
Control options


Build your Xamarin app


How do I add a Xamarin UITest to my solution?

Adding Xamarin.UITest to a Solution

Where can I learn more about file matching patterns?

File matching patterns reference

Do I need a build agent?

You need at least one agent to run your build. Get an agent.

I can't select a default agent queue and I can't queue my build. How do I fix this?

See queues.

I use Team Foundation Server on-premises and I don't see some of these features. Why not?

Some of these features are available only on Visual Studio Team Services and not yet available on-premises. Some features are available on-premises if you have upgraded to the latest version of TFS.