Jenkins Setup for Execution Engine V2

This guide will help you in setting up a Jenkins pipeline to run useMango™ tests. Follow the steps outlined here to run useMango™ tests and view the results.


To use Jenkins Pipeline, you will need:

  1. Jenkins 2.x or later (older versions back to 1.642.3 may work but are not recommended).

  2. Pipeline plugin, which is installed as a part of the Suggested Plugins.

Creating useMangoApiKey Credentials

Let’s start by creating the useMangoApiKey credentials that the Jenkins Pipeline script will need to retrieve useMango™ tests from your account:

  1. On the Jenkins home page, in the left panel, click Manage Jenkins. Scroll down until you reach the Security section. Click on the Manage Credentials option.
  2. Under Stores scoped to Jenkins, click on Jenkins.
  3. Click the Global credentials (unrestricted) link under System.
  4. Click Add Credentials on the left.
  5. Select the SecretText option from the Kind dropdown.
  6. Select Global from the Scope dropdown.
  7. Enter your useMango™ account API Key in the Secret field.
  8. Enter the value useMangoApiKey in the ID field.
  9. Click OK to save the credentials.

Creating your pipeline

Now, to set up the Jenkins pipeline,

  1. Create a Pipeline project in Jenkins.

  2. Next, we need to add parameters. Parameters allow you to prompt users for one or more inputs that will be passed into a build. In the Rebuild options choose This project is parameterized. We will need a total of four parameters (2 String and 1 Choice parameters).

    To add the parameters,

  • Click on Add Parameter and pick String Parameter from the dropdown menu, then enter Project as the Name. If the project you’re testing isn’t going to change, you can set a Default Value. The value will be the project you are testing in useMango™.

  • Create a new String Parameter, then enter Tags as the Name.

  • Finally, we need a Choice Parameter. From the dropdown choose Choice Parameter and add the following choices to it:

  1. Scroll down to the Pipeline section and select Pipeline Script from SCM from the Definition dropdown. Select Git from the SCM dropdown menu. In the Repository URL text field, paste the following useMango Jenkins public repository URL:

  2. Click on Apply, and Save the changes.

  3. To build the project, go to Build with Parameters, add the parameter values and examine the results.
    An example is shown below:

    We’re using the WebsiteTest project here, which includes a large number of useMango™ tests. We’ll execute useMango™ tests with the tags test and website that are currently marked as Ready.

If you are not familiar with the process of viewing test results in Jenkins, you can learn more about it here.