Test All Step

The Test All step executes all the tests defined for the projects in the snapshot (or the release for Utility projects).

Field

Description

Field

Description

Step Name

The name of the step.

Description

An optional description for the step.

Include Groups

Identifies which group(s) from the release/snapshot to execute tests for.  If no group is specified, all tests (according to strategy) for projects in the release will be executed.  

Exclude Groups

Skip testing any projects/packages from the snapshot which are tagged in the release with the selected project group(s).  Available project groups are defined by the pipeline.

Test Name

@Since 7.0.0.1 - Identifies which test to execute.  If not specified, all tests will be executed. Use comma-separated test names, or supply a regular expression to match one or more test names. If both test name and test tag are specified we will consider an intersection between them.

Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release).

Tags

@Since 7.0.0.1 - Filters for tests to execute with at least one matching tag. If not specified, all tests will be executed. Use comma-separated tags, or supply a regular expression to match one or more tests' tags.

Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release).

Precondition

An optional Groovy script which determines whether the gate or step is applicable during execution. The script has access to variables and methods listed in Pipeline Groovy Variables and Methods. You can find these variables and methods while using the Groovy Editor.

The script must return true if the step is applicable, or false otherwise.  If no script is provided, the default is to return true (applicable).

On Error

Continue

If checked, any failure will be ignored, and the pipeline execution will continue.

Notify Pipeline Roles

Selects one or more roles from the pipeline definition to notify in case of error.  Default role members are defined on the pipeline, and optionally overridden for each release. Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release).

When using a role script you can dynamically return a key/value pair. For example return [type: 'groupName', value: 'FD Administrators']. Supported types are roleId, roleName, groupId, and groupName. You can return Map with single key/value pair or list of such single key/value maps.

Tests are defined to execute based on the test automation configured on the project.  Only those projects which are part of the release will have their tests executed, and assuming they are in any group(s) which are specified on the step. 

@Since 7.0.0.2 - If multiple packages from the same project are part of the release, one test request will be submitted for each package. If duplicate test cases exist between the packages, then they will only be executed once.

Script Variables

The following macros are not currently supported in the footer:
  • style