Test All Step

The Test All step executes all Test Sets defined for the projects in the snapshot (or the release for Utility projects) according to the project's defined strategy.

Field

Description

Field

Description

Step Name

The name of the step.

Description

An optional description for the step.

Project Groups

Identifies which group(s) from the release/snapshot to execute tests for.  If no group is specified, all tests (according to strategy) for projects in the release will be executed.  

Exclude Project Groups

Skip testing any projects/packages from the snapshot which are tagged in the release with the selected project group(s).  Available project groups are defined by the pipeline.

Test Type

Identifies which types of tests to execute.  If not specified, all test types will be executed.  Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release).

Precondition

An optional Groovy script which determines whether the gate or step is applicable during execution. The script has access to variables and methods listed in Pipeline Groovy Variables and Methods. You can find these variables methods using Variable Lookup help.

The script must return true if the gate is applicable, or false otherwise.  If no script is provided, the default is to return true (applicable).

Continue

If checked, any failure will be ignored, and the pipeline execution will continue.

Notify Pipeline Roles

Selects one or more roles from the pipeline definition to notify in case of error.  Default role members are defined on the pipeline, and optional overridden for each release.



Test sets are defined to execute based on the testing strategy established on the project.  Only those projects which are part of the release will have their test sets executed, and assuming they are in any group(s) which are specified on the step. 

Script Variables

The following macros are not currently supported in the footer:
  • style