The Test All step executes all Test Sets defined for the projects in the snapshot (or the release for Utility projects) according to the project's defined strategy.
Field | Description |
|---|---|
Step Name | The name of the step. |
Description | An optional description for the step. |
Project Groups | Identifies which group(s) from the release/snapshot to execute tests for. If no group is specified, all tests (according to strategy) for projects in the release will be executed. |
| Exclude Project Groups | Skip testing any projects/packages from the snapshot which are tagged in the release with the selected project group(s). Available project groups are defined by the pipeline. |
| Test Type | Identifies which types of tests to execute. If not specified, all test types will be executed. Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release). |
| Precondition | An optional Groovy script which determines whether the gate or step is applicable during execution. The script has access to variables and methods listed in the expression |
| Continue | If checked, any failure will be ignored, and the pipeline execution will continue. |
| Notify Pipeline Roles | Selects one or more roles from the pipeline definition to notify in case of error. Default role members are defined on the pipeline, and optional overridden for each release. |
Test sets are defined to execute based on the testing strategy established on the project. Only those projects which are part of the release will have their test sets executed, and assuming they are in any group(s) which are specified on the step.