Test All Step
The Test All step executes all the tests defined for the projects in the snapshot (or the release for Utility projects).
Field | Description |
---|---|
Step Name | The name of the step. |
Description | An optional description for the step. |
Include Groups | Identifies which group(s) from the release/snapshot to execute tests for. If no group is specified, all tests (according to strategy) for projects in the release will be executed.  |
Exclude Groups | Skip testing any projects/packages from the snapshot which are tagged in the release with the selected project group(s). Available project groups are defined by the pipeline. |
Test Name | @Since 7.0.0.1 - Identifies which test to execute. If not specified, all tests will be executed. Use comma-separated test names, or supply a regular expression to match one or more test names. If both test name and test tag are specified we will consider an intersection between them. Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release). |
Tags | @Since 7.0.0.1 - Filters for tests to execute with at least one matching tag. If not specified, all tests will be executed. Use comma-separated tags, or supply a regular expression to match one or more tests' tags. Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release). |
Precondition | An optional Groovy script which determines whether the gate or step is applicable during execution. The script has access to variables and methods listed in Pipeline Groovy Variables and Methods. You can find these variables and methods while using the Groovy Editor. The script must return true if the step is applicable, or false otherwise. Â If no script is provided, the default is to return true (applicable). |
On Error | |
Continue | If checked, any failure will be ignored, and the pipeline execution will continue. |
Notify Pipeline Roles | Selects one or more roles from the pipeline definition to notify in case of error. Default role members are defined on the pipeline, and optionally overridden for each release. Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release). When using a role script you can dynamically return a key/value pair. For example |
Tests are defined to execute based on the test automation configured on the project. Â Only those projects which are part of the release will have their tests executed, and assuming they are in any group(s) which are specified on the step.Â
@Since 7.0.0.2 - If multiple packages from the same project are part of the release, one test request will be submitted for each package. If duplicate test cases exist between the packages, then they will only be executed once.
Script Variables
- style