Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Test All step executes all Test Sets the tests defined for the projects in the snapshot (or the release for Utility projects) according to the project's defined strategy.

...

Field

Description

Step Name

The name of the step.

Description

An optional description for the step.

Project

Include Groups

Identifies which group(s) from the release/snapshot to execute tests for.  If no group is specified, all tests (according to strategy) for projects in the release will be executed.  

Exclude

Project

Groups

Skip testing any projects/packages from the snapshot which are tagged in the release with the selected project group(s).  Available project groups are defined by the pipeline.

Test

TypeIdentifies which types of tests

Name

@Since 7.0.0.1 - Identifies which test to execute.  If not specified, all

test types will be executed.  Optionally

tests will be executed. Use comma-separated test names, or supply a regular expression to match one or more test names. If both test name and test tag are specified we will consider an intersection between them.

Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release).

Tags

@Since 7.0.0.1 - Filters for tests to execute with at least one matching tag. If not specified, all tests will be executed. Use comma-separated tags, or supply a regular expression to match one or more tests' tags.

Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release).

Precondition

An optional Groovy script which determines whether the gate or step is applicable during execution. The script has access to variables and methods listed in Pipeline Groovy Variables and Methods. You can find these variables and methods

using Variable Lookup help

while using the Groovy Editor.

The script must return true if the

gate

step is applicable, or false otherwise.  If no script is provided, the default is to return true (applicable).

On Error

Continue

If checked, any failure will be ignored, and the pipeline execution will continue.

Notify Pipeline Roles

Selects one or more roles from the pipeline definition to notify in case of error.  Default role members are defined on the pipeline, and

optional

optionally overridden for each release. Optionally, use a Groovy expression to make this field dynamic based on some contextual value (e.g. a property defined on the pipeline, and specified on the release

.

...

).

When using a role script you can dynamically return a key/value pair. For example return [type: 'groupName', value: 'FD Administrators']. Supported types are roleId, roleName, groupId, and groupName. You can return Map with single key/value pair or list of such single key/value maps.

Info

Tests are defined to execute based on the testing strategy established test automation configured on the project.  Only those projects which are part of the release will have their test sets tests executed, and assuming they are in any group(s) which are specified on the step. 

@Since 7.0.0.2 - If multiple packages from the same project are part of the release, one test request will be submitted for each package. If duplicate test cases exist between the packages, then they will only be executed once.

Script Variables

Include Page
FD70:Pipeline Groovy Variables and MethodsFD70:
Pipeline Groovy Variables and Methods