...
Test automation strategy defines test types that can be performed for a project at each environment and instance where the project is deployed. Usually QA engineers set up different instances of the application for performing different test types. For example, one instance is good enough for functional testing, providing a lot of available functionality, but it may not be suitable for performance testing. There is a separate instance with huge amount of data for performing testing To set up a new combination of the test type, environment and instance click the "+" button and select values from the drop down lists. To delete a combination click the "-" button.
To save test automation strategy for the project click the Save button. To cancel the changes click the Revert button.
...
At the General step of the wizard enter values for the following fields:
...
Required | Description | |
---|---|---|
Name | Yes | Name for the test set. |
Test Type | Yes | Select Test Type for the test set. The test set contains a bunch of test definitions related to this test type. |
Active | Yes | A flag indicating whether this test set is active. Defaults to "Yes". |
...
A test set can contain its own qualifiers in order to check whether the entire set of test definitions passed or failed. The same rule as for the test definitions works for the test sets as well. If all test qualifiers, defined at the test set, return true, then the test set run is considered successful.
Click the Next button in order to configure Qualifiers for the test set. Adding and removing test set qualifiers for the test set is performed in the same way as it is done for the test definitions.
For Test Sets FlexDeploy provides the following preconfigured qualifiers:
...
Argument | |
---|---|
Number of Test Definitions PASSED greater than "X" | Integer value |
Number of Test Definitions FAILED less than "X" | Integer value |
Percentage of Test Definitions PASSED greater than "X" % | Percentage value |
Percentage of Test Definitions FAILED less than "X" % | Percentage value |
...