Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

To configure the test to be run for a project click on the Test Automation tab.

Test Automation Strategy

Test automation strategy defines test types that can be performed for a project at each environment and instance where the project is deployed. Usually QA engineers set up different instances of the application for performing different test types. For example, one instance is good enough for functional testing, providing a lot of available functionality, but it may not be suitable for performance testing. There is a separate instance with huge amount of data for performing testing To set up a new combination of the test type, environment and instance click the plus button  and select values from the drop down lists. To delete a combination click the minus button .

...


At the Workflow step of the wizard select a workflow which is going to be used to run tests. Note, that only a workflow of Test Definition type can be selected here. Enter values for any inputs that are configured for the workflow.

Tip

You will need to select appropriate workflow for test executions. There are many workflows available out of box for supported test tools, but you can define your own test tool and workflow as well. Depending on workflow you select, you may have few inputs to configure.

  • Inputs are provided as Groovy expression where you can use various property keys. Here you can use all the available properties (plugin or workflow).
  • Note that endpoint execution related (various directory like FD_TEMP_DIR, FD_ARTIFACTS_DIR) variables can not be used here.
  • If property is defined for current deploy instance (not test instance) then you do not have to qualify it.
    • For example, "-P EndPoint="+FLEXDEPLOY_SERVER_HOSTNAME +":" + FLEXDEPLOY_SERVER_PORT + " -P Database=" + FDJDBC_URL
    • In this example, FLEXDEPLOY_SERVER_HOSTNAME, FLEXDEPLOY_SERVER_PORT, FDJDBC_URL are defined on current deployment instance and hence we did not have to use Instance code prefix. But if you used TOMCAT_FDJDBC_URL it will work as well.
  • If you are trying to use encrypted property like password then it may not be available here. In such situations, you can replacement variables in your test files or command line arguments. Whenever you use replacement variables on command line variables, those must be qualified using deploy instance code.
    • For example in case of SoapUI, you can pass arguments like this to use password property (where TOMCAT is instance code). "-P EndPoint="+FLEXDEPLOY_SERVER_HOSTNAME +":" + FLEXDEPLOY_SERVER_PORT + " -P Database=" + FDJDBC_URL + " -p\$TOMCAT_FD_JDBC_PASSWORD"
    • In this example, we are passing Unix environment variable syntax (assuming running on Unix) for password and we need to qualify using instance code in such cases.

Click the Next button in order to configure the Streams for the test definition.

...

The test definition view screen also contains Statistics tab representing historical information about test definition executions.


There are two charts on the Statistics tab: Test Results and Response Time. The charts represent the same data that is described in the Dashboard section, only related to the Test Definition.

...

Click the Next button in order to configure Qualifiers for the test set. Adding and removing test set qualifiers for the test set is performed in the same way as it is done for the test definitions.

For Test Sets FlexDeploy provides the following preconfigured qualifiers:

...

The test set view screen contains Statistics tab representing historical information about test set executions. The tab contains Test Results and Response Time charts representing the same information that is described in Dashboard section, only related to this test set.