Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 17 Current »

Workflow Types

Every workflow is designated a Type, with each Type serving a different purpose. To understand Workflow Types appropriately it is important to understand the Build and Deploy process within FlexDeploy. A diagram representing a typical implementation can be seen below.

Workflow Type

Description

Build

The first step in the Build/Deploy model. The Build Workflow most commonly does the following tasks:

  1. Clones the source code defined on the Project

  2. Does some form of compilation on the source code

  3. Publishes or produces the results to FlexDeploy’s Artifact Repository.

Deploy

The Deploy Workflow is most commonly the next workflow run. Its duties consist of reading or consuming Artifacts published during the Build Workflow and uploading or deploying those Artifacts to your Deploy Target.

An example of this could be taking html/css/javascript bundled during build and uploading to Azure to be served.

PreDeploy

Prior to running the aforementioned Deploy Workflow, you can optionally run a PreDeploy Workflow. The PreDeploy Workflow can use the Build Artifacts and running any checks prior to the Deploy Workflow executing. Some examples of this could be:

  • Running the deploy in preview mode

  • Performing some sanitation logic on the Deploy Target to ensure its ready for Deployment

  • Creating a manual task that must be reviewed prior to the Deploy executing

Test Definition

The last Workflow run is a Workflow testing the previous deployment on the Deploy Target. A common example being running some form REST tests, using something like Postman, to validate the Deployment.

Utility

Utility Workflows fall outside of the typical Build and Deploy process outlined above. Utility Workflows don’t consume or produce any artifacts and are most commonly used to run adhoc on demand logic on a Target Server.

A few examples would be:

  • Restarting a server

  • Running a script on a server

  • Performing server cleanup on a fixed schedule

Note that Utility Workflows can only be used by a specific Project Classification called Utility or can be referenced from other Workflows.

Other

Lastly, the black sheep of the family, Other Workflows cannot be used by any Project directly. Their only usage is to have common Workflow logic that can be called from the Workflow types listed before.

Workflow Operations

Assign

The Assign step provides the ability to assign a value to a workflow variable or a property. Property values that are overridden will keep the new value for the rest of the workflow execution.

image-20240318-170449.png

Field

Description

Variable

The variable or property that we are assigning to.

Expression

The expression (groovy) value that should be assigned.

Error Handler

The Error Handler step essentially provides a try/catch mechanism for your Workflow Definition. The Step itself provides two “scopes” in which nested Workflow Steps can be used. The first being the Default scope and the second being the On Error scope.

image-20240318-171745.png

Should an error occur while processing Steps defined in the Default Scope 1️⃣ , the Workflow Engine will immediately move to the On Error Scope 2️⃣ and start running Steps. The Error Handler Step provides a few configuration options outlined below:

image-20240318-173425.png

Field

Description

Propagate Error

Determines what action should occur after executing the Steps defined in the On Error Scope

  • True - The original error that triggered the move to the On Error Scope will be “re-thrown” and any steps defined after your Error Handler will not be executed.

  • False - The original error will suppressed and any steps defined after your Error Handler will being executing as if no error occurred.

Error Variable

Once an error occurs it can be useful to get access to the error object in your On Error Scope. Specifying a variable in this input will assign that error object into that variable so it can be accessed.

Error Variable Scope

Note that both Error Variable and Error Message Variable are scoped to the Error Handler On Error block. Both variables will not be accessible outside of this Scope.

Error Message Variable

Identical to Error Variable except it only contains the text of the error instead of the full object.

If

The If Step is a flow-control operation that allows your Workflow to dictate which Steps should be run depending on conditions.

image-20240318-204431.png

At minimum, the If Step requires an If Condition 1️⃣. One more Else If Conditions can optionally be added 2️⃣ and finally an optional Else block can be added 3️⃣. Every condition gets the full suite of available variables and properties at its disposal. Each condition/block can also run any number of Steps. A full example implementation of the If Step is below:

image-20240318-205117.png
Display Conditions

In the example above there is some redundancy in the conditions that makes it slightly harder to understand than it should be. We can simplify this by clicking the edit icon (blue star) next to the conditions.

image-20240318-205400.png

Here we can edit the condition as well as provide a Display Name to make it a little more user friendly.

image-20240318-205527.png

Invoke Plugin

Invoke Plugin provides the ability to invoke Plugin Operations for any installed Plugin in FlexDeploy. Unlike the rest of the Workflow Operations, Invoke Plugin cannot be dragged directly onto the Canvas. Instead, a list of available Plugins and Plugin Operations are shown below the Workflow Operations.

image-20240320-162419.png

In this separate section in the Palette, you can search for any Plugin or Plugin Operation and drag it onto the canvas which will present the applicable configuration for that Plugin Operation.

image-20240320-163040.png

The configuration for Invoke Plugin can be quite daunting, but we will break it down into manageable pieces.

Plugin Operation

1️⃣ The chosen Plugin and Plugin Operation shown here, are populated by default based on the Plugin Operation that was dragged into the canvas and rarely need to be changed.

Plugin Inputs

2️⃣ Plugin Inputs are 1 of 3 ways a Plugin Operation can receive configuration values from the user. The other 2 are Project Properties and Target Properties. The Plugin Inputs presented depend entirely upon the chosen Plugin and Plugin Operation. More detailed information about specific Plugin Inputs can be found in the respective Plugin Guides.

Plugin Outputs

3️⃣ Plugin Operations can optionally return Plugin Outputs. A Plugin Output is any meaningful piece of data that was calculated during Plugin Execution, for example the JDBC Plugin’s compileInvalid operation returns 4 Outputs:

image-20240320-164944.png

Any Plugin Output can be assigned to a Workflow Variable. Doing so allows the Output to be used elsewhere in the Workflow.

Endpoint Specification

4️⃣ Generally the Endpoint Specification does not need to be touched or modified. However, it can still be good to understand what it is and why it is present.

Whenever a Workflow executes, it executes on a specific Target which is decided when selecting an Environment and Target Group in the Workflow Request form. The cross-section of an Environment and Target Group is called a Target. The decided Target will have 1 or more Endpoints associated with it. These Endpoints are the physical machines/servers where this Plugin Execution will ultimately take place.

Having said all of that - we are ready to take a look at the available configuration:

Field

Description

Target Group Override

As mentioned above the Target Group and Target are decided when the Workflow Request form is submitted, should you wish to use a different Target Group, that can be specified here. This will result in a different set of Endpoints being used for Plugin Execution.

Endpoint Selection

A Target can have multiple Endpoints associated to it. This input allows you to specify which of those Endpoints are considered “candidates” for Plugin Execution.

Available options are:

  • All (default) - All Endpoints associated to the Target will considered for Execution (this does not necessarily mean they will be used).

  • Resource - An Endpoint may have a Resource Type associated to it (think of it like a tag). Selecting this option allows you to select Endpoints with only a specific Resource Type.

Endpoint Execution

Once the list of Endpoint candidates is chosen based on Selection criteria above, we can then decide which of those Endpoints should actually perform Plugin Executions. Available options are:

  • Any (default) - A random Endpoint from the available candidates will be chosen and used for the Plugin Execution

  • All - Every Endpoint in the candidate list will perform a Plugin Execution. Selecting this option presents two more additional options:

    • Max Parallel % - What percentage of the Endpoints should execute in parallel. 100% means all should execute at the same time. 1% means they should execute sequentially (provided there are not more than 100 Endpoints in the candidate list).

    • Stop On Error - Should any individual Plugin Execution fail, halt any subsequent Plugin Executions.

Artifacts Delivery

5️⃣ A Plugin Operation can Produce or Consume Artifacts from FlexDeploy’s Artifact Repository.

Most Plugin Operations will default these values, for example, most “Build” operations will have Produces checked, and vice versa with “Deploy” operations and Consumes. There are, however, a few Plugin Operations that are more build/deploy agnostic, such as the Shell Plugin - Execute in our example. Those Plugin Operations can either Consume, Produce, or do neither. It largely depends on the purpose of the Shell script and in these cases the options must be selected manually.

User Inputs

Some Plugin Operations allow for passing custom User Inputs into the Plugin Execution.

image-20240320-172459.png

Note that specifying a User Input on its own does not accomplish anything, it must be used as part of the Plugin Execution, in our case this means using it in our Shell script.

image-20240320-173052.png

User Outputs

Similar to User Inputs, a Plugin Operation can also allow custom User Outputs. They serve the same function as Plugin Outputs but are just user specific. Lets update our Shell API call example above to return the API response as an example. To start we need to add a new User Output.

image-20240320-173429.png

In the above example, API_RESPONSE is the output that should be returned from our Shell script, and WF_API_RESPONSE is the Workflow Variable that will capture this value and be usable elsewhere throughout the Workflow.

image-20240320-173740.png

Invoke Test

The Invoke Test step provides the ability to invoke a group of tests for the Project executing the Workflow. The Step will take into account any filters present in the Test Automation YAML configuration when determining what tests should be run. Several other configuration inputs can be specified to further refine the tests that should be executed.

image-20240318-210218.png

Field

Description

Test Name

Test Name allows further refinement of the tests considered for execution. Test Name and Test Tag will union the results should both be specified.

Allows multiple entries separated by comma. This input is a Groovy Script so be sure to enclose any literal text in quotes.

Tags

Run specific tests with specific tags in the Test Automation yaml configuration. Test Name and Test Tag will union the results should both be specified.

Allows multiple entries separated by comma. This input is a Groovy Script so be sure to enclose any literal text in quotes.

Test Qualifier

We can configure the Step itself to fail should the test results not meet expectation. The Test Qualifier input determines what those expectations should be.

Depending upon the value chosen, Test Qualifier Value may be presented to be filled in. Set to No Qualifier to pass the Step regardless of the results.

Output Variable

You can optionally assign the result of the Step to an output variable that can be used later in the Workflow.

Invoke Workflow

The Invoke Workflow Step allows the execution of other Workflows from the current Workflow. This allows common Workflow logic to be isolated and reused where needed.

image-20240319-201306.png

Field

Description

Workflow

This is the Workflow that should be called. While the field allows calling ANY other active Workflow, it doesn’t necessarily mean that you should. Generally its good practice to have your common Workflow logic created with the Workflow type Other.

Version Override

By Default, the active version of the invoked Workflow will be used when running this Step. You can however choose a specific version with this input.

Inputs (if any)

If the invoked Workflow has any defined Workflow Inputs, those will show up in this section.

Raise Fault

Raise Fault is a Step that will throw a custom error during Workflow execution. This can be useful if you are doing some upfront validation or if you recognize the Target or Endpoint state is not as it should be.

image-20240319-202637.png

Field

Description

Fault Name

Fault Name should be a shorthand identifier for the particular fault that was thrown. For example CUSTOMERPREFIX_VALIDATION_FAULT

Fault Details

Fault Details is a longer form description or message of the failure.

Run Groovy

The Run Groovy Step provides a blank Groovy script with access to all of the Workflow properties, variables, inputs, and FlexDeploy utility functions. Think of the Run Groovy script as a catch-all that can implement any solution if there is not a specific operation for it.

image-20240319-204154.png

The script is defined by marker 1️⃣. As you are writing your script you may find the need to create additional Workflow Variables that you would like to use outside of this step, in that case, you can quickly add more with the Add new Workflow Variable shortcut 2️⃣ .

In addition to the variables and utilities mentioned above, it also has access to the LOG helper which is a nice way to write custom log messages which will be shown on the Workflow execution.

image-20240319-204421.png

Wait

The Wait Step, you guessed it, waits for a set amount of milliseconds to pass before completing and allowing subsequent steps to continue.

image-20240319-205122.png

Like most Step configuration inputs, the Wait length does allow for using a Groovy Script for more dynamic wait times.

While

The While Step allows repetition of the Steps defined in its “scope” while some condition evaluates to true. The most common example is running the same set of steps n number of times before exiting.

image-20240319-205536.png

In the above example, we have a Workflow Variable called counter with a default value of 1. The loop condition then says we are going to continue executing while the counter is less than 5.

image-20240319-205805.png

In the example above we have the counter < 5 condition 1️⃣ are waiting for 2 seconds and incrementing our counter variable by 1 2️⃣.

Infinite Loops

Be sure that your While loop condition will eventually evaluate to false. Had we not added the assign step which increments our loop counter 2️⃣ , we would keep executing the wait step over and over as the counter variable would always be equal to the default value of 1

  • No labels