Automated Test Execution

Owned by Nick
Last updated: Apr 01, 2024
2 min read

AssertThat - BDD & Cucumber for Jira displays the execution test status against each User Story (or any Jira issue type) for manual and automated tests.  The manual test status for the scenario can be updated on the user story itself. 

Automated Test Execution

AssertThat provides a number of options for integrating with Test Automation Frameworks. The typical workflow would be

  1. Scenarios developed in AssertThat

  2. Scenarios downloaded using APIs or Integrations into the Test Automation framework

  3. Tests executed and results imported back into AssertThat

Following the import of the Test Automation results back into AssertThat the execution status for the scenarios will be updated for all Jira linked issues. Note it is possible to update specific and independent linked scenarios on import - see Manual Test Execution | Independent automated scenario execution status

image-20240229-115449.png
Test Execution status is updated in AssertThat for Automated test scenarios

For Scenario Outlines where multiple examples can be executed under the same scenario, multiple executions will be displayed for each example under Execution History. The Test Status also reflects the execution count for each example.

image-20240229-120432.png
Scenario Outline test automation counts for each Example

Independent automated scenario execution status

Automated tests linked to the story will have the status updated following Integration with Test Automation Frameworks.

By default scenario status will be updated across all linked user stories

A JQL filter can be supplied as a parameter with upload report as part of the Integrations or API call, so that only scenarios linked to filtered issues will be updated. The below example of the API is given below and this feature is also available in all the Automation Integrations.

More documentation on API usage can be found inAssertThat Rest API's and Test Automation Integration

Automated Results filtering

Test Automation will be loaded by default even if the scenario isn’t matched in the AssertThat Plugin. To filter and only load results for matched BDD Scenarios enable the Automated results filtering toggle in AssertThat configuration project settings.