Automated results filter toggle

Owned by Glib
Last updated: Apr 01, 2024 by Nick
2 min read

The “Automated results filter” can be useful where you have one Test Automation job that runs tests for multiple Jira projects, and you only want results for test scenarios to be imported for each project.

The toggle can be found on the AssertThat Config pages which can be found in Project Settings. If you don’t have access to this page please contact your Jira Admin. The below screenshot shows the Config page for Server/Data Center:

By default (with the toggle set to off) when the test automation results are imported, and a scenario doesn’t exist in a project, the test results will be imported and a label will be added next to the stating “SCENARIO MISSING” .

With the toggle enabled, scenarios will only be loaded to a project where the AssertThat scenario exists in the project.

Troubleshooting:

Toggle enabled and my scenario exists in AssertThat however the results haven’t been loaded for one of my scenarios?

Make sure that the scenario title and feature title match exactly what is in the Cucumber.json file and the scenario is loaded into AssertThat.

Make sure that scenario mode is set to ‘automated’.

Toggle disabled and “SCENARIO MISSING” label added but my scenarios exist in AssertThat?

Make sure that the scenario title and feature title match exactly what is in the Cucumber.json file and the scenario is loaded into AssertThat.

I’m on Server / DataCenter and I can’t see the toggle?

Check with your Jira Admin that you are on AssertThat version 1.11.5 or later.

For DataCenter, check with your Jira Admin that you are on AssertThat version 1.11.5 or later.