Why is my retry failed executions setting in Katalon executing all test cases again?

Product Forums Katalon Studio
1

I just want to know which option to use for below scenario:
Created multiple test cases as a suite, But in test cases folder given tag is applied to multiple scenarios(Like One Test case Folder Test case having one tag name with multiple scenarios (1 Test case equals to multiple scenarios with one tag)) bcz i have around 2000plus scenarios for that individual tag for every scenario is not consider Configured as retry failed executions only in katalon it’s not working
What’s happening is It executing again all (passed and failed ) cases in that test case

3 Likes
2

Hi there, :wave:

Thank you very much for your topic! It may take a little while before Katalon team member or others forum members respond to you.

In the meantime, you can double-check your post to see if you can add any extra information i.e. error logs, HTML codes, screenshots, etc. Check out this posting guide to help us help you better!

Thanks! :sunglasses:
Katalon Community team

3

Could you share more info how you have configured?

4

=================================
in Feature File:

Feature: Sample testing
@Smoke
Scenario: Scenario1 testing
@Smoke
Scenario: Scenario2 testing
@Smoke
Scenario: Scenario3 testing

Feature: Sanity Testing
@Sanity
Scenario: Testing1
@Sanity
Scenario: Testing2

================================
In Test cases Folder:

Created test_Sample1 as Testcase Name in that CucumberKW.runFeatureFolderWithTags(‘Include/features’, “@Smoke”)
Created test_Sample2 as Testcase Name in that CucumberKW.runFeatureFolderWithTags(‘Include/features’, “@Sanity”)

==============================================
In TestSuite Folder:

Added:
test_Sample1
test_Sample2
Clicked on Execution Information
1)selected Retry after executing all
2)selected retry failed executions only given input as 1

In The Above scenario:
In Feature: Sample testing one case failed and other two passed but in retry execution it again executing all 3 cases

5

When I watch test suites run on Test cloud it seems to replay the whole suite multiple times even if no failures. The test reports however shows they only ran each test once

6

Can you share screenshot of this configuration?

7

Can you try only with this option selected?

8

config
config1198×478 16.8 KB

Can’t select that one, bcz it is a sub section attched screenshot, I need to run only failed cases not all in testcase

9

what happens if you select RETRY FAILED EXECUTIONS IMMEDIATELY?