[Cucumber] When tags parameter is specified from the Insert List popup in the UI, Run Feature File with Tags completes as Passed but 0 test scenarios and 0 tests are executed

Please let us know what you are using Katalon Studio for? 1

  1. I’m exploring the tool
  2. I’m building a Proof of Concept
  3. I have currently applied Katalon Studio in my project
  4. I’m learning automated test with Katalon Studio

How would your work be affected if this issue has not been resolved? 2

  1. It doesn’t affect much, but I believe Katalon team should have this ticket resolved
  2. I can continue my job, resolving this ticket can boost my performance
  3. I can continue my job, but my performance is lower than expected
  4. I cannot continue my job and have to work on something else while awaiting your response

Operating System

Windows 10

Katalon Studio Version

8.2.5 (Trial)

Katalon Studio logs

Screenshots / Videos

Script view:

CucumberKW.runFeatureFileWithTags('include/features/HSMTests.feature', ((['@AKS']) as String))

Log viewer:

Console Log:

2022-04-08 07:21:06.953 INFO  c.k.katalon.core.main.TestCaseExecutor   - --------------------
2022-04-08 07:21:06.959 INFO  c.k.katalon.core.main.TestCaseExecutor   - START Test Cases/Get HSM Connection Status - AKS Cucumber Tests
2022-04-08 07:21:07.854 DEBUG M Connection Status - AKS Cucumber Tests - 1: runFeatureFileWithTags("include/features/HSMTests.feature", ["@AKS"])
2022-04-08 07:21:07.950 INFO  c.k.k.c.c.k.CucumberBuiltinKeywords      - Starting run keyword runFeatureFile: 'include/features/HSMTests.feature' and extract report to folder: 'C:\Users\sp185338\AppData\Local\Temp\Katalon\Test Cases\Get HSM Connection Status - AKS Cucumber Tests\20220408_072101/cucumber_report/1649416867931'...

0 Scenarios
0 Steps
0m0.007s

2022-04-08 07:21:09.392 INFO  c.k.katalon.core.main.TestCaseExecutor   - END Test Cases/Get HSM Connection Status - AKS Cucumber Tests

Steps to reproduce:

  1. Create a Cucumber feature file with at least 2 scenario outlines - both of which have Given/When/Then steps to run against a web service and verify the status and response parameters - and one or more rows in its Examples section…
  2. Add a tag to one of the scenario outlines…
  3. Create a test case and add a ‘Run Feature File with Tags’ step from the Manual tab.
  4. Edit the cell of the new row in the Input column and specify values as follows:
    • relativeFilePath: Specify the relative file path to the feature file (for example: include/features/.feature
    • tags: Double click the cell in the Value column and add the tag from Step 1 (include the @ symbol) in the List Input popup.
  5. Click OK in the List Input and Input popups.
  6. Run the test case.
  7. Inspect the Log viewer and Console tabs after the run is complete.

Expected Behavior:

Test run passes and all tests in the tagged scenario in the feature file associated with the test case are executed and pass.

Actual Behavior:

Test run passes - but no scenarios or tests are executed.

Workaround (from [Cucumber] Run Feature File with Tags - #20 by Brandon-Hinds):

Issue is resolved by changing (in Script tab) the format of the tag argument in the call to CucumberKW.runFeatureFileWithTags to the following:
CucumberKW.runFeatureFileWithTags('include/features/HSMTests.feature', '@AKS')

Log Viewer

Console: