I ran the Test Suites/healthcare-tests - TS_RegressionTestCollection which includes 2 times of invokation of a single Test Suite named healthcare-tests - TS_RegressionTest; one with Chrome, another with Firefox.
The bridge produced allure-report/healthcare-tests - TS_RegressionTestCollection_20260812_183045.html
I confirmed that I got the v1.0.2 of the bridge.
I re-applied the bridge over the healthcare-test project.
I ran the Test Suites/healthcare-tests - TS_RegressionTestCollection and got the report generated:
The report contains “1 item total — healthcare-tests - TS_RegressionTest”. I disagree with this.
As I commented above, I think the entry point of the “Collection report” should contain 2 links to the individual reports of “healthcare-tests - TS_RegressionTest” execution record; one with Chrone, another with Firefox — as Katalon’s UI does for its built-in reports.
Hi @kazurayam : firstly thx a bunch for raising these issues, all results below are from CI machines : Windows and MacOS as local Katalon IDE testing was not delivering the results and a waste of time. So here are the ADO CI machine results
I checked the v1.0.3.
I worked on macOS, Katalon Studio IDE v11.0.3.
I made the Sample WebUI project (Healthcare sample), “Test Suites/Test Suites/healthcare-tests - TS_RegressionTestSuiteCollection”.
But I personally disagree with this behavior. It breaks and erases the concept of “Test Suite Collection” as a sequence of individual execution of "Test Suite"s.
By the way, “Test Suite Collection” is an original term invented by Katalon. JUnit4, JUnit5, TestNG and other established testing frameworks do not employ the concept of “Test Suite Collection”. I think that the reporting frameworks (Extent, Allure) are designed adaptive to the classical JUnit. So I think that it is understantable that Katalon’s “Test Suite Collection” aren’t well fitting to the reporting frameworks.
In fact, I personally rarely use “Test Suite Collection”. If I were to run my tests using Katalon Runtime Engine for CI/CD, I would certainly refrain from “Test Suite Collection”. I would rather control the sequence of “Test Suite executions” using shell scripts or CI/CD’s pipeline, which resides out of Katalon project.
If you (Katalon users) are not using “Test Suite Collection”, my point above wouldn’t matter. The issue I raised above about “Test Suite Collection” isn’t a big issue.
Now, I would like to finalize this series of discussion in this topic. Thank you very much, Monty_Bagati, for responding to my posts very promptly. Great work!
@depapp now you can just copy paste the GitHub yml and include your katalon project. Nothing else needed (only GitHub). also ADO and gitlab examples yaml can be copied as is in your CI env.
