We ran a Test Suite Collection that contains nine (9) suites, but only got three report folders with the following names:
20181226_132644
20181226_132645
20181226_132646
I am suspecting that, since the folder names are unique only to the second (not millisecond), that the report folders are being overwritten by the next one until the second changes. Just a guess.
I am suspecting that, since the folder names are unique only to the second (not millisecond), that the report folders are being overwritten by the next one until the second changes. Just a guess.
Can you confirm this based on the information in each report (i.e. do you expect each report to contain results for a different subset of Test Cases)?
We expect each report folder to contain the HTML report (and JUnit XML, images, etc.) for one suite. Since the collection has 9 suites, we expect 9 report folders. Instead we get three report folders whose folder names differ by exactly one second: 44, 45, and 46. There are no reports for 6 of the nine suites. Each of the three folders contains a report for one suite, say, the third, sixth, and ninth suite.
Thank you. This is not super critical to us now, as we have separate jobs that run each suite. However, over time, after our Katalon project becomes more mature, we will rely mainly on the collection of suites to perform our regression tests. And we’d like to be able to see all of the reports for all the suites.
Hi,
We have exactly the same issue by using a test suite collection.
We have by pass the issue by sync the content of the “Reports” folder but the “reportFolder” option is not working with test suite collection and many test inside it.
Would be nice if there was a roll-up index.html report file at the same level that had links to the reports showing the suite names. As it stands, the tester has to open each folder and open each report file to find a failure. JUnit reports the failures, but there is no easy way to get to the specific report.
We are hand-jamming a powershell script to make the roll-up index.html.