I am using 6.3.2 build 4. There is one test in the suite. When I execute the suite & the test fails. I get the following in the junit report:
<?xml version="1.0" encoding="UTF-8" standalone="true"?>
Test Execution Log
TEST SUITE: BayCareConsumerEnroll2020[Expand All](javascript:expandAllChildren(‘s1’))
Full Name: |
BayCareConsumerEnroll2020 |
Start / End / Elapsed: |
2019-08-26 14:29:56.892 / 2019-08-26 14:31:52.050 / 00:01:55.158 |
Status: |
1 test total, 0 passed, 1 failed, 0 error, 0 incomplete |
If the test passes then the results are correct & all files match.
Thanks
Mark
It looks like my details were lost. Here is the junit report details:
testsuites errors=“0” failures=“1” tests=“0” time=“115” name=“BayCareConsumerEnroll2020”
testsuite id=“Test Suites/BayCareConsumerEnroll2020” errors=“0” failures=“1” tests=“0” time=“115” name=“BayCareConsumerEnroll2020” hostname="mdetering - " timestamp=“2019-08-26 14:29:56”>
html report:
TEST SUITE: BayCareConsumerEnroll2020[Expand All](javascript:expandAllChildren(‘s1’))
Full Name: |
BayCareConsumerEnroll2020 |
Start / End / Elapsed: |
2019-08-26 14:29:56.892 / 2019-08-26 14:31:52.050 / 00:01:55.158 |
Status: |
1 test total, 0 passed, 1 failed, 0 error, 0 incomplete |
This is the results when run locally. I am running these tests from Bamboo in a docker container and uploading the results to Jira. It displays as a testless build with 1 failure on Bamboo.
This bug makes Katalon Studio not a viable CI/CD implementation. When executed by Bamboo, the only time it provides value is when the test passes. If the test fails, it is reported as a testless build.