We have a number of Test Suite collections being kicked off from an Azure Agent using Katalon Runtime, but we are seeing numerous instances of Executions that don’t complete - the status indicator in the TestOps dashboard spins indefinitely in status ‘running’.
I can see from the logs that all the tests are complete, and at the point of uploading the report to Katalon TestOps, this is the point of failure, typically with the following error:
Katalon TestOps: Unexpected response, URL: https://analytics.katalon.com/api/v1/katalon/test-reports/multiple?projectId=45754&batch=1582817377339, Status: 403, Response: <html>
<head><title>403 Forbidden</title></head>
<body bgcolor="white">
<center><h1>403 Forbidden</h1></center>
</body>
</html>
System is unable to send report to Katalon TestOps. Reason: com.kms.katalon.integration.analytics.exceptions.AnalyticsApiExeception: <html>
<head><title>403 Forbidden</title></head>
<body bgcolor="white">
<center><h1>403 Forbidden</h1></center>
</body>
</html>
It’s worth noting that some executions do complete successfully, where the above isn’t seen in the logs, so it’s not like it’s a firewall/proxy issue on our side (as far as we can tell) that results in 100% failure (it’s more like 75% failure I would estimate).
Also, the ‘Mark as Completed’ / ‘Re-import’ options on the dashboard don’t seem to do anything other than remove what little execution information is displayed (i.e. the P, F, E, I columns go to zero, and there are no ‘Results’ information when you click on the execution ID).
Please can Katalon staff investigate this, as it’s currently rendering our dashboard nearly unusable - thanks.