While running Katalon test cases from the command line, I’m getting random (very random) failures that return exit code 2 which I believe is “execution has erroneous test cases”. The test collection/suite executed has a single test case which runs successfully 99.999% of the time. Stack trace of the failure indicated there is an issue with custom groovy code in the project that has several public utility methods:
Test Cases/Form - Apply Now Application - Online - Happy Path FAILED.
Reason:
org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:
file:/D:/Katalon%20Test/Monitoring/Scripts/Form%20-%20Apply%20Now%20Application%20-%20Online%20-%20Happy%20Path/Script1554324347883.groovy: 16: unable to resolve class global_package.UtilityMethods
@ line 16, column 1.
import global_package.UtilityMethods as GlobalUtilityMethods
^
1 error
at com.kms.katalon.core.main.ScriptEngine.getScript(ScriptEngine.java:199)
at com.kms.katalon.core.main.ScriptEngine.run(ScriptEngine.java:194)
at com.kms.katalon.core.main.ScriptEngine.runScriptAsRawText(ScriptEngine.java:119)
at com.kms.katalon.core.main.TestCaseExecutor.runScript(TestCaseExecutor.java:337)
at com.kms.katalon.core.main.TestCaseExecutor.doExecute(TestCaseExecutor.java:328)
at com.kms.katalon.core.main.TestCaseExecutor.processExecutionPhase(TestCaseExecutor.java:307)
at com.kms.katalon.core.main.TestCaseExecutor.accessMainPhase(TestCaseExecutor.java:299)
at com.kms.katalon.core.main.TestCaseExecutor.execute(TestCaseExecutor.java:233)
at com.kms.katalon.core.main.TestSuiteExecutor.accessTestCaseMainPhase(TestSuiteExecutor.java:133)
at com.kms.katalon.core.main.TestSuiteExecutor.accessTestSuiteMainPhase(TestSuiteExecutor.java:116)
at com.kms.katalon.core.main.TestSuiteExecutor.execute(TestSuiteExecutor.java:83)
at com.kms.katalon.core.main.TestCaseMain.startTestSuite(TestCaseMain.java:157)
at com.kms.katalon.core.main.TestCaseMain$startTestSuite$0.call(Unknown Source)
at TempTestSuite1562848994406.run(TempTestSuite1562848994406.groovy:35)
Running version 6.1.5 build 3 - test case is running against a headless Chrome instance and has been very reliable to date.
Interested to hear if there are suggestions to understand and possibly resolve these very rare errors.
Thank you.