Hello,
it seems that there is an error with the groovy scripting engine.
**OS **(Windows 10 Pro 1709 16299.248 on VMWare):
Katalon Studio Version (Katalon Studio Version: 5.3.0 Build: 1)
## Katalon Studio logs: empty for time period
## Environment (for Web testing)
I do have a test suite with 4 test cases which I call using the command line interface:
C:\Katalon_Studio_Windows_64-5.3.0\katalon -noSplash -runMode=console -consoleLog -projectPath=“C:\Users\Admin\Katalon Studio\yalst Testing\yalst Testing.prj” -retry=0 -testSuitePath=“Test Suites/yalst - Single” -browserType=“IE”
for Internet Explorer 11 (11.248.16299.0) or
C:\Katalon_Studio_Windows_64-5.3.0\katalon -noSplash -runMode=console -consoleLog -projectPath=“C:\Users\Admin\Katalon Studio\yalst Testing\yalst Testing.prj” -retry=0 -testSuitePath=“Test Suites/yalst - Single” -browserType=“Chrome”
for Chrome (64.0.3282.186), Firefox (59.0b3) or Edge (41.16299.248.0).
But the problem seems to be completely independent of the browser.
Steps to reproduce -
Actually the error is not completely reproducible. In 30% of the test suite runs while importing stuff in the beginning EVERY test case (here 4) in that particular test suites ends with error in the groovy script:
!SESSION 2018-02-28 14:17:19.866 -----------------------------------------------
eclipse.buildId=unknown
java.version=1.8.0_102
java.vendor=Oracle Corporation
BootLoader constants: OS=win32, ARCH=x86_64, WS=win32, NL=en_US
Framework arguments: -runMode=console -projectPath=C:\Users\Admin\Katalon Studio\yalst Testing\yalst Testing.prj -retry=0 -testSuitePath=Test Suites/yalst - Single -browserType=Edge
Command-line arguments: -os win32 -ws win32 -arch x86_64 -data config -runMode=console -consoleLog -projectPath=C:\Users\Admin\Katalon Studio\yalst Testing\yalst Testing.prj -retry=0 -testSuitePath=Test Suites/yalst - Single -browserType=Edge
!ENTRY org.eclipse.core.resources 2 10035 2018-02-28 14:17:26.663
!MESSAGE The workspace exited with unsaved changes in the previous session; refreshing workspace to recover changes.
Starting Groovy-Eclipse compiler resolver. Specified compiler level: unspecified
131 2.4.7.xx-201611170128-e46 = ACTIVE
--------------------------------------------------------------------------------
Test Suites/yalst - Single - Edge - 20180228_141736…0/4(0%)
--------------------------------------------------------------------------------
02-28-2018 02:17:39 PM - [RUN_DATA] - Logging run data ‘hostName’ with value ‘Admin - WinXVM’
02-28-2018 02:17:39 PM - [RUN_DATA] - Logging run data ‘os’ with value ‘Windows 10 64bit’
02-28-2018 02:17:39 PM - [RUN_DATA] - Logging run data ‘hostAddress’ with value ‘192.168.7.53’
02-28-2018 02:17:39 PM - [RUN_DATA] - Logging run data ‘katalonVersion’ with value ‘5.3.0.1’
02-28-2018 02:17:42 PM - [ERROR] - Test Cases/yalst Setup FAILED because (of) org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:
file:/C:/Users/Admin/Katalon%20Studio/yalst%20Testing/Scripts/yalst%20Setup/Script1518111430881.groovy: 20: unable to resolve class internal.GlobalVariable
@ line 20, column 1.
import internal.GlobalVariable as GlobalVariable
^
1 error
02-28-2018 02:17:42 PM - [ERROR] - Test Cases/yalst Administration - Start FAILED because (of) org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:
file:/C:/Users/Admin/Katalon%20Studio/yalst%20Testing/Scripts/yalst%20Administration%20-%20Start/Script1518112505143.groovy: 22: unable to resolve class internal.GlobalVariable
@ line 22, column 1.
import internal.GlobalVariable as GlobalVariable
^
1 error
02-28-2018 02:17:43 PM - [ERROR] - Test Cases/yalst Administration - StartUpWizard FAILED because (of) org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:
file:/C:/Users/Admin/Katalon%20Studio/yalst%20Testing/Scripts/yalst%20Administration%20-%20StartUpWizard/Script1519138592389.groovy: 22: unable to resolve class internal.GlobalVariable
@ line 22, column 1.
import internal.GlobalVariable as GlobalVariable
^
1 error
02-28-2018 02:17:44 PM - [ERROR] - Test Cases/yalst Administration - Edit and delete StartUpWizard operator FAILED because (of) org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:
file:/C:/Users/Admin/Katalon%20Studio/yalst%20Testing/Scripts/yalst%20Administration%20-%20Edit%20and%20delete%20StartUpWizard%20operator/Script1519151920936.groovy: 22: unable to resolve class internal.GlobalVariable
@ line 22, column 1.
import internal.GlobalVariable as GlobalVariable
^
1 error
02-28-2018 02:17:39 PM - [START] - Start Test Suite : Test Suites/yalst - Single
02-28-2018 02:17:40 PM - [START] - Start Test Case : Test Cases/yalst Setup
02-28-2018 02:17:40 PM - [INFO] - Evaluating variables for test case
02-28-2018 02:17:40 PM - [INFO] - Variable ‘domain’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:40 PM - [INFO] - Variable ‘ip’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘database’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘databaseUser’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘databasePassword’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘productKey’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘productKeyPart1’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘productKeyPart2’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘productKeyPart3’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘productKeyPart4’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘adminEmail’ is set to xxxxxxxxxxxxxxxxxxx default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘supportEmail’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘companyName’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:41 PM - [INFO] - Variable ‘companyUserName’ is set to xxxxxxxxxxxxxxxxxxx as default
02-28-2018 02:17:42 PM - [END] - End Test Case : Test Cases/yalst Setup
02-28-2018 02:17:42 PM - [START] - Start Test Case : Test Cases/yalst Administration - Start
02-28-2018 02:17:42 PM - [INFO] - Evaluating variables for test case
02-28-2018 02:17:42 PM - [END] - End Test Case : Test Cases/yalst Administration - Start
02-28-2018 02:17:42 PM - [START] - Start Test Case : Test Cases/yalst Administration - StartUpWizard
02-28-2018 02:17:43 PM - [INFO] - Evaluating variables for test case
02-28-2018 02:17:43 PM - [END] - End Test Case : Test Cases/yalst Administration - StartUpWizard
02-28-2018 02:17:43 PM - [START] - Start Test Case : Test Cases/yalst Administration - Edit and delete StartUpWizard operator
02-28-2018 02:17:43 PM - [INFO] - Evaluating variables for test case
02-28-2018 02:17:44 PM - [END] - End Test Case : Test Cases/yalst Administration - Edit and delete StartUpWizard operator
02-28-2018 02:17:44 PM - [END] - End Test Suite : Test Suites/yalst - Single
Sending report to email: [xxxxxxxxxxxxxxxxxxx ]…
I defaced some personal data but in general this is the output of the katalon command line window which I got seconds before the window was closed.
The browser, the test suite and the time when it happens seems to be completely random it just happens in 30% in all browsers, test suites and whenever.
## Expected Behavior -
The test suite will start the browser and continues.
## Actual Behavior -
The test suite stops and sends out an email with 4 errors (for every test case in that test suite) and no browser identifier.