I try to run suitecollection it doesn't run

liam.by · July 23, 2020, 3:08am

The test suite runs normally on the katalon engine.

But when I try to run suitecollection it doesn’t run as below and gives an error.

Please check it out.

INFO: Katalon Version: 7.6.0

INFO: Command-line arguments: -runMode=console -projectPath=/Users/kidsnote/Downloads/KidsnoteAutomation/Android/Android.prj -retry=0 -testSuiteCollectionPath=Test Suites/DirecterBasicFuntion -apiKey=******** --config -proxy.auth.option=NO_PROXY -proxy.system.option=NO_PROXY

INFO: User working dir: /Users/kidsnote/Downloads/Katalon_Studio_Engine_MacOS-7.6.0/Katalon Studio Engine.app/Contents/MacOS

INFO: Error log: /private/var/folders/8j/wqyy9zq93m3g4nx_nyqv6ydm0000gn/T/session-51987c2d/.metadata/.log

INFO: Katalon TestOps server URL: [https://analytics.katalon.com](https://analytics.katalon.com/)

INFO: Katalon Store server URL: [https://store.katalon.com](https://store.katalon.com/)

INFO: User home: /Users/kidsnote

INFO: Java vendor: Oracle Corporation

INFO: Java version: 1.8.0_181

INFO: Local OS: Mac OS X 64bit

INFO: CPU load: 0%

INFO: Total memory: 32768 MB

INFO: Free memory: 21463 MB

Start getting machine ID on Mac

Start appending additional signatures

hardwareSerialNumber 

osDependentUsername kidsnote

End appending additional signatures 640b2b48-3415-5f3b-9838-5e5c401361dc__kidsnote

End getting machine ID on Mac fb24a67c7cc3f0aefce95ecf113b3f73

INFO: Machine ID: fb24a67c7cc3f0aefce95ecf113b3f73

Activating...

Start activating offline...

Search for valid offline licenses in folder: /Users/kidsnote/.katalon/license

The number of valid offline licenses: 0

Offline activation failed.

Start activating online...

License quota exceeded.

Delete folder: bin

Delete folder: Libs

Cleaning up workspace

Opening project file: /Users/kidsnote/Downloads/KidsnoteAutomation/Android/Android.prj

Generating global variables...

Parsing custom keywords...

Project 'Android' opened

Start reloading plugins...

Katalon version: 7.6.0

Plugin info URL: https://store.katalon.com/api/products/ks?appVersion=7.6.0&appType=ENGINE&licenseType=ENTERPRISE

Plugin info: {

  "expired": false,

  "productId": 13,

  "name": "TestRail Integration",

  "id": 178499

}

Plugin info: {

  "expired": false,

  "productId": 4,

  "name": "Slack Integration",

  "id": 178429

}

Plugin name: TestRail Integration. Is online: true. Plugin location: /Users/kidsnote/Downloads/Katalon_Studio_Engine_MacOS-7.6.0/Katalon Studio Engine.app/Contents/Eclipse/configuration/plugin/install/178499/1.0.8/katalon-studio-testrail-plugin-1.0.8.jar.

Plugin name: Slack Integration. Is online: true. Plugin location: /Users/kidsnote/Downloads/Katalon_Studio_Engine_MacOS-7.6.0/Katalon Studio Engine.app/Contents/Eclipse/configuration/plugin/install/178429/1.0.7/katalon-studio-slack-plugin-1.0.7.jar.

Plugin "TestRail Integration" has been installed.

Plugin "Slack Integration" has been installed.

Start check license task

com.kms.katalon.execution.exception.ExecutionException: Unable to execute test suite 'Test Suites/DirecterBasic'

at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildLauncher(TestSuiteCollectionConsoleLauncher.java:195)

at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildSubLaunchers(TestSuiteCollectionConsoleLauncher.java:127)

at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.newInstance(TestSuiteCollectionConsoleLauncher.java:78)

at com.kms.katalon.execution.console.entity.TestSuiteCollectionLauncherOptionParser.getConsoleLauncher(TestSuiteCollectionLauncherOptionParser.java:93)

at com.kms.katalon.execution.console.ConsoleExecutor.execute(ConsoleExecutor.java:74)

at com.kms.katalon.execution.console.ConsoleMain.launch(ConsoleMain.java:341)

at com.kms.katalon.console.application.ConsoleApplicationStarter.start(ConsoleApplicationStarter.java:37)

at com.kms.katalon.application.Application.runConsole(Application.java:120)

at com.kms.katalon.application.Application.start(Application.java:84)

at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)

at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)

at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)

at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:388)

at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:243)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:673)

at org.eclipse.equinox.launcher.Main.basicRun(Main.java:610)

at org.eclipse.equinox.launcher.Main.run(Main.java:1519)

All launchers terminated

kidsnote@kidsnoteui-Macmini ~ %

rie.ota · December 7, 2020, 12:36am

Hi, I have a similar problem.

I run my test in Azure DevOps pipeline with KRE lisence. I can run the tests with Katalon 7.5.5 but cannot run with upper than 7.6. (also latest 7.8.0). I got same error as @liam.by. It just said Unable to execute test suite 'Test Suites/Test sute name'

I can run the tests locally with Katalon studio 7.8.0.

@liam.by Do you get any solution or find the cause?

ThanhTo · December 7, 2020, 3:57am

rie.ota · March 24, 2021, 5:01am

Is there any solution? I still run my test with 7.5.5 in azure DevOps Pipeline…
Of course, my test can run with 7.9.0 locally. And following code works with 7.5.5 even if it is in azure DevOps Pipeline.

Image: macOS-latest
My code :

  - task: katalonTask@0
    displayName: 'Basic test'
    continueOnError: true
    inputs:
      version: '7.9.0'
      executeArgs: '-noSplash -runMode=console -projectPath="$(System.DefaultWorkingDirectory)/shoboios/shoboios.prj" -testSuiteCollectionPath="Test Suites/Basic test/1.Basic_test_for_Gsuite" -executionProfile="katalon-g" -apiKey="$(katalon-api-key)" --config -webui.autoUpdateDrivers=true'

rie.ota · March 24, 2021, 5:19am

Another information :

My tests suite collection consists of the following

1. Test 1 / Chrome
2. Test 2 / Chrome
3. Test 3 / iOS

And failed test that shows Unable to execute test suite is Test 3 (iOS).

duyluong · March 26, 2021, 4:43am

Hi @rie.ota,

Please share with us the Azure console log

rie.ota · March 30, 2021, 7:21am

Hi, @duyluong, sorry for the late response,
log is here : console.log (18.9 KB)

rie.ota · April 1, 2021, 5:25am

@duyluong
One progress was made. By adding -browserType DeviceID, the Katalon task started without error. (The test itself fails, of course, because it includes PC browser tests.)

Just before Katalon task, bash task gets the UDID of the simulator, and Powershell rewrite the device ID of the Test Suite (.ts) to the UDID I got.

  - task: PowerShell@2
    displayName: 'Replace udid in ts' 
    inputs:
      targetType: 'inline' workingDirectory: '$(System)
      workingDirectory: '$(System.DefaultWorkingDirectory)'
      script: |
        echo $(udid)
        $Current = (Convert-Path .)
        Write-Host $Current
        $KatDir = Get-Item Test/
        Write-Host $KatDir
        Set-Location 'Test/Test Suites/Basic test/'
        (Get-Content '1.Basic_test_for_Gsuite.ts') | Foreach-Object {
        $_ -replace 'udid', '$(udid)' }
        Set-Content '1.Basic_test_for_Gsuite.ts'

With 7.5.5, the task is executed with that rewritten test suite, but it may not be working with 7.9.0.

My tests don’t work with 7.5.5 and I would like to know a workaround.
Or is there any other way to use the simulator within Azure DevOps Pipeline other than rewriting the UDID in ts file?

duyluong · April 1, 2021, 8:33am

Hi @rie.ota,

In the log we found this log:

2021-03-26T05:16:25.6833680Z com.kms.katalon.execution.exception.ExecutionException: Unable to execute test suite 'Test Suites/Common/allow notification'
2021-03-26T05:16:25.6933660Z 	at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildLauncher(TestSuiteCollectionConsoleLauncher.java:214)
2021-03-26T05:16:25.7036230Z 	at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildSubLaunchers(TestSuiteCollectionConsoleLauncher.java:142)
2021-03-26T05:16:25.7137880Z 	at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.newInstance(TestSuiteCollectionConsoleLauncher.java:84)
2021-03-26T05:16:25.7252350Z 	at com.kms.katalon.execution.console.entity.TestSuiteCollectionLauncherOptionParser.getConsoleLauncher(TestSuiteCollectionLauncherOptionParser.java:94)
2021-03-26T05:16:25.7354980Z 	at com.kms.katalon.execution.console.ConsoleExecutor.execute(ConsoleExecutor.java:74)

that means KRE could not run the test suite: Test Suites/Common/allow notification. You can remove this suite in the test suite collection and add it again then try run again.
You can also share the Test Suite folder with us (in private chat).

rie.ota · April 2, 2021, 2:24am

@duyluong I found that above my comment was wrong. Now, adding -browserType DeviceID works.

I guess that in 7.6 and above, for some reason, the test suite collection does not work unless we explicitly specify the device ID in the command syntax?

rie.ota · April 22, 2021, 2:11am

My test suite collection I mentioned above works with DeviceID, but another test suite collection still does not work with 7.6+. (it does not include mobile test) How can share test suite collection? (copy the ts file contents and send private massage?)

duyluong · April 23, 2021, 6:44am

Hi @rie.ota,

Parameter -deviceId is only available for test suite execution. For test suite collection, we currently don’t support overriding deviceId for all test suites in the selected collection. So, please remove the param then run the test suite collection again.

In case, the test suite collection still doesn’t run. Please zip the folder of Test Suites then send to me in private chat.

Thanks

rie.ota · April 23, 2021, 7:22am

Parameter -deviceId is only available for test suite execution.

yeah, I know, but for some reason, my test suits collection’s situation is as following

7.6+

with deviceID : works!
without deviceID : do not works…

7.5.5

without deviceID : works!

That is exactly my question. I will zip up the test suite and send it to you. Best regards.

Testing_Memory · April 23, 2021, 3:58pm

good morning. It does not work for me since when I want to run it it tells me that the license is not activated, but when I enter the account it appears activated

rajeshri.zade · May 4, 2021, 3:42am

Hey @duyluong
I have the same issue. I have tried Katalon docker images 7.6.0,7.6.1,7.7.0,7.8.0, latest and I get the same error

com.kms.katalon.execution.exception.ExecutionException: Unable to execute test suite ‘Test Suites/User Interface/Login’
at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildLauncher(TestSuiteCollectionConsoleLauncher.java:214)
at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildSubLaunchers(TestSuiteCollectionConsoleLauncher.java:142)
at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.newInstance(TestSuiteCollectionConsoleLauncher.java:84)
at com.kms.katalon.execution.console.entity.TestSuiteCollectionLauncherOptionParser.getConsoleLauncher(TestSuiteCollectionLauncherOptionParser.java:94)
at com.kms.katalon.execution.console.ConsoleExecutor.execute(ConsoleExecutor.java:74)
at com.kms.katalon.execution.console.ConsoleMain.launch(ConsoleMain.java:352)
at com.kms.katalon.console.application.ConsoleApplicationStarter.start(ConsoleApplicationStarter.java:37)
at com.kms.katalon.application.Application.runConsole(Application.java:125)
at com.kms.katalon.application.Application.start(Application.java:88)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:388)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:243)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:673)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:610)
at org.eclipse.equinox.launcher.Main.run(Main.java:1519)
at org.eclipse.equinox.launcher.Main.main(Main.java:1492)

COuld you please assist with the soluntion. PLease note I want to run collection through CLI.

catherine.larchevequ · April 6, 2022, 12:01am

Hi. I have this exact same error and tried implementing your proposed solution with no luck. Do you have any other insights that could lead me in the right direction to getting past this error? The collection runs successfully in Katalon Studio 8.2.5, but not in Jenkins via the Katalon Runtime Engine (Floating)

Error Message:

Smoke Test Collection:

Smoke Test (Suite):

rie.ota · September 12, 2023, 1:30am

@duyluong
I am really struggling with this issue. I have been fooling around with the problem by running an older Katalon runtime version (7.5.5) with the test suite collections for a long time.
Now, due to a problem with ChromeDriver, I have to upgrade Katalon version (KRE) to the latest version or the test itself will not work. However, I run into this problem when I upgrade to a newer version. The comments seem to indicate that several people are having trouble.

rie.ota · September 12, 2023, 3:00am

@rajeshri.zade @catherine.larchevequ
Sorry for the direct mention, but if you have a solution or workaround for this issue, please let me know.

atul.rai · September 12, 2023, 6:58am

Please provide some more details like kre and chrome version etc and log if possible

rie.ota · September 12, 2023, 7:51am

@atul.rai
All of my information is in this thread

I think the most important information is here: