I try to run suitecollection it doesn't run

The test suite runs normally on the katalon engine.

But when I try to run suitecollection it doesn’t run as below and gives an error.

Please check it out.

INFO: Katalon Version: 7.6.0

INFO: Command-line arguments: -runMode=console -projectPath=/Users/kidsnote/Downloads/KidsnoteAutomation/Android/Android.prj -retry=0 -testSuiteCollectionPath=Test Suites/DirecterBasicFuntion -apiKey=******** --config -proxy.auth.option=NO_PROXY -proxy.system.option=NO_PROXY

INFO: User working dir: /Users/kidsnote/Downloads/Katalon_Studio_Engine_MacOS-7.6.0/Katalon Studio Engine.app/Contents/MacOS

INFO: Error log: /private/var/folders/8j/wqyy9zq93m3g4nx_nyqv6ydm0000gn/T/session-51987c2d/.metadata/.log

INFO: Katalon TestOps server URL: [https://analytics.katalon.com](https://analytics.katalon.com/)

INFO: Katalon Store server URL: [https://store.katalon.com](https://store.katalon.com/)

INFO: User home: /Users/kidsnote

INFO: Java vendor: Oracle Corporation

INFO: Java version: 1.8.0_181

INFO: Local OS: Mac OS X 64bit

INFO: CPU load: 0%

INFO: Total memory: 32768 MB

INFO: Free memory: 21463 MB

Start getting machine ID on Mac

Start appending additional signatures

hardwareSerialNumber 

osDependentUsername kidsnote

End appending additional signatures 640b2b48-3415-5f3b-9838-5e5c401361dc__kidsnote

End getting machine ID on Mac fb24a67c7cc3f0aefce95ecf113b3f73

INFO: Machine ID: fb24a67c7cc3f0aefce95ecf113b3f73

Activating...

Start activating offline...

Search for valid offline licenses in folder: /Users/kidsnote/.katalon/license

The number of valid offline licenses: 0

Offline activation failed.

Start activating online...

License quota exceeded.

Delete folder: bin

Delete folder: Libs

Cleaning up workspace

Opening project file: /Users/kidsnote/Downloads/KidsnoteAutomation/Android/Android.prj

Generating global variables...

Parsing custom keywords...

Project 'Android' opened

Start reloading plugins...

Katalon version: 7.6.0

Plugin info URL: https://store.katalon.com/api/products/ks?appVersion=7.6.0&appType=ENGINE&licenseType=ENTERPRISE

Plugin info: {

  "expired": false,

  "productId": 13,

  "name": "TestRail Integration",

  "id": 178499

}

Plugin info: {

  "expired": false,

  "productId": 4,

  "name": "Slack Integration",

  "id": 178429

}

Plugin name: TestRail Integration. Is online: true. Plugin location: /Users/kidsnote/Downloads/Katalon_Studio_Engine_MacOS-7.6.0/Katalon Studio Engine.app/Contents/Eclipse/configuration/plugin/install/178499/1.0.8/katalon-studio-testrail-plugin-1.0.8.jar.

Plugin name: Slack Integration. Is online: true. Plugin location: /Users/kidsnote/Downloads/Katalon_Studio_Engine_MacOS-7.6.0/Katalon Studio Engine.app/Contents/Eclipse/configuration/plugin/install/178429/1.0.7/katalon-studio-slack-plugin-1.0.7.jar.

Plugin "TestRail Integration" has been installed.

Plugin "Slack Integration" has been installed.

Start check license task

com.kms.katalon.execution.exception.ExecutionException: Unable to execute test suite 'Test Suites/DirecterBasic'

at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildLauncher(TestSuiteCollectionConsoleLauncher.java:195)

at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildSubLaunchers(TestSuiteCollectionConsoleLauncher.java:127)

at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.newInstance(TestSuiteCollectionConsoleLauncher.java:78)

at com.kms.katalon.execution.console.entity.TestSuiteCollectionLauncherOptionParser.getConsoleLauncher(TestSuiteCollectionLauncherOptionParser.java:93)

at com.kms.katalon.execution.console.ConsoleExecutor.execute(ConsoleExecutor.java:74)

at com.kms.katalon.execution.console.ConsoleMain.launch(ConsoleMain.java:341)

at com.kms.katalon.console.application.ConsoleApplicationStarter.start(ConsoleApplicationStarter.java:37)

at com.kms.katalon.application.Application.runConsole(Application.java:120)

at com.kms.katalon.application.Application.start(Application.java:84)

at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)

at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)

at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)

at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:388)

at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:243)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:673)

at org.eclipse.equinox.launcher.Main.basicRun(Main.java:610)

at org.eclipse.equinox.launcher.Main.run(Main.java:1519)

All launchers terminated

kidsnote@kidsnoteui-Macmini ~ %

Hi, I have a similar problem.

I run my test in Azure DevOps pipeline with KRE lisence. I can run the tests with Katalon 7.5.5 but cannot run with upper than 7.6. (also latest 7.8.0). I got same error as @liam.by. It just said Unable to execute test suite 'Test Suites/Test sute name'

I can run the tests locally with Katalon studio 7.8.0.

@liam.by Do you get any solution or find the cause?

Is there any solution? I still run my test with 7.5.5 in azure DevOps Pipeline…
Of course, my test can run with 7.9.0 locally. And following code works with 7.5.5 even if it is in azure DevOps Pipeline.

Image: macOS-latest
My code :

  - task: katalonTask@0
    displayName: 'Basic test'
    continueOnError: true
    inputs:
      version: '7.9.0'
      executeArgs: '-noSplash -runMode=console -projectPath="$(System.DefaultWorkingDirectory)/shoboios/shoboios.prj" -testSuiteCollectionPath="Test Suites/Basic test/1.Basic_test_for_Gsuite" -executionProfile="katalon-g" -apiKey="$(katalon-api-key)" --config -webui.autoUpdateDrivers=true'

Another information :

My tests suite collection consists of the following

1. Test 1 / Chrome
2. Test 2 / Chrome
3. Test 3 / iOS

And failed test that shows Unable to execute test suite is Test 3 (iOS).

Hi @rie.ota,

Please share with us the Azure console log

Hi, @duyluong, sorry for the late response,
log is here : console.log (18.9 KB)

@duyluong
One progress was made. By adding -browserType DeviceID, the Katalon task started without error. (The test itself fails, of course, because it includes PC browser tests.)

Just before Katalon task, bash task gets the UDID of the simulator, and Powershell rewrite the device ID of the Test Suite (.ts) to the UDID I got.

  - task: PowerShell@2
    displayName: 'Replace udid in ts' 
    inputs:
      targetType: 'inline' workingDirectory: '$(System)
      workingDirectory: '$(System.DefaultWorkingDirectory)'
      script: |
        echo $(udid)
        $Current = (Convert-Path .)
        Write-Host $Current
        $KatDir = Get-Item Test/
        Write-Host $KatDir
        Set-Location 'Test/Test Suites/Basic test/'
        (Get-Content '1.Basic_test_for_Gsuite.ts') | Foreach-Object {
        $_ -replace 'udid', '$(udid)' }
        Set-Content '1.Basic_test_for_Gsuite.ts'

With 7.5.5, the task is executed with that rewritten test suite, but it may not be working with 7.9.0.

My tests don’t work with 7.5.5 and I would like to know a workaround.
Or is there any other way to use the simulator within Azure DevOps Pipeline other than rewriting the UDID in ts file?

Hi @rie.ota,

In the log we found this log:

2021-03-26T05:16:25.6833680Z com.kms.katalon.execution.exception.ExecutionException: Unable to execute test suite 'Test Suites/Common/allow notification'
2021-03-26T05:16:25.6933660Z 	at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildLauncher(TestSuiteCollectionConsoleLauncher.java:214)
2021-03-26T05:16:25.7036230Z 	at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildSubLaunchers(TestSuiteCollectionConsoleLauncher.java:142)
2021-03-26T05:16:25.7137880Z 	at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.newInstance(TestSuiteCollectionConsoleLauncher.java:84)
2021-03-26T05:16:25.7252350Z 	at com.kms.katalon.execution.console.entity.TestSuiteCollectionLauncherOptionParser.getConsoleLauncher(TestSuiteCollectionLauncherOptionParser.java:94)
2021-03-26T05:16:25.7354980Z 	at com.kms.katalon.execution.console.ConsoleExecutor.execute(ConsoleExecutor.java:74)

that means KRE could not run the test suite: Test Suites/Common/allow notification. You can remove this suite in the test suite collection and add it again then try run again.
You can also share the Test Suite folder with us (in private chat).

@duyluong I found that above my comment was wrong. Now, adding -browserType DeviceID works.

I guess that in 7.6 and above, for some reason, the test suite collection does not work unless we explicitly specify the device ID in the command syntax?

My test suite collection I mentioned above works with DeviceID, but another test suite collection still does not work with 7.6+. (it does not include mobile test) How can share test suite collection? (copy the ts file contents and send private massage?)

Hi @rie.ota,

Parameter -deviceId is only available for test suite execution. For test suite collection, we currently don’t support overriding deviceId for all test suites in the selected collection. So, please remove the param then run the test suite collection again.

In case, the test suite collection still doesn’t run. Please zip the folder of Test Suites then send to me in private chat.

Thanks

Parameter -deviceId is only available for test suite execution.

yeah, I know, but for some reason, my test suits collection’s situation is as following

7.6+

  • with deviceID : works!
  • without deviceID : do not works…

7.5.5

  • without deviceID : works!

That is exactly my question. I will zip up the test suite and send it to you. Best regards.

good morning. It does not work for me since when I want to run it it tells me that the license is not activated, but when I enter the account it appears activated

Hey @duyluong
I have the same issue. I have tried Katalon docker images 7.6.0,7.6.1,7.7.0,7.8.0, latest and I get the same error

com.kms.katalon.execution.exception.ExecutionException: Unable to execute test suite ‘Test Suites/User Interface/Login’
at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildLauncher(TestSuiteCollectionConsoleLauncher.java:214)
at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.buildSubLaunchers(TestSuiteCollectionConsoleLauncher.java:142)
at com.kms.katalon.execution.launcher.TestSuiteCollectionConsoleLauncher.newInstance(TestSuiteCollectionConsoleLauncher.java:84)
at com.kms.katalon.execution.console.entity.TestSuiteCollectionLauncherOptionParser.getConsoleLauncher(TestSuiteCollectionLauncherOptionParser.java:94)
at com.kms.katalon.execution.console.ConsoleExecutor.execute(ConsoleExecutor.java:74)
at com.kms.katalon.execution.console.ConsoleMain.launch(ConsoleMain.java:352)
at com.kms.katalon.console.application.ConsoleApplicationStarter.start(ConsoleApplicationStarter.java:37)
at com.kms.katalon.application.Application.runConsole(Application.java:125)
at com.kms.katalon.application.Application.start(Application.java:88)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:388)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:243)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:673)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:610)
at org.eclipse.equinox.launcher.Main.run(Main.java:1519)
at org.eclipse.equinox.launcher.Main.main(Main.java:1492)

COuld you please assist with the soluntion. PLease note I want to run collection through CLI.