Unable to run test suites using katalonc

Product Forums Katalon Studio
1

Hi - I have 2 questions.

I am evaluating katalon for my project and I have created a user account with 1 month trial. I downloaded the katalon studio and ran some test suites from the UI, now trying to understand how it can be called from the ADO pipeline.

I have the following questions.

  1. Trying to understand how can I use katalonc to run the test suites from the commandline.

Everytime I run, the katalonc command always opens up the katalon studio. What I expect is it runs on headless mode and run the test suites from the terminal. Not sure why it opens the studio.

Command I gave (retracted - removed api key)
katalonc -noSplash -runMode=console -projectPath=“web-service-tests.prj” -retry=0 -testSuitePath=“Test Suites/web-service-tests - All Test Cases” -browserType=“Web Service” -executionProfile=“default” -apiKey=“” --config -proxy.auth.option=NO_PROXY -proxy.system.option=NO_PROXY -proxy.system.applyToDesiredCapabilities=true -webui.autoUpdateDrivers=true

Also tried with the below command.
katalonc -noSplash -runMode=console -projectPath=“C:\Users\dnallazhagappan\azureworkspace\vs-crms-tests\TestCRMS\web-service-tests.prj” -retry=0 -testSuitePath=“Test Suites/web-service-tests - All Test Cases” -browserType=“Chrome (headless)” -executionProfile=“default” -apiKey=“” --config -webui.autoUpdateDrivers=true

I tried browserType as Web service, Chrome etc., but still the same error, also giving the correct api-key
2. This question is about the licence. We are planning to have 3 testers who will be using Katalon Studio and the Azure CI/CD pipeline might be running up to 3 test suites in parallel.

Now we need

  • 3 node-lock user licences or 3 floating licences.
  • 3 katalon runtime engine licences

Can you confirm if our understanding is correct.

Please let me know on the above 2 questions mainly on point 1 on why I am not able to run the test suites headless.

1 Like
2

Hi @deiveehan.nallazhaga,

Welcome to our community. Thank you for sharing your issue!

  1. When running Katalon Studio with katalonc from the command line, it should operate in headless mode without opening the Studio UI. Please review potential issues may happen:
  • Verify Path and Syntax: Make sure the paths are specified correctly, and the quotation marks around paths are standard ASCII quotes ("). Sometimes smart quotes (such as “ ”) can interfere with command execution.
  • Browser Type: When running API tests, use "Web Service" as the -browserType to ensure compatibility. For headless web UI tests, you can use "Chrome (headless)" or "Firefox (headless)".
  • API Key: Ensure the API key is valid and associated with your account. A missing or incorrect API key can sometimes cause unexpected behavior.

Here’s an example command to ensure it’s formatted correctly for a Web Service test suite:

katalonc -noSplash -runMode=console -projectPath="path_to_project/web-service-tests.prj" -retry=0 -testSuitePath="Test Suites/web-service-tests - All Test Cases" -browserType="Web Service" -executionProfile="default" -apiKey="your_api_key" --config -proxy.auth.option=NO_PROXY -proxy.system.option=NO_PROXY -proxy.system.applyToDesiredCapabilities=true -webui.autoUpdateDrivers=true

For headless Chrome UI tests, try:

katalonc -noSplash -runMode=console -projectPath="path_to_project/web-service-tests.prj" -retry=0 -testSuitePath="Test Suites/web-service-tests - All Test Cases" -browserType="Chrome (headless)" -executionProfile="default" -apiKey="your_api_key" --config -webui.autoUpdateDrivers=true
1 Like