Command line exit code every time = 0

in report I found:

5 test total, 3 passed, 2 failed, 0 error, 0 incomplete
by exit code was  0. I can send extra logs by request
1 Like

What is the exit code you are talking about here? Is it from Jenkins? Please help me to send more details about your case.

Hello, executing cmd via python:

  1. cmd = ‘start /W katalon.exe -noSplash -runMode=console -consoleLog -retry=0 -testSuitePath=“Test Suites/HostManagment” -browserType=“Chrome” -projectPath=“z:\ui_test\ui_test.prj” -summaryReport -reportFolder=“z:\ui_test\test_repo”’
  2. res = os.system(cmd)
  3. print(res)
execute from bat: same result. always 0-OK even if I have failed tests. temporary solution is: parse report.csv

Hi Roman,

Currently our exit code works correctly if you use Katalon Studio as a solution for CI/CD integration. We’ve not tried it with python but using Katalon Studio in python is quite a rare case, so what is your purpose when using Katalon Studio via python?

Regards

Vinh Nguyen said:

Hi Roman,

Currently our exit code works correctly if you use Katalon Studio as a solution for CI/CD integration. We’ve not tried it with python but using Katalon Studio in python is quite a rare case, so what is your purpose when using Katalon Studio via python?

Regards

Hi, why does the exit code differ? If I can’t use the exit code, is there other ways to get build status from console mode?

I’ve found the problem that exit code is always 0 since I updated Katalon to the latest version.

I’m seeing the same thing when running Katalon Studio Test Suite from Jenkins. I have 1 passed test case and 1 failed and Katalon exits with 0 everytime and thinks “Success!”. I also have the most recent version of Katalon Studio and Jenkins

Vinh Nguyen said:

Hi Roman,

Currently our exit code works correctly if you use Katalon Studio as a solution for CI/CD integration. We’ve not tried it with python but using Katalon Studio in python is quite a rare case, so what is your purpose when using Katalon Studio via python?

Regards

I disagree. I’ve followed the jenkins integration instructions and everything is working correctly except the exit code. Would be great to be able to get this working.

Try using “cmd /c katalon -noSplash -runMode=console…” as START actually starts a subprocess and 0 is something like “I successfully started the subprocess”. See also https://ss64.com/nt/start.html

1 Like