I would launch a Katalon test suite using console mode execution on a Windows box within cmd shell. I would like to run a test synchronously and get 0 if tests were successful, 1 if there are some failed tests.
I read Jenkins integration example suggesting to use command mode execution omitting -noExit and -consoleLog and running as a windows batch command.
So I opened a cmd and try to run
katalon -noSplash -runMode=console -projectPath=“D:\Workspace\Katalon\CreateStream\CreateStream.prj” -retry=0 -testSuitePath=“Test Suites/CreateProjectStream” -executionProfile=“test2” -browserType=“Chrome (headless)”
When I run this command it returns immediately with return code 0 while the json report file get written after some 20 seconds. So, return code 0 means that the test launched successfully and call to test suite is asynchronous.
How can I get a synchronous call where exit code is 0 upon success and 1 upon test failure ?
Alternatively, how can I get the same outcome from the json report ? I tried to read it but I really don’t know where to look for the test suite and/or test results.