How to get test suite collection logs displayed in console output

Web Testing
, , ,
1

Hello there,

When running a test suite via KRE command line from a jenkins pipeline, and checking console output, we get detailed run logs which is perfect, example:

Will print execution status every 15 second(s)

---------------------------------------------------------------------------------

Test Suites/My test suite - Chrome - 20260210_151655..
.........................................................................0/3(0%)

---------------------------------------------------------------------------------

2026-02-10 15:17:04.162 INFO  c.k.k.c.l.logback.LogbackConfigurator    - Logback default configuration initialized from: /opt/katalonstudio/configuration/org.eclipse.osgi/102/0/.cp/resources/logback/logback-execution.xml

2026-02-10 15:17:04.164 INFO  c.k.k.c.l.logback.LogbackConfigurator    - Logback custom configuration initialized from: /tmp/project/Include/config/log.properties

2026-02-10 15:17:04.521 INFO  c.k.katalon.core.main.TestSuiteExecutor  - START Test Suites/My test suite
etc....
2026-02-10 15:17:09.703 DEBUG testcase.My test case        - 1: enhancedClick(findTestObject("App/input - Email"))

Whereas when running a test suite collection, we don’t have detailed logs any more, and only execution status, example:

Will print execution status every 15 second(s)

---------------------------------------------------------------------------------

My test suite collection.....................................0/6(0%)

---------------------------------------------------------------------------------

My test suite A - Chrome - 20260210_154617..
.........................................................................0/3(0%)
My test suite B - Chrome - 20260210_154618..
.........................................................................0/3(0%)

---------------------------------------------------------------------------------

Test suite My test suite A - Chrome - 20260210_154618 is ready to start at 15:46:30.421173572
Running: My test suite A - Chrome - 20260210_154618

---------------------------------------------------------------------------------

My test suite collection....................................3/6(50%)

---------------------------------------------------------------------------------

My test suite A - Chrome - 20260210_154617..
.......................................................................3/3(100%)
My test suite B - Chrome - 20260210_154618..
.........................................................................0/3(0%)

---------------------------------------------------------------------------------

I tried to add the following arugment to the docker run katalon command line with no effect: -runMode=console -consoleLog -logLevel=DEBUG

→ Is there a way to keep detailed execution logs in addition to execution status for test suite collection?

2 Likes
2

Hi @yann.sautreuil,

KRE doesn’t currently stream the per-test-suite execution log with Test Suite Collection. You’ll mainly see the progress/status lines like you pasted. Your -runMode=console -logLevel=DEBUG won’t change that behavior for TSC runs.

For a Test Suite Collection, you can find detailed log in file execution0.log . More information here: How to get Katalon's console log in Collection of Suite execution? - #5 by kazurayam . Hope this can help

1 Like
3

Test suite collections don’t output detailed execution logs to the console in CI/CD environments like Jenkins, even though individual test suites do. The arguments you tried (-consoleLog,-logLevel=DEBUG) don’t work because:

  1. -consoleLog

    is Windows-only: According to the official KRE documentation, this argument explicitly states: “Display log in the console. Only use this option when running Katalon Studio in Windows Command Prompt. Do not use this option in other OSes or CI tools, for example Jenkins.”

  2. -logLevel=DEBUG

    is not a valid KRE argument: This parameter doesn’t exist in the KRE command-line syntax. The documentation lists all supported arguments, and log level control isn’t available as a command-line parameter for KRE.

  3. Design limitation: Test suite collections have different logging behavior by design—they’re optimized for batch execution and report generation rather than console output streaming.

1 Like
4

it’s time to revamp the documentation on supported/unsupported details based on the katalon version

5

No, by design.

I would rather recommend @yann.sautreuil to stop using Test Scuite Collection. He can achieve the same by Jenkins pipeline. A pipeline can execute a series of Katalon Test Suites as a batch, which will be effectively equivalent to “Test Suite Collection”. @yann.sutreuil will have better control over Jenkins pipeline than over TSC — he can see all messages logged in the console.

In mu humble opinion, “Test Suite Collection” is a feature designed for Katalon Studio GUI. If you have KRE license, then you do not need Test Suite Collection" at all. You can make a TSC-equivalent batch of Test Suites by many other format; by a simple shell script, Jenkins Pipeline, GitHub Workflow and so on.