Test Suite Passes in Katalon Studio But Has Multiple Errors When Run Using Jenkins

Thank you @Timo_Kuisma. I’ll check this tomorrow.

Hi @Timo_Kuisma,

Jenkins is not running in the services. I’m thinking maybe this is because of this?

while (WebUI.verifyTextNotPresent(‘May 2019’, false, FailureHandling.OPTIONAL)) {
CustomKeywords.‘myCustomKeywords.DatePicker.clickPreviousMonthButton’()
}

Are warnings considered as failed test case in Jenkins?
If yes, Is there something I need to do to ignore a test case that fail and just proceed to the next one?

Hi @Timo_Kuisma,

I tried this:

Test Suite:
Test case 1 - pass
Test case 2 - pass
Test case 3 - pass
Test case 4 - pass
Test case 5 - incomplete (does not continue to execute step when I check on the browser)

I moved Test case 5 on top:

Test case 5 - pass
Test case 1 - pass
Test case 2 - pass
Test case 3 - pass
Test case 4 - incomplete (this test case becomes incomplete now)

This is the step that fails:

while (WebUI.verifyTextNotPresent(‘May 2019’, false, FailureHandling.OPTIONAL)) {

CustomKeywords.'myCustomKeywords.DatePicker.clickPreviousMonthButton'()

}

WebUI.delay(5)

CustomKeywords.‘myCustomKeywords.DatePicker.clickDay’(‘23’) ← this is the step that can’t be executed, same with Test Case 5

hello,

did you find out why datepicker step will fail?

Hi @Timo_Kuisma,

I did not find it. But, I changed my custom keyword to Katalon Plugin (Calendar Keyword) and I am having this error:

hi,

did you added apiKey too in your katalon.exe command path?

Yes. Here it is.

hello,

still class not found exception?

Class not found is no longer shown. However, is it just okay to get this message?

Jun 19, 2019 1:07:44 PM org.openqa.selenium.remote.DesiredCapabilities chrome
INFO: Using new ChromeOptions() is preferred to DesiredCapabilities.chrome()
Starting ChromeDriver 74.0.3729.6 (255758eccf3d244491b8a1317aa76e1ce10d57e9-refs/branch-heads/3729@{#29}) on port 21340
Only local connections are allowed.
Please protect ports used by ChromeDriver and related test frameworks to prevent access by malicious code.
[1560920867.173][WARNING]: This version of ChromeDriver has not been tested with Chrome version 75.
Jun 19, 2019 1:07:48 PM org.openqa.selenium.remote.ProtocolHandshake createSession
INFO: Detected dialect: OSS
Jun 19, 2019 1:08:16 PM org.openqa.selenium.remote.DesiredCapabilities chrome
INFO: Using new ChromeOptions() is preferred to DesiredCapabilities.chrome()
Starting ChromeDriver 74.0.3729.6 (255758eccf3d244491b8a1317aa76e1ce10d57e9-refs/branch-heads/3729@{#29}) on port 3673
Only local connections are allowed.
Please protect ports used by ChromeDriver and related test frameworks to prevent access by malicious code.
[1560920898.011][WARNING]: This version of ChromeDriver has not been tested with Chrome version 75.
Jun 19, 2019 1:08:19 PM org.openqa.selenium.remote.ProtocolHandshake createSession
INFO: Detected dialect: OSS
Jun 19, 2019 1:08:51 PM org.openqa.selenium.remote.DesiredCapabilities chrome
INFO: Using new ChromeOptions() is preferred to DesiredCapabilities.chrome()
Starting ChromeDriver 74.0.3729.6 (255758eccf3d244491b8a1317aa76e1ce10d57e9-refs/branch-heads/3729@{#29}) on port 40396
Only local connections are allowed.
Please protect ports used by ChromeDriver and related test frameworks to prevent access by malicious code.
[1560920932.696][WARNING]: This version of ChromeDriver has not been tested with Chrome version 75.
Jun 19, 2019 1:08:54 PM org.openqa.selenium.remote.ProtocolHandshake createSession
INFO: Detected dialect: OSS
Finished: SUCCESS

hi,

no worries it’s only warning

Ok. So I guess I’m ok on this issue. Let me just ask, why does test case status (from passed to failed, or vice versa) changed when I change its order in the Test Suite? I just don’t get it.

hi,

don’t really know that, you have to debug it more maybe you will find out something :slight_smile:

Actually there’s no error log even in Katalon Analytics. This is the only thing I get:

hi,

what about Jenkins junit log?

Is this correct?

build is failed or is it in process?

looks correct path, Jenkins will complain is it not correct

It’s in process in Jenkins (console output is still loading) while in Katalon Analytics and Katalon Studio Reports, all test cases are successful.