# Test Suite Passes in Katalon Studio But Has Multiple Errors When Run Using Jenkins **URL:** \ **Category:** Integrations\ **Tags:** jenkins, integrations, katalon-studio\ **Created:** [June 17, 2019, 3:02pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946 "2019-06-17T15:02:37Z")\ **Posts on this page:** 17\ **Page:** 2
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 17, 2019, 4:41pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/22 "2019-06-17T16:41:59Z")
Thank you @Timo_Kuisma. I’ll check this tomorrow. ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 18, 2019, 1:43am UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/23 "2019-06-18T01:43:50Z")
Hi @Timo_Kuisma, Jenkins is not running in the services. I’m thinking maybe this is because of this? > while (WebUI.verifyTextNotPresent(‘May 2019’, false, FailureHandling.OPTIONAL)) { > CustomKeywords.‘myCustomKeywords.DatePicker.clickPreviousMonthButton’() > } Are warnings considered as failed test case in Jenkins? If yes, Is there something I need to do to ignore a test case that fail and just proceed to the next one? ![image](https://europe1.discourse-cdn.com/katalon/original/2X/8/847f143c54f81d82b95615c1bad56d952d94a674.png) ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 18, 2019, 2:27am UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/24 "2019-06-18T02:27:54Z")
Hi @Timo_Kuisma, I tried this: > Test Suite: > Test case 1 - pass > Test case 2 - pass > Test case 3 - pass > Test case 4 - pass > Test case 5 - incomplete (does not continue to execute step when I check on the browser) I moved Test case 5 on top: > Test case 5 - pass > Test case 1 - pass > Test case 2 - pass > Test case 3 - pass > Test case 4 - incomplete (this test case becomes incomplete now) This is the step that fails: > while (WebUI.verifyTextNotPresent(‘May 2019’, false, FailureHandling.OPTIONAL)) { > > ``` > CustomKeywords.'myCustomKeywords.DatePicker.clickPreviousMonthButton'() > > ``` > > } > > WebUI.delay(5) > > CustomKeywords.‘myCustomKeywords.DatePicker.clickDay’(‘23’) ← **this is the step that can’t be executed, same with Test Case 5** ---
**Author:** ![Timo\_Kuisma](https://avatars.discourse-cdn.com/v4/letter/t/8baadc/32.png) [@Timo\_Kuisma](https://forum.katalon.com/u/Timo_Kuisma)\ **Post date:** [June 18, 2019, 2:48pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/25 "2019-06-18T14:48:02Z")
hello, did you find out why datepicker step will fail? ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 19, 2019, 1:36am UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/26 "2019-06-19T01:36:34Z")
Hi @Timo_Kuisma, I did not find it. But, I changed my custom keyword to Katalon Plugin (Calendar Keyword) and I am having this error: ![image](https://europe1.discourse-cdn.com/katalon/original/2X/0/04d8e0aed9d58d50224581a806f58b2dd8fb5757.png) ---
**Author:** ![Timo\_Kuisma](https://avatars.discourse-cdn.com/v4/letter/t/8baadc/32.png) [@Timo\_Kuisma](https://forum.katalon.com/u/Timo_Kuisma)\ **Post date:** [June 19, 2019, 1:31pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/27 "2019-06-19T13:31:02Z")
hi, did you added apiKey too in your katalon.exe command path? ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 19, 2019, 1:56pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/28 "2019-06-19T13:56:26Z")
Yes. Here it is. ![image](https://europe1.discourse-cdn.com/katalon/original/2X/b/bd08d23beadbd928479b4bcb8668a80f9ff90c6c.png) ---
**Author:** ![Timo\_Kuisma](https://avatars.discourse-cdn.com/v4/letter/t/8baadc/32.png) [@Timo\_Kuisma](https://forum.katalon.com/u/Timo_Kuisma)\ **Post date:** [June 19, 2019, 2:04pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/29 "2019-06-19T14:04:18Z")
hello, still class not found exception? ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 19, 2019, 2:09pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/30 "2019-06-19T14:09:10Z")
Class not found is no longer shown. However, is it just okay to get this message? Jun 19, 2019 1:07:44 PM org.openqa.selenium.remote.DesiredCapabilities chrome INFO: Using `new ChromeOptions()` is preferred to `DesiredCapabilities.chrome()` Starting ChromeDriver 74.0.3729.6 (255758eccf3d244491b8a1317aa76e1ce10d57e9-refs/branch-heads/3729@{#29}) on port 21340 Only local connections are allowed. Please protect ports used by ChromeDriver and related test frameworks to prevent access by malicious code. [1560920867.173][WARNING]: This version of ChromeDriver has not been tested with Chrome version 75. Jun 19, 2019 1:07:48 PM org.openqa.selenium.remote.ProtocolHandshake createSession INFO: Detected dialect: OSS Jun 19, 2019 1:08:16 PM org.openqa.selenium.remote.DesiredCapabilities chrome INFO: Using `new ChromeOptions()` is preferred to `DesiredCapabilities.chrome()` Starting ChromeDriver 74.0.3729.6 (255758eccf3d244491b8a1317aa76e1ce10d57e9-refs/branch-heads/3729@{#29}) on port 3673 Only local connections are allowed. Please protect ports used by ChromeDriver and related test frameworks to prevent access by malicious code. [1560920898.011][WARNING]: This version of ChromeDriver has not been tested with Chrome version 75. Jun 19, 2019 1:08:19 PM org.openqa.selenium.remote.ProtocolHandshake createSession INFO: Detected dialect: OSS Jun 19, 2019 1:08:51 PM org.openqa.selenium.remote.DesiredCapabilities chrome INFO: Using `new ChromeOptions()` is preferred to `DesiredCapabilities.chrome()` Starting ChromeDriver 74.0.3729.6 (255758eccf3d244491b8a1317aa76e1ce10d57e9-refs/branch-heads/3729@{#29}) on port 40396 Only local connections are allowed. Please protect ports used by ChromeDriver and related test frameworks to prevent access by malicious code. [1560920932.696][WARNING]: This version of ChromeDriver has not been tested with Chrome version 75. Jun 19, 2019 1:08:54 PM org.openqa.selenium.remote.ProtocolHandshake createSession INFO: Detected dialect: OSS Finished: SUCCESS ---
**Author:** ![Timo\_Kuisma](https://avatars.discourse-cdn.com/v4/letter/t/8baadc/32.png) [@Timo\_Kuisma](https://forum.katalon.com/u/Timo_Kuisma)\ **Post date:** [June 19, 2019, 2:11pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/31 "2019-06-19T14:11:30Z")
hi, no worries it’s only warning ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 19, 2019, 2:17pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/32 "2019-06-19T14:17:48Z")
Ok. So I guess I’m ok on this issue. Let me just ask, why does test case status (from passed to failed, or vice versa) changed when I change its order in the Test Suite? I just don’t get it. ---
**Author:** ![Timo\_Kuisma](https://avatars.discourse-cdn.com/v4/letter/t/8baadc/32.png) [@Timo\_Kuisma](https://forum.katalon.com/u/Timo_Kuisma)\ **Post date:** [June 19, 2019, 2:26pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/33 "2019-06-19T14:26:52Z")
hi, don’t really know that, you have to debug it more maybe you will find out something 🙂 ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 19, 2019, 2:29pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/34 "2019-06-19T14:29:40Z")
Actually there’s no error log even in Katalon Analytics. This is the only thing I get: ![image](https://europe1.discourse-cdn.com/katalon/original/2X/a/a6116359fdb61e8e96e69cfb7e2450a639691c8c.png) ---
**Author:** ![Timo\_Kuisma](https://avatars.discourse-cdn.com/v4/letter/t/8baadc/32.png) [@Timo\_Kuisma](https://forum.katalon.com/u/Timo_Kuisma)\ **Post date:** [June 19, 2019, 2:32pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/35 "2019-06-19T14:32:04Z")
hi, what about Jenkins junit log? ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 19, 2019, 3:30pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/36 "2019-06-19T15:30:04Z")
Is this correct? ![image](https://europe1.discourse-cdn.com/katalon/original/2X/e/ea54906cda03b8b0ab620ea1ad35c6a0567ffb19.png) ![image](https://europe1.discourse-cdn.com/katalon/original/2X/9/978fbed488c1d965e247258e6f9872f3b53d7ce2.png) ---
**Author:** ![Timo\_Kuisma](https://avatars.discourse-cdn.com/v4/letter/t/8baadc/32.png) [@Timo\_Kuisma](https://forum.katalon.com/u/Timo_Kuisma)\ **Post date:** [June 19, 2019, 5:37pm UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/37 "2019-06-19T17:37:39Z")
build is failed or is it in process? looks correct path, Jenkins will complain is it not correct ---
**Author:** ![agarcia](https://dub1.discourse-cdn.com/katalon/user_avatar/forum.katalon.com/agarcia/32/16104_2.png) [@agarcia](https://forum.katalon.com/u/agarcia)\ **Post date:** [June 20, 2019, 2:15am UTC](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946/38 "2019-06-20T02:15:12Z")
It’s in process in Jenkins (console output is still loading) while in Katalon Analytics and Katalon Studio Reports, all test cases are successful. [Previous page](https://forum.katalon.com/t/test-suite-passes-in-katalon-studio-but-has-multiple-errors-when-run-using-jenkins/27946.md?page=1)