Jenkins job fails but Katalon Report passed


#1

Hello,

I followed the directions for Katalon Integration with Jenkins and the tests are running fine and actually completing and the report shows all tests are passed. But my jenkins job fails with this message. This is the last part of the logs:


Test Suites/UI_Test - Chrome (headless) - 20190515_085146…30/31(97%)

2019-05-15 09:18:21.475 INFO c.k.k.c.webui.common.WebUiCommonHelper - Unable to find the element located by ‘By.xpath: //i[@class=‘fa fa-3x fa-address-card’]’. Please recheck the objects properties to make sure the desired element is located.
2019-05-15 09:18:21.475 WARN k.k.c.w.k.b.WaitForElementVisibleKeyword - Web element with id: ‘Object Repository/TopNavbar/UserMenu/i_TaskUserManager’ located by ‘By.xpath: //i[@class=‘fa fa-3x fa-address-card’]’ not found
2019-05-15 09:18:21.475 DEBUG testcase.NavigateUserMenu - 1: click(findTestObject(“TopNavbar/i_userMenu”))
2019-05-15 09:18:21.554 DEBUG testcase.NavigateUserMenu - 4: verifyElementVisible(findTestObject(“TopNavbar/UserMenu/button_Sign Out”))
2019-05-15 09:18:21.594 DEBUG testcase.NavigateUserMenu - 5: click(findTestObject(“TopNavbar/UserMenu/button_Sign Out”))
2019-05-15 09:18:21.685 DEBUG testcase.NavigateUserMenu - 6: verifyElementVisible(findTestObject(“LoginPage/button_SignIn”))
2019-05-15 09:18:21.727 INFO c.k.katalon.core.main.TestCaseExecutor - END CALL Test Cases/Actions/TopNavbar/SignOut
2019-05-15 09:18:21.727 INFO c.k.katalon.core.main.TestCaseExecutor - --------------------
2019-05-15 09:18:22.296 INFO c.k.katalon.core.main.TestCaseExecutor - END Test Cases/UI Tests/OTMDashboard/VerifyOTMDashboard
2019-05-15 09:18:22.486 INFO c.k.katalon.core.main.TestSuiteExecutor - --------------------
2019-05-15 09:18:22.486 INFO c.k.katalon.core.main.TestSuiteExecutor - END Test Suites/UI_Test
2019-05-15 09:18:22.486 INFO c.k.katalon.core.main.TestSuiteExecutor - ====================
Launcher status after execution process completed: Running
Start writing reports to folder: C:\jenkins-katalon\workspace\OTMD-OrderTrackingManager\OTMD-CI-Katalon\Reports\UI_Test\20190515_085146
Reports were generated at folder: C:\jenkins-katalon\workspace\OTMD-OrderTrackingManager\OTMD-CI-Katalon\Reports\UI_Test\20190515_085146


Test Suites/UI_Test - Chrome (headless) - 20190515_085146…31/31(100%)

The batch file cannot be found.
Build step ‘Execute Windows batch command’ marked build as failure
Recording test results
Finished: FAILURE

You can see here the report shows as all 31 tests passed:


#2

One of your build steps is trying to execute a .bat, but can’t find it. Just as an FYI, there’s a big difference between your tests passing and a Jenkins build being marked as a Success.


#3

Hey Brandon, yup that is correct. I do not have another Batch command waiting. I did add C: to the batch command and now it ran successfully and returned the job successful too