Integrating with TestRail did not update test results

Integrations
, ,
21

@anon46315158
Hi,
I am again with the new question however with the same Test Rail update results.
This is with test rail integration code and disabled test rail plugin.

When i use a test suite with less number of test cases (approx 10), TestRail updated results correctly for the existing test run.
Now i have added 80 test cases to the same test suite and after running successfully it had not updated the Test Rail results for the existing test run.
Not sure what’s wrong ?
Below is Event log:

19:33:10.270 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Workspace/Add Workspace'
19:33:10.270 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.270 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Workspace.xlsx' and sheet name 'addWS'
19:33:10.286 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Portfolios/Add Portfolio'
19:33:10.286 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.286 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Portfolios.xlsx' and sheet name 'addPortfolio'
19:33:10.286 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Portfolios/ShowHistory'
19:33:10.286 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.286 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Portfolios.xlsx' and sheet name 'showHistory'
19:33:10.301 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Storyboard/AddStoryboad'
19:33:10.304 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.304 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Storyboard.xlsx' and sheet name 'addSB'
19:33:10.304 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Finance Code/Add Finance Code'
19:33:10.304 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.317 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Finance Code.xlsx' and sheet name 'Add FC'
19:33:10.317 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Cashflow Profiles/AddCashflowProfile'
19:33:10.333 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.333 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Cashflow Profiles.xlsx' and sheet name 'Add CF'
19:33:10.337 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Cashflow Profiles/Show History'
19:33:10.337 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.337 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Cashflow Profiles.xlsx' and sheet name 'ShowHistory'
19:33:10.337 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Portfolios/Add Portfolio Folder'
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Portfolios.xlsx' and sheet name 'addPortfolioFolder'
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Portfolios/SeachPortfolio'
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Portfolios.xlsx' and sheet name 'SearchPortfolio'
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Finance Code/Search Finance Code'
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Finance Code.xlsx' and sheet name 'SearchFC'
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Finding test data with id 'Data Files/Finance Code/AddFCFolder'
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Test data is excel file, reading excel file
19:33:10.349 [Worker-26: Launching the test suite...] DEBUG com.kms.katalon.core.testdata.TestDataFactory - Reading excel file with source file 'C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\DataFilesFolder\Finance Code.xlsx' and sheet name 'AddFolder'
chromedriver is located at default location: C:\Katalon\Katalon_Studio_Windows_64-8.6.5\Katalon_Studio_Windows_64-8.6.5\configuration\resources\drivers\chromedriver_win32\chromedriver.exe. In case your browser is updated to a newer version, please use this command to update chromdriver: --config -webui.autoUpdateDrivers=true
Launcher status after execution process completed: Running
Start writing execution.uuid file to folder: C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\Reports\20230720_193310\TestWebUI\20230720_193312
Start generating JUnit report folder at: C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\Reports\20230720_193310\TestWebUI\20230720_193312...
JUnit report were generated at folder: C:\Katalon Studio\Jacobi_KatalonWebUIRegressionTests\Reports\20230720_193310\TestWebUI\20230720_193312
For real-time monitoring and better reporting capabilities please integrate this project with Katalon TestOps (more details at https://docs.katalon.com/katalon-analytics/docs/integration-with-katalon-studio.html#enable-integration)
For real-time monitoring and better reporting capabilities please integrate this project with Katalon TestOps (more details at https://docs.katalon.com/katalon-analytics/docs/integration-with-katalon-studio.html#enable-integration)
22

The event log is useless, since you are not using the plugin.
Check what is happening in the console tab, when the test suite listener is reached and the testcase for publishing results is triggered (provided all other testcases finished)
You may either have some errors or something crashed, so the publish api calls were not executed.

Could be, again, one/some testrail cases id(s) is /are missing… or something else.

1 Like
24

Here is where you have to look carefully:

        "postData" : {
          "mimeType" : "application/json",
          "text" : "{\"results\": [{\"case_id\":143,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2945,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2794,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2800,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2814,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2815,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2932,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2849,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2844,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2848,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2819,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2947,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2944,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2928,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2946,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2923,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2924,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2925,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2813,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2811,\"status_id\":5,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2812,\"status_id\":5,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2807,\"status_id\":5,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2808,\"status_id\":5,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2804,\"status_id\":5,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2795,\"status_id\":5,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2946,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2797,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2927,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2803,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2810,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2806,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2805,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2809,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2929,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2936,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2798,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2847,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2799,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2935,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2835,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2922,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2832,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2921,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2836,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2831,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2833,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2834,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2930,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2801,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2796,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2916,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2816,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2846,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2817,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2818,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2820,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2933,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2850,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2830,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2948,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2866,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2870,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2920,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2868,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2940,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2937,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2919,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2869,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2939,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2867,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2941,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2938,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2859,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2851,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2852,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2853,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2854,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":2855,\"status_id\":1,\"comment\":\"Automation test via Katalon\"},{\"case_id\":138,\"status_id\":1,\"comment\":\"Automation test via Katalon\"}]}",

The Json structure seems to be OK, so double check if all testcase Id’s are present for the given run.

1 Like
25

You may like also to edit your post and remove the ‘Authorization’ field, is exposing your credentials.

26

Ok will check, Thanks
Yeah I did not realize credential part.
I am not able to edit my previous post, It got deleted by mistake.
I recovered and now I am not able to edit.
So deleting it again.

27

Thanks for your inputs, yes one more id was missed and now its working.

1 Like