The KRE running result was difference

Dear KS Community

We ran KRE for 2 similar test suites in 2 different logins, where previously the test suites had run successfully in KSE.
The KRE results we obtained are different; login Maryo has no Passed or Failed status, while login Sylvia has both Passed and Failed statuses.
Why are the KRE results different from each other?
What causes the KRE results to differ?

Attached are the KRE results (images of login Maryo and login Sylvia).
Many thanks

Best Regards
Sylvia Astrida

1 Like

Hello @sylvia.astrida !

I’m afraid I can’t see any attachment.
By the way, are you running both KSE and KRE in headless mode? Sometimes, there can be differences in behavior between headed and headless modes.

Could you re attach the mentioned results?

Bests!

Hi Katalon Community

Yes, we ran the headless one in KSE and ran well, and also the KRE script use a headless one too.

Please find attached the following image of KRE Results

Thanks & Regards
Sylvia

(attachments)


Hmmm, how are you executing the KRE? Are you using any custom timeout, or setting?

Could you provide the KRE batch script?

Have you tried to log in into your TestOps Platform and checked the error logs?

Dear Gaston,

Please find attached the ss of command script configuration and console log belong of myself and maryo scripts

Here are the scripts :

  1. Sylvia
    katalonc -noSplash -runMode=console -projectPath=“E:\DATA1\icndemoproject\icndemoproject.prj” -retry=0 -testSuitePath=“Test Suites/TS04_02AddDocuments” -browserType=“Chrome (headless)” -executionProfile=“default” -apiKey=“fb58d0d5-8847-4de9-a009-350aee7e5e62” -orgID=1273958 -testOpsProjectId=1244158 --config -webui.autoUpdateDrivers=true

  2. Maryo
    katalonc -noSplash -runMode=console -projectPath=“C:\Users\1556\git\icndemoproject\icndemoproject.prj” -retry=0 -testSuitePath=“Test Suites/TS02_02_Add Question” -browserType=“Chrome (headless)” -executionProfile=“default” -apiKey=“8e6f7847-d9e0-41d2-b7b9-fa2e405b2258” -orgID=1273958 --config -proxy.auth.option=NO_PROXY -proxy.system.option=NO_PROXY -proxy.system.applyToDesiredCapabilities=true

Many thanks
Sylvia

(attachments)



maryo_console0.log (12 KB)
sylvia_console0.log (12.6 KB)

Dear Katalon Community

Any update with our case ?

Many thanks & best regards
Sylvia Astrida

hey @sylvia.astrida , i noticed that in the Maryo script, the -testOpsProjectId argument does not exists. Maybe the argument -testOpsProjectId=1244158 is missing?

Dear Gaston

Maryo used the default Project like this

and when he ran the scripts with testOpsProjectID, he’d got the same result like before, here is his script :

katalonc -noSplash -runMode=console -projectPath=“C:\Users\1556\Documents\Katalon\icndemoproject\icndemoproject.prj” -retry=0 -testSuitePath=“Test Suites/TS02_01 Navigate to Master Question” -browserType=“Chrome (headless)” -executionProfile=“default” -apiKey=“8e6f7847-d9e0-41d2-b7b9-fa2e405b2258” -orgID=1273958 -testOpsProjectId=1244158 --config -proxy.auth.option=NO_PROXY -proxy.system.option=NO_PROXY -proxy.system.applyToDesiredCapabilities=true -webui.autoUpdateDrivers=true

and his results as follow

Would you please give us another suggestion ?

Many thanks
Sylvia Astrida

hmmm the only difference that i am seeing (looking back at the first post with the original attachments) is that in Sylvia’s image there is some console lines saying something about TestRails and Jira, but those lines are not present in Mario’s picture. so, I would suggest to double check your KSE pluging and integrations. (May be those lines are the result of some enabled integration you have)

Check your plugins Sylvia or any integration that could be present on you KSE but not in Mario’s.

bests,