Hi Katalon Team,
We are in process to setup &/or evaluate automation using Katalon studio v 7.7.2 for our application under testing. The AUT has WEB, API and thin tiers. To start with I created 3 test cases for REST API & 3 test-cases for web-ui and tried to ran these test cases in parallel execution mode. Katalon studio always throwing different errors for above 3 web-ui test cases though I’m using same platform(I.e chrome) for all runs.
I analyzed that Katalon studio throwing different errors for every run.
Per Katalon documentation &/or forum responses I tried below options:
Reduced thread pool size to 2 threads still Katalon studio throwing errors for 3 web-ui tests.
I tried to increase global project page load time - 30 seconds & actions time - 30 seconds underneath project ->settings->execution - web-ui setting but no luck.
I tried to increase heap size and tweak garbage collection algorithm but still web-ui test cases steps failing for different reasons.
Then I added is web-ui element visible method to detect web component visibility and based on visibility traversing subsequent logic. However those web-ui test cases failing for different reasons.
Per one Katalon studio forum thread - This is just my guess based on the symptoms, but it’s probably a consequence of multi-threading. When you use “Parallel Execution” mode in a Test Suite Collection, underneath Katalon will create many execution threads, and every now and then it switches to a different thread and continue that execution.
A side-effect is that during these switches, the browsers are in and out of focus, which may cause the web page (specifically the elements) to react unexpectedly. For example, an element may not be interactable if it’s not focused, and this may be the case when the entire browser is not focused.
Does this means parallel execution modes is not working at all ?
Please advice is there is any problem in my approach for running parallel mode & suggest how to rectify errors occurred while executing web-ui tests in parallel execution mode.