Let me clarify a bit. When @YoungNgo mentioned concurrent executions in a Test Suite Collection, he’s talking about Parallel Execution mode in a TSC. At somewhere else I explained already that it is not truly parallel, it is merely switching between multiple threads. This switching results in unstable test results.
When I referred to using 5 KR licenses, I was talking about true parallel execution, as in the execution instance are independent, and will scale as much as the infrastructure allows it to without affecting the stability. This choice would be the most beneficial to those who seek to have parallel executions to speed up the testing process without sacrificing stability, which I think is a lot of people.
The question of this thread has no Test Suite Collection mention in it so I didn’t consider this possibility. Sorry for that.
Probably why when I reached 3 suites, the third never completed - 2 seemed fine but I never did get 3 to work.
I think that’s what I was asking about. Keeping it simple, starting 5 independent runs of KRE (probably batch files but could be anything) each launching their own katalonc.exe launches. One machine, one account, one me, 5 suite/katalonc executions “running together at the same time”.
Please double-confirm: THAT is 5 licenses - correct?
Right. And that’s why the topic intrigued me. I’ve started multiple suite runs inside KSE a few times. I wondered what would happen (technically and license-wise) if I did the same with KRE.
@Russ_Thomas and @ThanhTo Thank you so much for your fast and detailed explanation. I’m fairly new to Katalon, so forgive me if I repeat some of the information you have already explained.
I did intended to achieve this using the test suit collection but @ThanhTo believes there may be stability issues.
Let me detail a bit, My test case enters about 80 different fields into the system to create a client and with all the checks and waits takes around one minute for each row of data. That means if I ran 50 test cases together it would take me 12 hours to get all of the data in.
I hoped to run about 40 or 50 test cases each in its own test suit with a test collection that executes them in parallel. Would having a CPU that can handle the multi threading solve the reliability?
I hope this clarifies why having multiple licences in my case would quickly become very costly because I would need more than 5 or 10.
Sorry for making @Russ_Thomas and @ThanhTo repeat yourselves but could you please confirm that having multiple licences is the only way or could the test suite collection option work for me?
I can’t understand, according to what @Russ_Thomas and @ThanhTo says. I need 5 licenses to be able to run 5 runs of katalonc at the same time, but I have been testing this with a trial license that they give me when registering and all runs run without trouble.