I have a test suite that contains 90 test case. from the 1st to 51 test case, there is no problem to open browser, it takes less than 4 secends.
from the 52nd test case, it takes more than 2 minutes to open browser
that’s mean i lose more than 76 minutes ( (90 - 52) * 2 = 75) for every execution of this test suite.
I’m using Katalon Version: 8.3.0 with docker
is there a solution for this problem?
Please try to reduce the problem surface.
Did you try making the 51st TC the first TC? What happens then?
What happens when you run the suite inside Katalon Studio?
What happens when you run the suite against a different browser?
The first part of getting help is to try to mitigate the issue yourself.
I have one that contains 215. Therefore, this is not a Katalon issue until you can prove categorically that it is.
We are facing the same problem when running our test collection in Docker.
We changed the order of our test suite in the collection and the first test case goes faster. But after a certain number of case, the next one takes longer and longer. So it’s not related with the test case or test suite. Looks like there is a resource problem somewhere, it creates a bottle neck somehow.
You may try incresing Heap memory
How about trying to allocate more memory to Katalon Studio provided that you have enough physical memory.
I checked my katalon.ini now. I found I have
Approximately 2GB. This is the default size set by the distributed zip of Katalon Studio.
My Mac has 4GB physical memory. Therefore I should specify -Xmx less than 4000m.
Faly, how much of physical memory do you have? Provided that your PC has 4GB, you may try extending -Xmx such as:
I suppose that Katalon Stud…
for example, try
-Xmx4096m and see
“Step execution log” may slow down you tests significantly.
Have a look at the following report and check if it applies to you.
I have published a demo project at GitHub.
Problem to solve
Katalon Studio’s “Log Viewer” slows down your test execution significantly. Are you aware of this fact?
Maybe not. So I will report my analysis here. I can explain how to make it better.
Let me go straight to the point. The following table shows the result I measured how long a Test Suite took to finish running. I used a single Test Suite while I applied several variation of the “Log Viewer” setups.
As the fo…
Are you sure if you close browser window once done? Having a lot of browser windows left opened will significantly affect to test performance.