I have tested execution speed in Katalon ver. 6.3.3 and 8.6.0 in the same environment and find that the latest version is a lot slower, in my situation by over 40%. I have also disabled the “Default Smart Wait” functionality in 8.6.0…
What else could affect speed execution the latest version?
BR,
Uroš
There could be many factors.
One of them could be this:
Plus, you should compare the 2 logs taken in v6.3.3 and v8.6.0 to find out which specific test steps got slower. Any significant performance differences should have some reasons. You need to look at each symptoms indivisually in detail. Performance issues could be resolved only by your detail inspections.
@Uros_Kocevar
Can you share with your report on both v6.3.3 and v8.6.0?
And share an example of test case script
I have done a detailed analysis and found out that the main reason for slower execution is step waitForElementNotPresent which is unable to locate an element by XPath. Also, the navigateToUrl step is quite slow…
Is it related to this?
Yes, thanks for the info.
Then you should wait for the v8.6.1 to be released
When the release of v8.6.1 is expected?
Read this:
I have done another test with the 8.6.5 version compared to 6.3.3. Execution time is better, but still slower by cca. 15-20%. As you can see from the screenshot, every step is executed a little bit slower. Is this expected behavior?
I also noticed the time difference, but I have no idea why.
Careful measurement and deep study would be required. I’m not interested in it so much.
If you want to make your tests run faster, then why not you have a look at my previous post:
You should NOT use the “Tree view” of the Log Viewer, which tends to make your tests run far slower.
The log shows “14:54:25-14:55:20”, which makes 55 seconds. This message apparently is telling that your test finished (= when the Log Viewer ceased printing logs) in 55 seconds after you clicked the start button 
. But I would say, that is not true. I believe that it took longer than 55 seconds if you had the Log Viewer “Tree View” was attached and opened.
I would like to ask you to go back to Katalon Studio GUI with the Log Viewer attached with the “Tree view” opened. Please try measuring the actural duration between the start and the end of your test using your wristwatch or stopwatch. I believe that your stopwatch would record longer than 55 seconds; for example, a wild guess, 100 seconds.
The log information does not take it into account how long the delay was caused by the Log Viewer to flush bulky texts into the GUI. Therefore the timestamp in the log will never be precise enough. You should not ignorantly trust the timestamps in the log. You should be aware that the Log Viewer causes invisible delay. You should have careful eyes on it.
Also at play is the evolution of the networks in use.
No single network is static over time. Trying to compare results across time over evolving networks is a practical impossibility.
Trying to compare results on the same day is fraught with difficulties that are very difficult to pin down. Only if there are dramatic differences should you show concern.
#JustSaying
