”This update addresses Smart Wait timeout issues, improves recorder handling for custom date pickers, enhances license management, and resolves several execution-related defects to deliver a smoother, more reliable testing experience.”
some of our scenarios that used to take 3m 24s now take 7m 30s - when watching scenarios, we can see that test execution is now much slower, because every UI interaction is delayed for much longer due to smart wait.
Hello, my test case passes in both cases, but like I mentioned, it now takes more than 2x as long to execute, on contrary, full regression test suite (80 tests) now failed in github action pipeline because it starved server out of resources, wheres with previous Katalon 10.2.4 everything was fine.
We just updated to Katalon 10.3.1 and noticed a big slowdown.
Some of our scenarios that previously took 3m 24s are now taking 7m 30s.
From observation, it seems that every UI interaction is delayed much longer due to Smart Wait. While the release notes mention fixes and improvements for Smart Wait, the actual execution feels slower and is impacting test runtime.
Question: Is this slowdown an intended behavior change in Smart Wait, or could it be a regression/bug introduced in 10.3.1? Is there a workaround or configuration to reduce the delay until it’s fixed (e.g., disabling Smart Wait or tuning its timeout values)?
yes, I did. I set Default wait for element timeout (in seconds) to 30s or even 15s, but it didn’t help.
Each command or every iteration with driver just takes 1s or 2s longer than usual.
Here is a very simple fast test - 2 runs - with and then without the new SmartWait
You can see the Elapsed time and also duration of each step.
(the logviewer shows duplicated commands/steps - but this is already reported in another topic)
May I ask you a question? You wrote that your test runs ok without SmartWait, right? Then you don’t need it. Why do you bother yourself wondering why the new SmartWait makes your test to run slower than before? You can just disable SmartWait, can’t you?
In my humble opinion, the SmartWait is like a cold medicine. When you really need it, it’s better to take the right amount of pills. However, when you are healthy every day, you should stop taking cold medicine as it may influence you to feel sick. I think Katalon should warn uers that SW is a medicine that could be harmful. I am afraid they haven’t and wouldn’t.
Haha, thank you for your reply. That’s a good point
Well, it’s not that simple to turn SmartWait off completely. We’ve been using it in our team for a few years. We’ve created so many projects and much more complicated test cases than what I showed you. If we turn this off most of our complicated test cases (especially with Jenkins and Katalon Runtime) aren’t stable anymore. It crashes on different things. W’e’ve always relied on SmartWait and it’s worked like this until now
My tests also slowed down significantly. Since katalon 10.3.x our total test run duration increased from 4 hours to 6 hours. It’s bothering. I have smart wait disabled though. My default page load timeout is 2 seconds, with continue after timeout. Delay between actions 33 miliseconds and default wait for element timeout is 2 seconds.
You wrote in the original post that you got a problem due to smart wait change in v10.3.1. Now I doubt it.
What is the basis for your reasoning? There could be other reasons, though unknown yet, couldn’t be?
If you could help us, please try running your test using Katalon Studio 10.3.0. Does it take 3m 24s, or 7m 30s? If v10.3.0 takes 3m 24s, then we can infer that the changes in v10.3.1 must be the reason of your difficulty. If v10.3.0 takes 7m 30s, then we can infer that the changes in v10.3.1 must NOT be the reason of your difficulty.
If you could help us, please try running your test using the older versions — 10.2.4, 10.2.3, 10.2.1, 10.2.0, 10.1.1, 10.1.0, 10.0.1, 10.0.0, 9.7.6, … if you could do this experiments, you would be able to firmly identify which version of KS got slower. Then we would be able to study the exact version for the reason of slowness in depth.
Question: Is this slowdown an intended behavior change in Smart Wait, or could it be a regression/bug introduced in 10.3.1?
Reference: Katalon Release Notes 10.x
