Katalon is slow to execute tests cases on MAC

Is it on Windows or on Mac?

This test took 17 seconds. Do you still think 17 seconds is too slow?

I think a test run in 17 seconds is acceptable.

I think that is Win, looking at the originating post, the Mac is the one with black theming which shows ~ 50s. which is meh.

@a.bluteau

How about cleanly deleting Chrome, and reinstalling it on Mac?

Things may change.

this is 100% accurate… just few days ago I submitted a ticket cuz the tests on my macs are so sluggish. i also have 8GB ram… which isn’t optimal…but shouldn’t really be the reason why.
Katalon takes up half of the RAM… then you can imagine the chrome instances eats up some memory too. However, CPU is barely used. But it’s still no excuse for test executions to be this sluggish.
check your MEMORY and CPU
image

The other half, because Chrome is special also :smiley:

@ashraf.madina see my thoughts on:

and feel free to bring your own opinion.
The war has started!

1 Like

I hate Mac myself… it’s cute and sexy to look at. Makes you look cool like carrying a teacup puppy on your waist as fashion statement. But if you want a system that doesn’t make your day miserable, windows wins.
Unfortunately, I chose to be cool and wanted to get the same machine as rest of our dev guys… so here’s to wearing 4" heels and carrying a puppy at the expense of comfort. :love_you_gesture:

On my M1 MacBook Air with 8GB RAM, Katalon Studio v8.6.8 runs fast enough.

Why not you buy a new scarely fast MacBook?

https://edition.cnn.com/2023/10/24/tech/apple-october-event-2023/index.html

I guess and hope, a new machine might resolve your slowness problem.

1 Like

I recommend using Mac pro with 16 GB of RAM to get the better experience with Katalon Studio. Mac Air ARM is fine but it should have at least 16 GB of RAM.

1 Like

@a.bluteau - the release of Katalon Studio 9.0.0 is available , you can try and see execution time are faster up to 25%

Katalon’s slow test case execution on macOS may be due to various factors, such as system performance, test complexity, or resource allocation. Troubleshooting specific issues is recommended.aalikinfo

1 Like

i don’t think the company is going to switch everyone to a 16gb mac. In a regular chrome browser, everything is normal. no lag, slowness. As soon as the test runs on katalon chrome instances… it is sluggish as hell. It was slow for looong time…but i think as Katalon went thru updates, it has become really sluggish now. It’s not that bad on my windows device…which has more space…but my work device is Mac. I think there’s something more than just memory and cpu issue here… but will see if there’s any difference in v9.0

so, wipe out OSX and install Linux on it. will work like a rocket!
aside of that, i doubt that only Katalon creates the issues on Mac.
As advised try also to install Chrome clean or whatever browser you may use.
and whatever else.
For some users (e.g. @kazurayam) it works just fine. for some not … so at this moment we cannot fully blame mac, nor katalon, nor anything else.
we can only troll!

Katalon Studio v9 introduce mac ARM support so you can try that version. If your computer is slow, please observe Task Monitor to see any process that affects Katalon Studio.

But again, Macbook Air (or even Macbook Pro) with 8gb of RAM only allow you to do basic stuffs

Environment:

  • MacBook Air, Apple M1 Chip, 8GB memory, macOS 12.7

I used the Sample WebUI test project “Healthcare”. I executed the following:

using Katalon Studio.app (v8.6.8)

2023-10-28 09:23:31.976 INFO  c.k.katalon.core.main.TestSuiteExecutor  - START Test Suites/healthcare-tests - TS_RegressionTest
...
2023-10-28 09:24:59.711 INFO  c.k.katalon.core.main.TestSuiteExecutor  - END Test Suites/healthcare-tests - TS_RegressionTest
2023-10-28 09:24:59.711 INFO  c.k.katalon.core.main.TestSuiteExecutor  - ====================

It took 87.707 seconds.

using Katalon Studio Arm64.app (v9.0.0)

2023-10-28 09:51:16.766 INFO  c.k.katalon.core.main.TestSuiteExecutor  - START Test Suites/healthcare-tests - TS_RegressionTest
...
2023-10-28 09:52:00.447 INFO  c.k.katalon.core.main.TestSuiteExecutor  - END Test Suites/healthcare-tests - TS_RegressionTest
2023-10-28 09:52:00.447 INFO  c.k.katalon.core.main.TestSuiteExecutor  - ====================

It took 43.664 seconds.

Discussion

My experiment showed that v8.6.8 took 88 seconds. Katalon Studio Arm64 (v9.0.0) took 43 seconds. This experiment proved that Katalon Studio Arm (v9.0.0) is much faster than v8.6.8 on a mac with M1 chip.

For your interest …

On mac with M1 chip, why a Katalon test suite runs slower on Katalon Studio v8.x than Katalon Studio Arm64 (v9.0.0)?

Katalon Studio v8.6.8 is built as a x86-64-based application software. On mac with Apple silicon chip, v8.6.8 run on top of a emulation layer named Rosseta 2. The Rosseta 2 provides an X86-inteface to the application. The x86-64 to Arm64 instruction translation makes the application run slow. Now Katalon Studio Arm64.app is released, which is compiled native to Apple silicon chip. Katalon Studio Arm64.app runs without Rosseta 2. So it runs much faster than v8.6.8.

1 Like

This was the difference in KSE 8.6 vs KS ARM v9
32 min vs. 10 min for teh same test execution on my MAC with 8gb RAM

KS v8
image

KS v9
image

@ashraf.madina

Do you still hate it?

still do. still faster on windows (among other things) lol. Automation in Safari is horrendous if not obsolete. That’s another reason.

why do that? all Mac users I know are not using safari at all.
So, at least in my opinion, is obsolete.

we don’t since we can’t. it would be nice to have some coverage on safari browser for our app. About 40% of our end-users uses Safari.