Test Suite - When running single tests they are fast, during suite run they are slow at random steps

**OS **MacOS Sierra 10.12.6

Katalon Studio Version 5.3.0

## Environment (for Web testing)

Browser FireFox, Chrome

## Steps to reproduce -

Run tests 1 by 1 (each test has “open browser”, “test” and “close browser” steps

or

Run tests via test suite (one “open browser”, multiple “tests”, one “close browser”)

## Expected Behavior -

Individual tests run fine, no slow down noticed at all after multiple runs

Running via the test suite, just runs them all one after another, so it should be faster if not the same average speed

## Actual Behavior -

Individual tests run fine, test suite will have random steps within random tests slow down for 20-30 seconds for no apparent reason

## Example

  1. Running test001 individually - average time of 30 seconds (includes startup and close browser steps)

  2. Running test001 as part of a test suite with tests (1) start browser, (2) run the test001 test, then (3) close the browser.

  3. within the test001 test above a normal click step will take 0.2 seconds, then randomly the same click step might take 20-30 seconds while the browser jsut sits there.

  4. If i look at the console, the test says "1 - click (24.582s), while below in the break down of the step, it says “Found 1 web element with id X in 3 seconds” so I do not know where the extra 20+ seconds comes from or why it is waiting

  5. If i run the test again, it will work fine, or perhaps another step in the test (eg: navigate to url) might take 20-30 seconds longer than it should due to a random slowdown like this…

Any help would be appreciated

From Report

From Console

Screen Shot 2018-02-07 at 3.43.30 PM.png

Screen Shot 2018-02-07 at 3.43.57 PM.png

Bump, Can someone from Katalon please have a look over this

Zac,

Thank you so much for the report, we are investigating the issue now.

Trong Bui said:

Zac,

Thank you so much for the report, we are investigating the issue now.

Hi there,
Any update on this issue?
Cheers

Trong Bui said:

Zac,

Thank you so much for the report, we are investigating the issue now.

Hi @Trong Bui, any update on this ticket…

Hi

Any update on this issue?

Zac,

There still appears to be some variability running a Test Case in a Test Suite versus Running a Test Case individually (See attached MS Word File)…

Katalon Studio Windows 64 Bit v5.4.1 - Test Case Execution Speed.docx

I’m still seeing this issue. When running my API tests, the first pack runs very quickly, but then the second one executes incredibly slowly.

Any update on this issue?

1 Like

I’m also seeing this issue.

Any update ?

1 Like

Any update?

1 Like