Hi,
I have question about collection behavior.
We are using Katalon Docker with collection of test suites. Recently after we changed our new VM we notice that the duration of test case takes more time when running within a collection.
We did few measurement with a test_suite_3 that contains 29 test cases, running it in a collection that contains only test_suite_3n, it takes ~1h40m
Then we split the test_suite_3 into 2 parts:
- part1: test case 1 to 19
- part2: test case 20 to 29
Then we rerun the 2 parts independently within a collection:
- within collection with only part1: it takes ~26min
- within collection with only part2: it takes ~12min
- within collection with part1 + part2: it takes ~1h40min
Why do we have ~1 extra hour when putting together the part1 and part2 in a collection? I can’t understand. Looks like more we run test case/test suite in a collection and more it takes longer.
Maybe there are few settings I missed when starting Docker. Below the main parameter we use when running Docker:
-m 4G --memory-swap=4G --shm-size=256m
Do you think it could be related to a memory issue somehow?
Thanks for your help.
Phung