Hello @kazurayam, hello all,
I took my time to answer because this was not at all part of the priorities as I only have one test suite with this problem because it is the only one with more than 50 tests.
To answer your questions, we have well analyzed the VM during its use:
- the processor is never overloaded
- the RAM is not overloaded either
On the test side:
- We tried on Chrome and Firefox → same problem
- We tried headless and headed → same problem
- We open the browser at the beginning of the test and we close it at the end
- We kill the WebDriver process at the end of each test
We are up to date at system/katalon/browser level
Here is the trace of the logs that we have when the bug occurs:
When working :
INFO: Using `new FirefoxOptions()` is preferred to `DesiredCapabilities.firefox()`
2023-02-16 09:06:43.603 INFO c.k.k.c.w.util.WebDriverPropertyUtil - User set preference: ['args', '[window-size=1920,1080]']
2023-02-16 09:06:43.603 INFO c.k.k.core.webui.driver.DriverFactory - Action delay is set to 850 milliseconds
1676538403655 geckodriver INFO Listening on 127.0.0.1:22765
1676538403702 mozrunner::runner INFO Running command: "/usr/lib/firefox/firefox" "--marionette" "-no-remote" "-profile" "/tmp/rust_mozprofileJHab5x"
[GFX1-]: glxtest: libpci missing
[GFX1-]: glxtest: libEGL missing
1676538404495 Marionette INFO Marionette enabled
1676538404499 Marionette INFO Listening on port 39535
Read port: 39535
1676538404629 RemoteAgent WARN TLS certificate errors will be ignored for this session
1676538404629 RemoteAgent INFO Proxy settings initialised: {"proxyType":"direct"}
console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /tmp/rust_mozprofileJHab5x/search.json.mozlz4", (void 0)))
Feb 16, 2023 9:06:45 AM org.openqa.selenium.remote.ProtocolHandshake createSession
INFO: Detected dialect: W3C
2023-02-16 09:06:45.958 INFO c.k.k.core.webui.driver.DriverFactory - sessionId = ae43f1de-6cbe-49de-8213-25e52560de74
2023-02-16 09:06:45.969 INFO c.k.k.core.webui.driver.DriverFactory - browser = Firefox 107.0
2023-02-16 09:06:45.970 INFO c.k.k.core.webui.driver.DriverFactory - platform = Linux
2023-02-16 09:06:45.970 INFO c.k.k.core.webui.driver.DriverFactory - seleniumVersion = 3.141.59
When we got the problem :
INFO: Using `new FirefoxOptions()` is preferred to `DesiredCapabilities.firefox()`
2023-02-16 09:49:41.998 INFO c.k.k.c.w.util.WebDriverPropertyUtil - User set preference: ['args', '[window-size=1920,1080]']
2023-02-16 09:49:41.998 INFO c.k.k.core.webui.driver.DriverFactory - Action delay is set to 850 milliseconds
1676540982170 geckodriver INFO Listening on 127.0.0.1:19967
1676540982587 mozrunner::runner INFO Running command: "/usr/lib/firefox/firefox" "--marionette" "-no-remote" "-profile" "/tmp/rust_mozprofile3zAawU"
[GFX1-]: glxtest: libpci missing
[GFX1-]: glxtest: libEGL missing
1676540984259 Marionette INFO Marionette enabled
1676540984269 Marionette INFO Listening on port 32853
Read port: 32853
1676540984682 RemoteAgent WARN TLS certificate errors will be ignored for this session
1676540984685 RemoteAgent INFO Proxy settings initialised: {"proxyType":"direct"}
console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /tmp/rust_mozprofile3zAawU/search.json.mozlz4", (void 0)))
Feb 16, 2023 9:49:48 AM org.openqa.selenium.remote.ProtocolHandshake createSession
INFO: Detected dialect: W3C
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
2023-02-16 09:51:58.639 INFO c.k.k.core.webui.driver.DriverFactory - sessionId = af9d0cd0-415c-4793-8006-801033d0fe95
2023-02-16 09:51:58.692 INFO c.k.k.core.webui.driver.DriverFactory - browser = Firefox 107.0
2023-02-16 09:51:58.692 INFO c.k.k.core.webui.driver.DriverFactory - platform = Linux
2023-02-16 09:51:58.692 INFO c.k.k.core.webui.driver.DriverFactory - seleniumVersion = 3.141.59
We can see that there is a repetition of
--------------------------------------------------------------------------------
Test Suites/TS/99-ExecutionTotale - Firefox - 20230216_090308........54/143(38%)
--------------------------------------------------------------------------------
for no reason and I have no explanation for this. Did I miss something ?
I am thinking about this concern to fix it now so I will answer quickly if you need more logs or information about our structure.