Katalon Docker - Parallel run - Is there any quota when running in parallel?

Hi,

We are trying to run our test collection (with 17 test suites, total of 280 test cases) in parallel. We did the test on Katalon Studio locally with max instances set at 6/8 and looks working. It’s away faster than sequential mode.

After that we decided to test the parallel run on our Jenkins but on Jenkins we observe a weird behavior. The Jenkins job runs normally and at some point the Jenkins terminates the job. We checked the log in Jenkins and there is nothing obvious that could explain that.
We retried few times and each time the job is terminated successfully in Jenkins and the duration is not consistent. It could be after 1hr, 2hr, 14mins…

We do have a Katalon floating license and we use the free tier with 2,000 Monthly Test Results. It was fine for our daily run of 280 test case. But this morning we saw the message in TestOps

I don’t know if there is any limitation due to that? Is there any daily quota?

We also tried to run our test with our local Jenkins and that time we have something in the Jenkins log.
I think it’s the cause that terminate our job on our local Jenkins (maybe not in the other Jenkins). Anyone knows why the testops.katalon.io is unknown?

Wed Sep 21 13:10:59 GMT 2022
com.kms.katalon.integration.analytics.exceptions.AnalyticsApiExeception: java.net.UnknownHostException: testops.katalon.io
	at com.kms.katalon.integration.analytics.exceptions.AnalyticsApiExeception.wrap(AnalyticsApiExeception.java:23)
	at com.kms.katalon.integration.analytics.providers.AnalyticsApiProvider.requestToken(AnalyticsApiProvider.java:153)
	at com.kms.katalon.integration.analytics.report.AnalyticsReportHelper.getKAToken(AnalyticsReportHelper.java:64)
	at com.kms.katalon.integration.analytics.report.AnalyticsReportHelper.isTestopsIntegrationEnabled(AnalyticsReportHelper.java:38)
	at com.kms.katalon.integration.analytics.report.AnalyticsReportIntegration.notifyProccess(AnalyticsReportIntegration.java:227)
	at com.kms.katalon.execution.launcher.BasicLauncher.notifyProccess(BasicLauncher.java:66)
	at com.kms.katalon.execution.launcher.ProcessLauncher.setStatus(ProcessLauncher.java:87)
	at com.kms.katalon.execution.launcher.ProcessLauncher.stop(ProcessLauncher.java:165)
	at com.kms.katalon.execution.launcher.manager.LauncherManager.stopAllLauncher(LauncherManager.java:179)
	at com.kms.katalon.execution.launcher.TestSuiteCollectionLauncher.stop(TestSuiteCollectionLauncher.java:440)
	at com.kms.katalon.execution.launcher.manager.LauncherManager.stopAllLauncher(LauncherManager.java:179)
	at com.kms.katalon.execution.console.ConsoleMain.lambda$2(ConsoleMain.java:525)
	at com.kms.katalon.application.utils.ActivationInfoCollector.lambda$1(ActivationInfoCollector.java:937)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: java.net.UnknownHostException: testops.katalon.io
	at java.net.InetAddress.getAllByName0(InetAddress.java:1287)
	at java.net.InetAddress.getAllByName(InetAddress.java:1199)
	at java.net.InetAddress.getAllByName(InetAddress.java:1127)

Thanks for your advice.
Phung

@phung.nguyen I hope that the issue has passed for you? We don’t have such quotas. Were you enabling automatic KS - TO integration before this? This is likely due to the fact that from Sep 21, we started counting KS test results pushed to TO into the monthly quota.

Sorry I forgot to close that post.
Thanks @anh.chu. We solved our issue.

1 Like