When I’m running the test cases on the Katalon Test Cloud then those are not running an they simply keep showing ‘Error’.
I tried executing them via -
Test Suite Collection
Individual Test case suites
But they are still not even starting the execution.
Please help in getting this resolved.
I recently migrated to new Katalon Test Ops.
There ere even no logs. I can only see “Setup environment and test project…” in the logs.
Thank you for your question, I have notified our team, help is on the way
Based on your description and the documentation, your issue is **directly related to the TestOps migration**. You’re experiencing test execution failures on TestCloud after migrating to the new Katalon TestOps platform, with tests stuck at “Setup environment and test project…” and showing “Error” status.
## Root Cause
**License Assignment Issue After Migration** - This is a **confirmed known issue** documented in Katalon’s official troubleshooting guide.
When you migrated to the new TestOps platform:
- **Licenses were NOT automatically transferred** from the Account level to the Organization level
- TestCloud requires Organization-level licenses to validate and execute tests
- Without proper license assignment at the Organization level, test execution fails during the environment setup phase
This explains why:
- Tests don’t start execution (license validation fails)
- You only see “Setup environment and test project…” in logs (execution stops at validation)
- No detailed error logs appear (it’s a license validation failure)
## Solution
**Assign Licenses to Your Organization** (Required Step)
Follow these steps to resolve the issue:
1. **Sign in to Katalon TestOps** with your Admin account
2. Navigate to **Admin Settings** > **Organization Settings** > **License Management**
3. Switch to the **KRE tab** and select **Assign Dedicated Licenses**
4. **Select your Organization** from the dropdown
5. **Specify the number of licenses** you need for test execution
6. Click **Assign**
**After completing these steps**, your TestCloud test executions should work normally for both:
- Individual Test Suite executions
- Test Suite Collection executions
### Important Notes:
- **Account Admin access required** - Only Account Administrators can assign licenses
- **Organization must match** - Ensure you’re assigning licenses to the Organization where your TestCloud tests are configured
- **TestCloud subscription required** - You must have an active TestCloud license or trial in addition to the KRE licenses
### Source
[KRE Tests Fail After Migrating to TestOps - Katalon Documentation]( KRE tests fail after migrating to TestOps | Katalon Docs )
-–
**If you’ve already assigned licenses and still experience issues**, please verify:
- The Organization ID in your test configuration matches the Organization where licenses are assigned
- Your TestCloud subscription is active
- Your user account has appropriate permissions in the Organization
Hi @akshay_sartabe this is Eve from the Support Team. Your account doesn’t have the TestCloud license yet so the execution couldn’t start.
If you’re under any other organizations that have the license, please feel free to let us know. We’ll check again.
Hope it helps,
Eve.
I’m pretty sure we have a license.
Here is my Org Id - 1640818
Hi @akshay_sartabe thank you so much for the information, we confirm that this account ID purchased the TestCloud license.
To support you on-time and address the issue completely, we created a support ticket to continue the conversation there. Kindly help us access it via the link and help view our suggestions.
Best regards,
Eve.
I already made sure that the licenses are assigned correctly.
But still having this issue.
Also it ran for another Test Suite Collection which has around 90 Test Cases. But the one with like 220 test cases is failing.
The larger number of test cases the Test Suite Collection contains, the JVM would require larger memory runtime. You may want to set the maximum heap size of JVM larger.
In the <Katalon Studio installation folder>/Contents/Eclipse/katalon.ini file, probably you have the following line:
-Xmx4096m
Change it to, for example,
-Xmx8192m
or even larger
-Xmx2g
@kazurayam These are the settings for the Katalon Studio. I’m facing this issue while executing on the Katalon Test Cloud.
I know nothing about the Test Cloud product. I would quite this topic.
Based on your description and the screenshot showing “Setup environment and test project…” with an Error status, I’ve identified the likely root cause. You recently migrated to the new Katalon TestOps, and this is a known issue related to license management during migration.
Key Observations:
In the new Katalon TestOps, licenses are managed at the Organization level instead of the Account level. During migration, all existing licenses remain at the Account level by default. If your TestCloud execution is using the -orgId parameter (or if your organization is configured to use Organization-level licenses), the system cannot find the required licenses at the Organization level, causing the execution to fail during the environment setup phase.
Follow these steps:
Important Notes:
-orgId, some without), assign licenses to both your Account and OrganizationIf the license reassignment doesn’t resolve the issue:
-orgId parameterHi,
We have found the root cause of this issue is that @akshay_sartabe was executing tests during the downtime of our TestCloud release. Retry and succeed now. Thank you everyone for your support to our fellow.
No not at all.
This not not true.
I ran my test scripts again and they are still stuck at the “Setup environment and test project…“.
I have to break down my main Test Suite Collection, which has more than 200 Test Cases, in smaller chunks, having around 100 test case and only then it would run.
The root cause that you have mentioned is definitely not correct here.
Also I want this to be escalated to get fixed ASAP.
Dear Akshay,
I have notified the team, we are on it
It is a completely separate license from the Studio, so it makes sense to mute the thread if you don’t use it