Does Azure Devops integration work also when executing on CI/CD pipeline (docker) with TRIAL license?

Product Forums Katalon Studio
, ,
1

Hi All,

my problem is as following. I signed up with new account, where my understanding is, that I get a trial license for Katalon Studio Enterprise (KSE) and Katalon Runtime Engine (KRE) for 1 month. I have Katalon Studio installed locally on my computer and we also have Azure Devops project created in our organization, where I have created a Test Plan with the same test case as in my local instance.
In my local instance of Katalon studio, I enabled ADO Integration, connecte with server URL, personal access token, fetched test plan and connected my test case in local Katalon with Test case from test plan in Azure project with Test ID. When I execute a test suite with this test case locally, it passes and I also see a new execution of this test case added in my test plan in Azure DevOp project, so it seems to be working correctly.

But If I try to run this test suite remotely by pipeline in Azure DevOps using docker image and seleniumbox (connected to Azure repository, where my remote katalon project folder is stored), the pipeline is executed successfully, also the test case passes, also a new test run is added to Azure Devops test plan (I guess based on JUnit_Report.xml), but the problem is, that the new execution of test case is not added to associated test case stored in test plan in Azure DevOps.

So if I run it locally from my computer, it’s connected and test execution in ADO is added but if remotely from CI/CD pipeline (docker / selenium box / runtime engine), a new execution is not added.

I tried to add a parameter -adoPlanId=618373, which is ID of my test plan, to the .yml pipeline for creating a docker image, but it doesn’t help.

So my question is, can it be some kind of problem with my trial license? Since my understanding is, for this kind of execution, KSE and KRE license are needed, but I think I have it in my trial for 1 month and it works, when I run it locally from my computer. Or may I have missing some test properties for remote Katalon, which sets the integration with ADO, as I do manually on local machine in Project Settings - Integration ?

Thank You in advance for help!

2

@Katalon_team guys, can you please look on this issue, we need to be sure that we can use it as it mentioned above before we ask our management for money…
thank you

3

Hi @feromoren,

So if I run it locally from my computer, it’s connected and test execution in ADO is added but if remotely from CI/CD pipeline (docker / selenium box / runtime engine), a new execution is not added.

When running with a remote repository, please remember to push this file: settings/external/com.kms.katalon.integration.azure.properties that include Azure DevOps integration to your repository.

So my question is, can it be some kind of problem with my trial license?

This one is not related to your trial license. When your account is in the trial period. You can access full features of Katalon Studio Enterprise and Katalon Runtime Engine.

1 Like
4

Hi @duyluong,

Yes I had this file pushed to the remote repository, sorry I forgot to mention that. But I already figured it out, the problem was, that I didn’t add a “Linux” option to the Test Configuration Mapping in settings of Katalon, that’s why it ran just on my local Windows computer and not linux machine, where our docker runs :slight_smile:

So this problem is solved for me. Thanks for Your support!

1 Like
5

@feromoren
We are glad to hear that. Happy testing.

Do you have any feedback or recommendation for us about Katalon - ADO integration features?

6

Hi @duyluong,

  1. Feedback: We had little bit problem to understand from Katalon pricing page, if we can use this integration feature if we already have Katalon Runtime Engine, but we already know, that also Katalon Enterprise is needed.

  2. Feedback / Question: If the integration is set up, is there any way how to integrate also the test cases created in Katalon to Azure test plan straight also with IDs or something like that ? Because some of our testers have already tons of test cases in their Katalon projects, so do they need to manually type the name of the every test case to Azure test plan, when creating a test case and copy the created Test ID from Azure and put it manually to every test case in Katalon for integration ? That probably will be quite a complication for bigger katalon projects.

Thanks!

7

Looking forward for above Feedback questions too. Since we are having the similar case with Katalon-ADO integration.