[Recap] Ask Katalon Anything - Week 1 - Feb 26 to Mar 4, 2024

[albert.vu]

[AKA] Katalon Studio Q&A

1. Desktop application automation testing within Katalon Studio Enterprise (KSE) is still lacking. Does Katalon have plans to improve this area of KSE

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #4 by yann.sautreuil - Miscellaneous - Katalon Community

@yann.sautreuil

Hello, we intensively use WebUI and WS features of KSE yet noticed that regarding desktop app automation KSE seems behind the competition: missing WebUI features (no video record, no screenshot, no “rerun from here”) and not handling all desktop app development languages meaning for some desktop app interactions is difficult and object recognition not working well.

Question: is it intended to remain like this, because KSE is actually mostly used for WebUI / WS test automation, or is it intended to catchup competitors in this domain?

Answer

@xuan.tran

Hi @yann.sautreuil,

Thank you for trusting Studio for your day-to-day work, I really appreciate your feedback on WebUI and WS features. We’re still working on enhancements and developing new features every releases.

For the object recognition, we’ve just released 9.3.1 yesterday, introducing Smart Locator, where it can be used in advanced cases that previous locators might not work well. We would love to hear if this new feature can help your testing work easier.

Some other docs I believe could help you:

• Generate screen-based videos in Katalon Studio reports | Katalon Docs
• View captured screenshots in Katalon Studio reports | Katalon Docs
• Debug a test case in Katalon Studio | Katalon Docs

If you have other issues or feature suggestions for video record, screenshot or debugging, please let me know. We would love to hear more from you so that we can improve Studio better.

2. Would it be possible to make a time boundary on test execution (stopping Katalon Runtime Engine test suites run) and then generate the report as "finally" part of execution (by sending it to TestOps)?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #5 by Elly_Tran - Miscellaneous - Katalon Community

@Elly_Tran

Feature request/idea from @wbalien.

Would or is it possible to make a time boundary on test execution (stopping KRE test suites run) and then generate the report as “finally” part of execution (by sending it to TestOps)?

Described here: How to stop KRE execution (TS Collection) but allow to generate report after kill signal/timeout?

Answer

@xuan.tran

Thanks @wbalien for your suggestion.

Currently, reports are only generated when execution is completed, and there will be no reports if the execution is stopped in the middle. We value your suggestion, and we might consider it for future releases.

3. Are there plans for Katalon StudioAssist to use alternative Large Langugage Models (LLM) such as Google Gemini or other (free/no-cost) models instead of ChatGPT?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #6 by Elly_Tran - Miscellaneous - Katalon Community

@Elly_Tran

A question from @Testinator-X :
Are there plans for Katalon StudioAssist to be able to use alternative language models (LLM) such as Google Gemini (formerly known as Bard) or other (free/no-cost) models instead of Chat GPT?

@Testinator-X

With this question, however, I would also like to emphasize the matter of data protection. The issue is not only important for large companies such as Apple, which is said to have issued a general ban on ChatGPT as early as the beginning of 2023, but also for small companies such as ours, which want to ensure that no sensitive information leaves the company.

Here, fore example you can find some LLMs to host yourself: library

Answer

@xuan.tran

Hi @Testinator-X ,
Currently, we use OpenAI models for StudioAssist. As such, we follow OpenAI data policies. These include:

• A 30-day data retention on OpenAI
• No data is used to train the OpenAIs model

For more information on OpenAI’s data policies, refer to: Enterprise privacy. On an account level, we can set the data retention to 0 days if desired.

We do have plans to support Azure OpenAI soon. Their policies on data are more stringent as the data will completely be controlled by Microsoft. Refer to Data, privacy, and security for Azure OpenAI Service - Azure AI services | Microsoft Learn for the data policy for Microsoft.

Other than the above-mentioned, our long-term plan is to support other LLMs (both propriety & open source models).

I hope that this addresses your concern.

4. Is there any plans to incorporate Performance/Load-testing capabilities into Katalon Platform such that someone does not need to use third-party tool to get performance insights about their application whose test cases are primarily housed in Katalon Studio?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #7 by Elly_Tran - Miscellaneous - Katalon Community

@Elly_Tran

A question from @katamba:
When running UI tests in Katalon, I understand that API calls are being made at the same time. So, am wondering if there are plans to incorporate performance/load testing capabilities into the Katalon Platform such that someone doesn’t have to use third-party tools to get performance insights about their application whose test cases are primarily housed in Katalon Studio?

Answer

@xuan.tran

Hi @katamba,

In the case where your test projects are all in Studio and you need to do performance testing, we have the integration with OctoPerf with detailed documentation here: OctoPerf and Katalon: Performance Testing | Katalon Docs
I hope that this will help

5. Which security-related information is Katalon Studio getting from our usage of the product itself?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #9 by grylion54 - Miscellaneous - Katalon Community

@grylion54

I received an email from Katalon that they “knew that I used Keywords” in my test scripts and to talk to Katalon about the new KS product, version 9.0, in which, if you use Keywords, you need to pay for subscription. Note: This is on my home machine in which I don’t do much except respond to forum questions.
However, my question is, what other security information is KS getting from our use of its product? Are my test scripts (or results) being sent to Katalon? Seriously, how vulnerable are we opening up our “corporate” information to Katalon with using your product?

Answer

@xuan.tran

Hi @grylion54,

We do collect some information about your application use for the purpose of analyzing and improving the product better, eg what types of keywords you use, but not more than that, we cannot read your script. You can refer to this document: Privacy Policy for further details of our tracking.

In case you do not want to be tracked, you have the option to disable usage tracking, but pls note that it will require a KSE license. I hope this info can help you.

6. Is it possible to run Katalon Runtime Engine on Apple Silicon (the M1 chip specifically)?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #15 by albert.vu - Miscellaneous - Katalon Community

@albert.vu

We also got a question from @trungnghia.ctn94 about the possibility of running Katalon Runtime Engine (KRE) on Apple Silicon (the M1 chip specifically) and whether the Product team has any plan to support KRE on Apple Silicon in the future.

Hi Katalon, In this doc https://docs.katalon.com/docs/release-notes/katalon-studio/katalon-studio-release-notes-version-9.x [Untitled] I see that KRE does not support for apple Silicon Chip. In my case: I want to use KRE in my M1 mac. Is there any way to do that? When will KRE have a version for Apple Silicon Chip? [Untitled]

Answer

@xuan.tran

Hi @trungnghia.ctn94,

I want to use KRE in my M1 mac. Is there any way to do that?

Yes, you can use KRE on Apple Silicon, KRE for macOS can run well on both Intel and Apple Silicon chips. I hope that this answer could help, if you need further support, please let me know.

Happy testing,
Xuan Tran

7. I am trying to iterate through the list of web elements but kept getting error (expand to see more

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #21 by ishmaleezi - Miscellaneous - Katalon Community

@ishmaleezi

hello, am trying to iterate through the list of web elements as in the webpage screenshot attached but the following errors occur. kindly assist. the id of the table starts with ‘ct100’ also brings errors. please note that the ids of the elements are different each time.

Answer

@grylion54

The error MultipleCompilationErrorsException means you have defined the same variable more than once. Somewhere in your code, you likely copied and pasted the variables, Table, rows_table and Columns_row. What you need to do is remove the definition from in front of the variables. You can leave the definition in front of the very first one in your code, then remove all others. As an example, keep your definition in the first instance:

WebElement Table = driver.findElement(...)

but any other use of the same variable, you just use:

Table = driver.findElement(...)

Same goes for the others listed in your error message.

8. How do I customize the reports generated by Katalon?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #22 by bmiryala - Miscellaneous - Katalon Community

Answer

@philipB

Which report do you want to customize? What information would you like to add? You can customize the email template a bit.

https://docs.katalon.com/docs/katalon-studio/test-reports/share-test-reports-via-email-in-katalon-studio#email-template

9. Does Katalon Studio support multiple languages for testing?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #23 by bmiryala - Miscellaneous - Katalon Community

@bmiryala

Hi,

Does Katalon Studio support multi language? If I use any xpath with english text, does Katalon has any ability to covert to desired language like French without changing any xpath?

Thanks.

Answer

@xuan.tran

Hi @bmiryala,
I found this doc that might help: Test different browser locales in Chrome with Desired Capabilities in Katalon Studio | Katalon Docs

If this solution is not working, please let me know

10. I am facing issues when trying to set up a mobile automation project using Perfecto Cloud

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #25 by syed.shoaib - Miscellaneous - Katalon Community

@syed.shoaib

Hi Team,

I’m trying to setup a mobile automation project using perfecto cloud.
I’m facing difficulties in the initial setup. Do you have any thread I can refer?

I used the plugins provided in Katalon Store but unable to achieve the result.
Can you please help with the steps for setting up a mobile project with perfecto?

Answer

@xuan.tran

Hi @syed.shoaib,
Please make sure that you use the latest plugin version and follow the instructions that we mentioned on this site: Perfecto Integration v2022. If you have any specific error message or screenshot of where you’re stuck, please share it with us so that we can help you further.

11. Can you walk us through on how each module of the Katalon Platform can be integrated with JIRA (no Xray), and more specifically, the activities that can be synced between the two platforms?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #26 by nathaniel1 - Miscellaneous - Katalon Community

@nathaniel1

Can the team walk through how each piece of the Katalon suite of products can be integrated with JIRA(no Xray), specifically the activities that can be synchronized between the two platforms? A high-level outline/diagram or flowchart?

We have Studio and TestOps attempting to bring TrueTest online as well.
CicleCI
Github

Answer

@philipB

Hey Nathaniel,

Here’s a video I recorded against Jira in the pas it also has GitLab integration but you can skip that part.

Note, some of the screens have changed but I believe it’s still applicable.

[Tutorial] Integrating Katalon TestOps With Jira and Gitlab

Let me know if you have any questions.

Philip B
Sr. PM Studio

12. Can we directly upload test cases/suit/folder from Katalon Studio to TestOps?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #27 by himanshupawar.work - Miscellaneous - Katalon Community

Answer

@philipB

The test results you can upload automatically - that setup is here: Set up overview in Katalon Studio | Katalon Docs

As for uploading the test cases for storage, the current method of syncing them would be through Git Integration in Studio and in TestOps.

Philip B
Sr. PM Studio

Let us know if we missed anything.

If you have a question about Katalon Studio, then don’t hesitate to let our Product team know in the thread below

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨