[Recap] Ask Katalon Anything - Week 2 - Mar 4 to Mar 12, 2024

[albert.vu]

Hi Community members,

Thank you very much for joining our recent Ask Katalon Anything (AKA) session! We hope you were able to get the answers you needed from our Product team members!

In this thread, we are going to consolidate all of the questions and answers from the second week of AKA. Each comment in this thread will correspond to a separate module within the Katalon Platform to easier navigation:

List of Katalon Studio questions & answers

:pushin: List of Katalon TestOps questions & answers

:pushin: List of Katalon TrueTest questions & answers

---

To see the questions and answers from the first week, you can refer to the topic below:

[Recap] Ask Katalon Anything - Week 1 - Feb 26 to Mar 4, 2024

[Extended] Hi Community members, In this thread, we are going to summarize all of the questions & answer that have been asked during Ask Katalon Anything (AKA) thus far. Each comment in this thread will correspond to a separate module within the Katalon Platform to easier navigation: List of Katalon Studio questions & answers List of Katalon TestOps questions & answers Our team has also decided to extend AKA for another week. Hence, from now until 2024-03-12T16:…

[albert.vu]

[AKA] Katalon Studio Q&A

I have covered all the prerequisites for the Katalon & Perfecto setup but I still could not connect to Perfecto cloud for device simulation

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #46 by syed.shoaib

@syed.shoaib

I have initial setup done as per the articles and Katalon demo video.
And I believe, I have covered all the prerequisites for the Katalon - Perfecto setup but I still cannot connect to perfecto cloud for device simulation.
Issues:
• Unable to record objects > cannot connect to remote for perfecto cloud to capture/record objects.

• Below is a screenshot from a sample mobile project, Unable to run any sample test cases for Katalon - Perfecto cloud.

I have referred below links for the initial setup.
 Perfecto article: Katalon Studio
 Katalon article: [Mobile] Set up real Android devices in Katalon Studio | Katalon Docs

Please help me with this issue

Answer

@Elly_Tran

Hi,

Please help update your Katalon to v9.3.1 as we fixed it in this release:

@albert.vu

We have fixed an issue where many of our users were not able to update the Chrome WebDriver to versions 121 and 122.

From Katalon Studio version 9.3 onward, the login does not work. What could be the issue?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #54 by viewxy

@viewxy

My problem is, from 9.3 onward, the login does not work. The browser never appears, I get an error, that there is no internet connection, which is not right. I tried through proxy, without proxy, any and every configuration. Raised tickets, but the “solution” was to open 9.0, log in, than I can use 9.3 until it automatically logs me out every 2 days…

Answer

@xuan.tran

Hi @viewxy,
Thank you for letting us know. We’re sorry for the inconvenience that you’re facing. We’re working on the improvement for the login so that it can work with special cases behind a proxy. Our team will constantly update you via your support ticket.

Will Katalon consider adding support for MacOS desktop application testing in the future?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #51 by albert.vu

Answer

@xuan.tran

Hi @leyssm1,
Currently, we don’t have any plans to support testing macOS desktop apps soon. If there are more requests coming up, we might consider it for future releases.

I am unable to pause my test run during execution. Is there any way we can pause the after sometimes resume the test run itself?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #56 by atul.rai

Answer

@xuan.tran

Hi @atul.rai,
Currently, we can only terminate the execution by clicking Stop, and then you have to rerun it again from the beginning. Is there any specific reason why you want to pause and resume it?

Is there any easy way to set up iOS devices in Katalon Studio?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #60 by Mark_Peterson

Answer

@albert.vu

Hi @Mark_Peterson,

Thank you for your question. So, before @xuan.tran jumps in to help you with your question, I would like to give you a pointer to one of our KShare articles which also covered iOS Testing below

Have you ever run into troubles whilst setting up Mobile testing environments, especially with the Apple’s iOS mobile operating system, such as: Cannot load the devices successfully (real devices or simulators/emulators) We can try to unplug and plug in the real devices to make sure the devices can be recognized by the machines. We may get unexpected issues regarding dependencies. Cannot start the application successfully. We can try to run the application id com.apple.Preferenc…

We hope this will be able to help you with your iOS testing project!

Can I use Web Recorder on websites that have multi-level shadow DOM?

[AKA] Katalon Studio - Feb 26 to Mar 12, 2024 ✨ - #61 by moises.h.lopez

Answer

@philip.becker

Yes; with the latest Enterprise edition, if you use smart locator it’s automatic. Selection methods for Web objects | Katalon Docs

@albert.vu

Hi @moises.h.lopez,

We would like to add more to Philip’s answer.

So, starting from Katalon Studio version 8.6.0 release last year, you can do that. And, just a sneak peek, this year we also have plans to improve our recorder and extend its capabilities even further.

Besides multi-level shadow DOM, are there any complex cases that you want us to support?

[albert.vu]

Katalon TestOps Q&A

May I trigger a TestOps schedule from my CI/CD pipeline?

[AKA] Katalon TestOps - Feb 26 to Mar 12, 2024 🪄 - #14 by pedro.ramsey

Answer

@vy.huynh

Hi Pedro
You can certainly use Katalon CLI, which is published on Docker Hub at Docker. With Katalon CLI, you can use it within your CI/CD tools, and trigger TestOps schedules from there by schedule IDs or schedule names. For more details, please refer to the following documentation Katalon CLI | Katalon Docs.

Is there any way to connect TestOps to my repository without using my PAT?

[AKA] Katalon TestOps - Feb 26 to Mar 12, 2024 🪄 - #16 by apolezhako

Answer

@vy.huynh

Hi @apolezhako

You can download your repository, zip it and then use the function Upload Script Repository to TestOps.

Hope this helps. Thank you.

I would like to know what options are there for Web Image-based Testing and/or PDF Content testing and how one can incorporate this with Katalon Studio using TestOps in order to find out and compare changes and mismatches between test case runs?

[AKA] Katalon TestOps - Feb 26 to Mar 12, 2024 🪄 - #17 by qa-dept

Answer

@vy.huynh

Hi @qa-dept

You can read more about Katalon TestOps visual testing in Visual Testing overview | Katalon Docs.
Or reading about PDF testing here [KShare] Using Katalon Studio to read PDF files directly on a webpage - Product Insights - Katalon Community

[albert.vu]

Katalon TrueTest Q&A

How does TrueTest works?

[AKA] Katalon TrueTest™️ - Feb 26 to Mar 12, 2024 ✨ - #7 by amadese

Answer

@nghi.hua

TrueTest operates by embedding a JavaScript code snippet into an application, enabling it to capture and analyze how end users interact with the application in real time. This process allows TrueTest to accurately map out user journeys, identify key user flows, and generate detailed test cases based on these interactions. Once these test cases are created, they can be seamlessly executed using Katalon’s TestOps or Katalon Studio, offering testers a comprehensive and efficient toolset for ensuring software quality. This integration not only streamlines the testing process but also enhances the accuracy and relevance of test cases, ensuring they reflect genuine user behaviors and preferences.

I finally got my infrastructure team to implement the TrueTest snippets for me; however, I am not getting the same result we in the AUT that we got when we tested in a “docker instance.

[AKA] Katalon TrueTest™️ - Feb 26 to Mar 12, 2024 ✨ - #10 by nathaniel1

@nathaniel1

Can I get a reset? (Is one needed?)

I finally got my infrastructure team to implement the TrueTest snippets for me; however, I am not getting the same result we in the AUT that we got when we tested in a “docker instance.”

TLDR: we saw it working in the docker instance and Testops, so we wired it to the testing AUT environment (Staging), and although we got a connection, I am not seeing the User session getting generated, and there appears to be one that got “stuck” while generating test cases, maybe? (see screenshots)

Do you think a reset from your end would help me? I kept adding different URLs to the environment, and I could not delete them.

Add images

Answer

@nghi.hua

I believe you can now see the generated result or generate another map without reseting from your end. If you still encounter any issue, please feel free to let me know.

How are the test cases generated by TrueTest different from traditional automated test cases, such as the ones generated by using Katalon Recorder?

[AKA] Katalon TrueTest™️ - Feb 26 to Mar 12, 2024 ✨ - #12 by apolezhako

Answer

@nghi.hua

The key distinction between TrueTest-generated test cases and traditional automated test cases, like those created with Katalon Recorder, lies in the underlying approach and the source of data used for test creation. Traditional tools like Katalon Recorder typically generate test cases based on predefined user scenarios or manual recordings. These test cases are scripted based on expected user behaviors and paths that testers anticipate or construct.

In contrast, TrueTest introduces a more dynamic and user-centric approach. It captures and analyzes actual user interactions with the software, not just predetermined paths or manually recorded scripts. This means TrueTest’s test cases are derived from real-world user behavior, capturing a wider array of user flows, including those that may not have been anticipated in traditional test scripting. As a result, the test cases generated by TrueTest are inherently more reflective of real user experiences and interactions. They can uncover issues and edge cases that traditional scripted tests might miss, providing a more comprehensive and authentic testing coverage.