Ask Katalon Anything - Sep 6 to Sep 22, 2023 💬

I am a long term Katalon Recorder user (having used it since 2016), and have no interest in using applications such as Katalon Studio, or other similar products.

I exclusively want a browser-based / browser-integrated solution, and a standalone IDE, even if it offers its own browser extensions, is still far more bloated a solution than what I would wish to use, when the greater majority of my work is performed and kept solely within the browser (with the exception being Slack, for comms). I have not developed a knowledge of Java, Playwright, C++, Perl, etc either to use something like Katalon Studio in the same way that I could use the scripting language present within Katalon Recorder.

You have recently made the decision to EoL Katalon Recorder development (and only offering to do one more maintenance release), which feels to me like a massive misstep. What you have already developed there over the years is great, and has the potential to really transform scripting based tools like these to another level if some of the suggestions already present in your forum were adopted, so it is deeply disappointing that you have chosen not to go down this route.

Whilst there are those who mistakenly view Katalon Recorder as a toy, those views come from a shallow understanding of what is possible with this tool. Yes, it is built upon a JS framework, and this has limitations, and at the end of the day being an open source application, you have no obligation as a company to develop it further, but you have built up a community around it over the years, and it is abandoning that community by moving away from it.

I personally have really valued the work Katalon has put into this over the years, too. Due to this, I have over the years attempted to show my appreciation for your efforts, by helping others in this community, via your forums.

I am aware that you are now developing (and looking to replace Katalon Recorder with) KR-CS from KR-KS4, but from what I can tell this is a very different application, even if it is aimed at a similar target market. It also appears to be vastly more limited in its capability and flexibility to what KR-KS4 offers, too (…and I do use the majority of what KR-KS4 currently offers, as well).

So, speaking from the PoV of a (long term and dedicated) KR-KS4 user, what I am hoping for clarity on is:

  • Understanding whether KR-CS will offer feature parity with everything KR-KS4 already offers (and if so, within what timelines)
  • Understanding whether existing test scripts / suites, etc will work OOTB with CS
  • …and subsequently whether existing knowledge around Selenese scripting will continue to be useful there (otherwise this means that all KR-KS4, Selenium IDE, etc users knowledge will become invalidated)
  • Whether there will now be a price barrier (or not) that will lock out a segment of your existing market

I have spent well over a decade developing my knowledge and understanding of Selenese, and used Selenium IDE (and a rival browser-based extension) for many years prior to my discovery of Katalon Recorder back in 2016.

Because of this, I have real concerns that all of this expertise will also no longer be usable by KR-CS. Likewise, all the years i’ve put into developing scripts that I use in KR-KS4 may be trashed, if I am unable to directly re-use those via KR-CS.

So, if you could please come back to me on the points and questions above, this would be appreciated! Thanks!

2 Likes

Any plans to integrate with copilot or code whisperers?

Hi Dinesh,

Thank you for your question. By Copilot, did you mean Microsoft 365 Copilot, or GitHub Copilot, or both? Please be more specific in your questions so that our PMs can provide you with the answers you need. Thanks!

1 Like

Hi @chihung.le,

I am sending you a few articles from our documentation base which I believe can help you as below:

For sharing Test sets/test artifacts:

For setting up Object Repository in Katalon Studio:

For Scheduling Test Run in Katalon TestOps:

For Scheduling Test Suite Collection in Katalon Studio:

I hope this helps. Should you have further questions, don’t hesitate to tag one of our PMs above by simply adding a @ and then type in their usernames. Thanks! :+1:

This is a great initiative, thanks Katalon Team! I have some question as below-
Test run on safari browser is not much compatible compare to other browser like chrome, Firefox, Edge chromium etc. So we expect improvement for this.

@tri.tle - when we run our test suite/testsuiteCollection on Windows 11 OS and view report on TestOps,then always showing Windows 10.
Sometimes are showing N/A as attacheched in the screenshot.

2 Likes

Hi @f_poccard,
Thank you for sharing this question!

As you might know, we had a PoC for Selenium 4 a while ago, and we’re keeping this item as a candidate for some upcoming releases.

We would love to hear your feedback on the PoC, so here’s the link for you to download and try it out: 8.2.1.alpha. Let us know your thoughts on this PoC :speech_balloon:, and happy testing! :green_heart:

Hi @Shakkir,

We had StudioAssist out for beta with 2 AI features, which are generating code and explaining code in Katalon Studio. Here’s the link for you to try out: 8.6.7.beta.

These features will be in an official release soon. And after that, we will also have some enhancements on mobile testing, so stay tuned for it. Are there any features in mind that you want us to support? Let us know by commenting below. Thank you so much. :green_heart:

1 Like

Hello @xuan.tran : Why it is taking too long to get the below issue resolved? The ageing of this issue is more than 180 days now.

Hi @xuan.tran,
I am using KRE 7.2.1 for executing some test cases in one of my Test suites in Katalon studio project on the same machine. There since each of the Test case needs some data set up before execution we need to work on few mins on data set up for each of the TCs. And if for some reason any test case fails, the data set up has to be done again from scratch for it.
So in case of failure of a TC in a suite, all subsequent TCs should not be executed or skipped so as to investigate the failure and also to avoid corrupting the test data by NOT executing subsequent TCs unnecessarily. I tried a feature of MaxFailedTCs argument in KRE v8.5 as well, but does not help in my case.

In event of failure, i was trying to kill the Katalonc.exe, but even after doing it, it keeps launching subsequent TCs in suite as per the sequence. I want to manually terminate the KatalonC.exe in case i observe some TCs failed.

How can i do it or is there any way, please help me.

Question: User Unexpected behavior I noticed in Katalon Studio. When using the methods WebUI.verifyElementNotPresent or WebUI.verifyElementPresent with the following syntax’
TestObject export_button = findTestObject(‘imging/action_export_button’)
button_state = WebUI.verifyElementVisible(export_button) and expect a returned boolean.
If the element is not present, it fails the test at this step. Even though Katalon indicates that it will return a boolean value based on element’s presents or not.

The only way I was able to get this to work is by using the Failure Handling and it has to use the OPTIONAL option not CONTINUE. Then even when using OPTIONAL I still see a warning level event when the element is not visible. WebUI.verifyElementVisible(export_button, FailureHandling.OPTIONAL)

What I expected with these methods is a cleaner exit of returning a boolean if the element is present or not and the step to continue. I didn’t expect the verifyElementPresents to be a hard assertion failure and stop the test. Is this the correct usage of these methods? I’ve seen other Selenium implementations where there were methods that can check the element presents and return a boolean and allow the test steps to continue -versus- an assertion method that will hard fail the test step.
Best,
Mike W.

Many TestRail customers are switching to alternative tools such as testmo or Qase, because the product quality there is apparently much better and the tools are also much more modern. In particular, the migration from TestRail to Testmo is said to be relatively easy, because Testmo’s roots are in TestRail. Are further plugins planned to support integrating Katalon to these or other test management tools?

1 Like

Google has not put chromedriver version 116 in the chromedriver download endpoint, and the mismatch with chrome browser causes tests not to run as the browswer fails to open. What can we do to mitigate this issue?

What Katalon Studio Version are you on? Maybe an update to Katalon 8.6.6 helps?

hi @albert.vu meant github copilot

Hi @guy.mason

Thank you for reaching out. We appreciate your inquiry and value your interest in Katalon Cloud Studio. Please find below the information you requested:

  1. Feature parity between Katalon Cloud Studio and Katalon Recorder:
  • Katalon Cloud Studio offers a user-friendly test authoring capability with test steps presented in plain English, comprehensive keyword suggestions, and descriptions. This makes test creation and review easier for users.
  • Additionally, as a web-based tool located on TestOps, Cloud Studio offers convenient access from any web browser, allowing you to work on your tests anytime and anywhere.
  • You can freely execute Cloud Studio test cases with Katalon TestCloud and conveniently view the test reports on TestOps, providing an all-in-one platform experience.
  • The product is still in the development stage and requires further improvements to match the functionality of KR-KS4. We highly value the sincere feedback from our valuable users, as it helps us make Cloud Studio significantly more useful and efficient for you.
  • While we have planned release timelines, they are subject to changes based on new findings and user feedback. We assure you that we will keep our users informed of every new update.
  1. Compatibility of existing KR test scripts/suites with Cloud Studio: This is not available for now, we have it in our backlog to consider. We will inform KR users when we have any specific plan for it.

  2. Scripting support:
    At the moment, our Cloud Studio doesn’t support scripting, which means you won’t be able to apply your scripting knowledge.
    While we understand your interest in scripting, we cannot provide a definite confirmation regarding its introduction in the future. If scripting is considered at a later stage, it is important to be aware that there may be slight differences in the way you write tests due to the use of different frameworks.
    We appreciate your understanding in this matter, and we will make sure to keep you updated on any further developments regarding scripting capabilities in Cloud Studio.

  3. Pricing: The product is currently in the Beta phase, and during this period, it is completely free to use. We will provide further information about pricing as we near the general availability launch.

We appreciate your loyalty as a KR-KS4 user. Your feedback is important to us as we strive to make Cloud Studio even better. If you have any further questions, please feel free to ask. Thank you for choosing Katalon.

2 Likes

Hi Albert,

Thank you for the links. I’m going to check each one and contact back if need any further assistant.

Cheers,

Chi Hung Le

~WRD0001.jpg

1 Like

How do you get Visual Testing Up and running. It seems no matter how many times I walk through the documentation I cannot get a baseline image to be set up for comparison, even though it exists in the baseline collection. One image just constantly says missing. Missing what? When the first image is opened its on the baseline side with nothing on the other side to compare it to. Then the second image when opened, the baseline is empty even though there is a file in the baseline. I am completely lost on this. I have gone through the documentation about 10 times now uploading an image then running a suite that captures and image as a checkpoint, but no change. Then tried to just have it generate one for me, click pass and save to baseline, re-run the suite and try to compare, again no luck. Is anyone using this successfully?

1 Like

Hi @atul.rai,
Apologies for the delayed response and thank you for your questions. I will address them in the following text.

Could you provide more specifics about the issues you’re experiencing with the Safari browser? Understanding your needs better will help us make the necessary improvements.

In relation to the issues with Windows 11, following a period of investigation, we have determined that the problem originates from our system. We are currently addressing the issue and I will get back to you once it has been resolved.

1 Like

Hi @Testinator-X,

Thank you for your valuable insights. Katalon has plans to support integration with other test management tools such as Xray, which was released by Katalon in 2023. However, the implementation timeline will depend on the priority of integrations, so Katalon will have an official announcement if an integration will be released in the near future.

2 Likes

Hi @Monty_Bagati,
Sorry for the late reply. I’m a bit confused, related to Drag and Drop keywords, we have these webUI keywords:

I’ve got our dev to check and these two are still working fine. Can you provide more details on the scenario you are testing? If possible, can you also share the web page that you’re testing?
I’m looking forward to hearing more to see if I can help.