[Live KataMeet] Flaky Tests “Painkillers” - Methods that work!

Hello everyone,

:dizzy: [[SAVE YOUR SEAT]](

:dizzy: Apr. 6th, 2021 | 11 AM EST

For the first time ever, we are very excited to introduce to you - KataMeet. Designed as a virtual podium for Katalon Community Ambassadors and fellow users, KataMeet aims to leverage “Katalon regulars” insights to grow our community’s expertise.

In this upcoming Flaky Tests “Painkillers” - Methods that work! session, it’s our honor to have Jagmit Singh - Senior Automation Engineer and Katalon Community Ambassador - as our speaker.

 In this hands-on session, you’ll gain insights on the:

  :fire: Top 5 causes of flaky tests in automation testing
  :fire: Best practices to spot and deal with flaky tests
  :fire: Ultimate headache-relievers to test flakiness with Katalon Studio and Katalon TestOps (a live demo included!)

HAVE YOU REGISTERED? We can’t wait to see you on Tuesday :wink:

UPDATED

Hi all,

Thanks for your interest in Katameet Ep #1. If you were not able to join the event, worry not! Please find the recap video HERE.

Also, please take a look at some of the FAQs/questions asked in this episode:

Q: Can we use TSC. for performance load testing? I tried 20 concurrent users running but I’m getting load sequentially. How do concurrent users work for Test Suite Collections?
A: TSC concurrent executions are sort of like context switching and are not truly parallel executions. I think you need to integrate with another tool, specifically designed for load testing. For Katalon Studio, it is primarily used functional testing and not so much for performance load testing. In certain situations, one can use Katalon for performance testing also.
Additionally, load testing is the process of putting demand on a software system and measuring its response. Load and performance testing analyzes software intended for a multi-user audience by subjecting the software to different numbers of virtual and live users while monitoring performance measurements under these different loads. So you would need to use the load test tools (eg: JMeter, Gatling…) to create the number of users, and the ability to create performance reports instead of functional reports.

Q: How can Katalon help resolve OTP messages?
A: Maybe this can be helpful: Capture OTP while Sign in/Sign up - #18 by HeleneB

Q: Can I run the API Suite in web services and UI suite in the browser simultaneously by using the Test Suite Collection?
A: Yes, you can use Test Suite Collection to trigger the test parallelly.

Q: How can I manage Selenium tests with different environments and various test parameters for each test function/class? Currently, all my test functions use parametrizes from Excel. But as I have more and more tests, parametrize syntax is getting busier in a single python script that I already split them out to 4 scripts. Am I on the wrong path and shouldn’t have used Selenium tests for this?
A: You can use Katalon Profile to handle the different environments and various test parameters. I really think you should find a tool that supports built-in parameterization like Katalon. Learn more here

Q: Are API tests as effective as UI tests? Is it true that UI testing will pick up issues that API tests may not?
A: I think you will need need to test the API and UI to make sure the functions are working correctly. UI tests indeed pick up some user experience issues that API tests do not, however, when you have thousands of UI tests then I do not think the amount of user experience being tested justifies the increase in execution due to its flakiness.

1 Like