Hi Vasanthi.j,
In Katalon TestOps, a flaky test case is a test that both passes and fails from time to time with no code modifications.
When Katalon TestOps identifies flaky test cases as “most unreliable,” it refers to test cases that exhibit inconsistent behavior across multiple executions. This unreliability can stem from: Test Script Issues (as you mentioned), Application Issues (Actual bugs in the application under test, Performance inconsistencies, etc.), or Infrastructure Issues.
Recommended Actions when looking at this Flaky Test Case Report:
- Investigate each flaky test to determine if it’s a test issue or application bug
- Fix test scripts for timing/environmental issues
- Prioritize application bugs revealed by consistent failure patterns
- Use flakiness % to prioritize which tests need immediate attention
Bottom line: Treat flaky tests as diagnostic tools that need investigation rather than reliable indicators of application health. Focus on stabilizing your most flaky tests first to improve overall test suite confidence.