This is a email after a test suite execution. how do I even configure this in katalon settings to show failed test cases? I know the response from katalon team will be “showing a list of failed test cases is not supported in the template notification” - but then katalon can’t explain how it shows up when failures are 3 or less???
How can we get this to be enabled all the time?
Not sure if it can help, but please note that retry mechanism seems to be involved here:
First scenario “06” failed 2 times, so still failed even after 1 retry, appears as failed in the overall result of 18 scenario, and 2 failed test executions are listed in the detailed lists of all failed test executions
Second scenario “01” failed one time only, but seems it was successfull on second attemp, thus I guess scenario is part of the 16 pass scenario, but first failed attempt is anyway listed in failed test executions (means you have flakiness in your scripts, should be looked at anyway)
Third scenario “13” failed 2 times like scenario “06”
I do not rely on emails notifications to get details about failed scenario, but I guess if I had to do it, then I would create my own template and try to improve it to provide the list of scenario which in the end after all retries are actually failed + maybe for information / warning the list of scenario which in the end worked but due to retry and thus show some flakiness to be improved.
Not sure I understand what you’re trying to say. Unfortunately, this has nothing to do with what I asked.
