Can Your AI Debugger Find the First Wrong Step, not Just Explain the Last Error?

“The save failed” is a symptom. “The role changed, but the open tab kept showing an enabled Save button” is a much more useful starting point for investigation.

A fresh Ministry of Testing discussion raises a practical distinction: describing a failure is not the same as locating where expected and observed behavior first diverged.

Try this with one stateful browser bug:
• Record the starting state: user role, existing data, open tabs, and relevant prior actions.
• Capture the action sequence and a trace or network log, with sensitive data removed.
• Ask your AI assistant for the earliest evidenced divergence, the expected behavior, and the observation supporting its answer.
• Require it to separate facts from hypotheses and identify missing evidence rather than invent a cause.
• Replay the sequence from the same starting state to check whether the proposed explanation holds.

The first failing assertion is a clue, not necessarily the root cause. A stale session or earlier state change may have set up the failure several steps before the error appeared.

What would you include in a bug report so an AI assistant- or a teammate -can investigate rather than just summarize?

Source: What's one QA task AI still does surprisingly badly? - Discussions - The Club: Software Testing & Quality Engineering Community Forum | Ministry of Testing

logs, artifacts, issue description, replications etc

the thing that moved the needle for me was giving it the passing run next to the failing one. same test, same starting state, two traces. the earliest point where the two diverge is usually the real wrong step, and a model is pretty good at diffing two sequences, much better than at guessing a cause from one red stack trace.

so in the bug report i now include: the last known good run id, the failing run id, and the first step where the screenshots or network calls differ. “the save failed” becomes “step 4 returned 200 in the good run and 403 in the bad one, the role change at step 2 never refreshed the token”.

the other rule is to make it say “i don’t know” explicitly. if the evidence stops at step 4, the answer should stop at step 4 too, not fill the gap with a plausible story.