I’ve noticed something similar. If I ever copy a project across to a bunch of VMs, some sessions of Katalon notice the changes and ask if I want to update them. Other’s don’t - they either update blindly with no report, or, rarely, don’t update at all.
Whatever they’re using in the Java core for file system watching is flaky at best.