Refresh issue in test suite collection

After pulling the changes, did you close & reopen the project?

After pulling the changes, did you ever opened the new testcases in the Test Case editor in your Katalon Studio GUI?

My Guess

Unless you manually open a test case script in GUI, Katalon Studio may not recognize that it has got a new script in the pulled project.

In my experience, unless given a chance to refresh, Katalon Studio often goes out of sync with files on disk. See the following ancient post:

Katalon developer stated they have fixed this issue. But I believe there remain some edge cases where Katalon Studio gets out of sync with files on disk. I’ve got bored with this issue. I am not going to debate this bug any longer.

What I do

I would just repeat closing and reopening projects when necessary. Especially I always do close&reopen a project after pulling it from a Git remote repository. It’s a rule of thumb.