I have been having the exact same issue and had started a thread on this myself - Cannot run visual checkpoint tests in TestOps - Product Forums / Katalon TestOps - Katalon Community
I updated my test as you described and used the headless chrome browser to execute it in TestOps and it does pass now but it doesn’t create the visual checkpoint and isn’t shown as a visual test run.
I followed the steps in several Katalon videos that I had watched on Visual Testing to initially set the test up so I’m a bit confused on how to get this to run as a visual test. It really seems like it should be simple but so far it has been anything but that.