Same suggestion as @grylion54
You should try increasing the -Xmx value specified in the katalon.ini file
katalon.ini