By the way, you can also open **katalon.**ini file in your Katalon Studio folder and increase -Xmx value to be higher
Screen Shot 2018-04-04 at 15.50.50.png