Hello! I just started executing tests on Github runners a week ago and have been able to successfully get a few builds of our Smoke Test suite (6-7 tests total). I’ve created a yml file for a couple of configurations and at least for now I’m just executing them manually, until I get the hang of it. I’m aware you can also create a properties file to condense the CMD line arguments if desired.
I’m mostly looking for the smartest way to configure this so that longterm I won’t need 20+ yml files to support a variety of config options. For example, I currently have 11 Test Suites, and 3 Test Collections. I may not always want to run the full Test Collection. If I’m doing a full E2E regression sweep, I may want to run a Test Collection with configs for Windows + Chrome, Mac + Safari, Mac + Firefox etc. The amount of combinations kind of makes my head spin and I wish there was a way to set parameters for OS and Browser at the GUI level in Github Actions just like when you run Test Suites locally in Katalon Studio.
Any pointers? I’ll attach an img of a basic workflow I’m using.