Issues with test suite collections

I am having an issue with running test suite collections. What happens is the collection tries to start a second test suite before the first test suite has completely finished. This is happening multiple times per test suite collection run.

The error text in the popup dialog box is “The execution process is already running, please wait until it finishes and try again.”