Consider using PHPUnit as the runner #7
Description
I started with this idea in mind, and it didn't turn out well. PHPUnit is restricted in many ways by a long legacy and a specific mode of execution (1 test, 1 execution).
It might be possible to hook this up to a dataProvider in PHPUnit. /shrug