Design simulation infrastructure to evaluate a self-driving model on limited compute

Start from an open question: how would you evaluate a self-driving model? Then design the infrastructure: running thousands of simulations when there is not enough compute, choosing which scenarios to run first, making each simulation faster, reproducing and triaging a bug found in simulation, and reporting results so a model change can be accepted or rejected.