We can parallelize better at this line:
|
refs.append(s.evaluate.remote(env_config=self.env_config, |
By using the Solver system we are forcing a serial call for each actor, but are parallelizing by running each actor independently.
Think through better ray usage?