VectorEnv

class maze.train.parallelization.vector_env.vector_env.VectorEnv(n_envs: int)

Abstract base class for vectorised environments.

An instance of this class encapsulates multiple environments under the hood and steps them synchronously.

Note that actions and observations are handled and returned in a stacked form, i.e. not as a list, but as a single action/observation dict where the items have an additional dimension corresponding to the number of encapsulated environments (as such setting is more convenient when working with Torch policies). To convert these to/from a list, use the training helpers such as maze.train.utils.train_utils.stack_numpy_dict_list() and maze.train.utils.train_utils.unstack_numpy_list_dict().

Also note that in structured scenarios, only synchronous environments are supported – i.e., in each sub-step, the actor ID must be the same for all environments.

Parameters:

n_envs – The number of encapsulated environments.

abstract reset()

Reset all the environments and return respective observations in env-aggregated form.

Returns:

observations in env-aggregated form.

abstract seed(seeds: List[Any]) → None

Sets the seed for this vectorised env’s random number generator(s) and its contained parallel envs.

abstract step(actions: Dict[str, int | numpy.ndarray]) → Tuple[Dict[str, numpy.ndarray], numpy.ndarray, numpy.ndarray, Iterable[Dict[Any, Any]]]

Step the environments with the given actions.

Parameters:

actions – the list of actions for the respective envs.

Returns:

observations, rewards, dones, information-dicts all in env-aggregated form.