dodox/fancy_gym
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Little hack to make envs work, that don't expose the max_episode_steps in their spec

Browse Source
This commit is contained in:
Dominik Moritz Roth 2023-06-11 17:37:32 +02:00
parent 2ad42f4132
commit abeb963b4e
1 changed files with 8 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
fancy_gym/utils/make_env_helpers.py
View File

@ -93,6 +93,14 @@ def make(env_id: str, seed: int, **kwargs):
else:
env = make_gym(env_id, seed, **kwargs)
if not env.spec.max_episode_steps == None:
# Hack: Some envs violate the gym spec in that they don't correctly expose the maximum episode steps
# Gymnasium disallows accessing private attributes, so we have to get creative to read the internal values
# TODO: Remove this, when all supported envs correctly implement this themselves
unwrapped = env.unwrapped if hasattr(env, 'unwrapped') else env
if hasattr(unwrapped, '_max_episode_steps'):
env.spec.max_episode_steps = unwrapped.__getattribute__('_max_episode_steps')
# try:
env.reset(seed=seed)
# except TypeError: