From 4b631b71776a183b2028dd6fde7a7b85e21d34c4 Mon Sep 17 00:00:00 2001 From: Dominik Roth Date: Thu, 18 Jan 2024 22:23:52 +0100 Subject: [PATCH] Tweaked image layout (docs) --- docs/source/envs/dmc.md | 2 ++ docs/source/envs/fancy/index.rst | 2 +- docs/source/envs/fancy/mujoco.md | 14 +++++++------- docs/source/envs/meta.md | 6 ++++++ docs/source/envs/open_ai.md | 5 +++++ 5 files changed, 21 insertions(+), 8 deletions(-) diff --git a/docs/source/envs/dmc.md b/docs/source/envs/dmc.md index 0220427..b8a81f2 100644 --- a/docs/source/envs/dmc.md +++ b/docs/source/envs/dmc.md @@ -1,5 +1,7 @@ # DeepMind Control (DMC) + + These are the Environment Wrappers for selected [DeepMind Control](https://github.com/google-deepmind/dm_control) environments in order to use our Motion Primitive gym interface with them. diff --git a/docs/source/envs/fancy/index.rst b/docs/source/envs/fancy/index.rst index 937f17c..0b4c4cc 100644 --- a/docs/source/envs/fancy/index.rst +++ b/docs/source/envs/fancy/index.rst @@ -6,7 +6,7 @@ Fancy Gym adds a couple new environments. Some of these are adaptations of exist .. raw:: html
- +

Box Pushing Task (fancy/BoxPushingDense-v0)


diff --git a/docs/source/envs/fancy/mujoco.md b/docs/source/envs/fancy/mujoco.md index 1ed8644..5061457 100644 --- a/docs/source/envs/fancy/mujoco.md +++ b/docs/source/envs/fancy/mujoco.md @@ -5,7 +5,7 @@ ### Box Pushing
- +
The box-pushing task presents an advanced environment for reinforcement learning (RL) systems, utilizing the versatile Franka Emika Panda robotic arm, which boasts seven degrees of freedom (DoFs). The objective of this task is to precisely manipulate a box to a specified goal location and orientation. @@ -29,7 +29,7 @@ Variations of this environment are available, differing in reward structures and ### Table Tennis
- +
The table tennis task offers a dynamic and interactive environment designed for the development and testing of reinforcement learning (RL) systems. Using a robotic arm equipped with seven degrees of freedom (DoFs), the challenge is to respond to incoming balls and return them accurately to a specified goal location on the opponent's side of the table. @@ -54,6 +54,11 @@ Variations of the table tennis environment are available to cater to different r ### Beer Pong +
+ +
+ + The Beer Pong task is based upon a robotic system with seven Degrees of Freedom (DoF), challenging the robot to throw a ball into a cup placed on a large table. The environment's context is established by the cup's location, defined within a range of x-coordinates from -1.42 to 1.42 meters and y-coordinates from -4.05 to -1.25 meters. The observation space includes the cosine and sine of the robot's joint angles, the angular velocities, and distances of the ball relative to the top and bottom of the cup, along with the cup's position and the current timestep. The action space for the robot is defined by the torques applied to each joint. For episode-based methods, the parameter space is expanded to 15 dimensions, which includes two weights for the basis functions per joint and the duration of the throw, namely the ball release time. @@ -71,11 +76,6 @@ An additional reward component at the final timestep T assesses the chosen ball A successful throw in this task is determined by the ball landing in the cup at the episode's conclusion, showcasing the robot's ability to accurately predict and execute the complex motion required for this popular party game. -
- -
- - | Name | Description | Horizon | Action Dimension | Observation Dimension | | ------------------------------- | ---------------------------------------------------------------------------------------------- | ------- | ---------------- | --------------------- | | `fancy/BeerPong-v0` | Beer Pong task, based on a custom environment with multiple task variations | 300 | 3 | 29 | diff --git a/docs/source/envs/meta.md b/docs/source/envs/meta.md index 8fd013a..e4ec33c 100644 --- a/docs/source/envs/meta.md +++ b/docs/source/envs/meta.md @@ -1,5 +1,11 @@ # Metaworld +
+ +

Metaworld Dial Turn Task (metaworld/dial-turn-v2)

+
+
+ [Metaworld](https://meta-world.github.io/) is an open-source simulated benchmark designed to advance meta-reinforcement learning and multi-task learning, comprising 50 diverse robotic manipulation tasks. The benchmark features a universal tabletop environment equipped with a simulated Sawyer arm and a variety of everyday objects. This shared environment is pivotal for reusing structured learning and efficiently acquiring related tasks. ## Step-Based Environments diff --git a/docs/source/envs/open_ai.md b/docs/source/envs/open_ai.md index 646918b..1b2c57b 100644 --- a/docs/source/envs/open_ai.md +++ b/docs/source/envs/open_ai.md @@ -1,5 +1,10 @@ # Gymnasium +
+ +
+
+ These are the Environment Wrappers for selected [Farama Gymnasium](https://gymnasium.farama.org/) (previously OpenAI Gym) environments to use the Motion Primitive gym interface for them. ## Step-Based Environments