English
Related papers

Related papers: safe-control-gym: a Unified Benchmark Suite for Sa…

200 papers

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Active flow control (AFC) involves manipulating fluid flow over time to achieve a desired performance or efficiency. AFC, as a sequential optimisation task, can benefit from utilising Reinforcement Learning (RL) for dynamic optimisation. In…

Machine Learning · Computer Science 2023-05-04 Mosayeb Shams , Ahmed H. Elsheikh

Reinforcement learning has become one of the most trending subjects in the recent decade. It has seen applications in various fields such as robot manipulations, autonomous driving, path planning, computer gaming, etc. We accomplished three…

Artificial Intelligence · Computer Science 2021-10-18 Hanzhi Yang

Safety is a critical component of autonomous systems and remains a challenge for learning-based policies to be utilized in the real world. In particular, policies learned using reinforcement learning often fail to generalize to novel…

Robotics · Computer Science 2023-04-04 Kai-Chieh Hsu , Allen Z. Ren , Duy Phuong Nguyen , Anirudha Majumdar , Jaime F. Fisac

This paper presents panda-gym, a set of Reinforcement Learning (RL) environments for the Franka Emika Panda robot integrated with OpenAI Gym. Five tasks are included: reach, push, slide, pick & place and stack. They all follow a Multi-Goal…

Machine Learning · Computer Science 2021-12-21 Quentin Gallouédec , Nicolas Cazin , Emmanuel Dellandréa , Liming Chen

Recent advances in robot-assisted surgery have resulted in progressively more precise, efficient, and minimally invasive procedures, sparking a new era of robotic surgical intervention. This enables doctors, in collaborative interaction…

Robotics · Computer Science 2024-01-30 Samuel Schmidgall , Axel Krieger , Jason Eshraghian

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control…

Robotics · Computer Science 2025-07-21 Shingo Ayabe , Takuto Otomo , Hiroshi Kera , Kazuhiko Kawamoto

The deployment of autonomous robots in safety-critical applications requires safety guarantees. Provably safe reinforcement learning is an active field of research that aims to provide such guarantees using safeguards. These safeguards…

Machine Learning · Computer Science 2026-05-08 Tim Walter , Hannah Markgraf , Jonathan Külz , Matthias Althoff

The objective of this research is to enable safety-critical systems to simultaneously learn and execute optimal control policies in a safe manner to achieve complex autonomy. Learning optimal policies via trial and error, i.e., traditional…

Systems and Control · Electrical Eng. & Systems 2022-04-05 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Recent advancements in reinforcement learning (RL) have led to significant progress in humanoid robot locomotion, simplifying the design and training of motion policies in simulation. However, the numerous implementation details make…

Robotics · Computer Science 2025-06-19 Yushi Wang , Penghui Chen , Xinyu Han , Feng Wu , Mingguo Zhao

This paper presents an extension of the OpenAI Gym for robotics using the Robot Operating System (ROS) and the Gazebo simulator. The content discusses the software architecture proposed and the results obtained by using two Reinforcement…

Reinforcement learning has been successfully used to solve difficult tasks in complex unknown environments. However, these methods typically do not provide any safety guarantees during the learning process. This is particularly problematic,…

Systems and Control · Electrical Eng. & Systems 2019-07-02 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Joschka Boedecker , Andreas Krause

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

Safety is one of the key issues preventing the deployment of reinforcement learning techniques in real-world robots. While most approaches in the Safe Reinforcement Learning area do not require prior knowledge of constraints and robot…

Machine Learning · Computer Science 2024-09-24 Jonas Günster , Puze Liu , Jan Peters , Davide Tateo

OpenAI Gym is a toolkit for reinforcement learning (RL) research. It includes a large number of well-known problems that expose a common interface allowing to directly compare the performance results of different RL algorithms. Since many…

Networking and Internet Architecture · Computer Science 2018-10-11 Piotr Gawłowicz , Anatolij Zubow

Reinforcement learning (RL) has shown promising results in active flow control (AFC), yet progress in the field remains difficult to assess as existing studies rely on heterogeneous observation and actuation schemes, numerical setups, and…

Machine Learning · Computer Science 2026-05-28 Jannis Becktepe , Aleksandra Franz , Nils Thuerey , Sebastian Peitz

In addressing control problems such as regulation and tracking through reinforcement learning, it is often required to guarantee that the acquired policy meets essential performance and stability criteria such as a desired settling time and…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Francesco De Lellis , Marco Coraggio , Giovanni Russo , Mirco Musolesi , Mario di Bernardo

In recent years, advanced model-based and data-driven control methods are unlocking the potential of complex robotics systems, and we can expect this trend to continue at an exponential rate in the near future. However, ensuring safety with…

Robotics · Computer Science 2024-08-29 Gianni Lunardi , Asia La Rocca , Matteo Saveriano , Andrea Del Prete

Simulating physical systems is a core component of scientific computing, encompassing a wide range of physical domains and applications. Recently, there has been a surge in data-driven methods to complement traditional numerical simulations…

Machine Learning · Computer Science 2021-08-19 Karl Otness , Arvi Gjoka , Joan Bruna , Daniele Panozzo , Benjamin Peherstorfer , Teseo Schneider , Denis Zorin

Designing control policies for legged locomotion is complex due to the under-actuated and non-continuous robot dynamics. Model-free reinforcement learning provides promising tools to tackle this challenge. However, a major bottleneck of…

Robotics · Computer Science 2022-03-08 Tsung-Yen Yang , Tingnan Zhang , Linda Luu , Sehoon Ha , Jie Tan , Wenhao Yu