English
Related papers

Related papers: ContractionPPO: Certified Reinforcement Learning v…

200 papers

In safety-critical domains, reinforcement learning (RL) agents must often satisfy strict, zero-cost safety constraints while accomplishing tasks. Existing model-free methods frequently either fail to achieve near-zero safety violations or…

Machine Learning · Computer Science 2026-05-11 Dominik Wagner , Ankit Kanwar , Luke Ong

Deploying Reinforcement Learning (RL) agents in the real-world require that the agents satisfy safety constraints. Current RL agents explore the environment without considering these constraints, which can lead to damage to the hardware or…

Machine Learning · Computer Science 2021-03-17 Harshit Sikchi , Wenxuan Zhou , David Held

Legged robots have the potential to traverse complex terrain and access confined spaces beyond the reach of traditional platforms thanks to their ability to carefully select footholds and flexibly adapt their body posture while walking.…

Robotics · Computer Science 2024-03-04 Takahiro Miki , Joonho Lee , Lorenz Wellhausen , Marco Hutter

Compact quadrupedal robots are proving increasingly suitable for deployment in real-world scenarios. Their smaller size fosters easy integration into human environments. Nevertheless, real-time locomotion on uneven terrains remains…

Robotics · Computer Science 2026-02-20 Davide Plozza , Patricia Apostol , Paul Joseph , Simon Schläpfer , Michele Magno

Parkour poses a significant challenge for legged robots, requiring navigation through complex environments with agility and precision based on limited sensory inputs. In this work, we introduce a novel method for training end-to-end visual…

Robotics · Computer Science 2024-09-23 Elliot Chane-Sane , Joseph Amigo , Thomas Flayols , Ludovic Righetti , Nicolas Mansard

Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and…

Robotics · Computer Science 2024-03-07 Zifan Xu , Amir Hossain Raj , Xuesu Xiao , Peter Stone

Force control in hydraulic actuators is notoriously difficult due to strong nonlinearities, uncertainties, and the high risks associated with unsafe exploration during learning. This paper investigates safe reinforcement learning (RL) for…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Lucca Maitan , Lucas Toschi , Cícero Zanette , Elisa G. Vergamini , Leonardo F. Santos , Thiago Boaventura

We introduce Diffusion Policy Policy Optimization, DPPO, an algorithmic framework including best practices for fine-tuning diffusion-based policies (e.g. Diffusion Policy) in continuous control and robot learning tasks using the policy…

Robotic loco-manipulation tasks often involve contact-rich interactions with the environment, requiring the joint modeling of contact force and robot position. However, recent visuomotor policies often focus solely on learning position or…

Robotics · Computer Science 2025-10-07 Peiyuan Zhi , Peiyang Li , Jianqin Yin , Baoxiong Jia , Siyuan Huang

Reinforcement learning (RL) has re-emerged as a natural approach for training interactive LLM agents in real-world environments. However, directly applying the widely used Group Relative Policy Optimization (GRPO) algorithm to multi-turn…

Machine Learning · Computer Science 2026-01-27 Junbo Li , Peng Zhou , Rui Meng , Meet P. Vadera , Lihong Li , Yang Li

This paper proposes a data-driven method for learning convergent control policies from offline data using Contraction theory. Contraction theory enables constructing a policy that makes the closed-loop system trajectories inherently…

Machine Learning · Computer Science 2022-02-04 Navid Rezazadeh , Maxwell Kolarich , Solmaz S. Kia , Negar Mehr

Reinforcement learning (RL) in continuous state-action spaces remains challenging in scientific computing due to poor sample efficiency and lack of pathwise physical consistency. We introduce Differential Reinforcement Learning…

Machine Learning · Computer Science 2026-02-06 Minh Nguyen , Chandrajit Bajaj

As reinforcement learning (RL) has achieved great success and been even adopted in safety-critical domains such as autonomous vehicles, a range of empirical studies have been conducted to improve its robustness against adversarial attacks.…

Machine Learning · Computer Science 2022-03-17 Fan Wu , Linyi Li , Zijian Huang , Yevgeniy Vorobeychik , Ding Zhao , Bo Li

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

Trust region policy optimization (TRPO) is a popular and empirically successful policy search algorithm in Reinforcement Learning (RL) in which a surrogate problem, that restricts consecutive policies to be 'close' to one another, is…

Machine Learning · Computer Science 2019-12-13 Lior Shani , Yonathan Efroni , Shie Mannor

Safe Reinforcement Learning (RL) often faces significant issues such as constraint violations and instability, necessitating the use of constrained policy optimization, which seeks optimal policies while ensuring adherence to specific…

Machine Learning · Computer Science 2025-08-07 Ning Yang , Pengyu Wang , Guoqing Liu , Haifeng Zhang , Pin Lv , Jun Wang

Traditional portfolio management methods can incorporate specific investor preferences but rely on accurate forecasts of asset returns and covariances. Reinforcement learning (RL) methods do not rely on these explicit forecasts and are…

Portfolio Management · Quantitative Finance 2022-03-23 Ruan Pretorius , Terence van Zyl

Reinforcement Learning (RL) robot controllers usually aggregate many task objectives into one scalar reward. While large-scale proximal policy optimisation (PPO) has enabled impressive results such as robust robot locomotion in the real…

Robotics · Computer Science 2025-09-19 Humphrey Munn , Brendan Tidd , Peter Böhm , Marcus Gallagher , David Howard

Reinforcement learning (RL), driven by data-driven methods, has become an effective solution for robot leg motion control problems. However, the mainstream RL methods for bipedal robot terrain traversal, such as teacher-student policy…

Robotics · Computer Science 2025-08-05 Haodong Huang , Shilong Sun , Yuanpeng Wang , Chiyao Li , Hailin Huang , Wenfu Xu