English
Related papers

Related papers: Uncertainty-aware Contact-safe Model-based Reinfor…

200 papers

We introduce a Bayesian (deep) model-based reinforcement learning method (RoMBRL) that can capture model uncertainty to achieve sample-efficient policy optimisation. We propose to formulate the model-based policy optimisation problem as a…

Robotics · Computer Science 2021-01-06 Tai Hoang , Ngo Anh Vien

Learning has propelled the cutting edge of performance in robotic control to new heights, allowing robots to operate with high performance in conditions that were previously unimaginable. The majority of the work, however, assumes that the…

Robotics · Computer Science 2018-03-13 Christopher D. McKinnon , Angela P. Schoellig

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

Machine Learning · Computer Science 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider

The use of robotics in controlled environments has flourished over the last several decades and training robots to perform tasks using control strategies developed from dynamical models of their hardware have proven very effective. However,…

Robotics · Computer Science 2019-07-16 Zach Dwiel , Madhavun Candadai , Mariano Phielipp

In real-world tasks, reinforcement learning (RL) agents frequently encounter situations that are not present during training time. To ensure reliable performance, the RL agents need to exhibit robustness against worst-case situations. The…

Machine Learning · Computer Science 2021-03-19 Sebastian Curi , Ilija Bogunovic , Andreas Krause

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

Reinforcement learning is a promising approach to synthesizing policies for challenging robotics tasks. A key problem is how to ensure safety of the learned policy---e.g., that a walking robot does not fall over or that an autonomous car…

Machine Learning · Computer Science 2020-10-22 Osbert Bastani

Robust reinforcement learning (RL) is to find a policy that optimizes the worst-case performance over an uncertainty set of MDPs. In this paper, we focus on model-free robust RL, where the uncertainty set is defined to be centering at a…

Machine Learning · Computer Science 2021-10-29 Yue Wang , Shaofeng Zou

Action-constrained reinforcement learning (ACRL) is a generic framework for learning control policies with zero action constraint violation, which is required by various safety-critical and resource-constrained applications. The existing…

Machine Learning · Computer Science 2025-03-18 Wei Hung , Shao-Hua Sun , Ping-Chun Hsieh

Trajectory optimization with contact-rich behaviors has recently gained attention for generating diverse locomotion behaviors without pre-specified ground contact sequences. However, these approaches rely on precise models of robot dynamics…

Robotics · Computer Science 2020-09-29 Luke Drnach , Ye Zhao

Modern engineering systems, such as autonomous vehicles, flexible robotics, and intelligent aerospace platforms, require controllers that are robust to uncertainties, adaptive to environmental changes, and safety-aware under real-time…

Robotics · Computer Science 2025-12-16 Patrick Kostelac , Xuerui Wang , Anahita Jamshidnejad

Designing and analyzing model-based RL (MBRL) algorithms with guaranteed monotonic improvement has been challenging, mainly due to the interdependence between policy optimization and model learning. Existing discrepancy bounds generally…

Machine Learning · Computer Science 2023-11-09 Tianying Ji , Yu Luo , Fuchun Sun , Mingxuan Jing , Fengxiang He , Wenbing Huang

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

Machine Learning · Computer Science 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Distributionally Robust Reinforcement Learning (DR-RL) aims to derive a policy optimizing the worst-case performance within a predefined uncertainty set. Despite extensive research, previous DR-RL algorithms have predominantly favored…

Machine Learning · Computer Science 2024-06-26 Yudan Wang , Shaofeng Zou , Yue Wang

Reinforcement Learning from Verifiable Rewards (RLVR) suffers from exploration inefficiency, where models struggle to generate successful rollouts, resulting in minimal learning signal. This challenge is particularly severe for tasks that…

Machine Learning · Computer Science 2026-03-20 Saaket Agashe , Jayanth Srinivasa , Gaowen Liu , Ramana Kompella , Xin Eric Wang

Model information can be used to predict future trajectories, so it has huge potential to avoid dangerous region when implementing reinforcement learning (RL) on real-world tasks, like autonomous driving. However, existing studies mostly…

Robotics · Computer Science 2021-03-08 Haitong Ma , Jianyu Chen , Shengbo Eben Li , Ziyu Lin , Yang Guan , Yangang Ren , Sifa Zheng

Learning-based controllers are often purposefully kept out of real-world applications due to concerns about their safety and reliability. We explore how state-of-the-art world models in Model-Based Reinforcement Learning can be utilized…

Robotics · Computer Science 2025-03-05 Fabian Domberg , Georg Schildbach

Reinforcement learning (RL) is gaining attention by more and more researchers in quantitative finance as the agent-environment interaction framework is aligned with decision making process in many business problems. Most of the current…

Mathematical Finance · Quantitative Finance 2022-05-31 Huifang Huang , Ting Gao , Yi Gui , Jin Guo , Peng Zhang

Model Predictive Control (MPC)-based Reinforcement Learning (RL) offers a structured and interpretable alternative to Deep Neural Network (DNN)-based RL methods, with lower computational complexity and greater transparency. However,…

Systems and Control · Electrical Eng. & Systems 2025-07-15 Hossein Nejatbakhsh Esfahani , Javad Mohammadpour Velni

Imitation Learning has provided a promising approach to learning complex robot behaviors from expert demonstrations. However, learned policies can make errors that lead to safety violations, which limits their deployment in safety-critical…

Robotics · Computer Science 2025-08-06 Le Qiu , Yusuf Umut Ciftci , Somil Bansal