English
Related papers

Related papers: Learning Robust Controllers Via Probabilistic Mode…

200 papers

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

The linear quadratic regulator (LQR) problem has reemerged as an important theoretical benchmark for reinforcement learning-based control of complex dynamical systems with continuous state and action spaces. In contrast with nearly all…

Machine Learning · Computer Science 2020-05-04 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

Safety is one of the biggest concerns to applying reinforcement learning (RL) to the physical world. In its core part, it is challenging to ensure RL agents persistently satisfy a hard state constraint without white-box or black-box…

Robotics · Computer Science 2023-10-19 Weiye Zhao , Tairan He , Changliu Liu

In this paper, we present a robotic model-based reinforcement learning method that combines ideas from model identification and model predictive control. We use a feature-based representation of the dynamics that allows the dynamics model…

Machine Learning · Computer Science 2016-03-16 Christopher Xie , Sachin Patil , Teodor Moldovan , Sergey Levine , Pieter Abbeel

In many contemporary applications such as healthcare, finance, robotics, and recommendation systems, continuous deployment of new policies for data collection and online learning is either cost ineffective or impractical. We consider a…

Machine Learning · Computer Science 2021-06-07 DiJia Su , Jason D. Lee , John M. Mulvey , H. Vincent Poor

We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Filippo Airaldi , Bart De Schutter , Azita Dabiri

In this paper, we continue our prior work on using imitation learning (IL) and model free reinforcement learning (RL) to learn driving policies for autonomous driving in urban scenarios, by introducing a model based RL method to drive the…

Robotics · Computer Science 2020-05-12 Zhuo Xu , Jianyu Chen , Masayoshi Tomizuka

The Robust Markov Decision Process (RMDP) framework focuses on designing control policies that are robust against the parameter uncertainties due to the mismatches between the simulator model and real-world settings. An RMDP problem is…

Machine Learning · Computer Science 2022-05-17 Kishan Panaganti , Dileep Kalathil

Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Lukas Beckenbach , Pavel Osinenko , Stefan Streif

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

Offline reinforcement learning provides a viable approach to obtain advanced control strategies for dynamical systems, in particular when direct interaction with the environment is not available. In this paper, we introduce a conceptual…

Machine Learning · Computer Science 2024-01-04 Marc Weber , Phillip Swazinna , Daniel Hein , Steffen Udluft , Volkmar Sterzing

Deep reinforcement learning agents for continuous control are known to exhibit significant instability in their performance over time. In this work, we provide a fresh perspective on these behaviors by studying the return landscape: the…

Machine Learning · Computer Science 2024-04-12 Nate Rahn , Pierluca D'Oro , Harley Wiltzer , Pierre-Luc Bacon , Marc G. Bellemare

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

Machine Learning · Computer Science 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

Learning robust and generalizable world models is crucial for enabling efficient and scalable robotic control in real-world environments. In this work, we introduce a novel framework for learning world models that accurately capture…

Robotics · Computer Science 2025-12-16 Chenhao Li , Andreas Krause , Marco Hutter

Model-based Reinforcement Learning (RL) is a popular learning paradigm due to its potential sample efficiency compared to model-free RL. However, existing empirical model-based RL approaches lack the ability to explore. This work studies a…

Machine Learning · Computer Science 2021-07-16 Yuda Song , Wen Sun

We present a reinforcement learning (RL) framework in which the learned policy comes with a machine-checkable certificate of provable adversarial robustness. Our approach, called CAROL, learns a model of the environment. In each learning…

Machine Learning · Computer Science 2023-05-30 Chenxi Yang , Greg Anderson , Swarat Chaudhuri

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

Machine Learning · Computer Science 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

Model-based offline optimization with dynamics-aware policy provides a new perspective for policy learning and out-of-distribution generalization, where the learned policy could adapt to different dynamics enumerated at the training stage.…

Machine Learning · Computer Science 2022-06-09 Chengxing Jia , Hao Yin , Chenxiao Gao , Tian Xu , Lei Yuan , Zongzhang Zhang , Yang Yu

Deep reinforcement learning has the potential to address various scientific problems. In this paper, we implement an optics simulation environment for reinforcement learning based controllers. The environment captures the essence of…

Machine Learning · Computer Science 2023-10-03 Abulikemu Abuduweili , Changliu Liu

Model-based planners and controllers are commonly used to solve complex manipulation problems as they can efficiently optimize diverse objectives and generalize to long horizon tasks. However, they often fail during deployment due to noisy…

Robotics · Computer Science 2025-03-10 Shivam Vats , Devesh K. Jha , Maxim Likhachev , Oliver Kroemer , Diego Romeres