English
Related papers

Related papers: Model-Based Reinforcement Learning for Control und…

200 papers

For over a decade, model-based reinforcement learning has been seen as a way to leverage control-based domain knowledge to improve the sample-efficiency of reinforcement learning agents. While model-based agents are conceptually appealing,…

Machine Learning · Computer Science 2021-05-28 Brandon Amos , Samuel Stanton , Denis Yarats , Andrew Gordon Wilson

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

Machine Learning · Computer Science 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Learning policies which are robust to changes in the environment are critical for real world deployment of Reinforcement Learning agents. They are also necessary for achieving good generalization across environment shifts. We focus on…

Machine Learning · Computer Science 2023-06-08 Anuj Mahajan , Amy Zhang

Recent work in reinforcement learning has leveraged symmetries in the model to improve sample efficiency in training a policy. A commonly used simplifying assumption is that the dynamics and reward both exhibit the same symmetry; however,…

Machine Learning · Computer Science 2024-08-20 Yasin Sonmez , Neelay Junnarkar , Murat Arcak

This work shows that value-aware model learning, known for its numerous theoretical benefits, is also practically viable for solving challenging continuous control tasks in prevalent model-based reinforcement learning algorithms. First, we…

Machine Learning · Computer Science 2022-01-31 Nirbhay Modhe , Harish Kamath , Dhruv Batra , Ashwin Kalyan

Aerial manipulators undergo rapid, configuration-dependent changes in inertial coupling forces and aerodynamic forces, making accurate dynamics modeling a core challenge for reliable control. Analytical models lose fidelity under these…

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

Non-linear dynamical systems represent a compact, flexible, and robust tool for reactive motion generation. The effectiveness of dynamical systems relies on their ability to accurately represent stable motions. Several approaches have been…

Robotics · Computer Science 2020-06-01 Matteo Saveriano

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

Systems and Control · Computer Science 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

We draw on the latest advancements in the physics community to propose a novel method for discovering the governing non-linear dynamics of physical systems in reinforcement learning (RL). We establish that this method is capable of…

Machine Learning · Computer Science 2022-09-01 Rushiv Arora , Bruno Castro da Silva , Eliot Moss

Feedback-based control is the de-facto standard when it comes to controlling classical stochastic systems and processes. However, standard feedback-based control methods are challenged by quantum systems due to measurement induced…

Quantum Physics · Physics 2024-05-14 Kai Meinerz , Simon Trebst , Mark Rudner , Evert van Nieuwenburg

Approaches to keeping a dynamical system within state constraints typically rely on a model-based safety condition to limit the control signals. In the face of significant modeling uncertainty, the system can suffer from important…

Systems and Control · Electrical Eng. & Systems 2022-02-08 Marc-Antoine Beaudoin , Benoit Boulet

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

Learning auxiliary tasks, such as multiple predictions about the world, can provide many benefits to reinforcement learning systems. A variety of off-policy learning algorithms have been developed to learn such predictions, but as yet there…

Machine Learning · Computer Science 2022-02-24 Matthew McLeod , Chunlok Lo , Matthew Schlegel , Andrew Jacobsen , Raksha Kumaraswamy , Martha White , Adam White

In this paper we are introducing a new reinforcement learning method for control problems in environments with delayed feedback. Specifically, our method employs stochastic planning, versus previous methods that used deterministic planning.…

Machine Learning · Computer Science 2024-02-02 Zhiyuan Yao , Ionut Florescu , Chihoon Lee

Robust stability and stochastic stability have separately seen intense study in control theory for many decades. In this work we establish relations between these properties for discrete-time systems and employ them for robust control…

Dynamical Systems · Mathematics 2020-04-20 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

Modeling complex dynamical systems under varying conditions is computationally intensive, often rendering high-fidelity simulations intractable. Although reduced-order models (ROMs) offer a promising solution, current methods often struggle…

Machine Learning · Computer Science 2026-01-16 Andrew F. Ilersich , Kevin Course , Prasanth B. Nair

This paper introduces a continuous-time constrained nonlinear control scheme which implements a model predictive control strategy as a continuous-time dynamic system. The approach is based on the idea that the solution of the optimal…

Systems and Control · Computer Science 2017-09-20 Marco M. Nicotra , Dominic Liao-McPherson , Ilya V. Kolmanovsky