English
Related papers

Related papers: Dual Control for Approximate Bayesian Reinforcemen…

200 papers

Integrating measurements and historical data can enhance control systems through learning-based techniques, but ensuring performance and safety is challenging. Robust model predictive control strategies, like stochastic model predictive…

Systems and Control · Electrical Eng. & Systems 2023-03-28 J. Pohlodek , H. Alsmeier , B. Morabito , C. Schlauch , A. Savchenko , R. Findeisen

There has recently been an increased interest in reinforcement learning for nonlinear control problems. However standard reinforcement learning algorithms can often struggle even on seemingly simple set-point control problems. This paper…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattsson , Torbjörn Wigren

As we aim to control complex systems, use of a simulator in model-based reinforcement learning is becoming more common. However, it has been challenging to overcome the Reality Gap, which comes from nonlinear model bias and susceptibility…

Robotics · Computer Science 2017-05-16 Gilwoo Lee , Siddhartha S. Srinivasa , Matthew T. Mason

Autonomous learning has been a promising direction in control and robotics for more than a decade since data-driven learning allows to reduce the amount of engineering knowledge, which is otherwise required. However, autonomous…

Machine Learning · Statistics 2017-10-12 Marc Peter Deisenroth , Dieter Fox , Carl Edward Rasmussen

Research in reinforcement learning has produced algorithms for optimal decision making under uncertainty that fall within two main types. The first employs a Bayesian framework, where optimality improves with increased computational time.…

Machine Learning · Statistics 2011-09-22 Christos Dimitrakakis

Deep learning has enjoyed much recent success, and applying state-of-the-art model learning methods to controls is an exciting prospect. However, there is a strong reluctance to use these methods on safety-critical systems, which have…

Systems and Control · Electrical Eng. & Systems 2021-07-06 David D. Fan , Jennifer Nguyen , Rohan Thakker , Nikhilesh Alatur , Ali-akbar Agha-mohammadi , Evangelos A. Theodorou

We propose a model-based lifelong reinforcement-learning approach that estimates a hierarchical Bayesian posterior distilling the common structure shared across different tasks. The learned posterior combined with a sample-based Bayesian…

Machine Learning · Computer Science 2022-10-24 Haotian Fu , Shangqun Yu , Michael Littman , George Konidaris

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2022-12-05 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

We consider reinforcement learning (RL) in continuous time and study the problem of achieving the best trade-off between exploration of a black box environment and exploitation of current knowledge. We propose an entropy-regularized reward…

Optimization and Control · Mathematics 2019-02-14 Haoran Wang , Thaleia Zariphopoulou , Xunyu Zhou

Reinforcement learning (RL) and Deep Reinforcement Learning (DRL), in particular, have the potential to disrupt and are already changing the way we interact with the world. One of the key indicators of their applicability is their ability…

Machine Learning · Computer Science 2024-08-20 Nikolai Rozanov

Bayesian methods for machine learning have been widely investigated, yielding principled methods for incorporating prior information into inference algorithms. In this survey, we provide an in-depth review of the role of Bayesian methods…

Artificial Intelligence · Computer Science 2016-09-16 Mohammad Ghavamzadeh , Shie Mannor , Joelle Pineau , Aviv Tamar

A finite horizon optimal tracking problem is considered for linear dynamical systems subject to parametric uncertainties in the state-space matrices and exogenous disturbances. A suboptimal solution is proposed using a model predictive…

Optimization and Control · Mathematics 2022-02-08 Anilkumar Parsi , Andrea Iannelli , Roy S. Smith

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Bayesian reinforcement learning (RL) offers a principled and elegant approach for sequential decision making under uncertainty. Most notably, Bayesian agents do not face an exploration/exploitation dilemma, a major pathology of frequentist…

Machine Learning · Computer Science 2024-06-26 Mattie Fellows , Brandon Kaplowitz , Christian Schroeder de Witt , Shimon Whiteson

Continuous control Deep Reinforcement Learning (RL) approaches are known to suffer from estimation biases, leading to suboptimal policies. This paper introduces innovative methods in RL, focusing on addressing and exploiting estimation…

Machine Learning · Computer Science 2024-10-14 Niccolò Turcato , Alberto Sinigaglia , Alberto Dalla Libera , Ruggero Carli , Gian Antonio Susto

Learning-based methods have been successful in solving complex control tasks without significant prior knowledge about the system. However, these methods typically do not provide any safety guarantees, which prevents their use in…

Systems and Control · Computer Science 2018-11-08 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Andreas Krause

This paper studies the continuous-time reinforcement learning for stochastic singular control with the application to an infinite-horizon irreversible reinsurance problems. The singular control is equivalently characterized as a pair of…

Optimization and Control · Mathematics 2025-12-03 Zongxia Liang , Xiaodong Luo , Xiang Yu

Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. Although deep reinforcement learning…

Machine Learning · Computer Science 2026-03-11 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Optimal control of the future is the next frontier for AI. Current approaches to this problem are typically rooted in reinforcement learning (RL). RL is mathematically distinct from supervised learning, which has been the main workhorse for…

Machine Learning · Statistics 2026-05-06 Yuxin Bai , Aranyak Acharyya , Ashwin De Silva , Zeyu Shen , James Hassett , Joshua T. Vogelstein

Reinforcement learning methods are increasingly used to optimise dialogue policies from experience. Most current techniques are model-free: they directly estimate the utility of various actions, without explicit model of the interaction…

Artificial Intelligence · Computer Science 2013-04-09 Pierre Lison