English
Related papers

Related papers: Information Theoretic Model Predictive Q-Learning

200 papers

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

This paper presents a novel approach to multi-agent reinforcement learning (RL) for linear systems with convex polytopic constraints. Existing work on RL has demonstrated the use of model predictive control (MPC) as a function approximator…

Systems and Control · Electrical Eng. & Systems 2025-01-06 Samuel Mallick , Filippo Airaldi , Azita Dabiri , Bart De Schutter

A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is…

Systems and Control · Electrical Eng. & Systems 2019-11-21 Anilkumar Parsi , Andrea Iannelli , Mingzhou Yin , Mohammad Khosravi , Roy S. Smith

Modern engineering systems, such as autonomous vehicles, flexible robotics, and intelligent aerospace platforms, require controllers that are robust to uncertainties, adaptive to environmental changes, and safety-aware under real-time…

Robotics · Computer Science 2025-12-16 Patrick Kostelac , Xuerui Wang , Anahita Jamshidnejad

This paper investigates the problem of robust model predictive control (RMPC) of linear-time-invariant (LTI) discrete-time systems subject to structured uncertainty and bounded disturbances. Typically, the constrained RMPC problem with…

Systems and Control · Electrical Eng. & Systems 2022-08-18 Anastasis Georgiou , Furqan Tahir , Imad M. Jaimoukha , Simos A. Evangelou

Optimal decision making with limited or no information in stochastic environments where multiple agents interact is a challenging topic in the realm of artificial intelligence. Reinforcement learning (RL) is a popular approach for arriving…

Machine Learning · Computer Science 2019-01-08 Roi Ceren

Robust model predictive control (MPC) is a well-known control technique for model-based control with constraints and uncertainties. In classic robust tube-based MPC approaches, an open-loop control sequence is computed via periodically…

Systems and Control · Electrical Eng. & Systems 2022-06-13 Xinglong Zhang , Jiahang Liu , Xin Xu , Shuyou Yu , Hong Chen

The contribution of this paper is a framework for training and evaluation of Model Predictive Control (MPC) implemented using constrained neural networks. Recent studies have proposed to use neural networks with differentiable convex…

Machine Learning · Statistics 2020-05-11 Rebecka Winqvist , Arun Venkitaraman , Bo Wahlberg

We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and…

Machine Learning · Computer Science 2023-09-12 Marin Vlastelica , Sebastian Blaes , Cristina Pineri , Georg Martius

Large-scale ride-hailing systems often combine real-time routing at the individual request level with a macroscopic Model Predictive Control (MPC) optimization for dynamic pricing and vehicle relocation. The MPC relies on a demand forecast…

Artificial Intelligence · Computer Science 2021-11-08 Enpeng Yuan , Pascal Van Hentenryck

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

Model predictive control (MPC) for linear systems with quadratic costs and linear constraints is shown to admit an exact representation as an implicit neural network. A method to "unravel" the implicit neural network of MPC into an explicit…

Systems and Control · Electrical Eng. & Systems 2024-04-19 Ross Drummond , Pablo R Baldivieso-Monasterios , Giorgio Valmorbida

Co-optimization of both vehicle speed and gear position via model predictive control (MPC) has been shown to offer benefits for fuel-efficient autonomous driving. However, optimizing both the vehicle's continuous dynamics and discrete gear…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Samuel Mallick , Gianpietro Battocletti , Qizhang Dong , Azita Dabiri , Bart De Schutter

Deterministic model predictive control (MPC), while powerful, is often insufficient for effectively controlling autonomous systems in the real-world. Factors such as environmental noise and model error can cause deviations from the expected…

Optimization and Control · Mathematics 2024-07-29 Alex Oshin , Hassan Almubarak , Evangelos A. Theodorou

One of the main challenges in modern control applications, particularly in robot and vehicle motion control, is achieving accurate, fast, and safe movement. To address this, optimal control policies have been developed to enforce safety…

We study inverse reinforcement learning (IRL) and imitation learning (IM), the problems of recovering a reward or policy function from expert's demonstrated trajectories. We propose a new way to improve the learning process by adding a…

Machine Learning · Computer Science 2022-08-23 The Viet Bui , Tien Mai , Patrick Jaillet

Robust reinforcement learning (RRL) aims at seeking a robust policy to optimize the worst case performance over an uncertainty set of Markov decision processes (MDPs). This set contains some perturbed MDPs from a nominal MDP (N-MDP) that…

Machine Learning · Computer Science 2023-11-21 Ukjo Hwang , Songnam Hong

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

Machine Learning · Computer Science 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang