English
Related papers

Related papers: Policy Gradient Reinforcement Learning for Uncerta…

200 papers

The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning…

Robotics · Computer Science 2022-07-21 Jaeuk Shin , Astghik Hakobyan , Mingyu Park , Yeoneung Kim , Gihun Kim , Insoon Yang

In this paper, we tackle the problem of Unmanned Aerial (UA V) path planning in complex and uncertain environments by designing a Model Predictive Control (MPC), based on a Long-Short-Term Memory (LSTM) network integrated into the Deep…

Machine Learning · Computer Science 2023-03-08 Mahya Ramezani , Hamed Habibi , Jose luis Sanchez Lopez , Holger Voos

The rising presence of autonomous vehicles (AVs) on public roads necessitates the development of advanced control strategies that account for the unpredictable nature of human-driven vehicles (HVs). This study introduces a learning-based…

Robotics · Computer Science 2024-04-09 Jie Wang , Yash Vardhan Pant , Zhihao Jiang

Learning-based approaches to verifying unknown Markov decision processes (MDPs) often employ uncertain MDPs. These models use, for example, confidence intervals to capture transition uncertainty and allow synthesis of policies that are…

Machine Learning · Computer Science 2026-05-05 Yannik Schnitzer , Alessandro Abate , David Parker

In this work we address the problem of performing a repetitive task when we have uncertain observations and dynamics. We formulate this problem as an iterative infinite horizon optimal control problem with output feedback. Previously, this…

Systems and Control · Electrical Eng. & Systems 2021-10-04 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

We propose a control design method for linear time-invariant systems that iteratively learns to satisfy unknown polyhedral state constraints. At each iteration of a repetitive task, the method constructs an estimate of the unknown…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Charlott Vallon , Francesco Borrelli

We propose an approach to design a Model Predictive Controller (MPC) for constrained Linear Time Invariant systems performing an iterative task. The system is subject to an additive disturbance, and the goal is to learn to satisfy state and…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Akhil Shetty , Kameshwar Poolla , Francesco Borrelli

As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a…

Systems and Control · Electrical Eng. & Systems 2021-09-14 Robert Dyro , James Harrison , Apoorva Sharma , Marco Pavone

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad

In this paper, we investigate a hybrid scheme that combines nonlinear model predictive control (MPC) and model-based reinforcement learning (RL) for navigation planning of an autonomous model car across offroad, unstructured terrains…

Robotics · Computer Science 2023-10-03 Faraz Lotfi , Khalil Virji , Farnoosh Faraji , Lucas Berry , Andrew Holliday , David Meger , Gregory Dudek

A robust Learning Model Predictive Controller (LMPC) for uncertain systems performing iterative tasks is presented. At each iteration of the control task the closed-loop state, input and cost are stored and used in the controller design.…

Systems and Control · Electrical Eng. & Systems 2021-07-06 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

This paper addresses the problem of learning control policies for mobile robots, modeled as unknown Markov Decision Processes (MDPs), that are tasked with temporal logic missions, such as sequencing, coverage, or surveillance. The MDP…

Robotics · Computer Science 2022-07-13 Yiannis Kantaros

We present a direct data-driven approach to synthesize robust control invariant (RCI) sets and their associated gain-scheduled feedback control laws for linear parameter-varying (LPV) systems subjected to bounded disturbances. A data-set…

Systems and Control · Electrical Eng. & Systems 2023-11-06 Manas Mejari , Ankit Gupta , Dario Piga

Model predictive control (MPC) is widely used for path tracking of autonomous vehicles due to its ability to handle various types of constraints. However, a considerable predictive error exists because of the error of mathematics model or…

Robotics · Computer Science 2020-07-21 Chaoyang Jiang , Hanqing Tian , Jibin Hu , Jiankun Zhai , Chao Wei , Jun Ni

This paper investigates the problem of robust model predictive control (RMPC) of linear-time-invariant (LTI) discrete-time systems subject to structured uncertainty and bounded disturbances. Typically, the constrained RMPC problem with…

Systems and Control · Electrical Eng. & Systems 2022-08-18 Anastasis Georgiou , Furqan Tahir , Imad M. Jaimoukha , Simos A. Evangelou

Model-based policy optimization often struggles with inaccurate system dynamics models, leading to suboptimal closed-loop performance. This challenge is especially evident in Model Predictive Control (MPC) policies, which rely on the model…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Riccardo Zuliani , Efe C. Balta , John Lygeros

Nonlinear model predictive control (MPC) is a flexible and increasingly popular framework used to synthesize feedback control strategies that can satisfy both state and control input constraints. In this framework, an optimization problem,…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Kong Yao Chee , M. Ani Hsieh , Nikolai Matni

We propose a computationally efficient Learning Model Predictive Control (LMPC) scheme for constrained optimal control of a class of nonlinear systems where the state and input can be reconstructed using lifted outputs. For the considered…

Optimization and Control · Mathematics 2021-01-19 Siddharth H. Nair , Ugo Rosolia , Francesco Borrelli

Explicit model-predictive control (MPC) is a widely used control design method that employs optimization tools to find control policies offline; commonly it is posed as a semi-definite program (SDP) or as a mixed-integer SDP in the case of…

Robotics · Computer Science 2023-07-25 Oleg Balakhnov , Sergei Savin , Alexandr Klimchik

While MPC enables nonlinear feedback control by solving an optimal control problem at each timestep, the computational burden tends to be significantly large, making it difficult to optimize a policy within the control period. To address…

Robotics · Computer Science 2024-10-10 Mitsuki Morita , Satoshi Yamamori , Satoshi Yagi , Norikazu Sugimoto , Jun Morimoto