English
Related papers

Related papers: Incorporating Recurrent Reinforcement Learning int…

200 papers

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

One major issue in learning-based model predictive control (MPC) for autonomous driving is the contradiction between the system model's prediction accuracy and computation efficiency. The more situations a system model covers, the more…

Robotics · Computer Science 2023-04-11 Kang Zhao , Jianru Xue , Xiangning Meng , Gengxin Li , Mengsen Wu

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

Lane change in dense traffic typically requires the recognition of an appropriate opportunity for maneuvers, which remains a challenging problem in self-driving. In this work, we propose a chance-aware lane-change strategy with high-level…

Robotics · Computer Science 2024-02-19 Yubin Wang , Yulin Li , Zengqi Peng , Hakim Ghazzai , Jun Ma

Model predictive control (MPC) is an effective method for controlling robotic systems, particularly autonomous aerial vehicles such as quadcopters. However, application of MPC can be computationally demanding, and typically requires…

Machine Learning · Computer Science 2016-02-17 Tianhao Zhang , Gregory Kahn , Sergey Levine , Pieter Abbeel

Model-Predictive Control (MPC) is a powerful tool for controlling complex, real-world systems that uses a model to make predictions about future behavior. For each state encountered, MPC solves an online optimization problem to choose a…

Machine Learning · Computer Science 2021-04-15 Mohak Bhardwaj , Sanjiban Choudhury , Byron Boots

Partially Observable Markov Decision Processes (POMDPs) can model complex sequential decision-making problems under stochastic and uncertain environments. A main reason hindering their broad adoption in real-world applications is the lack…

In this paper, we propose a new model predictive control (MPC) formulation for autonomous driving. The novelty of our MPC stems from the following results. Firstly, we adopt an alternating minimization approach wherein linear velocities and…

Traffic signal control is an important problem in urban mobility with a significant potential of economic and environmental impact. While there is a growing interest in Reinforcement Learning (RL) for traffic signal control, the work so far…

Artificial Intelligence · Computer Science 2022-12-13 Mayuresh Kunjir , Sanjay Chawla

Reinforcement Learning (RL) has recently impressed the world with stunning results in various applications. While the potential of RL is now well-established, many critical aspects still need to be tackled, including safety and stability…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Mario Zanon , Sébastien Gros

Sampling-based Model Predictive Control (MPC) is a flexible control framework that can reason about non-smooth dynamics and cost functions. Recently, significant work has focused on the use of machine learning to improve the performance of…

Robotics · Computer Science 2022-12-07 Jacob Sacks , Byron Boots

Planning plays an important role in the broad class of decision theory. Planning has drawn much attention in recent work in the robotics and sequential decision making areas. Recently, Reinforcement Learning (RL), as an agent-environment…

Artificial Intelligence · Computer Science 2016-08-18 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Cooperative control of groups of autonomous vehicles (AVs), i.e., platoons, is a promising direction to improving the efficiency of autonomous transportation systems. In this context, distributed co-optimization of both vehicle speed and…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Samuel Mallick , Gianpietro Battocletti , Dimitris Boskos , Azita Dabiri , Bart De Schutter

We propose an iterative approach for designing Robust Learning Model Predictive Control (LMPC) policies for a class of nonlinear systems with additive, unmodelled dynamics. The nominal dynamics are assumed to be difference flat, i.e., the…

Systems and Control · Electrical Eng. & Systems 2023-03-23 Siddharth H. Nair , Francesco Borrelli

State of the art methods for target tracking with sensor management (or controlled sensing) are model-based and are obtained through solutions to Partially Observable Markov Decision Process (POMDP) formulations. In this paper a…

Signal Processing · Electrical Eng. & Systems 2024-07-22 Adarsh M. Subramaniam , Argyrios Gerogiannis , James Z. Hare , Venugopal V. Veeravalli

This paper presents an auto-optimal model predictive control (MPC) framework enhanced with active learning, designed to autonomously track optimal operational conditions in an unknown environment,where the conditions may dynamically adjust…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Yuan Tan , Jun Yang , Zhongguo Li , Wen-Hua Chen , Shihua Li

Driverless vehicles are complex systems operating in constantly changing environments. Automated driving is achieved by controlling the coupled longitudinal and lateral vehicle dynamics. Model predictive control is one of the most promising…

Optimization and Control · Mathematics 2025-09-25 Yassine Kebbati , Naima Ait-Oufroukh , Vicenç Puig , Vincent Vigneron , Dalil Ichalal

In applications of offline reinforcement learning to observational data, such as in healthcare or education, a general concern is that observed actions might be affected by unobserved factors, inducing confounding and biasing estimates…

Machine Learning · Computer Science 2023-03-24 Andrew Bennett , Nathan Kallus

This paper addresses the problem of training a reinforcement learning (RL) policy under partial observability by exploiting a privileged, anytime-feasible planner agent available exclusively during training. We formalize this as a Partially…

Machine Learning · Computer Science 2026-04-10 Mohsen Amiri , Mohsen Amiri , Ali Beikmohammadi , Sindri Magnuśson , Mehdi Hosseinzadeh

This paper proposes a reinforcement learning method for controller synthesis of autonomous systems in unknown and partially-observable environments with subjective time-dependent safety constraints. Mathematically, we model the system…

Robotics · Computer Science 2021-04-06 Yu Wang , Alper Kamil Bozkurt , Miroslav Pajic