English
Related papers

Related papers: Incorporating Recurrent Reinforcement Learning int…

200 papers

This paper presents an approach for learning Model Predictive Control (MPC) schemes directly from data using Reinforcement Learning (RL) methods. The state-of-the-art learning methods use RL to improve the performance of parameterized MPC…

Systems and Control · Electrical Eng. & Systems 2023-01-05 Shambhuraj Sawant , Akhil S Anand , Dirk Reinhardt , Sebastien Gros

In real-world reinforcement learning (RL) scenarios, agents often encounter partial observability, where incomplete or noisy information obscures the true state of the environment. Partially Observable Markov Decision Processes (POMDPs) are…

Machine Learning · Computer Science 2025-05-19 Ashok Arora , Neetesh Kumar

As autonomous vehicles move from a simplified research setting to practical use, there exists a large gap between the dynamic behavior of a human driving and an autonomous system. Risk-aware behavior needs to naturally develop in order to…

Robotics · Computer Science 2026-05-14 Jason Gibson , Bogdan Vlahov , Patrick Spieler , Evangelos A. Theodorou

Model predictive control (MPC) is a popular approach for trajectory optimization in practical robotics applications. MPC policies can optimize trajectory parameters under kinodynamic and safety constraints and provide guarantees on safety,…

Robotics · Computer Science 2023-06-08 Returaj Burnwal , Anirban Santara , Nirav P. Bhatt , Balaraman Ravindran , Gaurav Aggarwal

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

Automated vehicles are gradually entering people's daily life to provide a comfortable driving experience for the users. The generic and user-agnostic automated vehicles have limited ability to accommodate the different driving styles of…

Human-Computer Interaction · Computer Science 2022-08-18 Shili Sheng , Erfan Pakdamanian , Kyungtae Han , Ziran Wang , Lu Feng

Model Predictive Control (MPC) is a method to control nonlinear systems with guaranteed stability and constraint satisfaction but suffers from high computation times. Approximate MPC (AMPC) with neural networks (NNs) has emerged to address…

Systems and Control · Electrical Eng. & Systems 2024-09-24 Henrik Hose , Alexander Gräfe , Sebastian Trimpe

As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a…

Systems and Control · Electrical Eng. & Systems 2021-09-14 Robert Dyro , James Harrison , Apoorva Sharma , Marco Pavone

Continuous state spaces and stochastic, switching dynamics characterize a number of rich, realworld domains, such as robot navigation across varying terrain. We describe a reinforcementlearning algorithm for learning in these domains and…

Machine Learning · Computer Science 2012-06-18 Emma Brunskill , Bethany Leffler , Lihong Li , Michael L. Littman , Nicholas Roy

Efficient exploration has presented a long-standing challenge in reinforcement learning, especially when rewards are sparse. A developmental system can overcome this difficulty by learning from both demonstrations and self-exploration.…

Machine Learning · Computer Science 2021-02-19 Siqing Hou , Dongqi Han , Jun Tani

How can a robot safely navigate around people with complex motion patterns? Deep Reinforcement Learning (DRL) in simulation holds some promise, but much prior work relies on simulators that fail to capture the nuances of real human motion.…

Robotics · Computer Science 2025-02-17 James R. Han , Hugues Thomas , Jian Zhang , Nicholas Rhinehart , Timothy D. Barfoot

This work presents a distributed algorithm for resolving cooperative multi-vehicle conflicts in highly constrained spaces. By formulating the conflict resolution problem as a Multi-Agent Reinforcement Learning (RL) problem, we can train a…

Robotics · Computer Science 2023-02-06 Xu Shen , Francesco Borrelli

Real-world sequential decision making problems commonly involve partial observability, which requires the agent to maintain a memory of history in order to infer the latent states, plan and make good decisions. Coping with partial…

Machine Learning · Computer Science 2022-02-09 Yonathan Efroni , Chi Jin , Akshay Krishnamurthy , Sobhan Miryoosefi

The agent learns to organize decision behavior to achieve a behavioral goal, such as reward maximization, and reinforcement learning is often used for this optimization. Learning an optimal behavioral strategy is difficult under the…

Machine Learning · Computer Science 2023-05-09 Kazuki Takahashi , Tomoki Fukai , Yutaka Sakai , Takashi Takekawa

Rapid online adaptation to changing tasks is an important problem in machine learning and, recently, a focus of meta-reinforcement learning. However, reinforcement learning (RL) algorithms struggle in POMDP environments because the state of…

Neural and Evolutionary Computing · Computer Science 2020-04-29 Eseoghene Ben-Iwhiwhu , Pawel Ladosz , Jeffery Dick , Wen-Hua Chen , Praveen Pilly , Andrea Soltoggio

We model, simulate and control the guiding problem for a herd of evaders under the action of repulsive drivers. The problem is formulated in an optimal control framework, where the drivers (controls) aim to guide the evaders (states) to a…

Optimization and Control · Mathematics 2020-05-01 Dongnam Ko , Enrique Zuazua

A model predictive control (MPC) scheme for a permanent-magnet synchronous motor (PMSM) is presented. The torque controller optimizes a quadratic cost consisting of control error and machine losses repeatedly, accounting the voltage and…

Systems and Control · Computer Science 2013-01-01 Jean-Francois Stumper , Alexander Dötlinger , Ralph Kennel

Model predictive control (MPC) is an optimal control strategy where control input calculation is based on minimizing the predicted tracking error over a finite horizon that moves with time. This strategy has an advantage over conventional…

Systems and Control · Electrical Eng. & Systems 2021-12-28 Joseph Chai , Eran Medagoda , Erkan Kayacan

This paper presents the development and implementation of a Model Predictive Control (MPC) framework for trajectory tracking in autonomous vehicles under diverse driving conditions. The proposed approach incorporates a modular architecture…

Robotics · Computer Science 2025-06-06 Nitish Kumar , Rajalakshmi Pachamuthu

In this review/tutorial article, we present recent progress on optimal control of partially observed Markov Decision Processes (POMDPs). We first present regularity and continuity conditions for POMDPs and their belief-MDP reductions, where…

Optimization and Control · Mathematics 2025-01-03 Ali Devran Kara , Serdar Yuksel