English
Related papers

Related papers: Simple Policy Evaluation for Data-Rich Iterative T…

200 papers

An iterative learning based economic model predictive controller (ILEMPC) is proposed for repetitive tasks in this paper. Compared with existing works, the initial feasible trajectory of the proposed ILEMPC is not restricted to be…

Systems and Control · Computer Science 2018-02-13 Yushen Long , Lihua Xie , Shuai Liu

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

Value-based methods for reinforcement learning lack generally applicable ways to derive behavior from a value function. Many approaches involve approximate value iteration (e.g., $Q$-learning), and acting greedily with respect to the…

Machine Learning · Computer Science 2020-08-27 Alan Chan , Kris de Asis , Richard S. Sutton

This paper proposes an Adaptive Learning Model Predictive Control strategy for uncertain constrained linear systems performing iterative tasks. The additive uncertainty is modeled as the sum of a bounded process noise and an unknown…

Systems and Control · Computer Science 2018-04-27 Monimoy Bujarbaruah , Xiaojing Zhang , Ugo Rosolia , Francesco Borrelli

We present a decentralized minimum-time trajectory optimization scheme based on learning model predictive control for multi-agent systems with nonlinear decoupled dynamics and coupled state constraints. By performing the same task…

Systems and Control · Electrical Eng. & Systems 2020-12-21 Edward L. Zhu , Yvonne R. Stürz , Ugo Rosolia , Francesco Borrelli

When deploying autonomous agents in unstructured environments over sustained periods of time, adaptability and robustness oftentimes outweigh optimality as a primary consideration. In other words, safety and survivability constraints play a…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Motoya Ohnishi , Gennaro Notomista , Masashi Sugiyama , Magnus Egerstedt

We present an approach for safe trajectory planning, where a strategic task related to autonomous racing is learned sample-efficient within a simulation environment. A high-level policy, represented as a neural network, outputs a reward…

Robotics · Computer Science 2022-12-06 Rudolf Reiter , Jasper Hoffmann , Joschka Boedecker , Moritz Diehl

We tackle the issue of finding a good policy when the number of policy updates is limited. This is done by approximating the expected policy reward as a sequence of concave lower bounds which can be efficiently maximized, drastically…

Artificial Intelligence · Computer Science 2016-12-30 Nicolas Le Roux

This paper addresses the problem of learning the optimal control policy for a nonlinear stochastic dynamical system with continuous state space, continuous action space and unknown dynamics. This class of problems are typically addressed in…

Machine Learning · Computer Science 2019-04-18 Ran Wang , Karthikeya Parunandi , Dan Yu , Dileep Kalathil , Suman Chakravorty

In this paper we present a Learning Model Predictive Controller (LMPC) for autonomous racing. We model the autonomous racing problem as a minimum time iterative control task, where an iteration corresponds to a lap. In the proposed approach…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Ugo Rosolia , Francesco Borrelli

For safe and efficient planning and control in autonomous driving, we need a driving policy which can achieve desirable driving quality in long-term horizon with guaranteed safety and feasibility. Optimization-based approaches, such as…

Artificial Intelligence · Computer Science 2017-07-11 Liting Sun , Cheng Peng , Wei Zhan , Masayoshi Tomizuka

An important question in data-driven control is how to obtain an informative dataset. In this work, we consider the problem of effective data acquisition of an unknown linear system with bounded disturbance for both open-loop and…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Shilun Feng , Dawei Shi , Yang Shi , Kaikai Zheng

This article proposes a hierarchical learning architecture for safe data-driven control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control…

Systems and Control · Electrical Eng. & Systems 2021-07-15 Charlott Vallon , Francesco Borrelli

This paper presents policy-based motion planning for robotic systems. The motion planning literature has been mostly focused on open-loop trajectory planning which is followed by tracking online. In contrast, we solve the problem of path…

Robotics · Computer Science 2024-01-08 Guoxiang Zhao , Devesh K. Jha , Yebin Wang , Minghui Zhu

This paper presents a new fast and robust algorithm that provides fuel-optimal impulsive control input sequences that drive a linear time-variant system to a desired state at a specified time. This algorithm is applicable to a broad class…

Optimization and Control · Mathematics 2020-10-06 Adam W. Koenig , Simone D'Amico

In this paper we present a Learning Model Predictive Control (LMPC) strategy for linear and nonlinear time optimal control problems. Our work builds on existing LMPC methodologies and it guarantees finite time convergence properties for the…

Systems and Control · Electrical Eng. & Systems 2020-10-06 Ugo Rosolia , Francesco Borrelli

This work introduces a novel control strategy called Iterative Linear Quadratic Regulator for Iterative Tasks (i2LQR), which aims to improve closed-loop performance with local trajectory optimization for iterative tasks in a dynamic…

Systems and Control · Electrical Eng. & Systems 2023-09-08 Yifan Zeng , Suiyi He , Han Hoang Nguyen , Yihan Li , Zhongyu Li , Koushil Sreenath , Jun Zeng

This paper proposes an iterative distributionally robust model predictive control (MPC) scheme to solve a risk-constrained infinite-horizon optimal control problem. In each iteration, the algorithm generates a trajectory from the starting…

Optimization and Control · Mathematics 2023-08-23 Alireza Zolanvari , Ashish Cherukuri

Traditional dynamic models of continuum robots are in general computationally expensive and not suitable for real-time control. Recent approaches using learning-based methods to approximate the dynamic model of continuum robots for control…

Robotics · Computer Science 2022-05-16 Xinran Wang , Nicolas Rojas

Multi-Objective Learning Model Predictive Control is a novel data-driven control scheme which improves a linear system's closed-loop performance with respect to several convex control objectives over iterations of a repeated task. At each…

Systems and Control · Electrical Eng. & Systems 2024-10-21 Siddharth H. Nair , Charlott Vallon , Francesco Borrelli