English
Related papers

Related papers: Adaptive Variants of Optimal Feedback Policies

200 papers

We study deterministic, discrete linear time-invariant systems with infinite-horizon discounted quadratic cost. It is well-known that standard stabilizability and detectability properties are not enough in general to conclude stability…

Optimization and Control · Mathematics 2025-09-04 Jonathan de Brusse , Jamal Daafouz , Mathieu Granzotto , Romain Postoyan , Dragan Nesic

The objective of this research is to enable safety-critical systems to simultaneously learn and execute optimal control policies in a safe manner to achieve complex autonomy. Learning optimal policies via trial and error, i.e., traditional…

Systems and Control · Electrical Eng. & Systems 2022-04-05 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

This paper deals with the tracking control problem for a class of unknown pure feedback system with pure state constraints on the state variables and unknown time-varying bounded disturbances. An adaptive controller is presented for such…

Systems and Control · Electrical Eng. & Systems 2022-10-11 Pankaj Kumar Mishra , Nishchal K Verma

The growing complexity of modern control tasks calls for controllers that can react online as objectives and disturbances change, while preserving closed-loop stability. Recent approaches for improving the performance of nonlinear systems…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Danilo Saccani , Luca Furieri , Giancarlo Ferrari-Trecate

This work is concerned with solving neural network-based feedback controllers efficiently for optimal control problems. We first conduct a comparative study of two prevalent approaches: offline supervised learning and online direct policy…

Optimization and Control · Mathematics 2024-04-10 Yue Zhao , Jiequn Han

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

Machine Learning · Computer Science 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli

In this paper, the inverse reinforcement learning (IRL) problem is addressed to reconstruct the unknown cost function underlying an observed optimal policy in a model-free manner, whose online adaptation with completely off-policy system…

Optimization and Control · Mathematics 2025-11-20 Yibei Li , Yuexin Cao , Zhixin Liu , Lihua Xie

We develop an optimization-based framework for joint real-time trajectory planning and feedback control of feedback-linearizable systems. To achieve this goal, we define a target trajectory as the optimal solution of a time-varying…

Systems and Control · Electrical Eng. & Systems 2020-03-17 Tianqi Zheng , John Simpson-Porco , Enrique Mallada

The high sample complexity of reinforcement learning challenges its use in practice. A promising approach is to quickly adapt pre-trained policies to new environments. Existing methods for this policy adaptation problem typically rely on…

Machine Learning · Computer Science 2020-06-16 Yuda Song , Aditi Mavalankar , Wen Sun , Sicun Gao

In this work we seek for an approach to integrate safety in the learning process that relies on a partly known state-space model of the system and regards the unknown dynamics as an additive bounded disturbance. We introduce a framework for…

Machine Learning · Computer Science 2018-11-12 Stanislav Fedorov , Antonio Candelieri

The fundamental lemma from behavioral systems theory yields a data-driven non-parametric system representation that has shown great potential for the data-efficient control of unknown linear and weakly nonlinear systems, even in the…

Systems and Control · Electrical Eng. & Systems 2024-09-26 Johannes Teutsch , Sebastian Ellmaier , Sebastian Kerz , Dirk Wollherr , Marion Leibold

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

Machine Learning · Computer Science 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

In this paper, we propose an online learning-based predictive control (LPC) approach designed for nonlinear systems that lack explicit system dynamics. Unlike traditional model predictive control (MPC) algorithms that rely on known system…

Optimization and Control · Mathematics 2025-03-17 Yuanqing Zhang , Huanshui Zhang

A strategy is proposed for adaptive stabilization of linear systems, depending on an uncertain parameter. Offline, the Riccati stabilizing feedback input control operators, corresponding to parameters in a finite training set of chosen…

Optimization and Control · Mathematics 2023-07-27 Philipp A. Guth , Karl Kunisch , Sérgio S. Rodrigues

We approach the fundamental problem of obstacle avoidance for robotic systems via the lens of online learning. In contrast to prior work that either assumes worst-case realizations of uncertainty in the environment or a stationary…

Robotics · Computer Science 2023-11-07 David Snyder , Meghan Booker , Nathaniel Simon , Wenhan Xia , Daniel Suo , Elad Hazan , Anirudha Majumdar

In large-scale networks of uncertain dynamical systems, where communication is limited and there is a strong interaction among subsystems, learning local models and control policies offers great potential for designing high-performance…

Systems and Control · Electrical Eng. & Systems 2021-11-08 Andrea Carron , Jerome Sieber , Melanie N. Zeilinger

Stabilizing unstable periodic orbits in a chaotic invariant set not only reveals information about its structure but also leads to various interesting applications. For the successful application of a chaos control scheme, convergence speed…

Adaptation and Self-Organizing Systems · Physics 2016-10-10 Christian Bick , Marc Timme , Christoph Kolodziejski

Reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems. For many such systems, these policies are trained in a simulated environment. Due to discrepancies between the simulated…

Systems and Control · Electrical Eng. & Systems 2020-11-23 Anubhav Guha , Anuradha Annaswamy

Feedback controllers for port-Hamiltonian systems reveal an intrinsic inverse optimality property since each passivating state feedback controller is optimal with respect to some specific performance index. Due to the nonlinear…

Optimization and Control · Mathematics 2020-07-20 Lukas Kölsch , Pol Jané Soneira , Felix Strehle , Sören Hohmann