English
Related papers

Related papers: A Data-Driven Approach for Inverse Optimal Control

200 papers

We develop a data-driven, model-free approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator for the purpose of control. In particular, DNN…

Machine Learning · Computer Science 2020-10-16 Yiqiang Han , Wenjian Hao , Umesh Vaidya

This paper studies data-driven iterative learning control (ILC) for linear time-invariant (LTI) systems with unknown dynamics, output disturbances and input box-constraints. Our main contributions are: 1) using a non-parametric data-driven…

Systems and Control · Electrical Eng. & Systems 2023-12-25 Jia Wang , Leander Hemelhof , Ivan Markovsky , Panagiotis Patrinos

We present an online multi-task learning approach for adaptive nonlinear control, which we call Online Meta-Adaptive Control (OMAC). The goal is to control a nonlinear system subject to adversarial disturbance and unknown…

Machine Learning · Computer Science 2021-10-28 Guanya Shi , Kamyar Azizzadenesheli , Michael O'Connell , Soon-Jo Chung , Yisong Yue

Data-driven analysis and control of dynamical systems have gained a lot of interest in recent years. While the class of linear systems is well studied, theoretical results for nonlinear systems are still rare. In this paper, we present a…

Systems and Control · Electrical Eng. & Systems 2023-11-28 Robin Strässer , Julian Berberich , Frank Allgöwer

In this paper, a novel Koopman-type inverse operator for linear time-invariant non-minimum phase systems with stochastic disturbances is proposed. This operator employs functions of the desired output to directly calculate the input.…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Yuhan Li , Xiaoqiang Ji

We consider the problem of discounted optimal state-feedback regulation for general unknown deterministic discrete-time systems. It is well known that open-loop instability of systems, non-quadratic cost functions and complex nonlinear…

Systems and Control · Electrical Eng. & Systems 2020-03-31 Alexandros Tanzanakis , John Lygeros

This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization…

Optimization and Control · Mathematics 2021-09-08 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

We propose the application of Koopman operator theory for the design of stabilizing feedback controller for a nonlinear control system. The proposed approach is data-driven and relies on the use of time-series data generated from the…

Optimization and Control · Mathematics 2019-01-24 Bowen Huang , Xu Ma , Umesh Vaidya

This paper considers the problem of controlling a dynamical system when the state cannot be directly measured and the control performance metrics are unknown or partially known. In particular, we focus on the design of data-driven…

Optimization and Control · Mathematics 2023-09-01 Liliaokeawawa Cothren , Gianluca Bianchin , Emiliano Dall'Anese

This paper presents an active learning strategy for robotic systems that takes into account task information, enables fast learning, and allows control to be readily synthesized by taking advantage of the Koopman operator representation. We…

Robotics · Computer Science 2019-06-13 Ian Abraham , Todd D. Murphey

We study the problem of data-driven, constrained control of unknown nonlinear dynamics from a single ongoing and finite-horizon trajectory. We consider a one-step optimal control problem with a smooth, black-box objective, typically a…

Optimization and Control · Mathematics 2022-06-23 Abraham P. Vinod , Arie Israel , Ufuk Topcu

The aim of this paper is to propose a new data-driven control scheme for multi-input-multi-output linear time-invariant systems whose system model are completely unknown. Using a non-minimal input-output realization, the proposed method can…

Systems and Control · Electrical Eng. & Systems 2022-01-11 Nam H. Jo , Hyungbo Shim

Koopman operator theory, a powerful framework for discovering the underlying dynamics of nonlinear dynamical systems, was recently shown to be intimately connected with neural network training. In this work, we take the first steps in…

Neural and Evolutionary Computing · Computer Science 2021-10-08 Akshunna S. Dogra , William T Redman

Transfer and Koopman operator methods offer a framework for representing complex, nonlinear dynamical systems via linear transformations, enabling a deeper understanding of the underlying dynamics. The spectra of these operators provide…

Dynamical Systems · Mathematics 2026-03-25 Gary Froyland , Kevin Kühl

Continuous control and planning remains a major challenge in robotics and machine learning. Neuroscience offers the possibility of learning from animal brains that implement highly successful controllers, but it is unclear how to relate an…

Artificial Intelligence · Computer Science 2019-08-14 Saurabh Daptardar , Paul Schrater , Xaq Pitkow

Inverse optimal control, also known as inverse reinforcement learning, is the problem of recovering an unknown reward function in a Markov decision process from expert demonstrations of the optimal policy. We introduce a probabilistic…

Machine Learning · Computer Science 2012-06-22 Sergey Levine , Vladlen Koltun

As we aim to control complex systems, use of a simulator in model-based reinforcement learning is becoming more common. However, it has been challenging to overcome the Reality Gap, which comes from nonlinear model bias and susceptibility…

Robotics · Computer Science 2017-05-16 Gilwoo Lee , Siddhartha S. Srinivasa , Matthew T. Mason

This article addresses the problem of data-driven numerical optimal control for unknown nonlinear systems. In our scenario, we suppose to have the possibility of performing multiple experiments (or simulations) on the system. Experiments…

Systems and Control · Electrical Eng. & Systems 2025-06-19 Marco Borghesi , Lorenzo Sforni , Giuseppe Notarstefano

A high order optimal control strategy implemented in the Koopman operator framework is proposed in this work. The new technique exploits the Koopman representation of the solution of the equations of motion to develop an energy optimal…

Optimization and Control · Mathematics 2022-07-15 Simone Servadio , Roberto Armellin , Richard Linares

In this paper, the problem of finite horizon inverse optimal control (IOC) is investigated, where the quadratic cost function of a dynamic process is required to be recovered based on the observation of optimal control sequences. We propose…

Optimization and Control · Mathematics 2018-11-02 Yibei Li , Yu Yao , Xiaoming Hu