中文
相关论文

相关论文: Online Control with Adversarial Disturbance for Co…

200 篇论文

Actor-critic algorithms address the dual goals of reinforcement learning (RL), policy evaluation and improvement via two separate function approximators. The practicality of this approach comes at the expense of training instability, caused…

机器学习 · 计算机科学 2024-06-11 Bahareh Tasdighi , Abdullah Akgül , Manuel Haussmann , Kenny Kazimirzak Brink , Melih Kandemir

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

机器学习 · 统计学 2024-05-20 Lexing Ying

Maximizing long-term rewards is the primary goal in sequential decision-making problems. The majority of existing methods assume that side information is freely available, enabling the learning agent to observe all features' states before…

机器学习 · 计算机科学 2023-07-19 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

This paper demonstrates the applicability of the combination of concurrent learning as a tool for parameter estimation and non-parametric Gaussian Process for online disturbance learning. A control law is developed by using both techniques…

系统与控制 · 电气工程与系统科学 2021-06-03 Vedant Bhandari , Erkan Kayacan

Due to their complex nonlinear dynamics and batch-to-batch variability, batch processes pose a challenge for process control. Due to the absence of accurate models and resulting plant-model mismatch, these problems become harder to address…

机器学习 · 计算机科学 2022-05-03 Tanuja Joshi , Hariprasad Kodamana , Harikumar Kandath , Niket Kaisare

In this work we consider the online control of a known linear dynamic system with adversarial disturbance and adversarial controller cost. The goal in online control is to minimize the regret, defined as the difference between cumulative…

最优化与控制 · 数学 2021-10-15 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

In this paper, we investigate the power of online learning in stochastic network optimization with unknown system statistics {\it a priori}. We are interested in understanding how information and learning can be efficiently incorporated…

最优化与控制 · 数学 2014-07-30 Longbo Huang , Xin Liu , Xiaohong Hao

This paper proposes a data-driven control framework to regulate an unknown, stochastic linear dynamical system to the solution of a (stochastic) convex optimization problem. Despite the centrality of this problem, most of the available…

最优化与控制 · 数学 2021-08-31 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

We address the problem of learning to control an unknown nonlinear dynamical system through sequential interactions. Motivated by high-stakes applications in which mistakes can be catastrophic, such as robotics and healthcare, we study…

机器学习 · 计算机科学 2025-04-14 James Wang , Bruce D. Lee , Ingvar Ziemann , Nikolai Matni

We address the tracking problem for a class of uncertain non-affine nonlinear systems with high relative degrees, performing non-repetitive tasks. We propose a rigorously proven, robust adaptive learning control scheme that relies on a…

系统与控制 · 电气工程与系统科学 2026-02-03 Shuai Gao , Dong Shen , Abdelhamid Tayebi

We study the problem of Online Convex Optimization (OCO) with memory, which allows loss functions to depend on past decisions and thus captures temporal effects of learning problems. In this paper, we introduce dynamic policy regret as the…

机器学习 · 计算机科学 2023-08-16 Peng Zhao , Yu-Hu Yan , Yu-Xiang Wang , Zhi-Hua Zhou

We propose a data-driven online convex optimization algorithm for controlling dynamical systems. In particular, the control scheme makes use of an initially measured input-output trajectory and behavioral systems theory which enable it to…

最优化与控制 · 数学 2021-11-03 Marko Nonhoff , Matthias A. Müller

In this work, we investigate the problem of simultaneously learning and controlling a system subject to adversarial choices of disturbances and system parameters. We study the problem for a scalar system with $l_\infty$-norm bounded…

最优化与控制 · 数学 2018-12-31 Dimitar Ho , Nikolai Matni , John C. Doyle

Controlling continuous-time dynamical systems is generally a two step process: first, identify or model the system dynamics with differential equations, then, minimize the control objectives to achieve optimal control function and optimal…

人工智能 · 计算机科学 2024-04-23 Cheng Chi

In this paper, we provide a theoretical framework that separates the control and learning tasks in a linear system. This separation allows us to combine offline model-based control with online learning approaches and thus circumvent current…

最优化与控制 · 数学 2024-03-26 Andreas A. Malikopoulos

This paper introduces a framework for quantitative characterization of the controllability of time-varying linear systems (or networks) in terms of input novelty. The motivation for such an approach comes from the study of biophysical…

最优化与控制 · 数学 2014-11-24 Gautam Kumar , Delsin Menolascino , ShiNung Ching

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

机器学习 · 计算机科学 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

This work proposes a robust data-driven predictive control approach for unknown nonlinear systems in the presence of bounded process and measurement noise. Data-driven reachable sets are employed for the controller design instead of using…

系统与控制 · 电气工程与系统科学 2023-07-18 Mahsa Farjadnia , Amr Alanwar , Muhammad Umar B. Niazi , Marco Molinari , Karl Henrik Johansson

This paper presents a stochastic model predictive controller (SMPC) for linear time-invariant systems in the presence of additive disturbances. The distribution of the disturbance is unknown and is assumed to have a bounded support. A…

系统与控制 · 电气工程与系统科学 2022-10-03 Hotae Lee , Monimoy Bujarbaruah , Francesco Borrelli

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

机器学习 · 计算机科学 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli