English
Related papers

Related papers: Online convex optimization for data-driven control…

200 papers

We consider online convex optimization with time-varying constraints and conduct performance analysis using two stringent metrics: dynamic regret with respect to the online solution benchmark, and hard constraint violation that does not…

Machine Learning · Computer Science 2025-01-15 Juncheng Wang , Bingjie Yan , Yituo Liu

Modern control designs in robotics, aerospace, and cyber-physical systems rely heavily on real-world data obtained through system outputs. However, these outputs can be compromised by system faults and malicious attacks, distorting critical…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Hiroyasu Tsukamoto , Joudi Hajar , Soon-Jo Chung , Fred Y. Hadaegh

We consider the problem of online prediction in a marginally stable linear dynamical system subject to bounded adversarial or (non-isotropic) stochastic perturbations. This poses two challenges. Firstly, the system is in general…

Machine Learning · Computer Science 2020-11-24 Udaya Ghai , Holden Lee , Karan Singh , Cyril Zhang , Yi Zhang

This paper investigates distributed online convex optimization in the presence of an aggregative variable without any global/central coordinators over a multi-agent network, where each individual agent is only able to access partial…

Optimization and Control · Mathematics 2020-07-15 Xiuxian Li , Xinlei Yi , Lihua Xie

We study online convex optimization under stochastic sub-gradient observation faults, where we introduce adaptive algorithms with minimax optimal regret guarantees. We specifically study scenarios where our sub-gradient observations can be…

Machine Learning · Computer Science 2019-04-23 Hakan Gokcesu , Suleyman S. Kozat

We provide an online convex optimization algorithm with regret that interpolates between the regret of an algorithm using an optimal preconditioning matrix and one using a diagonal preconditioning matrix. Our regret bound is never worse…

Machine Learning · Computer Science 2019-05-31 Ashok Cutkosky , Tamas Sarlos

The regret bound of dynamic online learning algorithms is often expressed in terms of the variation in the function sequence ($V_T$) and/or the path-length of the minimizer sequence after $T$ rounds. For strongly convex and smooth…

Machine Learning · Computer Science 2020-08-17 Ting-Jui Chang , Shahin Shahrampour

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

This paper develops and analyzes feedback-based online optimization methods to regulate the output of a linear time-invariant (LTI) dynamical system to the optimal solution of a time-varying convex optimization problem. The design of the…

Optimization and Control · Mathematics 2018-05-31 Marcello Colombino , Emiliano Dall'Anese , Andrey Bernstein

We consider the framework of non-stationary Online Convex Optimization where a learner seeks to control its dynamic regret against an arbitrary sequence of comparators. When the loss functions are strongly convex or exp-concave, we…

Machine Learning · Computer Science 2021-11-24 Dheeraj Baby , Hilaf Hasson , Yuyang Wang

We present an adaptive online gradient descent algorithm to solve online convex optimization problems with long-term constraints , which are constraints that need to be satisfied when accumulated over a finite number of rounds T , but can…

Machine Learning · Statistics 2015-12-24 Rodolphe Jenatton , Jim Huang , Cédric Archambeau

In this paper, we present a data-driven controller design method for continuous-time nonlinear systems, using no model knowledge but only measured data affected by noise. While most existing approaches focus on systems with polynomial…

Systems and Control · Electrical Eng. & Systems 2022-02-11 Robin Strässer , Julian Berberich , Frank Allgöwer

In this book, I introduce the basic concepts of Online Learning through the modern view of Online Convex Optimization. Here, online learning refers to the framework of regret minimization under worst-case assumptions. I present first-order…

Machine Learning · Computer Science 2026-04-28 Francesco Orabona

We incorporate future information in the form of the estimated value of future gradients in online convex optimization. This is motivated by demand response in power systems, where forecasts about the current round, e.g., the weather or the…

Optimization and Control · Mathematics 2020-12-14 Antoine Lesage-Landry , Iman Shames , Joshua A. Taylor

To deal with changing environments, a new performance measure -- adaptive regret, defined as the maximum static regret over any interval, was proposed in online learning. Under the setting of online convex optimization, several algorithms…

Machine Learning · Computer Science 2021-05-17 Lijun Zhang , Guanghui Wang , Wei-Wei Tu , Zhi-Hua Zhou

We study optimal regret bounds for control in linear dynamical systems under adversarially changing strongly convex cost functions, given the knowledge of transition dynamics. This includes several well studied and fundamental frameworks…

Machine Learning · Computer Science 2019-09-12 Naman Agarwal , Elad Hazan , Karan Singh

In the past few years, Online Convex Optimization (OCO) has received notable attention in the control literature thanks to its flexible real-time nature and powerful performance guarantees. In this paper, we propose new step-size rules and…

Optimization and Control · Mathematics 2023-01-18 Pedro Zattoni Scroccaro , Arman Sharifi Kolarijani , Peyman Mohajerin Esfahani

This paper mainly addresses the distributed online optimization problem where the local objective functions are assumed to be convex or non-convex. First, the distributed algorithms are proposed for the convex and non-convex situations,…

Optimization and Control · Mathematics 2025-03-24 Yaowen Wang , Lipo Mo , Min Zuo , Yuanshi Zheng

This paper considers distributed online nonconvex optimization with time-varying inequality constraints over a network of agents, where the nonconvex local loss and convex local constraint functions can vary arbitrarily across iterations.…

Optimization and Control · Mathematics 2025-11-19 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

We study online maximization of non-monotone Diminishing-Return(DR)-submodular functions over down-closed convex sets, a regime where existing projection-free online methods suffer from suboptimal regret and limited feedback guarantees. Our…

Machine Learning · Computer Science 2026-02-25 Yiyang Lu , Haresh Jadav , Mohammad Pedramfar , Ranveer Singh , Vaneet Aggarwal