English
Related papers

Related papers: Dual Adaptivity: A Universal Algorithm for Minimiz…

200 papers

This paper considers the distributed bandit convex optimization problem with time-varying constraints. In this problem, the global loss function is the average of all the local convex loss functions, which are unknown beforehand. Each agent…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Lihua Xie , Tianyou Chai , Tao Yang

In this paper, we study dynamic regret in unconstrained online convex optimization (OCO) with movement costs. Specifically, we generalize the standard setting by allowing the movement cost coefficients $\lambda_t$ to vary arbitrarily over…

Machine Learning · Computer Science 2026-02-09 Emmanuel Esposito , Andrew Jacobsen , Hao Qiu , Mengxiao Zhang

In this paper we focus on the problem of Online Principal Component Analysis in the regret minimization framework. For this problem, all existing regret minimization algorithms for the fully-adversarial setting are based on a positive…

Machine Learning · Computer Science 2019-02-01 Dan Garber

We study non-convex delayed-noise online optimization problems by evaluating dynamic regret in the non-stationary setting when the loss functions are quasar-convex. In particular, we consider scenarios involving quasar-convex functions…

Optimization and Control · Mathematics 2026-01-08 Felipe Lara , Cristian Vega

This paper investigates the problem of regret minimization in linear time-varying (LTV) dynamical systems. Due to the simultaneous presence of uncertainty and non-stationarity, designing online control algorithms for unknown LTV systems…

Machine Learning · Computer Science 2022-06-07 Yuzhen Han , Ruben Solozabal , Jing Dong , Xingyu Zhou , Martin Takac , Bin Gu

We study the problem of meta-learning through the lens of online convex optimization, developing a meta-algorithm bridging the gap between popular gradient-based meta-learning and classical regularization-based multi-task transfer methods.…

Machine Learning · Computer Science 2019-05-17 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

The advancement of artificial intelligence has cast a new light on the development of optimization algorithm. This paper proposes to learn a two-phase (including a minimization phase and an escaping phase) global optimization algorithm for…

Machine Learning · Computer Science 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

In this paper, we consider the sequential decision problem where the goal is to minimize the general dynamic regret on a complete Riemannian manifold. The task of offline optimization on such a domain, also known as a geodesic metric space,…

Machine Learning · Computer Science 2023-07-06 Zihao Hu , Guanghui Wang , Jacob Abernethy

We study dynamic regret in online convex optimization, where the objective is to achieve low cumulative loss relative to an arbitrary benchmark sequence. By observing that competing with an arbitrary sequence of comparators…

Machine Learning · Computer Science 2025-12-12 Andrew Jacobsen , Alessandro Rudi , Francesco Orabona , Nicolo Cesa-Bianchi

The key task of machine learning is to minimize the loss function that measures the model fit to the training data. The numerical methods to do this efficiently depend on the properties of the loss function. The most decisive among these…

Machine Learning · Computer Science 2025-10-31 Tomas Hrycej , Bernhard Bermeitinger , Massimo Pavone , Götz-Henrik Wiegand , Siegfried Handschuh

We consider the problem of online learning with non-convex losses. In terms of feedback, we assume that the learner observes - or otherwise constructs - an inexact model for the loss function encountered at each stage, and we propose a…

Machine Learning · Computer Science 2020-10-19 Amélie Héliou , Matthieu Martin , Panayotis Mertikopoulos , Thibaud Rahier

We examine the problem of regret minimization when the learner is involved in a continuous game with other optimizing agents: in this case, if all players follow a no-regret algorithm, it is possible to achieve significantly lower regret…

Computer Science and Game Theory · Computer Science 2023-03-20 Yu-Guan Hsieh , Kimon Antonakopoulos , Volkan Cevher , Panayotis Mertikopoulos

Practitioners conducting adaptive experiments often encounter two competing priorities: maximizing total welfare (or `reward') through effective treatment assignment and swiftly concluding experiments to implement population-wide…

Machine Learning · Computer Science 2024-07-31 Chao Qin , Daniel Russo

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a stochastic gradient of its own objective function in the previous time, and can communicate with its neighbors via a…

Optimization and Control · Mathematics 2024-01-29 Yuchen Yang , Kaihong Lu , Long Wang

Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at the chosen decision point in each round. In this work, we investigate whether optimistic…

Machine Learning · Computer Science 2026-05-22 Shuche Wang , Adarsh Barik , Vincent Y. F. Tan

We extend and combine several tools of the literature to design fast, adaptive, anytime and scale-free online learning algorithms. Scale-free regret bounds must scale linearly with the maximum loss, both toward large losses and toward very…

Machine Learning · Computer Science 2024-10-22 Laurent Orseau , Marcus Hutter

In this work, we study the online convex optimization problem with curved losses and delayed feedback. When losses are strongly convex, existing approaches obtain regret bounds of order $d_{\max} \ln T$, where $d_{\max}$ is the maximum…

Machine Learning · Computer Science 2025-06-10 Hao Qiu , Emmanuel Esposito , Mengxiao Zhang

In this paper, we develop a novel virtual-queue-based online algorithm for online convex optimization (OCO) problems with long-term and time-varying constraints and conduct a performance analysis with respect to the dynamic regret and…

Optimization and Control · Mathematics 2021-11-16 Qingsong Liu , Wenfei Wu , Longbo Huang , Zhixuan Fang

This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret…

Machine Learning · Computer Science 2022-12-29 Shinji Ito , Taira Tsuchiya , Junya Honda

We present an online learning analysis of minimax adaptive control for the case where the uncertainty includes a finite set of linear dynamical systems. Precisely, for each system inside the uncertainty set, we define the model-based regret…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Venkatraman Renganathan , Andrea Iannelli , Anders Rantzer