English
Related papers

Related papers: $O(\sqrt{T})$ Static Regret and Instance Dependent…

200 papers

Many online decision problems over combinatorial actions are addressed via convex relaxations, leading to online convex optimization with piecewise linear objectives and induced polyhedral structure. We show that regret in such problems is…

In this paper, we present an improved analysis for dynamic regret of strongly convex and smooth functions. Specifically, we investigate the Online Multiple Gradient Descent (OMGD) algorithm proposed by Zhang et al. (2017). The original…

Machine Learning · Computer Science 2021-04-15 Peng Zhao , Lijun Zhang

Reflecting the greater significance of recent history over the distant past in non-stationary environments, $\lambda$-discounted regret has been introduced in online convex optimization (OCO) to gracefully forget past data as new…

Machine Learning · Computer Science 2025-05-27 Wenhao Yang , Sifan Yang , Lijun Zhang

In this paper, we consider an online optimization process, where the objective functions are not convex (nor concave) but instead belong to a broad class of continuous submodular functions. We first propose a variant of the Frank-Wolfe…

Machine Learning · Statistics 2018-02-19 Lin Chen , Hamed Hassani , Amin Karbasi

We study the framework of universal dynamic regret minimization with strongly convex losses. We answer an open problem in Baby and Wang 2021 by showing that in a proper learning setup, Strongly Adaptive algorithms can achieve the near…

Machine Learning · Computer Science 2022-01-25 Dheeraj Baby , Yu-Xiang Wang

This paper addresses safe distributed online optimization over an unknown set of linear safety constraints. A network of agents aims at jointly minimizing a global, time-varying function, which is only partially observable to each…

Optimization and Control · Mathematics 2023-02-27 Ting-Jui Chang , Sapana Chaudhary , Dileep Kalathil , Shahin Shahrampour

Bandit convex optimization (BCO) is a general framework for online decision making under uncertainty. While tight regret bounds for general convex losses have been established, existing algorithms achieving these bounds have prohibitive…

Machine Learning · Computer Science 2024-10-04 Arun Suggala , Y. Jennifer Sun , Praneeth Netrapalli , Elad Hazan

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

Machine Learning · Computer Science 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

Unlike classical control theory, such as Linear Quadratic Control (LQC), real-world control problems are highly complex. These problems often involve adversarial perturbations, bandit feedback models, and non-quadratic, adversarially chosen…

Machine Learning · Computer Science 2024-10-03 Y. Jennifer Sun , Zhou Lu

We introduce an online convex optimization algorithm which utilizes projected subgradient descent with optimal adaptive learning rates. Our method provides second-order minimax-optimal dynamic regret guarantee (i.e. dependent on the sum of…

Optimization and Control · Mathematics 2022-09-14 Hakan Gokcesu , Suleyman S. Kozat

Projection-based algorithms for Constrained Online Convex Optimization (COCO) achieve optimal $\mathcal{O}(T^{1/2})$ regret guarantees but face scalability challenges due to the computational complexity of projections. To circumvent this,…

Machine Learning · Computer Science 2026-01-29 Yiyang Lu , Mohammad Pedramfar , Vaneet Aggarwal

This paper considers distributed online convex constrained optimization, in which various agents in a multi-agent system cooperate to minimize a global cost function through communicating with neighbors over a time-varying network. When the…

Optimization and Control · Mathematics 2023-02-02 Wentao Zhang , Yang Shi , Baoyong Zhang , Deming Yuan

In this paper, we study adaptive online convex optimization, and aim to design a universal algorithm that achieves optimal regret bounds for multiple common types of loss functions. Existing universal methods are limited in the sense that…

Machine Learning · Computer Science 2019-05-16 Guanghui Wang , Shiyin Lu , Lijun Zhang

This article investigates the problem of controlling linear time-invariant systems subject to time-varying and a priori unknown cost functions, state and input constraints, and exogenous disturbances. We combine the online convex…

Systems and Control · Electrical Eng. & Systems 2025-12-18 Marko Nonhoff , Emiliano Dall'Anese , Matthias A. Müller

In this paper, we study online convex optimization in dynamic environments, and aim to bound the dynamic regret with respect to any sequence of comparators. Existing work have shown that online gradient descent enjoys an…

Machine Learning · Computer Science 2018-10-26 Lijun Zhang , Shiyin Lu , Zhi-Hua Zhou

In repeated interaction problems with adaptive agents, our objective often requires anticipating and optimizing over the space of possible agent responses. We show that many problems of this form can be cast as instances of online…

Machine Learning · Computer Science 2024-06-28 William Brown , Christos Papadimitriou , Tim Roughgarden

Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical success of…

Machine Learning · Statistics 2025-01-07 Wenzhi Gao , Dongdong Ge , Chenyu Xue , Chunlin Sun , Yinyu Ye

We study the problem of online learning (OL) from revealed preferences: a learner wishes to learn a non-strategic agent's private utility function through observing the agent's utility-maximizing actions in a changing environment. We adopt…

Optimization and Control · Mathematics 2021-06-07 Violet Xinying Chen , Fatma Kılınç-Karzan

We consider the problem of online convex optimization against an arbitrary adversary with bandit feedback, known as bandit convex optimization. We give the first $\tilde{O}(\sqrt{T})$-regret algorithm for this setting based on a novel…

Machine Learning · Computer Science 2016-03-16 Elad Hazan , Yuanzhi Li

Online convex optimization (OCO) is a powerful tool for learning sequential data, making it ideal for high precision control applications where the disturbances are arbitrary and unknown in advance. However, the ability of OCO-based…

Systems and Control · Electrical Eng. & Systems 2024-05-14 Joyce Lai , Peter Seiler