English
Related papers

Related papers: Online Convex Optimization with Unconstrained Doma…

200 papers

A well-studied generalization of the standard online convex optimization (OCO) framework is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the…

Machine Learning · Computer Science 2024-10-29 Abhishek Sinha , Rahul Vaze

We consider the setting of online logistic regression and consider the regret with respect to the 2-ball of radius B. It is known (see [Hazan et al., 2014]) that any proper algorithm which has logarithmic regret in the number of samples…

Machine Learning · Computer Science 2020-11-04 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

We investigate decentralized online convex optimization (D-OCO), in which a set of local learners are required to minimize a sequence of global loss functions using only local computations and communications. Previous studies have…

Machine Learning · Computer Science 2024-12-12 Yuanyu Wan , Tong Wei , Bo Xue , Mingli Song , Lijun Zhang

We study online learning with bandit feedback (i.e. learner has access to only zeroth-order oracle) where cost/reward functions $\f_t$ admit a "pseudo-1d" structure, i.e. $\f_t(\w) = \loss_t(\pred_t(\w))$ where the output of $\pred_t$ is…

Machine Learning · Computer Science 2021-02-16 Aadirupa Saha , Nagarajan Natarajan , Praneeth Netrapalli , Prateek Jain

This paper studies bandit convex optimization in non-stationary environments with two-point feedback, using dynamic regret as the performance measure. We propose an algorithm based on bandit mirror descent that extends naturally to…

Optimization and Control · Mathematics 2026-05-26 Chang He , Bo Jiang , Shuzhong Zhang

We study adversarial online learning with hidden-convex losses, i.e., nonconvex losses that become convex after a nonlinear reparameterization. Ghai, Lu and Hazan (2022) proved that, under geometric and smoothness assumptions, online…

Machine Learning · Computer Science 2026-05-27 Anas Barakat , Andreas Kontogiannis , Vasilis Pollatos , Ioannis Panageas , Antonios Varvitsiotis

We study adversarial online nonparametric regression with general convex losses and propose a parameter-free learning algorithm that achieves minimax optimal rates. Our approach leverages chaining trees to compete against H{\"o}lder…

Statistics Theory · Mathematics 2025-04-14 Paul Liautaud , Pierre Gaillard , Olivier Wintenberger

Recent research has shown that quasar-convexity can be found in applications such as identification of linear dynamical systems and generalized linear models. Such observations have in turn spurred exciting developments in design and…

Optimization and Control · Mathematics 2024-07-08 Yuen-Man Pun , Iman Shames

We study the online calibration of multi-dimensional forecasts over an arbitrary convex set $\mathcal{P} \subset \mathbb{R}^d$ relative to an arbitrary norm $\Vert\cdot\Vert$. We connect this with the problem of external regret minimization…

Machine Learning · Computer Science 2025-05-28 Maxwell Fishelson , Noah Golowich , Mehryar Mohri , Jon Schneider

Online bilevel optimization (OBO) has emerged as a powerful framework for many machine learning problems. Prior works have developed several algorithms that minimize the standard bilevel local regret or the window-averaged bilevel local…

Machine Learning · Computer Science 2026-05-12 Tingkai Jia , Haiguang Wang , Cheng Chen

We study various discrete nonlinear combinatorial optimization problems in an online learning framework. In the first part, we address the question of whether there are negative results showing that getting a vanishing (or even vanishing…

Data Structures and Algorithms · Computer Science 2020-06-24 Evripidis Bampis , Dimitris Christou , Bruno Escoffier , Nguyen Kim Thang

We propose new algorithms with provable performance for online binary optimization subject to general constraints and in dynamic settings. We consider the subset of problems in which the objective function is submodular. We propose the…

Optimization and Control · Mathematics 2024-05-03 Antoine Lesage-Landry , Julien Pallage

We study online convex optimisation with $\ell_q$-Lipschitz losses, $\ell_p$-regularised FTRL, and randomised two-point finite-difference gradient estimators based on cone-measure sampling from $\ell_r$-spheres. For random Lipschitz losses…

Machine Learning · Computer Science 2026-05-12 David Janz , El-Mahdi El-Mhamdi , Arya Akhavan

We revisit multi-agent asynchronous online optimization with delays, where only one of the agents becomes active for making the decision at each round, and the corresponding feedback is received by all the agents after unknown delays.…

Machine Learning · Computer Science 2026-02-05 Lingchan Bao , Tong Wei , Yuanyu Wan

We consider a the general online convex optimization framework introduced by Zinkevich. In this setting, there is a sequence of convex functions. Each period, we must choose a signle point (from some feasible set) and pay a cost equal to…

Machine Learning · Computer Science 2007-05-23 Abraham D. Flaxman , Adam Tauman Kalai , H. Brendan McMahan

We introduce an online mathematical framework for survival analysis, allowing real time adaptation to dynamic environments and censored data. This framework enables the estimation of event time distributions through an optimal second order…

Machine Learning · Computer Science 2024-02-09 Camila Fernandez , Pierre Gaillard , Joseph de Vilmarest , Olivier Wintenberger

Learning at the edges has become increasingly important as large quantities of data are continually generated locally. Among others, this paradigm requires algorithms that are simple (so that they can be executed by local devices), robust…

Machine Learning · Computer Science 2024-02-06 Tuan-Anh Nguyen , Nguyen Kim Thang , Denis Trystram

We revisit the challenge of designing online algorithms for the bandit convex optimization problem (BCO) which are also scalable to high dimensional problems. Hence, we consider algorithms that are \textit{projection-free}, i.e., based on…

Machine Learning · Computer Science 2019-10-09 Dan Garber , Ben Kretzu

We study the problem of online convex optimization (OCO) under unknown linear constraints that are either static, or stochastically time-varying. For this problem, we introduce an algorithm that we term Optimistically Safe OCO (OSOCO) and…

Machine Learning · Computer Science 2025-07-16 Spencer Hutchinson , Tianyi Chen , Mahnoosh Alizadeh

In this paper, we study the optimistic online convex optimization problem in dynamic environments. Existing works have shown that Ader enjoys an $O\left(\sqrt{\left(1+P_T\right)T}\right)$ dynamic regret upper bound, where $T$ is the number…

Machine Learning · Computer Science 2022-03-29 Qing-xin Meng , Jian-wei Liu