English
Related papers

Related papers: Online Discrepancy Minimization via Persistent Sel…

200 papers

We develop a new reduction that converts any online convex optimization algorithm suffering $O(\sqrt{T})$ regret into an $\epsilon$-differentially private stochastic convex optimization algorithm with the optimal convergence rate $\tilde…

Machine Learning · Computer Science 2022-10-14 Qinzi Zhang , Hoang Tran , Ashok Cutkosky

In this paper, we consider algorithms with integral action for solving online optimization problems characterized by quadratic cost functions with a time-varying optimal point described by an $(n-1)$th order polynomial. Using a version of…

Optimization and Control · Mathematics 2025-09-12 Alex Xinting Wu , Ian R. Petersen , Iman Shames

This paper considers the problem of designing the user trajectory in a device-to-device communications setting. We consider a pair of pedestrians connected through a D2D link. The pedestrians seek to reach their respective destinations…

Optimization and Control · Mathematics 2018-04-16 Amrit S. Bedi , Ketan Rajawat , Marceau Coupechoux

This paper considers distributed online nonconvex optimization with time-varying inequality constraints over a network of agents. For a time-varying graph, we propose a distributed online primal-dual algorithm with compressed communication…

Optimization and Control · Mathematics 2025-09-01 Kunpeng Zhang , Lei Xu , Xinlei Yi , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

Semi-online algorithms that are allowed to perform a bounded amount of repacking achieve guaranteed good worst-case behaviour in a more realistic setting. Most of the previous works focused on minimization problems that aim to minimize some…

Data Structures and Algorithms · Computer Science 2021-04-21 Sebastian Berndt , Kilian Grage , Klaus Jansen , Lukas Johannsen , Maria Kosche

In the convex optimization approach to online regret minimization, many methods have been developed to guarantee a $O(\sqrt{T})$ bound on regret for subdifferentiable convex loss functions with bounded subgradients, by using a reduction to…

Machine Learning · Computer Science 2016-09-20 Arthur Flajolet , Patrick Jaillet

We consider an assortment selection and pricing problem in which a seller has $N$ different items available for sale. In each round, the seller observes a $d$-dimensional contextual preference information vector for the user, and offers to…

Machine Learning · Computer Science 2025-03-18 Yigit Efe Erginbas , Thomas A. Courtade , Kannan Ramchandran

We study adversarial online learning with hidden-convex losses, i.e., nonconvex losses that become convex after a nonlinear reparameterization. Ghai, Lu and Hazan (2022) proved that, under geometric and smoothness assumptions, online…

Machine Learning · Computer Science 2026-05-27 Anas Barakat , Andreas Kontogiannis , Vasilis Pollatos , Ioannis Panageas , Antonios Varvitsiotis

We consider online packing problems where we get a stream of axis-parallel rectangles. The rectangles have to be placed in the plane without overlapping, and each rectangle must be placed without knowing the subsequent rectangles. The goal…

Computational Geometry · Computer Science 2021-01-27 Mikkel Abrahamsen , Lorenzo Beretta

In this paper, we study the classical Hedge algorithm in combinatorial settings. In each round, the learner selects a vector $\boldsymbol{x}_t$ from a set $X \subseteq \{0,1\}^d$, observes a full loss vector $\boldsymbol{y}_t \in…

Machine Learning · Computer Science 2025-10-27 Zhiyuan Fan , Arnab Maiti , Kevin Jamieson , Lillian J. Ratliff , Gabriele Farina

We present space lower bounds for online pattern matching under a number of different distance measures. Given a pattern of length m and a text that arrives one character at a time, the online pattern matching problem is to report the…

Data Structures and Algorithms · Computer Science 2011-06-23 Raphael Clifford , Markus Jalsenius , Ely Porat , Benjamin Sach

This paper studies classification with an abstention option in the online setting. In this setting, examples arrive sequentially, the learner is given a hypothesis class $\mathcal H$, and the goal of the learner is to either predict a label…

Machine Learning · Computer Science 2016-09-29 Chicheng Zhang , Kamalika Chaudhuri

We consider the problem of online convex optimization against an arbitrary adversary with bandit feedback, known as bandit convex optimization. We give the first $\tilde{O}(\sqrt{T})$-regret algorithm for this setting based on a novel…

Machine Learning · Computer Science 2016-03-16 Elad Hazan , Yuanzhi Li

While Adam is one of the most effective optimizer for training large-scale machine learning models, a theoretical understanding of how to optimally set its momentum factors, $\beta_1$ and $\beta_2$, remains largely incomplete. Prior works…

Machine Learning · Computer Science 2025-12-29 Quan Nguyen

This paper considers online convex optimization with time-varying constraint functions. Specifically, we have a sequence of convex objective functions $\{f_t(x)\}_{t=0}^{\infty}$ and convex constraint functions…

Optimization and Control · Mathematics 2017-02-20 Michael J. Neely , Hao Yu

In the online checkpointing problem, the task is to continuously maintain a set of k checkpoints that allow to rewind an ongoing computation faster than by a full restart. The only operation allowed is to replace an old checkpoint by the…

Data Structures and Algorithms · Computer Science 2013-05-01 Karl Bringmann , Benjamin Doerr , Adrian Neumann , Jakub Sliacan

We consider the problem of sorting $n$ elements subject to persistent random comparison errors. In this problem, each comparison between two elements can be wrong with some fixed (small) probability $p$, and comparing the same pair of…

Data Structures and Algorithms · Computer Science 2025-08-28 Barbara Geissmann , Stefano Leucci , Chih-Hung Liu , Paolo Penna

This paper studies the online correlated selection (OCS) problem. It was introduced by Fahrbach, Huang, Tao, and Zadimoghaddam (2020) to obtain the first edge-weighted online bipartite matching algorithm that breaks the $0.5$ barrier.…

Data Structures and Algorithms · Computer Science 2021-12-17 Ruiquan Gao , Zhongtian He , Zhiyi Huang , Zipei Nie , Bijun Yuan , Yan Zhong

We resolve a 30-year-old open problem concerning the power of unlabeled data in online learning by tightly quantifying the gap between transductive and standard online learning. In the standard setting, the optimal mistake bound is…

Machine Learning · Computer Science 2025-12-16 Zachary Chase , Steve Hanneke , Shay Moran , Jonathan Shafer

We present the first in-place algorithm for sorting an array of size n that performs, in the worst case, at most O(n log n) element comparisons and O(n) element transports. This solves a long-standing open problem, stated explicitly, e.g.,…

Data Structures and Algorithms · Computer Science 2007-05-23 Gianni Franceschini , Viliam Geffert