English
Related papers

Related papers: Optimal Online Discrepancy Minimization

200 papers

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

Modern data centers face a key challenge of effectively serving user requests that arrive online. Such requests are inherently multi-dimensional and characterized by demand vectors over multiple resources such as processor cycles, storage…

Data Structures and Algorithms · Computer Science 2015-08-19 Sungjin Im , Nathaniel Kell , Janardhan Kulkarni , Debmalya Panigrahi

We describe approximation algorithms in Linial's classic LOCAL model of distributed computing to find maximum-weight matchings in a hypergraph of rank $r$. Our main result is a deterministic algorithm to generate a matching which is an…

Data Structures and Algorithms · Computer Science 2023-10-13 David G. Harris

We address online combinatorial optimization when the player has a prior over the adversary's sequence of losses. In this framework, Russo and Van Roy proposed an information-theoretic analysis of Thompson Sampling based on the information…

Machine Learning · Computer Science 2022-04-05 Sébastien Bubeck , Mark Sellke

We study \emph{parallel} online algorithms: For some fixed integer $k$, a collective of $k$ parallel processes that perform online decisions on the same sequence of events forms a $k$-\emph{copy algorithm}. For any given time and input…

Data Structures and Algorithms · Computer Science 2019-10-09 Sándor P. Fekete , Jonas Grosse-Holz , Phillip Keldenich , Arne Schmidt

We resolve an open question from (Christiano, 2014b) posed in COLT'14 regarding the optimal dependency of the regret achievable for online local learning on the size of the label set. In this framework the algorithm is shown a pair of items…

Machine Learning · Computer Science 2015-08-25 Pranjal Awasthi , Moses Charikar , Kevin A. Lai , Andrej Risteski

An important result in discrepancy due to Banaszczyk states that for any set of $n$ vectors in $\mathbb{R}^m$ of $\ell_2$ norm at most $1$ and any convex body $K$ in $\mathbb{R}^m$ of Gaussian measure at least half, there exists a $\pm 1$…

Data Structures and Algorithms · Computer Science 2017-08-04 Nikhil Bansal , Daniel Dadush , Shashwat Garg , Shachar Lovett

We give an online algorithm that with high probability computes a $\left(\frac{e}{e-1} + o(1)\right)\Delta$ edge coloring on a graph $G$ with maximum degree $\Delta = \omega(\log n)$ under online edge arrivals against oblivious adversaries,…

Data Structures and Algorithms · Computer Science 2021-11-02 Janardhan Kulkarni , Yang P. Liu , Ashwin Sah , Mehtaab Sawhney , Jakub Tarnawski

Speculative sampling reduces the latency of autoregressive decoding for target model LLMs without sacrificing inference quality, by using a cheap draft model to suggest a candidate token and a verification criterion to accept or resample…

Machine Learning · Computer Science 2025-11-21 Rahul Krishna Thomas , Arka Pal

Given a sequence of convex functions $f_0, f_1, \ldots, f_T$, we study the problem of sampling from the Gibbs distribution $\pi_t \propto e^{-\sum_{k=0}^tf_k}$ for each epoch $t$ in an online manner. Interest in this problem derives from…

Machine Learning · Computer Science 2019-12-06 Holden Lee , Oren Mangoubi , Nisheeth K. Vishnoi

We present a new approach for finding matchings in dense graphs by building on Szemer\'edi's celebrated Regularity Lemma. This allows us to obtain non-trivial albeit slight improvements over longstanding bounds for matchings in streaming…

Data Structures and Algorithms · Computer Science 2022-07-20 Sepehr Assadi , Soheil Behnezhad , Sanjeev Khanna , Huan Li

The element distinctness problem takes as input a list $I$ of $n$ values from a totally ordered universe and the goal is to decide whether $I$ contains any duplicates. It is a well-studied problem with a classical worst-case $\Omega(n \log…

Data Structures and Algorithms · Computer Science 2025-11-06 Ivor van der Hoog , Eva Rotenberg , Daniel Rutschmann

This paper studies the online scheduling problem of minimizing total flow time for $n$ jobs on $m$ identical machines. A classical $\Omega(n)$ lower bound shows that no deterministic single-machine algorithm can beat the trivial greedy,…

Data Structures and Algorithms · Computer Science 2026-04-02 Yutong Geng , Enze Sun , Zonghan Yang , Yuhao Zhang

There are distributed graph algorithms for finding maximal matchings and maximal independent sets in $O(\Delta + \log^* n)$ communication rounds; here $n$ is the number of nodes and $\Delta$ is the maximum degree. The lower bound by Linial…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-13 Alkida Balliu , Sebastian Brandt , Juho Hirvonen , Dennis Olivetti , Mikaël Rabie , Jukka Suomela

In the online bipartite matching with reassignments problem, an algorithm is initially given only one side of the vertex set of a bipartite graph; the vertices on the other side are revealed to the algorithm one by one, along with its…

Data Structures and Algorithms · Computer Science 2020-03-12 Yongho Shin , Kangsan Kim , Seungmin Lee , Hyung-Chan An

The permutahedron is the convex polytope with vertex set consisting of the vectors $(\pi(1),\dots, \pi(n))$ for all permutations (bijections) $\pi$ over $\{1,\dots, n\}$. We study a bandit game in which, at each step $t$, an adversary…

Machine Learning · Computer Science 2014-07-08 Nir Ailon , Kohei Hatano , Eiji Takimoto

We introduce an online convex optimization algorithm which utilizes projected subgradient descent with optimal adaptive learning rates. Our method provides second-order minimax-optimal dynamic regret guarantee (i.e. dependent on the sum of…

Optimization and Control · Mathematics 2022-09-14 Hakan Gokcesu , Suleyman S. Kozat

We present a polynomial-time online algorithm for maximizing the conditional value at risk (CVaR) of a monotone stochastic submodular function. Given $T$ i.i.d. samples from an underlying distribution arriving online, our algorithm produces…

Data Structures and Algorithms · Computer Science 2021-05-21 Tasuku Soma , Yuichi Yoshida

We propose the algorithms for online convex optimization which lead to cumulative squared constraint violations of the form $\sum\limits_{t=1}^T\big([g(x_t)]_+\big)^2=O(T^{1-\beta})$, where $\beta\in(0,1)$. Previous literature has focused…

Machine Learning · Computer Science 2019-02-08 Jianjun Yuan , Andrew Lamperski

This paper considers online optimization of a renewal-reward system. A controller performs a sequence of tasks back-to-back. Each task has a random vector of parameters, called the task type vector, that affects the task processing options…

Optimization and Control · Mathematics 2021-06-01 Michael J. Neely