English
Related papers

Related papers: Pure entropic regularization for metrical task sys…

200 papers

We study two canonical online optimization problems under capacity/budget constraints: the fractional one-way trading problem (OTP) and the integral online knapsack problem (OKP) under an infinitesimal assumption. Under the competitive…

Data Structures and Algorithms · Computer Science 2020-09-23 Ying Cao , Bo Sun , Danny H. K. Tsang

In this paper, we provide two new stable online algorithms for the problem of prediction in reinforcement learning, \emph{i.e.}, estimating the value function of a model-free Markov reward process using the linear function approximation…

Machine Learning · Computer Science 2018-06-19 Ajin George Joseph , Shalabh Bhatnagar

In the matroid buyback problem, an algorithm observes a sequence of bids and must decide whether to accept each bid at the moment it arrives, subject to a matroid constraint on the set of accepted bids. Decisions to reject bids are…

Computer Science and Game Theory · Computer Science 2009-11-30 Ashwinkumar B. V. , Robert Kleinberg

In the online load balancing problem on related machines, we have a set of jobs (with different sizes) arriving online, and we need to assign each job to a machine immediately upon its arrival, so as to minimize the makespan, i.e., the…

Data Structures and Algorithms · Computer Science 2019-09-11 Bo Li , Minming Li , Xiaowei Wu

We introduce a model of online algorithms subject to strict constraints on data retention. An online learning algorithm encounters a stream of data points, one per round, generated by some stationary process. Crucially, each data point can…

Machine Learning · Computer Science 2024-04-18 Nicole Immorlica , Brendan Lucier , Markus Mobius , James Siderius

We consider the problem of designing uniformly stable first-order optimization algorithms for empirical risk minimization. Uniform stability is often used to obtain generalization error bounds for optimization algorithms, and we are…

Machine Learning · Computer Science 2022-07-19 Amit Attia , Tomer Koren

We study the problem of high-dimensional robust mean estimation in an online setting. Specifically, we consider a scenario where $n$ sensors are measuring some common, ongoing phenomenon. At each time step $t=1,2,\ldots,T$, the $i^{th}$…

Machine Learning · Computer Science 2023-10-26 Daniel M. Kane , Ilias Diakonikolas , Hanshen Xiao , Sihan Liu

We consider the online traveling salesman problem on the real line (OLTSPL) in which a salesman begins at the origin, traveling at no faster than unit speed along the real line, and wants to serve a sequence of requests, arriving online…

Data Structures and Algorithms · Computer Science 2025-07-10 Pei-Chuan Chen , Erik D. Demaine , Chung-Shou Liao , Hao-Ting Wei

Adding entropic regularization to Optimal Transport (OT) problems has become a standard approach for designing efficient and scalable solvers. However, regularization introduces a bias from the true solution. To mitigate this bias while…

We contribute the first randomized algorithm that is an integration of arbitrarily many deterministic algorithms for the fully online multiprocessor scheduling with testing problem. When there are two machines, we show that with two…

Data Structures and Algorithms · Computer Science 2023-06-29 Mingyang Gong , Zhi-Zhong Chen , Guohui Lin , Lusheng Wang

We study algorithms for online linear optimization in Hilbert spaces, focusing on the case where the player is unconstrained. We develop a novel characterization of a large class of minimax algorithms, recovering, and even improving,…

Machine Learning · Computer Science 2014-05-22 H. Brendan McMahan , Francesco Orabona

In the k-median problem we are given sets of facilities and customers, and distances between them. For a given set F of facilities, the cost of serving a customer u is the minimum distance between u and a facility in F. The goal is to find…

Data Structures and Algorithms · Computer Science 2020-05-29 Marek Chrobak , Claire Kenyon , John Noga , Neal E. Young

Adversarial online linear optimization (OLO) is essentially about making performance tradeoffs with respect to the unknown difficulty of the adversary. In the setting of one-dimensional fixed-time OLO on a bounded domain, it has been…

Machine Learning · Statistics 2026-02-09 Zhiyu Zhang , Aaditya Ramdas

The setting for the online transportation problem is a metric space $M$, populated by $m$ parking garages of varying capacities. Over time cars arrive in $M$, and must be irrevocably assigned to a parking garage upon arrival in a way that…

Data Structures and Algorithms · Computer Science 2025-10-21 Stephen Arndt , Benjamin Moseley , Kirk Pruhs , Marc Uetz

We study the classic Euclidean Minimum Spanning Tree (MST) problem in the Massively Parallel Computation (MPC) model. Given a set $X \subset \mathbb{R}^d$ of $n$ points, the goal is to produce a spanning tree for $X$ with weight within a…

Data Structures and Algorithms · Computer Science 2023-08-02 Rajesh Jayaram , Vahab Mirrokni , Shyam Narayanan , Peilin Zhong

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

This paper studies online optimization under inventory (budget) constraints. While online optimization is a well-studied topic, versions with inventory constraints have proven difficult. We consider a formulation of inventory-constrained…

Performance · Computer Science 2024-12-20 Qiulin Lin , Hanling Yi , John Pang , Minghua Chen , Adam Wierman , Michael Honig , Yuanzhang Xiao

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

We study the online load balancing problem on unrelated machines, with the objective of minimizing the square of the $\ell_2$ norm of the loads on the machines. The greedy algorithm of Awerbuch et al. (STOC'95) is optimal for deterministic…

Data Structures and Algorithms · Computer Science 2025-11-06 Sander Borst , Danish Kashaev

Entropic regularization provides a simple way to approximate linear programs whose constraints split into two or more tractable blocks. The resulting objectives are amenable to cyclic Kullback-Leibler (KL) Bregman projections, with…

Optimization and Control · Mathematics 2026-05-11 Gabriel Peyré