English
Related papers

Related papers: Online Discrepancy with Recourse for Vectors and G…

200 papers

We revisit online binary classification by shifting the focus from competing with the best-in-class binary loss to competing against relaxed benchmarks that capture smoothed notions of optimality. Instead of measuring regret relative to the…

Machine Learning · Statistics 2025-04-16 Omar Montasser , Abhishek Shetty , Nikita Zhivotovskiy

This paper considers the problem of online optimization where the objective function is time-varying. In particular, we extend coordinate descent type algorithms to the online case, where the objective function varies after a finite number…

Optimization and Control · Mathematics 2024-04-26 Yankai Lin , Iman Shames , Dragan Nešić

We study the problem of online convex optimization (OCO) under unknown linear constraints that are either static, or stochastically time-varying. For this problem, we introduce an algorithm that we term Optimistically Safe OCO (OSOCO) and…

Machine Learning · Computer Science 2025-07-16 Spencer Hutchinson , Tianyi Chen , Mahnoosh Alizadeh

We study the problem of dynamic regret minimization in online convex optimization, in which the objective is to minimize the difference between the cumulative loss of an algorithm and that of an arbitrary sequence of comparators. While the…

Machine Learning · Computer Science 2024-11-05 Andrew Jacobsen , Francesco Orabona

Modern data centers face a key challenge of effectively serving user requests that arrive online. Such requests are inherently multi-dimensional and characterized by demand vectors over multiple resources such as processor cycles, storage…

Data Structures and Algorithms · Computer Science 2015-08-19 Sungjin Im , Nathaniel Kell , Janardhan Kulkarni , Debmalya Panigrahi

We revisit the problem of \textit{online linear optimization} in case the set of feasible actions is accessible through an approximated linear optimization oracle with a factor $\alpha$ multiplicative approximation guarantee. This setting…

Machine Learning · Computer Science 2017-09-12 Dan Garber

We study an online vector balancing problem, in which $n$ independent Gaussian random vectors $\boldsymbol{\zeta}(1),\dots,\boldsymbol{\zeta}(n) \sim \mathcal{N}(0, I_n)$, each of dimension $n$, arrive one at a time. The goal is to choose…

Probability · Mathematics 2026-05-15 Christian Fiedler , Joe Jackson , Daniel Lacker , Jonathan Niles-Weed

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

Machine Learning · Computer Science 2012-07-03 Huahua Wang , Arindam Banerjee

This paper presents a new regularization approach -- termed OpReg-Boost -- to boost the convergence and lessen the asymptotic error of online optimization and learning algorithms. In particular, the paper considers online algorithms for…

Machine Learning · Computer Science 2022-04-05 Nicola Bastianello , Andrea Simonetto , Emiliano Dall'Anese

In the online balanced graph repartitioning problem, one has to maintain a clustering of $n$ nodes into $\ell$ clusters, each having $k = n / \ell$ nodes. During runtime, an online algorithm is given a stream of communication requests…

Data Structures and Algorithms · Computer Science 2021-08-26 Marcin Bienkowski , Martin Böhm , Martin Koutecký , Thomas Rothvoß , Jiří Sgall , Pavel Veselý

We introduce a natural online allocation problem that connects several of the most fundamental problems in online optimization. Let $M$ be an $n$-point metric space. Consider a resource that can be allocated in arbitrary fractions to the…

Data Structures and Algorithms · Computer Science 2021-12-01 Nikhil Bansal , Christian Coester

This paper considers the distributed online convex optimization problem with time-varying constraints over a network of agents. This is a sequential decision making problem with two sequences of arbitrarily varying convex loss and…

Optimization and Control · Mathematics 2022-12-29 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Tianyou Chai , Karl H. Johansson

We study an online contextual decision-making problem with resource constraints. At each time period, the decision-maker first predicts a reward vector and resource consumption matrix based on a given context vector and then solves a…

Machine Learning · Computer Science 2022-06-16 Heyuan Liu , Paul Grigas

For many computational problems involving randomness, intricate geometric features of the solution space have been used to rigorously rule out powerful classes of algorithms. This is often accomplished through the lens of the multi Overlap…

Computational Complexity · Computer Science 2023-02-14 David Gamarnik , Eren C. Kızıldağ , Will Perkins , Changji Xu

This paper addresses safe distributed online optimization over an unknown set of linear safety constraints. A network of agents aims at jointly minimizing a global, time-varying function, which is only partially observable to each…

Optimization and Control · Mathematics 2023-02-27 Ting-Jui Chang , Sapana Chaudhary , Dileep Kalathil , Shahin Shahrampour

We investigate boosted online regression and propose a novel family of regression algorithms with strong theoretical bounds. In addition, we implement several variants of the proposed generic algorithm. We specifically provide theoretical…

Statistics Theory · Mathematics 2016-12-07 Dariush Kari , Farhan Khan , Selami Ciftci , Suleyman Serdar Kozat

We study the problem of maintaining a lightweight bounded-degree $(1+\varepsilon)$-spanner of a dynamic point set in a $d$-dimensional Euclidean space, where $\varepsilon>0$ and $d$ are arbitrary constants. In our fully-dynamic setting,…

Computational Geometry · Computer Science 2024-03-07 Hadi Khodabandeh , David Eppstein

We consider a variant of the classical online linear optimization problem in which at every step, the online player receives a "hint" vector before choosing the action for that round. Rather surprisingly, it was shown that if the hint…

Machine Learning · Computer Science 2020-10-05 Aditya Bhaskara , Ashok Cutkosky , Ravi Kumar , Manish Purohit

We study the problem of safe online convex optimization, where the action at each time step must satisfy a set of linear safety constraints. The goal is to select a sequence of actions to minimize the regret without violating the safety…

Machine Learning · Computer Science 2021-11-16 Sapana Chaudhary , Dileep Kalathil

We study the problem of online non-stochastic control (ONC), which is the control of a linear system under adversarial disturbances and adversarial cost functions, with the aim of minimizing the total cost incurred. A recent line of…

Optimization and Control · Mathematics 2026-04-21 Vijeth Hebbar , Spencer Hutchinson , Mahnoosh Alizadeh , Cédric Langbort