English
Related papers

Related papers: Online Matrix Completion with Side Information

200 papers

This work addresses the classic machine learning problem of online prediction with expert advice. We consider the finite-horizon version of this zero-sum, two-person game. Using verification arguments from optimal control theory, we view…

Machine Learning · Computer Science 2020-06-30 Vladimir A. Kobzar , Robert V. Kohn , Zhilei Wang

Online parameter identification is of importance, e.g., for model predictive control. Since the parameters have to be identified simultaneously to the process of the modeled system, dynamical update laws are used for state and parameter…

Numerical Analysis · Mathematics 2016-04-20 Romana Boiger , Barbara Kaltenbacher

We study the matrix discrepancy problem in the average-case setting. Given a sequence of $m \times m$ symmetric matrices $A_1,\ldots,A_n$, its discrepancy is defined as the minimal spectral norm over all signed sums $\sum_{i=1}^n x_iA_i$…

Probability · Mathematics 2025-10-07 Dmitriy Kunisky , Timm Oertel , Nicola Wengiel , Peiyuan Zhang

Recent progress in (semi-)streaming algorithms for monotone submodular function maximization has led to tight results for a simple cardinality constraint. However, current techniques fail to give a similar understanding for natural…

Data Structures and Algorithms · Computer Science 2022-02-17 Moran Feldman , Paul Liu , Ashkan Norouzi-Fard , Ola Svensson , Rico Zenklusen

Submodular maximization subject to matroid constraints is a central problem with many applications in machine learning. As algorithms are increasingly used in decision-making over datapoints with sensitive attributes such as gender or race,…

Data Structures and Algorithms · Computer Science 2026-01-16 Sepideh Mahabadi , Sherry Sarkar , Jakub Tarnawski

We study algorithms for online linear optimization in Hilbert spaces, focusing on the case where the player is unconstrained. We develop a novel characterization of a large class of minimax algorithms, recovering, and even improving,…

Machine Learning · Computer Science 2014-05-22 H. Brendan McMahan , Francesco Orabona

Bin covering is a dual version of classic bin packing. Thus, the goal is to cover as many bins as possible, where covering a bin means packing items of total size at least one in the bin. For online bin covering, competitive analysis fails…

Data Structures and Algorithms · Computer Science 2014-02-28 Marie G. Christ , Lene M. Favrholdt , Kim S. Larsen

Given any increasing sequence of norms $\|\cdot\|_0,\dots,\|\cdot\|_{T-1}$, we provide an online convex optimization algorithm that outputs points $w_t$ in some domain $W$ in response to convex losses $\ell_t:W\to \mathbb{R}$ that…

Machine Learning · Computer Science 2020-02-11 Ashok Cutkosky

We consider the classic Set Cover problem in the data stream model. For $n$ elements and $m$ sets ($m\geq n$) we give a $O(1/\delta)$-pass algorithm with a strongly sub-linear $\tilde{O}(mn^{\delta})$ space and logarithmic approximation…

Data Structures and Algorithms · Computer Science 2016-05-03 Sariel Har-Peled , Piotr Indyk , Sepideh Mahabadi , Ali Vakilian

We study the online learning with feedback graphs framework introduced by Mannor and Shamir (2011), in which the feedback received by the online learner is specified by a graph $G$ over the available actions. We develop an algorithm that…

Machine Learning · Computer Science 2021-07-21 Liad Erez , Tomer Koren

Motivated by studying the power of randomness, certifying algorithms and barriers for fine-grained reductions, we investigate the question whether the multiplication of two $n\times n$ matrices can be performed in near-optimal…

Data Structures and Algorithms · Computer Science 2018-06-26 Marvin Künnemann

We advance a recently flourishing line of work at the intersection of learning theory and computational economics by studying the learnability of two classes of mechanisms prominent in economics, namely menus of lotteries and two-part…

Computer Science and Game Theory · Computer Science 2024-07-17 Maria-Florina Balcan , Hedyeh Beyhaghi

Why does the low dimensionality of representations, typically $d\approx 1000$, not prevent modern embedding-based retrieval models from scaling to billions, or even trillions, of data points? To answer this question, we study maximal-margin…

Machine Learning · Computer Science 2026-05-25 Kiril Bangachev , Guy Bresler , Jonathan Kogan , Yury Polyanskiy

Online bidding is a classical problem in online decision-making, with applications in resource allocation, hierarchical clustering, and the analysis of approximation algorithms. We study its randomized learning-augmented variant, where an…

Data Structures and Algorithms · Computer Science 2026-05-15 Mathis Degryse , Imrane Saakour , Christoph Dürr , Spyros Angelopoulos

We consider the setting of online linear regression for arbitrary deterministic sequences, with the square loss. We are interested in the aim set by Bartlett et al. (2015): obtain regret bounds that hold uniformly over all competitor…

Machine Learning · Statistics 2019-02-26 Pierre Gaillard , Sébastien Gerchinovitz , Malo Huard , Gilles Stoltz

This paper considers the matrix completion problem. We show that it is not necessary to assume joint incoherence, which is a standard but unintuitive and restrictive condition that is imposed by previous studies. This leads to a sample…

Information Theory · Computer Science 2016-11-15 Yudong Chen

We revisit online binary classification by shifting the focus from competing with the best-in-class binary loss to competing against relaxed benchmarks that capture smoothed notions of optimality. Instead of measuring regret relative to the…

Machine Learning · Statistics 2025-04-16 Omar Montasser , Abhishek Shetty , Nikita Zhivotovskiy

We consider online learning problems under a partial observability model capturing situations where the information conveyed to the learner is between full information and bandit feedback. In the simplest variant, we assume that in addition…

Machine Learning · Computer Science 2026-04-28 Tomas Kocak , Gergely Neu , Michal Valko , Remi Munos

Let $D(n)$ be the maximal determinant for $n \times n$ $\{\pm 1\}$-matrices, and ${\mathcal R}(n) = D(n)/n^{n/2}$ be the ratio of $D(n)$ to the Hadamard upper bound. We give several new lower bounds on ${\mathcal R}(n)$ in terms of $d$,…

Combinatorics · Mathematics 2016-10-26 Richard P. Brent , Judy-anne H. Osborn , Warren D. Smith

It is the main goal of this paper to propose a novel method to perform matrix completion on-line. Motivated by a wide variety of applications, ranging from the design of recommender systems to sensor network localization through seismic…

Machine Learning · Statistics 2014-01-13 Charanpal Dhanjal , Romaric Gaudel , Stéphan Clémençon