English
Related papers

Related papers: On Approximation Guarantees for Greedy Low Rank Op…

200 papers

We present an optimal, combinatorial 1-1/e approximation algorithm for monotone submodular optimization over a matroid constraint. Compared to the continuous greedy algorithm (Calinescu, Chekuri, Pal and Vondrak, 2008), our algorithm is…

Data Structures and Algorithms · Computer Science 2013-11-20 Yuval Filmus , Justin Ward

In this paper we develop a procedure to deal with a family of parameter-dependent ill-posed problems, for which the exact solution in general does not exist. The original problems are relaxed by considering corresponding approximate ones,…

Analysis of PDEs · Mathematics 2022-06-29 Martin Lazar , Enrique Zuazua

We study the convergence of a variant of distributed gradient descent (DGD) on a distributed low-rank matrix approximation problem wherein some optimization variables are used for consensus (as in classical DGD) and some optimization…

Optimization and Control · Mathematics 2018-12-27 Zhihui Zhu , Qiuwei Li , Xinshuo Yang , Gongguo Tang , Michael B. Wakin

Nowadays, low-rank approximations of matrices are an important component of many methods in science and engineering. Traditionally, low-rank approximations are considered in unitary invariant norms, however, recently element-wise…

Numerical Analysis · Mathematics 2026-05-15 Stanislav Morozov , Dmitry Zheltkov , Alexander Osinsky

We introduce and study the problem of consistent low-rank approximation, in which rows of an input matrix $\mathbf{A}\in\mathbb{R}^{n\times d}$ arrive sequentially and the goal is to provide a sequence of subspaces that well-approximate the…

Data Structures and Algorithms · Computer Science 2026-03-03 David P. Woodruff , Samson Zhou

We address the collective matrix completion problem of jointly recovering a collection of matrices with shared structure from partial (and potentially noisy) observations. To ensure well--posedness of the problem, we impose a joint low rank…

Machine Learning · Statistics 2015-04-09 Suriya Gunasekar , Makoto Yamada , Dawei Yin , Yi Chang

Motivated by online advertisement and exchange settings, greedy randomized algorithms for the maximum matching problem have been studied, in which the algorithm makes (random) decisions that are essentially oblivious to the input graph. Any…

Data Structures and Algorithms · Computer Science 2013-07-12 T-H. Hubert Chan , Fei Chen , Xiaowei Wu , Zhichao Zhao

Two common approaches in low-rank optimization problems are either working directly with a rank constraint on the matrix variable, or optimizing over a low-rank factorization so that the rank constraint is implicitly ensured. In this paper,…

Optimization and Control · Mathematics 2020-12-17 Wooseok Ha , Haoyang Liu , Rina Foygel Barber

Submodular maximization subject to matroid constraints is a central problem with many applications in machine learning. As algorithms are increasingly used in decision-making over datapoints with sensitive attributes such as gender or race,…

Data Structures and Algorithms · Computer Science 2026-01-16 Sepideh Mahabadi , Sherry Sarkar , Jakub Tarnawski

This paper studies noisy low-rank matrix completion: given partial and noisy entries of a large low-rank matrix, the goal is to estimate the underlying matrix faithfully and efficiently. Arguably one of the most popular paradigms to tackle…

Machine Learning · Statistics 2019-10-08 Yuxin Chen , Yuejie Chi , Jianqing Fan , Cong Ma , Yuling Yan

We propose a method for low-rank semidefinite programming in application to the semidefinite relaxation of unconstrained binary quadratic problems. The method improves an existing solution of the semidefinite programming relaxation to…

Optimization and Control · Mathematics 2021-12-07 Roman Pogodin , Mikhail Krechetov , Yury Maximov

We study the problem of estimating a low-rank positive semidefinite (PSD) matrix from a set of rank-one measurements using sensing vectors composed of i.i.d. standard Gaussian entries, which are possibly corrupted by arbitrary outliers.…

Information Theory · Computer Science 2016-12-21 Yuanxin Li , Yue Sun , Yuejie Chi

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

Machine Learning · Statistics 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

We consider minimizing a smooth function subject to a summation constraint over its variables. By exploiting a connection between the greedy 2-coordinate update for this problem and equality-constrained steepest descent in the 1-norm, we…

Optimization and Control · Mathematics 2023-07-04 Amrutha Varshini Ramesh , Aaron Mishkin , Mark Schmidt , Yihan Zhou , Jonathan Wilder Lavington , Jennifer She

We study the problem of learning a partially observed matrix under the low rank assumption in the presence of fully observed side information that depends linearly on the true underlying matrix. This problem consists of an important…

Machine Learning · Statistics 2026-02-05 Dimitris Bertsimas , Nicholas A. G. Johnson

We consider the problem of maximizing a monotone nondecreasing set function under multiple constraints, where the constraints are also characterized by monotone nondecreasing set functions. We propose two greedy algorithms to solve the…

Optimization and Control · Mathematics 2023-05-09 Lintao Ye , Zhi-Wei Liu , Ming Chi , Vijay Gupta

Many important problems in discrete optimization require maximization of a monotonic submodular function subject to matroid constraints. For these problems, a simple greedy algorithm is guaranteed to obtain near-optimal solutions. In this…

Data Structures and Algorithms · Computer Science 2015-03-17 Daniel Golovin , Andreas Krause

Bayesian Reinforcement Learning (RL) is capable of not only incorporating domain knowledge, but also solving the exploration-exploitation dilemma in a natural way. As Bayesian RL is intractable except for special cases, previous work has…

Artificial Intelligence · Computer Science 2013-06-14 Kenji Kawaguchi , Mauricio Araya

While greedy algorithms have long been observed to perform well on a wide variety of problems, up to now approximation ratios have only been known for their application to problems having submodular objective functions $f$. Since many…

Data Structures and Algorithms · Computer Science 2018-01-16 J. David Smith , My T. Thai

Geometric optimisation algorithms are developed that efficiently find the nearest low-rank correlation matrix. We show, in numerical tests, that our methods compare favourably to the existing methods in the literature. The connection with…

Other Condensed Matter · Physics 2007-05-23 Igor Grubisic , Raoul Pietersz