English
Related papers

Related papers: Submatrix localization via message passing

200 papers

Submodular maximization is a classic algorithmic problem with multiple applications in data mining and machine learning; there, the growing need to deal with massive instances motivates the design of algorithms balancing the quality of the…

Data Structures and Algorithms · Computer Science 2024-02-20 Georgios Amanatidis , Federico Fusco , Philip Lazos , Stefano Leonardi , Alberto Marchetti Spaccamela , Rebecca Reiffenhäuser

We revisit Matrix Balancing, a pre-conditioning task used ubiquitously for computing eigenvalues and matrix exponentials. Since 1960, Osborne's algorithm has been the practitioners' algorithm of choice and is now implemented in most…

Optimization and Control · Mathematics 2021-07-06 Jason M. Altschuler , Pablo A. Parrilo

In array processing, a common problem is to estimate the angles of arrival of $K$ deterministic sources impinging on an array of $M$ antennas, from $N$ observations of the source signal, corrupted by gaussian noise. The problem reduces to…

Probability · Mathematics 2011-06-28 Walid Hachem , Philippe Loubaton , Xavier Mestre , Jamal Najim , Pascal Vallet

A well-known analysis of Tropp and Gilbert shows that orthogonal matching pursuit (OMP) can recover a k-sparse n-dimensional real vector from 4 k log(n) noise-free linear measurements obtained through a random Gaussian measurement matrix…

Information Theory · Computer Science 2015-05-28 Alyson K. Fletcher , Sundeep Rangan

Factorization machine (FM) is a popular machine learning model to capture the second order feature interactions. The optimal learning guarantee of FM and its generalized version is not yet developed. For a rank $k$ generalized FM of $d$…

Machine Learning · Statistics 2019-02-01 Ming Lin , Shuang Qiu , Jieping Ye , Xiaomin Song , Qi Qian , Liang Sun , Shenghuo Zhu , Rong Jin

The problem of approximately computing the $k$ dominant Fourier coefficients of a vector $X$ quickly, and using few samples in time domain, is known as the Sparse Fourier Transform (sparse FFT) problem. A long line of work on the sparse FFT…

Data Structures and Algorithms · Computer Science 2017-04-12 Volkan Cevher , Michael Kapralov , Jonathan Scarlett , Amir Zandieh

Knapsack is one of the most fundamental problems in theoretical computer science. In the $(1 - \epsilon)$-approximation setting, although there is a fine-grained lower bound of $(n + 1 / \epsilon) ^ {2 - o(1)}$ based on the $(\min,…

Data Structures and Algorithms · Computer Science 2025-08-12 Xiao Mao

Clustering is a long-standing research problem and a fundamental tool in AI and data analysis. The traditional k-center problem, a fundamental theoretical challenge in clustering, has a best possible approximation ratio of 2, and any…

Machine Learning · Computer Science 2026-04-28 Chaoqi Jia , Longkun Guo , Kewen Liao , Zhigang Lu , Chao Chen , Jason Xue

We study the problem of recovering an incomplete $m\times n$ matrix of rank $r$ with columns arriving online over time. This is known as the problem of life-long matrix completion, and is widely applied to recommendation system, computer…

Machine Learning · Computer Science 2016-12-04 Maria-Florina Balcan , Hongyang Zhang

This paper is motivated by the reconstruction problem on the sparse stochastic block model. Mossel, et. al. proved that a reconstruction algorithm that recovers an optimal fraction of the communities in the symmetric, 2-community case. The…

Probability · Mathematics 2023-12-20 Byron Chin , Allan Sly

We consider the problem of reconstructing a rank-$k$ $n \times n$ matrix $M$ from a sampling of its entries. Under a certain incoherence assumption on $M$ and for the case when both the rank and the condition number of $M$ are bounded, it…

Machine Learning · Statistics 2017-08-23 David Gamarnik , Quan Li , Hongyi Zhang

Compressive sensing aims to recover a high-dimensional sparse signal from a relatively small number of measurements. In this paper, a novel design of the measurement matrix is proposed. The design is inspired by the construction of…

Information Theory · Computer Science 2016-03-22 Xu Chen , Dongning Guo

The problem central to sparse recovery and compressive sensing is that of stable sparse recovery: we want a distribution of matrices A in R^{m\times n} such that, for any x \in R^n and with probability at least 2/3 over A, there is an…

Data Structures and Algorithms · Computer Science 2011-12-30 Eric Price , David P. Woodruff

Computing accurate low rank approximations of large matrices is a fundamental data mining task. In many applications however the matrix contains sensitive information about individuals. In such case we would like to release a low rank…

Data Structures and Algorithms · Computer Science 2012-11-06 Moritz Hardt , Aaron Roth

We consider the classic $k$-center problem {in the constant dimensional Euclidean space} under a parallel setting, on the low-local-space Massively Parallel Computation (MPC) model, with local space per machine of ${O}(n^{\delta})$, where…

Data Structures and Algorithms · Computer Science 2026-04-21 Sam Coy , Artur Czumaj , Gopinath Mishra

We consider a class of pattern matching problems where a normalising transformation is applied at every alignment. Normalised pattern matching plays a key role in fields as diverse as image processing and musical information processing…

Data Structures and Algorithms · Computer Science 2015-03-19 Ayelet Butman , Peter Clifford , Raphael Clifford , Markus Jalsenius , Noa Lewenstein , Benny Porat , Ely Porat , Benjamin Sach

We consider the synthesis problem of Compressed Sensing - given s and an MXn matrix A, extract from it an mXn submatrix A', certified to be s-good, with m as small as possible. Starting from the verifiable sufficient conditions of…

Optimization and Control · Mathematics 2014-04-11 Anatoli Juditsky , Fatma Kilinc Karzan , Arkadii S. Nemirovski

Clustering and estimating cluster means are core problems in statistics and machine learning, with k-means and Expectation Maximization (EM) being two widely used algorithms. In this work, we provide a theoretical explanation for the…

Machine Learning · Statistics 2025-06-19 David Silva-Sánchez , Roy R. Lederman

In this paper, we first propose a new iterative algorithm, called the K-sets+ algorithm for clustering data points in a semi-metric space, where the distance measure does not necessarily satisfy the triangular inequality. We show that the…

Data Structures and Algorithms · Computer Science 2017-05-12 Cheng-Shang Chang , Chia-Tai Chang , Duan-Shin Lee , Li-Heng Liou

In this paper, we investigate optimization problems with nonnegative and orthogonal constraints, where any feasible matrix of size $n \times p$ exhibits a sparsity pattern such that each row accommodates at most one nonzero entry. Our…

Optimization and Control · Mathematics 2025-11-06 Lei Wang , Xin Liu , Xiaojun Chen