English
Related papers

Related papers: Computational and Statistical Boundaries for Subma…

200 papers

To model modern large-scale datasets, we need efficient algorithms to infer a set of $P$ unknown model parameters from $N$ noisy measurements. What are fundamental limits on the accuracy of parameter inference, given finite signal-to-noise…

Machine Learning · Statistics 2016-09-07 Madhu Advani , Surya Ganguli

A simple model to study subspace clustering is the high-dimensional $k$-Gaussian mixture model where the cluster means are sparse vectors. Here we provide an exact asymptotic characterization of the statistically optimal reconstruction…

Machine Learning · Statistics 2023-04-04 Luca Pesce , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

We determine statistical and computational limits for estimation of a rank-one matrix (the spike) corrupted by an additive gaussian noise matrix, in a sparse limit, where the underlying hidden vector (that constructs the rank-one matrix)…

Information Theory · Computer Science 2020-11-02 Jean Barbier , Nicolas Macris , Cynthia Rush

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

In this paper, we explore statistical versus computational trade-off to address a basic question in the application of a distributed algorithm: what is the minimal computational cost in obtaining statistical optimality? In smoothing spline…

Statistics Theory · Mathematics 2017-07-25 Zuofeng Shang , Guang Cheng

We introduce a framework for proving lower bounds on computational problems over distributions against algorithms that can be implemented using access to a statistical query oracle. For such algorithms, access to the input distribution is…

Computational Complexity · Computer Science 2016-08-16 Vitaly Feldman , Elena Grigorescu , Lev Reyzin , Santosh Vempala , Ying Xiao

Statistical inference problems arising within signal processing, data mining, and machine learning naturally give rise to hard combinatorial optimization problems. These problems become intractable when the dimensionality of the data is…

Statistical Mechanics · Physics 2017-04-27 Adel Javanmard , Andrea Montanari , Federico Ricci-Tersenghi

Accurate detection of signal components is a frequently-encountered challenge in statistical applications with low signal-to-noise ratio. This problem is particularly challenging in settings with heteroscedastic noise. In certain…

Computation · Statistics 2021-08-19 William Leeb

In the study of high-dimensional data, it is often assumed that the data set possesses an underlying lower-dimensional structure. A practical model for this structure is an embedded compact manifold with boundary. Since the underlying…

Machine Learning · Statistics 2025-08-22 Pei-Cheng Kuo , Nan Wu

Reinforcement learning with function approximation has recently achieved tremendous results in applications with large state spaces. This empirical success has motivated a growing body of theoretical work proposing necessary and sufficient…

Machine Learning · Computer Science 2022-07-05 Daniel Kane , Sihan Liu , Shachar Lovett , Gaurav Mahajan

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

The problem of compressive detection of random subspace signals is studied. We consider signals modeled as $\mathbf{s} = \mathbf{H} \mathbf{x}$ where $\mathbf{H}$ is an $N \times K$ matrix with $K \le N$ and $\mathbf{x} \sim…

Information Theory · Computer Science 2016-05-06 Alireza Razavi , Mikko Valkama , Danijela Cabric

This paper studies the statistical and computational limits of high-order clustering with planted structures. We focus on two clustering models, constant high-order clustering (CHC) and rank-one higher-order clustering (ROHC), and study the…

Statistics Theory · Mathematics 2023-10-04 Yuetian Luo , Anru R. Zhang

Signal detection in environments with unknown signal bandwidth and time intervals is a fundamental problem in adversarial and spectrum-sharing scenarios. This paper addresses the problem of detecting signals occupying unknown degrees of…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Ali Rasteh , Sundeep Rangan

We consider the densest submatrix problem, which seeks the submatrix of fixed size of a given binary matrix that contains the most nonzero entries. This problem is a natural generalization of fundamental problems in combinatorial…

Optimization and Control · Mathematics 2026-03-13 Valentine Olanubi , Phineas Agar , Brendan Ames

Randomized matrix sparsification has proven to be a fruitful technique for producing faster algorithms in applications ranging from graph partitioning to semidefinite programming. In the decade or so of research into this technique, the…

Numerical Analysis · Mathematics 2009-11-23 Alex Gittens , Joel A. Tropp

High signal to noise ratio (SNR) consistency of model selection criteria in linear regression models has attracted a lot of attention recently. However, most of the existing literature on high SNR consistency deals with model order…

Machine Learning · Statistics 2017-03-13 Sreejith Kallummil , Sheetal Kalyani

We study the density estimation problem defined as follows: given $k$ distributions $p_1, \ldots, p_k$ over a discrete domain $[n]$, as well as a collection of samples chosen from a ``query'' distribution $q$ over $[n]$, output $p_i$ that…

Data Structures and Algorithms · Computer Science 2024-10-31 Anders Aamand , Alexandr Andoni , Justin Y. Chen , Piotr Indyk , Shyam Narayanan , Sandeep Silwal , Haike Xu

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

We present a new computational approach to approximating a large, noisy data table by a low-rank matrix with sparse singular vectors. The approximation is obtained from thresholded subspace iterations that produce the singular vectors…

Methodology · Statistics 2011-12-13 Dan Yang , Zongming Ma , Andreas Buja