English
Related papers

Related papers: Low-degree estimation thresholds in planted hyperg…

200 papers

We study information-theoretic phase transitions for the detectability of latent geometry in bipartite random geometric graphs RGGs with Gaussian d-dimensional latent vectors while only a subset of edges carries latent information…

Probability · Mathematics 2026-04-13 Andreas Göbel , Marcus Pappik , Leon Schiller

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

Machine Learning · Statistics 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

The study of Markov processes and broadcasting on trees has deep connections to a variety of areas including statistical physics, graphical models, phylogenetic reconstruction, Markov Chain Monte Carlo, and community detection in random…

Probability · Mathematics 2022-10-26 Frederic Koehler , Elchanan Mossel

We consider a random sparse graph with bounded average degree, in which a subset of vertices has higher connectivity than the background. In particular, the average degree inside this subset of vertices is larger than outside (but still…

Machine Learning · Statistics 2015-09-02 Andrea Montanari

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

We study planted problems---finding hidden structures in random noisy inputs---through the lens of the sum-of-squares semidefinite programming hierarchy (SoS). This family of powerful semidefinite programs has recently yielded many new…

Data Structures and Algorithms · Computer Science 2017-10-31 Samuel B. Hopkins , Pravesh K. Kothari , Aaron Potechin , Prasad Raghavendra , Tselil Schramm , David Steurer

We study sparse principal components analysis in the high-dimensional setting, where $p$ (the number of variables) can be much larger than $n$ (the number of observations). We prove optimal, non-asymptotic lower and upper bounds on the…

Machine Learning · Statistics 2012-02-07 Vincent Q. Vu , Jing Lei

We investigate implications of the (extended) low-degree conjecture (recently formalized in [MW23]) in the context of the symmetric stochastic block model. Assuming the conjecture holds, we establish that no polynomial-time algorithm can…

Computational Complexity · Computer Science 2025-04-29 Jingqiu Ding , Yiding Hua , Lucas Slot , David Steurer

Radio map estimation from sparse measurements is fundamental to wireless network planning, optimization, and localized map updating. Most recent learning-based approaches formulate the problem as dense map completion over a predefined grid,…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Ang Li , Chengyu Liu , Yue Wang

In this paper, we consider the problem of learning high-dimensional tensor regression problems with low-rank structure. One of the core challenges associated with learning high-dimensional models is computation since the underlying…

Machine Learning · Statistics 2016-12-01 Han Chen , Garvesh Raskutti , Ming Yuan

We study the computational cost of recovering a unit-norm sparse principal component $x \in \mathbb{R}^n$ planted in a random matrix, in either the Wigner or Wishart spiked model (observing either $W + \lambda xx^\top$ with $W$ drawn from…

Statistics Theory · Mathematics 2022-06-24 Yunzi Ding , Dmitriy Kunisky , Alexander S. Wein , Afonso S. Bandeira

In many high-dimensional estimation problems the main task consists in minimizing a cost function, which is often strongly non-convex when scanned in the space of parameters to be estimated. A standard solution to flatten the corresponding…

Machine Learning · Statistics 2020-09-04 Giulio Biroli , Chiara Cammarota , Federico Ricci-Tersenghi

We develop two methods for the following fundamental statistical task: given an $\epsilon$-corrupted set of $n$ samples from a $d$-dimensional sub-Gaussian distribution, return an approximate top eigenvector of the covariance matrix. Our…

Data Structures and Algorithms · Computer Science 2020-06-15 Arun Jambulapati , Jerry Li , Kevin Tian

We consider the problem of mixed sparse linear regression with two components, where two real $k$-sparse signals $\beta_1, \beta_2$ are to be recovered from $n$ unlabelled noisy linear measurements. The sparsity is allowed to be sublinear…

Machine Learning · Statistics 2023-07-07 Gabriel Arpino , Ramji Venkataramanan

In this paper we consider asymptotically exact support recovery in the context of high dimensional and sparse Canonical Correlation Analysis (CCA). Our main results describe four regimes of interest based on information theoretic and…

Statistics Theory · Mathematics 2022-10-12 Nilanjana Laha , Rajarshi Mukherjee

Online or recursive robust PCA can be posed as a problem of recovering a sparse vector, $S_t$, and a dense vector, $L_t$, which lies in a slowly changing low-dimensional subspace, from $M_t:= S_t + L_t$ on-the-fly as new data comes in. For…

Information Theory · Computer Science 2014-05-26 Jinchun Zhan , Namrata Vaswani , Chenlu Qiu

We study the statistical limits of both detecting and estimating a rank-one deformation of a symmetric random Gaussian tensor. We establish upper and lower bounds on the critical signal-to-noise ratio, under a variety of priors for the…

Probability · Mathematics 2017-01-25 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira

We study a practical algorithm for sparse principal component analysis (PCA) of incomplete and noisy data. Our algorithm is based on the semidefinite program (SDP) relaxation of the non-convex $l_1$-regularized PCA problem. We provide…

Machine Learning · Statistics 2022-09-16 Hanbyul Lee , Qifan Song , Jean Honorio

We tackle the challenges of modeling high-dimensional data sets, particularly those with latent low-dimensional structures hidden within complex, non-linear, and noisy relationships. Our approach enables a seamless integration of concepts…

Machine Learning · Statistics 2025-03-17 Zichuan Guo , Mihai Cucuringu , Alexander Y. Shestopaloff

Significant recent work has studied the ability of gradient descent to recover a hidden planted direction $\theta^\star \in S^{d-1}$ in different high-dimensional settings, including tensor PCA and single-index models. The key quantity that…

Machine Learning · Computer Science 2026-03-09 Stanley Wei , Alex Damian , Jason D. Lee
‹ Prev 1 3 4 5 6 7 10 Next ›