中文
相关论文

相关论文: Low-degree estimation thresholds in planted hyperg…

200 篇论文

Sparse principal component analysis (SPCA) is widely used for dimensionality reduction and feature extraction in high-dimensional data analysis. Despite many methodological and theoretical developments in the past two decades, the…

统计理论 · 数学 2023-05-01 Teng Zhang , Haoyi Yang , Lingzhou Xue

Sparse principal component analysis (PCA) involves nonconvex optimization for which the global solution is hard to obtain. To address this issue, one popular approach is convex relaxation. However, such an approach may produce suboptimal…

机器学习 · 统计学 2014-08-25 Zhaoran Wang , Huanran Lu , Han Liu

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

统计理论 · 数学 2009-08-26 Arash A. Amini , Martin J. Wainwright

Suppose we are given an $n$-dimensional order-3 symmetric tensor $T \in (\mathbb{R}^n)^{\otimes 3}$ that is the sum of $r$ random rank-1 terms. The problem of recovering the rank-1 components is possible in principle when $r \lesssim n^2$…

计算复杂性 · 计算机科学 2023-03-28 Alexander S. Wein

We consider two problems that arise in machine learning applications: the problem of recovering a planted sparse vector in a random linear subspace and the problem of decomposing a random low-rank overcomplete 3-tensor. For both problems,…

数据结构与算法 · 计算机科学 2016-02-04 Samuel B. Hopkins , Tselil Schramm , Jonathan Shi , David Steurer

In recent work, robust Principal Components Analysis (PCA) has been posed as a problem of recovering a low-rank matrix $\mathbf{L}$ and a sparse matrix $\mathbf{S}$ from their sum, $\mathbf{M}:= \mathbf{L} + \mathbf{S}$ and a provably exact…

信息论 · 计算机科学 2023-07-19 Jinchun Zhan , Namrata Vaswani

We introduce a framework for proving lower bounds on computational problems over distributions against algorithms that can be implemented using access to a statistical query oracle. For such algorithms, access to the input distribution is…

计算复杂性 · 计算机科学 2016-08-16 Vitaly Feldman , Elena Grigorescu , Lev Reyzin , Santosh Vempala , Ying Xiao

We investigate the computation of minimum-cost spanning trees satisfying prescribed vertex degree constraints: Given a graph $G$ and a constraint function $D$, we ask for a (minimum-cost) spanning tree $T$ such that for each vertex $v$, $T$…

数据结构与算法 · 计算机科学 2026-05-05 Narek Bojikian , Alexander Firbas , Robert Ganian , Hung P. Hoang , Krisztina Szilágyi

As tensors become widespread in modern data analysis, Tucker low-rank Principal Component Analysis (PCA) has become essential for dimensionality reduction and structural discovery in tensor datasets. Motivated by the common scenario where…

统计方法学 · 统计学 2025-04-08 Elynn Chen , Xi Chen , Wenbo Jing , Yichen Zhang

The widespread use of multisensor technology and the emergence of big data sets have brought the necessity to develop more versatile tools to represent higher-order data with multiple aspects and high dimensionality. Data in the form of…

信号处理 · 电气工程与系统科学 2018-06-27 Ali Zare , Alp Ozdemir , Mark A. Iwen , Selin Aviyente

Tensor robust principal component analysis (RPCA), which seeks to separate a low-rank tensor from its sparse corruptions, has been crucial in data science and machine learning where tensor structures are becoming more prevalent. While…

机器学习 · 统计学 2022-12-23 Harry Dong , Megna Shah , Sean Donegan , Yuejie Chi

We consider an online version of the robust Principle Component Analysis (PCA), which arises naturally in time-varying source separations such as video foreground-background separation. This paper proposes a compressive online robust PCA…

信息论 · 计算机科学 2017-05-30 Huynh Van Luong , Nikos Deligiannis , Jurgen Seiler , Soren Forchhammer , Andre Kaup

Sparse linear regression with ill-conditioned Gaussian random designs is widely believed to exhibit a statistical/computational gap, but there is surprisingly little formal evidence for this belief, even in the form of examples that are…

数据结构与算法 · 计算机科学 2022-03-08 Jonathan A. Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

A dynamic graph algorithm is a data structure that answers queries about a property of the current graph while supporting graph modifications such as edge insertions and deletions. Prior work has shown strong conditional lower bounds for…

数据结构与算法 · 计算机科学 2023-01-30 Monika Henzinger , Ami Paz , A. R. Sricharan

High-dimensional data sets are often analyzed and explored via the construction of a latent low-dimensional space which enables convenient visualization and efficient predictive modeling or clustering. For complex data structures, linear…

机器学习 · 计算机科学 2022-05-25 Oskar Allerbo , Rebecka Jörnsten

Many real world datasets subsume a linear or non-linear low-rank structure in a very low-dimensional space. Unfortunately, one often has very little or no information about the geometry of the space, resulting in a highly under-determined…

计算机视觉与模式识别 · 计算机科学 2016-05-27 Nauman Shahid , Nathanael Perraudin , Pierre Vandergheynst

Detection of planted subgraphs in Erd\"os-R\'enyi random graphs has been extensively studied, leading to a rich body of results characterizing both statistical and computational thresholds. However, most prior work assumes a purely random…

信息论 · 计算机科学 2025-08-05 Dor Elimelech , Wasim Huleihel

Many statistical estimation techniques for high-dimensional or functional data are based on a preliminary dimension reduction step, which consists in projecting the sample $\bX_1, \hdots, \bX_n$ onto the first $D$ eigenvectors of the…

统计理论 · 数学 2010-04-26 Gérard Biau , André Mas

We propose a robust and efficient approach to the problem of compressive phase retrieval in which the goal is to reconstruct a sparse vector from the magnitude of a number of its linear measurements. The proposed framework relies on…

信息论 · 计算机科学 2015-10-28 Sohail Bahmani , Justin Romberg

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

机器学习 · 统计学 2022-03-22 Joshua K. Behne , Galen Reeves