中文
相关论文

相关论文: Low-degree estimation thresholds in planted hyperg…

200 篇论文

Tensor classification has become increasingly crucial in statistics and machine learning, with applications spanning neuroimaging, computer vision, and recommendation systems. However, the high dimensionality of tensors presents significant…

统计方法学 · 统计学 2024-09-24 Elynn Chen , Yuefeng Han , Jiayu Li

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

统计方法学 · 统计学 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

Sparse Principal Component Analysis (PCA) is a prevalent tool across a plethora of subfields of applied statistics. While several results have characterized the recovery error of the principal eigenvectors, these are typically in spectral…

统计理论 · 数学 2022-02-09 Joshua Agterberg , Jeremias Sulam

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

数据结构与算法 · 计算机科学 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

We study computational-statistical gaps for improper learning in sparse linear regression. More specifically, given $n$ samples from a $k$-sparse linear model in dimension $d$, we ask what is the minimum sample complexity to efficiently (in…

机器学习 · 计算机科学 2024-06-26 Rares-Darius Buhai , Jingqiu Ding , Stefan Tiegel

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

统计理论 · 数学 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

This work studies estimation of sparse principal components in high dimensions. Specifically, we consider a class of estimators based on kernel PCA, generalizing the covariance thresholding algorithm proposed by Krauthgamer et al. (2015).…

统计理论 · 数学 2025-04-10 Michael J. Feldman , Theodor Misiakiewicz , Elad Romanov

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

机器学习 · 计算机科学 2016-06-13 Furong Huang

Statistical inference for tensors has emerged as a critical challenge in analyzing high-dimensional data in modern data science. This paper introduces a unified framework for inferring general and low-Tucker-rank linear functionals of…

统计理论 · 数学 2025-01-28 Ke Xu , Elynn Chen , Yuefeng Han

Planted Dense Subgraph (PDS) problem is a prototypical problem with a computational-statistical gap. It also exhibits an intriguing additional phenomenon: different tasks, such as detection or recovery, appear to have different…

统计理论 · 数学 2023-07-03 Guy Bresler , Tianze Jiang

There is a growing body of work on proving hardness results for average-case estimation problems by bounding the low-degree advantage (LDA) - a quantitative estimate of the closeness of low-degree moments - between a null distribution and a…

计算复杂性 · 计算机科学 2025-05-26 Rares-Darius Buhai , Jun-Ting Hsieh , Aayush Jain , Pravesh K. Kothari

We study the problem of sparse tensor principal component analysis: given a tensor $\pmb Y = \pmb W + \lambda x^{\otimes p}$ with $\pmb W \in \otimes^p\mathbb{R}^n$ having i.i.d. Gaussian entries, the goal is to recover the $k$-sparse unit…

机器学习 · 计算机科学 2021-11-03 Davin Choo , Tommaso d'Orsi

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

机器学习 · 计算机科学 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

This paper develops several average-case reduction techniques to show new hardness results for three central high-dimensional statistics problems, implying a statistical-computational gap induced by robustness, a detection-recovery gap and…

计算复杂性 · 计算机科学 2020-05-20 Matthew Brennan , Guy Bresler

In sparse principal component analysis we are given noisy observations of a low-rank matrix of dimension $n\times p$ and seek to reconstruct it under additional sparsity assumptions. In particular, we assume here each of the principal…

统计理论 · 数学 2016-04-27 Yash Deshpande , Andrea Montanari

In this paper, we consider the statistical inference for several low-rank tensor models. Specifically, in the Tucker low-rank tensor PCA or regression model, provided with any estimates achieving some attainable error rate, we develop the…

统计理论 · 数学 2021-11-01 Dong Xia , Anru R. Zhang , Yuchen Zhou

Deep generative modeling has led to new and state of the art approaches for enforcing structural priors in a variety of inverse problems. In contrast to priors given by sparsity, deep models can provide direct low-dimensional…

最优化与控制 · 数学 2018-12-12 Wen Huang , Paul Hand , Reinhard Heckel , Vladislav Voroninski

Tensors, which provide a powerful and flexible model for representing multi-attribute data and multi-way interactions, play an indispensable role in modern data science across various fields in science and engineering. A fundamental task is…

机器学习 · 计算机科学 2022-06-23 Tian Tong , Cong Ma , Ashley Prater-Bennette , Erin Tripp , Yuejie Chi

In this paper, assuming the low-degree conjecture, we provide evidence of computational hardness for two problems: (1) the (partial) matching recovery problem in the sparse correlated Erd\H{o}s-R\'enyi graphs $\mathcal G(n,q;\rho)$ when the…

机器学习 · 统计学 2025-12-30 Zhangsong Li

In this article we consider the graph alignment problem from the perspective of high-dimensional statistics: we aim to estimate an unknown permutation $\pi^*$ from the observation of two correlated random adjacency matrices $A_1$, $A_2$. We…

概率论 · 数学 2025-10-30 Laurent Massoulié