中文
相关论文

相关论文: 0-1 phase transitions in sparse spiked matrix esti…

200 篇论文

We consider the problem of detecting the presence of a signal in a rank-one spiked Wigner model. For general non-Gaussian noise, assuming that the signal is drawn from the Rademacher prior, we prove that the log likelihood ratio (LR) of the…

统计理论 · 数学 2024-12-19 Hye Won Chung , Jiho Lee , Ji Oon Lee

We establish exact asymptotic expressions for the normalized mutual information and minimum mean-square-error (MMSE) of sparse linear regression in the sub-linear sparsity regime. Our result is achieved by a generalization of the adaptive…

信息论 · 计算机科学 2023-04-11 Lan V. Truong

Asymptotic lower bounds for estimation play a fundamental role in assessing the quality of statistical procedures. In this paper we propose a framework for obtaining semi-parametric efficiency bounds for sparse high-dimensional models,…

统计理论 · 数学 2017-10-16 Jana Jankova , Sara van de Geer

Estimation of a high dimensional precision matrix is a critical problem to many areas of statistics including Gaussian graphical models and inference on high dimensional data. Working under the structural assumption of sparsity, we propose…

统计方法学 · 统计学 2020-12-17 Adam B Kashlak

Estimating singular subspaces from noisy matrices is a fundamental problem with wide-ranging applications across various fields. Driven by the challenges of data integration and multi-view analysis, this study focuses on estimating shared…

统计理论 · 数学 2024-11-27 Zhengchi Ma , Rong Ma

We consider generalized linear models in regimes where the number of nonzero components of the signal and accessible data points are sublinear with respect to the size of the signal. We prove a variational formula for the asymptotic mutual…

信息论 · 计算机科学 2020-10-29 Clément Luneau , Jean Barbier , Nicolas Macris

Motivated by multimodal estimation, we study a multi-view spiked Wigner model in which several noisy matrix observations contain correlated latent spikes. We derive a spectral estimator for the latent spikes by linearizing approximate…

概率论 · 数学 2026-05-20 Xiaodong Yang , Subhabrata Sen , Yue M. Lu

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

统计理论 · 数学 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

This paper investigates how models of spatiotemporal dynamics in the form of nonlinear partial differential equations can be identified directly from noisy data using a combination of sparse regression and weak formulation. Using the…

动力系统 · 数学 2020-01-08 Daniel R. Gurevich , Patrick A. K. Reinbold , Roman O. Grigoriev

We consider the problem of recovering an unknown low-rank matrix X with (possibly) non-orthogonal, effectively sparse rank-1 decomposition from measurements y gathered in a linear measurement process A. We propose a variational formulation…

信息论 · 计算机科学 2023-06-13 Johannes Maly

Consider the standard Gaussian linear regression model $Y=X\theta+\epsilon$, where $Y\in R^n$ is a response vector and $ X\in R^{n*p}$ is a design matrix. Numerous work have been devoted to building efficient estimators of $\theta$ when $p$…

统计理论 · 数学 2012-01-26 Nicolas Verzelen

We consider high dimensional sparse regression, and develop strategies able to deal with arbitrary -- possibly, severe or coordinated -- errors in the covariance matrix $X$. These may come from corrupted data, persistent experimental…

机器学习 · 统计学 2013-01-15 Yudong Chen , Constantine Caramanis , Shie Mannor

This paper studies the problem of shuffled linear regression, where the correspondence between predictors and responses in a linear model is obfuscated by a latent permutation. Specifically, we consider the model $y = \Pi_* X \beta_* + w$,…

统计理论 · 数学 2024-02-16 Leon Lufkin , Yihong Wu , Jiaming Xu

This paper considers the problem of detecting the support (sparsity pattern) of a sparse vector from random noisy measurements. Conditional power of a component of the sparse vector is defined as the energy conditioned on the component…

信息论 · 计算机科学 2015-03-24 Alyson K. Fletcher , Sundeep Rangan , Vivek K Goyal

We consider a sparse high dimensional regression model where the goal is to recover a $k$-sparse unknown vector $\beta^*$ from $n$ noisy linear observations of the form $Y=X\beta^*+W \in \mathbb{R}^n$ where $X \in \mathbb{R}^{n \times p}$…

统计理论 · 数学 2019-09-24 David Gamarnik , Ilias Zadik

We consider unbiased estimation of a sparse nonrandom vector corrupted by additive white Gaussian noise. We show that while there are infinitely many unbiased estimators for this problem, none of them has uniformly minimum variance.…

统计理论 · 数学 2010-06-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

We study the statistical decision process of detecting the signal from a `signal+noise' type matrix model with an additive Wigner noise. We propose a hypothesis test based on the linear spectral statistics of the data matrix, which does not…

统计理论 · 数学 2021-03-05 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

We consider the problem of estimating the support of a vector $\beta^* \in \mathbb{R}^{p}$ based on observations contaminated by noise. A significant body of work has studied behavior of $\ell_1$-relaxations when applied to measurement…

机器学习 · 统计学 2008-05-21 Dapo Omidiran , Martin J. Wainwright

This paper studies the problem of power allocation in compressed sensing when different components in the unknown sparse signal have different probability to be non-zero. Given the prior information of the non-uniform sparsity and the total…

信息论 · 计算机科学 2014-05-12 Xiaochen Zhao , Wei Dai

This paper develops theoretical results regarding noisy 1-bit compressed sensing and sparse binomial regression. We show that a single convex program gives an accurate estimate of the signal, or coefficient vector, for both of these models.…

信息论 · 计算机科学 2012-07-20 Yaniv Plan , Roman Vershynin