中文
相关论文

相关论文: Minimum Variance Estimation of a Sparse Vector wit…

200 篇论文

A novel framework of compressed sensing, namely statistical compressed sensing (SCS), that aims at efficiently sampling a collection of signals that follow a statistical distribution, and achieving accurate reconstruction on average, is…

计算机视觉与模式识别 · 计算机科学 2015-05-27 Guoshen Yu , Guillermo Sapiro

This paper focuses on random projection operators when the subspace of projection is estimated. We derive non-asymptotic upper bounds on the error between the projection onto the estimated subspace and the projection onto the underlying…

统计理论 · 数学 2026-03-31 Luca Castelli

A constrained L1 minimization method is proposed for estimating a sparse inverse covariance matrix based on a sample of $n$ iid $p$-variate random variables. The resulting estimator is shown to enjoy a number of desirable properties. In…

统计方法学 · 统计学 2011-02-14 Tony Cai , Weidong Liu , Xi Luo

Large, multi-dimensional spatio-temporal datasets are omnipresent in modern science and engineering. An effective framework for handling such data are Gaussian process deep generative models (GP-DGMs), which employ GP priors over the latent…

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

统计理论 · 数学 2013-02-14 T. Tony Cai , Harrison H. Zhou

We study the sparse high-dimensional Gaussian mixture model when the number of clusters is allowed to grow with the sample size. A minimax lower bound for parameter estimation is established, and we show that a constrained maximum…

统计理论 · 数学 2024-02-26 Dapeng Yao , Fangzheng Xie , Yanxun Xu

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. However, when using such…

机器学习 · 计算机科学 2025-08-29 Neta Shoham , Haim Avron

To achieve scalable and accurate inference for latent Gaussian processes, we propose a variational approximation based on a family of Gaussian distributions whose covariance matrices have sparse inverse Cholesky (SIC) factors. We combine…

机器学习 · 统计学 2023-05-30 Jian Cao , Myeongjong Kang , Felix Jimenez , Huiyan Sang , Florian Schafer , Matthias Katzfuss

We propose a new sparse estimation method, termed MIC (Minimum approximated Information Criterion), for generalized linear models (GLM) in fixed dimensions. What is essentially involved in MIC is the approximation of the $\ell_0$-norm with…

统计方法学 · 统计学 2018-07-23 Xiaogang Su , Juanjuan Fan , Richard A. Levine , Martha E. Nunn , Chih-Ling Tsai

Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as $l_0$ regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called…

机器学习 · 统计学 2015-03-20 Kun Yang

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

数据结构与算法 · 计算机科学 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We consider the equivalent problems of estimating the residual variance, the proportion of explained variance $\eta$ and the signal strength in a high-dimensional linear regression model with Gaussian random design. Our aim is to understand…

统计方法学 · 统计学 2017-03-17 Nicolas Verzelen , Elisabeth Gassiat

This two-part work considers the minimum means square error (MMSE) estimation problem for a high dimensional multi-layer generalized linear model (ML-GLM), which resembles a feed-forward fully connected deep learning network in that each of…

信息论 · 计算机科学 2020-07-21 Haochuan Zhang , Qiuyun Zou , Hongwen Yang

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

统计理论 · 数学 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

Solving linear regression problems based on the total least-squares (TLS) criterion has well-documented merits in various applications, where perturbations appear both in the data vector as well as in the regression matrix. However,…

信息论 · 计算机科学 2011-04-20 Hao Zhu , Geert Leus , Georgios B. Giannakis

We consider distributed estimation of a Gaussian source in a heterogenous bandwidth constrained sensor network, where the source is corrupted by independent multiplicative and additive observation noises, with incomplete statistical…

信息论 · 计算机科学 2018-05-23 Alireza Sani , Azadeh Vosoughi

This note presents a unified analysis of the recovery of simple objects from random linear measurements. When the linear functionals are Gaussian, we show that an s-sparse vector in R^n can be efficiently recovered from 2s log n…

信息论 · 计算机科学 2012-03-01 Emmanuel Candes , Benjamin Recht

This paper considers the task of estimating the $l_2$ norm of a $n$-dimensional random Gaussian vector from noisy measurements taken after many of the entries of the vector are \emph{missed} and only $K\ (0\le K\le n)$ entries are retained…

信息论 · 计算机科学 2020-10-19 Samrat Mukhopadhyay

In this paper, we study the problem of recovering a group sparse vector from a small number of linear measurements. In the past the common approach has been to use various "group sparsity-inducing" norms such as the Group LASSO norm for…

机器学习 · 统计学 2018-07-31 Shashank Ranjan , Mathukumalli Vidyasagar

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

信号处理 · 电气工程与系统科学 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus