中文
相关论文

相关论文: Minimum Variance Estimation of a Sparse Vector wit…

200 篇论文

We study nonasymptotic minimax estimation of the linear functional $L(\theta)=\eta^\top \theta$ for a high-dimensional $s$-sparse mean vector with an arbitrary loading vector $\eta$. For symmetric noise with exponentially decaying tails, we…

统计理论 · 数学 2026-04-29 Jie Xie , Dongming Huang

We derive improved regression and classification rates for support vector machines using Gaussian kernels under the assumption that the data has some low-dimensional intrinsic structure that is described by the box-counting dimension. Under…

统计理论 · 数学 2021-04-08 Thomas Hamm , Ingo Steinwart

We consider the estimation of a sparse parameter vector from measurements corrupted by white Gaussian noise. Our focus is on unbiased estimation as a setting under which the difficulty of the problem can be quantified analytically. We show…

信息论 · 计算机科学 2010-02-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

Compressed sensing deals with the reconstruction of sparse signals using a small number of linear measurements. One of the main challenges in compressed sensing is to find the support of a sparse signal. In the literature, several bounds on…

信息论 · 计算机科学 2009-11-26 Ali Hormati , Amin Karbasi , Soheil Mohajer , Martin Vetterli

Given a heterogeneous Gaussian sequence model with unknown mean $\theta \in \mathbb R^d$ and known covariance matrix $\Sigma = \operatorname{diag}(\sigma_1^2,\dots, \sigma_d^2)$, we study the signal detection problem against sparse…

统计理论 · 数学 2023-08-03 Julien Chhor , Rajarshi Mukherjee , Subhabrata Sen

This paper focusses on the sparse estimation in the situation where both the the sensing matrix and the measurement vector are corrupted by additive Gaussian noises. The performance bound of sparse estimation is analyzed and discussed in…

信息论 · 计算机科学 2015-06-12 Yujie Tang , Laming Chen , Yuantao Gu

This paper presents a novel variational inference framework for deriving a family of Bayesian sparse Gaussian process regression (SGPR) models whose approximations are variationally optimal with respect to the full-rank GPR model enriched…

机器学习 · 计算机科学 2019-03-25 Haibin Yu , Trong Nghia Hoang , Kian Hsiang Low , Patrick Jaillet

In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the square loss, closing a…

机器学习 · 计算机科学 2019-05-28 Kwang-Sung Jun , Ashok Cutkosky , Francesco Orabona

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

信号处理 · 电气工程与系统科学 2017-11-01 Michael Krikheli , Amir Leshem

We consider the problem of estimating a sparse linear regression vector $\beta^*$ under a gaussian noise model, for the purpose of both prediction and model selection. We assume that prior knowledge is available on the sparsity pattern,…

We study the estimation of the covariance matrix $\Sigma$ of a $p$-dimensional normal random vector based on $n$ independent observations corrupted by additive noise. Only a general nonparametric assumption is imposed on the distribution of…

统计理论 · 数学 2018-03-28 Denis Belomestny , Mathias Trabs , Alexandre B. Tsybakov

We assume the direct sum <A> o <B> for the signal subspace. As a result of post- measurement, a number of operational contexts presuppose the a priori knowledge of the LB -dimensional "interfering" subspace <B> and the goal is to estimate…

应用统计 · 统计学 2017-04-17 Guillaume Bouleux , Rémy Boyer

This paper presents a variational Bayesian kernel selection (VBKS) algorithm for sparse Gaussian process regression (SGPR) models. In contrast to existing GP kernel selection algorithms that aim to select only one kernel with the highest…

机器学习 · 计算机科学 2019-12-06 Tong Teng , Jie Chen , Yehong Zhang , Kian Hsiang Low

We consider the problem of sparse normal means estimation in a distributed setting with communication constraints. We assume there are $M$ machines, each holding $d$-dimensional observations of a $K$-sparse vector $\mu$ corrupted by…

机器学习 · 统计学 2022-02-15 Chen Amiraz , Robert Krauthgamer , Boaz Nadler

Gaussian Graphical Models (GGMs) are popular tools for studying network structures. However, many modern applications such as gene network discovery and social interactions analysis often involve high-dimensional noisy data with outliers or…

机器学习 · 统计学 2015-10-30 Eunho Yang , Aurélie C. Lozano

We present estimators for a well studied statistical estimation problem: the estimation for the linear regression model with soft sparsity constraints ($\ell_q$ constraint with $0<q\leq1$) in the high-dimensional setting. We first present a…

统计理论 · 数学 2013-11-11 Li Zhang

We consider the observations of an unknown $s$-sparse vector ${\boldsymbol \theta}$ corrupted by Gaussian noise with zero mean and unknown covariance matrix ${\boldsymbol \Sigma}$. We propose minimax optimal methods of estimating the…

统计理论 · 数学 2026-03-17 Yuhao Wang , Pengkun Yang , Alexandre B. Tsybakov

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

统计理论 · 数学 2016-07-21 Jana Janková , Sara van de Geer

In this paper, we consider the estimation of a low Tucker rank tensor from a number of noisy linear measurements. The general problem covers many specific examples arising from applications, including tensor regression, tensor completion,…

机器学习 · 统计学 2023-07-11 Yuetian Luo , Anru R. Zhang

We consider the problem of estimation of a linear functional in the Gaussian sequence model where the unknown vector theta in R^d belongs to a class of s-sparse vectors with unknown s. We suggest an adaptive estimator achieving a…