English
Related papers

Related papers: On estimation of nonsmooth functionals of sparse n…

200 papers

In this paper, a general class of regularized $M$-estimators of scatter matrix are proposed which are suitable also for low or insufficient sample support (small $n$ and large $p$) problems. The considered class constitutes a natural…

Applications · Statistics 2015-06-19 Esa Ollila , David E. Tyler

Consider a Gaussian nonparametric regression problem having both an unknown mean function and unknown variance function. This article presents a class of difference-based kernel estimators for the variance function. Optimal convergence…

Statistics Theory · Mathematics 2009-09-29 Lawrence D. Brown , M. Levine

We study estimation of a gradient-sparse parameter vector $\boldsymbol{\theta}^* \in \mathbb{R}^p$, having strong gradient-sparsity $s^*:=\|\nabla_G \boldsymbol{\theta}^*\|_0$ on an underlying graph $G$. Given observations $Z_1,\ldots,Z_n$…

Machine Learning · Statistics 2020-06-03 Sheng Xu , Zhou Fan , Sahand Negahban

We consider the estimation of an n-dimensional vector s from the noisy element-wise measurements of $\mathbf{s}\mathbf{s}^T$, a generic problem that arises in statistics and machine learning. We study a mismatched Bayesian inference…

Information Theory · Computer Science 2021-09-14 Farzad Pourkamali , Nicolas Macris

In high dimensional sparse regression, pivotal estimators are estimators for which the optimal regularization parameter is independent of the noise level. The canonical pivotal estimator is the square-root Lasso, formulated along with its…

Machine Learning · Statistics 2020-09-04 Mathurin Massias , Quentin Bertrand , Alexandre Gramfort , Joseph Salmon

For the important classical problem of inference on a sparse high-dimensional normal mean vector, we propose a novel empirical Bayes model that admits a posterior distribution with desirable properties under mild conditions. In particular,…

Statistics Theory · Mathematics 2014-10-31 Ryan Martin , Stephen G. Walker

An approximate maximum likelihood method of estimation of diffusion parameters $(\vartheta,\sigma)$ based on discrete observations of a diffusion $X$ along fixed time-interval $[0,T]$ and Euler approximation of integrals is analyzed. We…

Statistics Theory · Mathematics 2018-08-21 Miljenko Huzak

We consider a matrix-valued Gaussian sequence model, that is, we observe a sequence of high-dimensional $M \times N$ matrices of heterogeneous Gaussian random variables $x_{ij,k}$ for $i \in\{1,...,M\}$, $j \in \{1,...,N\}$ and $k \in…

Statistics Theory · Mathematics 2013-01-22 Cristina Butucea , Ghislaine Gayraud

The telegraph process $\{X(t), t>0\}$, is supposed to be observed at $n+1$ equidistant time points $t_i=i\Delta_n,i=0,1,..., n$. The unknown value of $\lambda$, the underlying rate of the Poisson process, is a parameter to be estimated. The…

Probability · Mathematics 2007-06-13 stefano m. iacus , nakahiro yoshida

We apply a method recently introduced to the statistical literature to directly estimate the precision matrix from an ensemble of samples drawn from a corresponding Gaussian distribution. Motivated by the observation that cosmological…

Instrumentation and Methods for Astrophysics · Physics 2016-05-25 Nikhil Padmanabhan , Martin White , Harrison H. Zhou , Ross O'Connell

We assume the direct sum <A> o <B> for the signal subspace. As a result of post- measurement, a number of operational contexts presuppose the a priori knowledge of the LB -dimensional "interfering" subspace <B> and the goal is to estimate…

Applications · Statistics 2017-04-17 Guillaume Bouleux , Rémy Boyer

We study the estimation problem for linear time-invariant (LTI) state-space models with Gaussian excitation of an unknown covariance. We provide non asymptotic lower bounds for the expected estimation error and the mean square estimation…

Statistics Theory · Mathematics 2021-09-20 Boualem Djehiche , Othmane Mazhar

We give the description of the following model: $$ U_{n}=X_{n}(Y_{n}+U_{n-1})$$ for $n>1$ in the case where the $X_{n}$ are i.d.d. random variables with probability density: $$ A x^{A-1} , x \in [0,1] ,$$ $A$ is also a random variable…

Probability · Mathematics 2013-12-10 Jean-François Chamayou

The problem of estimating a linear functional based on observational data is canonical in both the causal inference and bandit literatures. We analyze a broad class of two-stage procedures that first estimate the treatment effect function,…

Statistics Theory · Mathematics 2022-09-28 Wenlong Mou , Martin J. Wainwright , Peter L. Bartlett

We propose a general methodology for the construction and analysis of minimax estimators for a wide class of functionals of finite dimensional parameters, and elaborate on the case of discrete distributions, where the alphabet size $S$ is…

Information Theory · Computer Science 2015-03-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

We consider sparse matrix estimation where the goal is to estimate an $n\times n$ matrix from noisy observations of a small subset of its entries. We analyze the estimation error of the popularly utilized collaborative filtering algorithm…

Statistics Theory · Mathematics 2025-07-29 Christian Borgs , Jennifer Chayes , Devavrat Shah , Christina Lee Yu

We consider constrained optimization problems with a nonsmooth objective function in the form of mathematical expectation. The Sample Average Approximation (SAA) is used to estimate the objective function and variable sample size strategy…

Optimization and Control · Mathematics 2022-08-09 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

Let $\varepsilon_1,\ldots,\varepsilon_n$ be independent identically distributed Rademacher random variables, that is $\mathbb{P}\{\varepsilon_i=\pm1\}=1/2$. Let $S_n=a_1\varepsilon_1+\cdots+a_n\varepsilon_n$, where…

Probability · Mathematics 2015-06-02 Vidmantas Kastytis Bentkus , Dainius Dzindzalieta

We study the problem of estimating an unknown vector $\theta$ from an observation $X$ drawn according to the normal distribution with mean $\theta$ and identity covariance matrix under the knowledge that $\theta$ belongs to a known closed…

Statistics Theory · Mathematics 2017-03-03 Xi Chen , Adityanand Guntuboyina , Yuchen Zhang

This article studies a trimmed version of the Nadaraya-Watson estimator to estimate the unknown non-parametric regression function. The characterization of the estimator through minimization problem is established, and its pointwise…

Statistics Theory · Mathematics 2019-09-27 Subhra Sankar Dhar , Prashant Jha , Prabrisha Rakhshit