English
Related papers

Related papers: Minimax estimation with thresholding and its appli…

200 papers

Wavelet estimators for a probability density f enjoy many good properties, however they are not "shape-preserving" in the sense that the final estimate may not be non-negative or integrate to unity. A solution to negativity issues may be to…

Methodology · Statistics 2017-08-29 Carlos Aya Moreno , Gery Geenens , Spiridon Penev

We consider estimating the parametric components of semi-parametric multiple index models in a high-dimensional and non-Gaussian setting. Such models form a rich class of non-linear models with applications to signal processing, machine…

Statistics Theory · Mathematics 2018-07-19 Zhuoran Yang , Krishnakumar Balasubramanian , Han Liu

We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics,…

Statistics Theory · Mathematics 2023-12-27 Akifumi Okuno , Masaaki Imaizumi

We introduce a class of dimension reduction estimators based on an ensemble of the minimum average variance estimates of functions that characterize the central subspace, such as the characteristic functions, the Box--Cox transformations…

Statistics Theory · Mathematics 2012-03-16 Xiangrong Yin , Bing Li

We study design-unbiased estimation of the finite-population total $\sum_{i=1}^N y_i$ when each outcome satisfies known bounds $y_i\in[a_i,b_i]$. For any sampling design with inclusion probabilities $\pi_i>0$, we prove a sharp lower bound…

Statistics Theory · Mathematics 2026-05-21 P. M. Aronow , Patrick Lopatto

We develop approximation algorithms for set-selection problems with deterministic constraints, but random objective values, i.e., stochastic probing problems. When the goal is to maximize the objective, approximation algorithms for probing…

Data Structures and Algorithms · Computer Science 2021-11-04 Weina Wang , Anupam Gupta , Jalani Williams

We want to reconstruct a signal based on inhomogeneous data (the amount of data can vary strongly), using the model of regression with a random design. Our aim is to understand the consequences of inhomogeneity on the accuracy of estimation…

Statistics Theory · Mathematics 2016-08-16 Stéphane Gaiffas

Many statistical estimands can expressed as continuous linear functionals of a conditional expectation function. This includes the average treatment effect under unconfoundedness and generalizations for continuous-valued and personalized…

Methodology · Statistics 2020-11-23 David A. Hirshberg , Stefan Wager

We consider the nonparametric estimation problem of time-dependent multivariate functions observed in a presence of additive cylindrical Gaussian white noise of a small intensity. We derive minimax lower bounds for the $L^2$-risk in the…

Statistics Theory · Mathematics 2012-11-02 Jérémie Bigot , Theofanis Sapatinas

The problem of quickest change detection is studied in the context of detecting an arbitrary unknown mean-shift in multiple independent Gaussian data streams. The James-Stein estimator is used in constructing detection schemes that exhibit…

Statistics Theory · Mathematics 2026-04-21 Topi Halme , Venugopal V. Veeravalli , Visa Koivunen

We develop an approach for estimating models described via conditional moment restrictions, with a prototypical application being non-parametric instrumental variable regression. We introduce a min-max criterion function, under which the…

Econometrics · Economics 2020-06-15 Nishanth Dikkala , Greg Lewis , Lester Mackey , Vasilis Syrgkanis

High-dimensional time series are a core ingredient of the statistical modeling toolkit, for which numerous estimation methods are known.But when observations are scarce or corrupted, the learning task becomes much harder.The question is:…

Signal Processing · Electrical Eng. & Systems 2022-05-06 Guillaume Dalle , Yohann de Castro

We consider minimax-optimal designs for the prediction of individual parameters in random coefficient regression models. We focus on the minimax-criterion, which minimizes the "worst case" for the basic criterion with respect to the…

Statistics Theory · Mathematics 2018-11-09 Maryna Prus

Stein's paradox holds considerable sway in high-dimensional statistics, highlighting that the sample mean, traditionally considered the de facto estimator, might not be the most efficacious in higher dimensions. To address this, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Seyedalireza Khoshsirat , Chandra Kambhamettu

The James-Stein estimator has attracted much interest as a shrinkage estimator that yields better estimates than the maximum likelihood estimator. The James-Stein estimator is also very useful as an argument in favor of empirical Bayesian…

Methodology · Statistics 2025-08-05 Yoshiko Hayashi

We study a class of statistical inverse problems with non-linear pointwise operators motivated by concrete statistical applications. A two-step procedure is proposed, where the first step smoothes the data and inverts the non-linearity.…

Statistics Theory · Mathematics 2016-11-08 Kolyan Ray , Johannes Schmidt-Hieber

This paper considers the problem of estimating a high-dimensional vector of parameters $\boldsymbol{\theta} \in \mathbb{R}^n$ from a noisy observation. The noise vector is i.i.d. Gaussian with known variance. For a squared-error loss…

Information Theory · Computer Science 2018-03-19 K. Pavan Srinath , Ramji Venkataramanan

For signals belonging to balls in smoothness classes and noise with enough moments, the asymptotic behavior of the minimax quadratic risk among soft-threshold estimates is investigated. In turn, these results, combined with a median…

Statistics Theory · Mathematics 2016-08-16 R. Averkamp , C. Houdré

The Reverse Stein Effect is identified and illustrated: A statistician who shrinks his/her data toward a point chosen without reliable knowledge about the underlying value of the parameter to be estimated but based instead upon the observed…

Methodology · Statistics 2012-03-27 Michael D. Perlman , Sanjay Chaudhuri

Optimal estimation and inference for both the minimizer and minimum of a convex regression function under the white noise and nonparametric regression models are studied in a nonasymptotic local minimax framework, where the performance of a…

Statistics Theory · Mathematics 2024-03-12 T. Tony Cai , Ran Chen , Yuancheng Zhu