English
Related papers

Related papers: Stein COnsistent Risk Estimator (SCORE) for hard t…

200 papers

In this paper, we consider the problem of verifying safety constraint satisfaction for single-input single-output systems with uncertain transfer function coefficients. We propose a new type of barrier function based on a vector norm. This…

Optimization and Control · Mathematics 2020-08-04 Binghan He , Gray C. Thomas , Luis Sentis

Threshold selection is a fundamental problem in any threshold-based extreme value analysis. While models are asymptotically motivated, selecting an appropriate threshold for finite samples is difficult and highly subjective through standard…

Methodology · Statistics 2024-10-30 Conor Murphy , Jonathan A. Tawn , Zak Varty

This study proposes a robust estimator for stochastic frontier models by integrating the idea of Basu et al. [1998, Biometrika 85, 549-559] into such models. We verify that the suggested estimator is strongly consistent and asymptotic…

Methodology · Statistics 2015-07-29 Junmo Song , Dong-hyun Oh , Jiwon Kang

We observe a random measure $N$ and aim at estimating its intensity $s$. This statistical framework allows to deal simultaneously with the problems of estimating a density, the marginals of a multivariate distribution, the mean of a random…

Statistics Theory · Mathematics 2009-05-12 Yannick Baraud

Active learning seeks to build the best possible model with a budget of labelled data by sequentially selecting the next point to label. However the training set is no longer \textit{iid}, violating the conditions required by existing…

Machine Learning · Statistics 2019-10-14 Jack Goetz , Ambuj Tewari

Stein unbiased risk estimation is generalized twice, from the Gaussian shift model to nonparametric families of smooth densities, and from the quadratic risk to more general divergence type distances. The development relies on a connection…

Statistics Theory · Mathematics 2011-05-12 Werner Ehm

We develop a new approach for estimating the risk of an arbitrary estimator of the mean vector in the classical normal means problem. The key idea is to generate two auxiliary data vectors, by adding carefully constructed normal noise…

Statistics Theory · Mathematics 2024-04-25 Natalia L. Oliveira , Jing Lei , Ryan J. Tibshirani

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

The problem of estimating the shift (or, equivalently, the center of symmetry) of an unknown symmetric and periodic function $f$ observed in Gaussian white noise is considered. Using the blockwise Stein method, a penalized profile…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan

Knowing when a classifier's prediction can be trusted is useful in many applications and critical for safely using AI. While the bulk of the effort in machine learning research has been towards improving classifier performance,…

Machine Learning · Statistics 2018-10-30 Heinrich Jiang , Been Kim , Melody Y. Guan , Maya Gupta

Stein's formula states that a random variable of the form $z^\top f(z) - \text{div} f(z)$ is mean-zero for functions $f$ with integrable gradient. Here, $\text{div} f$ is the divergence of the function $f$ and $z$ is a standard normal…

Statistics Theory · Mathematics 2020-02-10 Pierre C Bellec , Cun-Hui Zhang

We consider a model selection estimator of the covariance of a random process. Using the Unbiased Risk Estimation (URE) method, we build an estimator of the risk which allows to select an estimator in a collection of model. Then, we present…

Statistics Theory · Mathematics 2011-12-22 Hélène Lescornel , Jean-Michel Loubes , Claudie Chabriac

To improve the efficiency of Monte Carlo estimation, practitioners are turning to biased Markov chain Monte Carlo procedures that trade off asymptotic exactness for computational speed. The reasoning is sound: a reduction in variance due to…

Machine Learning · Statistics 2019-01-03 Jackson Gorham , Lester Mackey

A data-driven block thresholding procedure for wavelet regression is proposed and its theoretical and numerical properties are investigated. The procedure empirically chooses the block size and threshold level at each resolution level by…

Statistics Theory · Mathematics 2009-03-31 T. Tony Cai , Harrison H. Zhou

We consider quasi-admissibility/inadmissibility of Stein-type shrinkage estimators of the mean of a multivariate normal distribution with covariance matrix an unknown multiple of the identity. Quasi-admissibility/inadmissibility is defined…

Statistics Theory · Mathematics 2016-09-13 Yuzo Maruyama , William E. Strawderman

Prediction performance of a risk scoring system needs to be carefully assessed before its adoption in clinical practice. Clinical preventive care often uses risk scores to screen asymptomatic population. The primary clinical interest is to…

Methodology · Statistics 2018-06-22 Yan Yuan , Qian M. Zhou , Bingying Li , Hengrui Cai , Eric J. Chow , Gregory T. Armstrong

We present an extension to the robust phase estimation protocol, which can identify incorrect results that would otherwise lie outside the expected statistical range. Robust phase estimation is increasingly a method of choice for…

Unbiased risk estimation, \`a la Stein, is studied for infinitely divisible laws with finite second moment.

Statistics Theory · Mathematics 2007-06-13 R. Averkamp , C. Houdré

Gradient estimation -- approximating the gradient of an expectation with respect to the parameters of a distribution -- is central to the solution of many machine learning problems. However, when the distribution is discrete, most common…

Machine Learning · Statistics 2024-04-16 Jiaxin Shi , Yuhao Zhou , Jessica Hwang , Michalis K. Titsias , Lester Mackey

Iterative thresholding algorithms seek to optimize a differentiable objective function over a sparsity or rank constraint by alternating between gradient steps that reduce the objective, and thresholding steps that enforce the constraint.…

Methodology · Statistics 2019-08-01 Haoyang Liu , Rina Foygel Barber