English
Related papers

Related papers: Can we define a best estimator in simple 1-D cases…

200 papers

We study the parameter estimation problem for a varying index coefficient model in high dimensions. Unlike the most existing works that iteratively estimate the parameters and link functions, based on the generalized Stein's identity, we…

Machine Learning · Statistics 2019-10-29 Sen Na , Zhuoran Yang , Zhaoran Wang , Mladen Kolar

Parameter estimation is one of the most important tasks in statistics, and is key to helping people understand the distribution behind a sample of observations. Traditionally parameter estimation is done either by closed-form solutions…

Machine Learning · Computer Science 2024-03-04 Xiaoxin Yin , David S. Yin

The main approach to inference for multivariate extremes consists in approximating the joint upper tail of the observations by a parametric family arising in the limit for extreme events. The latter may be expressed in terms of…

Methodology · Statistics 2015-06-17 Raphaël Huser , Anthony C. Davison , Marc G. Genton

Many learning algorithms require categorical data to be transformed into real vectors before it can be used as input. Often, categorical variables are encoded as one-hot (or dummy) vectors. However, this mode of representation can be…

Machine Learning · Statistics 2021-10-29 Jonathan Johannemann , Vitor Hadad , Susan Athey , Stefan Wager

We study the optimal linear prediction of a random function that takes values in an infinite dimensional Hilbert space. We begin by characterizing the mean square prediction error (MSPE) associated with a linear predictor and discussing the…

Statistics Theory · Mathematics 2025-09-10 Won-Ki Seo

We propose a novel methodology relating item response theory methods with small area estimation strategies in the presence of missing data. Specifically, we propose an unbiased estimator for the average ability parameter of three-parameter…

The selection of the best classification algorithm for a given dataset is a very widespread problem, occuring each time one has to choose a classifier to solve a real-world problem. It is also a complex task with many important…

Machine Learning · Computer Science 2012-08-16 Vincent Labatut , Hocine Cherifi

We consider estimating the parametric components of semi-parametric multiple index models in a high-dimensional and non-Gaussian setting. Such models form a rich class of non-linear models with applications to signal processing, machine…

Statistics Theory · Mathematics 2018-07-19 Zhuoran Yang , Krishnakumar Balasubramanian , Han Liu

We consider the problem of estimating the parameters of a supercritical controlled branching process consistently from a single observed trajectory of population size counts. Our goal is to establish which parameters can and cannot be…

Probability · Mathematics 2025-08-19 Peter Braunsteins , Sophie Hautphenne , James Kerlidis

We show that scale-adjusted versions of the centroid-based classifier enjoys optimal properties when used to discriminate between two very high-dimensional populations where the principal differences are in location. The scale adjustment…

Statistics Theory · Mathematics 2010-02-26 Peter Hall , Tung Pham

Efficiency of self-optimizing systems is heavily dependent on their optimization strategies, e.g., choosing exact or approximate solver. A choice of such a strategy, in turn, is influenced by numerous factors, such as re-optimization time,…

Machine Learning · Computer Science 2019-09-10 Dmytro Pukhkaiev , Uwe Aßmann

In this paper, we study an asymptotic approximation of the Fisher information for the estimation of a scalar parameter using quantized measurements. We show that, as the number of quantization intervals tends to infinity, the loss of Fisher…

Information Theory · Computer Science 2013-10-28 Rodrigo Cabral Farias , Jean-Marc Brossier

We address the problem of existence of unbiased constrained parameter estimators. We show that if the constrained set of parameters is compact and the hypothesized distributions are absolutely continuous with respect to one another, then…

Statistics Theory · Mathematics 2016-09-26 Anelia Somekh-Baruch , Amir Leshem , Venkatesh Saligrama

We study the asymptotic behavior of piecewise constant least squares regression estimates, when the number of partitions of the estimate is penalized. We show that the estimator is consistent in the relevant metric if the signal is in…

Statistics Theory · Mathematics 2009-09-29 Leif Boysen , Volkmar Liebscher , Axel Munk , Olaf Wittich

We consider least squares estimators of the finite regression parameter $\alpha$ in the single index regression model $Y=\psi(\alpha^T X)+\epsilon$, where $X$ is a $d$-dimensional random vector, $\E(Y|X)=\psi(\alpha^T X)$, and where $\psi$…

Statistics Theory · Mathematics 2023-01-31 Fadoua Balabdaoui , Piet Groeneboom

We compare estimators of the (essential) supremum and the integral of a function $f$ defined on a measurable space when $f$ may be observed at a sample of points in its domain, possibly with error. The estimators compared vary in their…

Statistics Theory · Mathematics 2017-04-04 Larry Goldstein , Yosef Rinott , Marco Scarsini

We study admissibility of a subclass of generalized Bayes estimators of a multivariate normal vector when the variance is unknown, under scaled quadratic loss. Minimaxity is also established for certain of these estimators.

Statistics Theory · Mathematics 2020-03-20 Yuzo Maruyama , William E. Strawderman

An effective two-stage method for an estimation of parameters of the linear regression is considered. For this purpose we introduce a certain quasi-estimator that, in contrast to usual estimator, produces two alternative estimates. It is…

Statistics Theory · Mathematics 2010-10-06 Anatoly Gordinsky

We consider the problem of estimating the unconditional distribution of a post-model-selection estimator. The notion of a post-model-selection estimator here refers to the combined procedure resulting from first selecting a model (e.g., by…

Statistics Theory · Mathematics 2007-11-08 Hannes Leeb , Benedikt M. Poetscher

This paper investigates the estimation of radio channel parameters from receiver data, whereby the transmitter is fully unknown. We use a multipath model to describe the radio channel between transmitter and receiver. According to this…

Information Theory · Computer Science 2015-12-14 Stephan Häfner , Reiner Thomä