English
Related papers

Related papers: Some new ideas in nonparametric estimation

200 papers

In this paper we investigate the problem of designing experiments for series estimators in nonparametric regression models with correlated observations. We use projection based estimators to derive an explicit solution of the best linear…

Statistics Theory · Mathematics 2018-12-14 Holger Dette , Maria Konstantinou , Kirsten Schorning

Bagging is a useful method for large-scale statistical analysis, especially when the computing resources are very limited. We study here the asymptotic properties of bagging estimators for $M$-estimation problems but with massive datasets.…

Statistics Theory · Mathematics 2023-04-14 Yuan Gao , Riquan Zhang , Hansheng Wang

We develop a set of scalable Bayesian inference procedures for a general class of nonparametric regression models. Specifically, nonparametric Bayesian inferences are separately performed on each subset randomly split from a massive…

Statistics Theory · Mathematics 2019-09-05 Zuofeng Shang , Botao Hao , Guang Cheng

We focus on the problem of manifold estimation: given a set of observations sampled close to some unknown submanifold $M$, one wants to recover information about the geometry of $M$. Minimax estimators which have been proposed so far all…

Statistics Theory · Mathematics 2021-10-27 Vincent Divol

Algorithmic statistics considers the following problem: given a binary string $x$ (e.g., some experimental data), find a "good" explanation of this data. It uses algorithmic information theory to define formally what is a good explanation.…

Machine Learning · Computer Science 2015-09-21 Alexey Milovanov

We consider an empirical likelihood framework for inference for a statistical model based on an informative sampling design. Covariate information is incorporated both through the weights and the estimating equations. The estimator is based…

Methodology · Statistics 2019-05-03 Sanjay Chaudhuri , Mark S. Handcock

In stochastic decision problems, one often wants to estimate the underlying probability measure statistically, and then to use this estimate as a basis for decisions. We shall consider how the uncertainty in this estimation can be…

Statistics Theory · Mathematics 2017-05-24 Samuel N. Cohen

The purpose of this paper is to provide guidelines for empirical researchers who use a class of bivariate threshold crossing models with dummy endogenous variables. A common practice employed by the researchers is the specification of the…

Econometrics · Economics 2019-03-06 Sukjin Han , Sungwon Lee

Debiased estimation has long been an area of research in the group testing literature. This has led to the development of several estimators with the goal of bias minimization and, recently, an unbiased estimator based on sequential…

Methodology · Statistics 2018-06-08 Gregory Haber , Yaakov Malinovsky

A novel approach to the problem of partial state estimation of nonlinear systems is proposed. The main idea is to translate the state estimation problem into one of estimation of constant, unknown parameters related to the systems initial…

Systems and Control · Computer Science 2016-04-08 Ortega Romeo , Bobtsov Alexey , Pyrkin Anton , Aranovskiy Stanislav

Ensuring that analyses performed on a dataset are representative of the entire population is one of the central problems in statistics. Most classical techniques assume that the dataset is independent of the analyst's query and break down…

Machine Learning · Computer Science 2024-09-25 Guy Blanc

For consistency (even oracle properties) of estimation and model prediction, almost all existing methods of variable/feature selection critically depend on sparsity of models. However, for ``large $p$ and small $n$" models sparsity…

Methodology · Statistics 2010-08-10 Lu Lin , Lixing Zhu , Yujie Gai

We consider a problem in parametric estimation: given $n$ samples from an unknown distribution, we want to estimate which distribution, from a given one-parameter family, produced the data. Following Schulman and Vazirani, we evaluate an…

Statistics Theory · Mathematics 2025-07-15 Aaron Abrams , Sandy Ganzell , Henry Landau , Zeph Landau , James Pommersheim , Eric Zaslow

The empirical distribution function assigns mass $1/n$ to each of the $n$ observations in a sample. As these are highly variable, estimation error may be reduced by replacing them with estimated observations that are asymptotically less…

Methodology · Statistics 2026-05-26 Tommaso Lando , Lorenzo Tedesco

A basic issue in both teaching of and practice of statistics is the interplay between modelling assumptions and inference performance. The general message conveyed is that stronger assumptions lead to better statistical performance of the…

Statistics Theory · Mathematics 2026-03-20 Morten Byholt , Nils Lid Hjort

A parameter estimation problem is considered for a stochastic parabolic equation with multiplicative noise under the assumption that the equation can be reduced to an infinite system of uncoupled diffusion processes. From the point of view…

Probability · Mathematics 2007-09-10 Igor Cialenco , Sergey V. Lototsky

The present paper discusses the problem of estimating the finite population mean of study variable in simple random sampling in the presence of non response and response error together. The estimators in this article use auxiliary…

Methodology · Statistics 2014-04-08 Prayas Sharma , Rajesh Singh

In the context of a species sampling problem we discuss a non-parametric maximum likelihood estimator for the underlying probability mass function. The estimator is known in the computer science literature as the high profile estimator. We…

Statistics Theory · Mathematics 2018-01-12 Dragi Anevski , Richard D. Gill , Stefan Zohren

We address the problem of A/B testing, a widely used protocol for evaluating the potential improvement achieved by a new decision system compared to a baseline. This protocol segments the population into two subgroups, each exposed to a…

Machine Learning · Statistics 2025-06-16 Otmane Sakhi , Alexandre Gilotte , David Rohde

Large-scale sequential data is often exposed to some degree of inhomogeneity in the form of sudden changes in the parameters of the data-generating process. We consider the problem of detecting such structural changes in a high-dimensional…

Methodology · Statistics 2016-01-15 Florencia Leonardi , Peter Bühlmann