English
Related papers

Related papers: Efficient estimation with incomplete data via gene…

200 papers

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

Combining information both within and between sample realizations, we propose a simple estimator for the local regularity of surfaces in the functional data framework. The independently generated surfaces are measured with errors at…

Statistics Theory · Mathematics 2023-10-03 Omar Kassi , Nicolas Klutchnikoff , Valentin Patilea

Generalized linear models are a popular tool in applied statistics, with their maximum likelihood estimators enjoying asymptotic Gaussianity and efficiency. As all models are wrong, it is desirable to understand these estimators' behaviours…

Methodology · Statistics 2024-12-10 Elliot H. Young , Rajen D. Shah

People employ the function-on-function regression to model the relationship between two random curves. Fitting this model, widely used strategies include algorithms falling into the framework of functional partial least squares (typically…

Methodology · Statistics 2021-02-12 Zhiyang Zhou

We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…

Machine Learning · Statistics 2020-05-29 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

We study estimation of a multivariate function $f:{\bf R}^d \to {\bf R}$ when the observations are available from function $Af$, where $A$ is a known linear operator. Both the Gaussian white noise model and density estimation are studied.…

Statistics Theory · Mathematics 2009-04-21 Jussi Klemelä , Enno Mammen

In this paper we tackle the ANOVA problem for directional data (with particular emphasis on geological data) by having recourse to the Le Cam methodology usually reserved for linear multivariate analysis. We construct locally and…

Statistics Theory · Mathematics 2012-12-07 Christophe Ley , Yvik Swan , Thomas Verdebout

This paper establishes a nearly optimal algorithm for estimating the frequencies and amplitudes of a mixture of sinusoids from noisy equispaced samples. We derive our algorithm by viewing line spectral estimation as a sparse recovery…

Information Theory · Computer Science 2013-04-02 Gongguo Tang , Badri Narayan Bhaskar , Benjamin Recht

Observations which are realizations from some continuous process are frequent in sciences, engineering, economics, and other fields. We consider linear models, with possible random effects, where the responses are random functions in a…

Statistics Theory · Mathematics 2016-11-30 Giacomo Aletti , Caterina May , Chiara Tommasi

This paper focuses on a semiparametric regression model in which the response variable is explained by the sum of two components. One of them is parametric (linear), the corresponding explanatory variable is measured with additive error and…

Methodology · Statistics 2024-11-20 Silvia Novo , Germán Aneiros , Philippe Vieu

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

Statistics Theory · Mathematics 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao

We study convex empirical risk minimization for high-dimensional inference in binary models. Our first result sharply predicts the statistical performance of such estimators in the linear asymptotic regime under isotropic Gaussian features.…

Statistics Theory · Mathematics 2020-02-27 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

This paper obtains asymptotic results for parametric inference using prediction-based estimating functions when the data are high frequency observations of a diffusion process with an infinite time horizon. Specifically, the data are…

Statistics Theory · Mathematics 2020-07-27 Emil S. Jørgensen , Michael Sørensen

We develop a computational procedure to estimate the covariance hyperparameters for semiparametric Gaussian process regression models with additive noise. Namely, the presented method can be used to efficiently estimate the variance of the…

Machine Learning · Computer Science 2022-06-22 Siavash Ameli , Shawn C. Shadden

This paper is concerned with estimation and inference for ultrahigh dimensional partially linear single-index models. The presence of high dimensional nuisance parameter and nuisance unknown function makes the estimation and inference…

Methodology · Statistics 2024-04-09 Shijie Cui , Xu Guo , Zhe Zhang

Recently, Su and Cook proposed a dimension reduction technique called the inner envelope which can be substantially more efficient than the original envelope or existing dimension reduction techniques for multivariate regression. However,…

Methodology · Statistics 2022-05-25 Linquan Ma , Hyunseung Kang , Lan Liu

To investigate a dilemma of statistical and computational efficiency faced by long-run variance estimators, we propose a decomposition of kernel weights in a quadratic form and some online inference principles. These proposals allow us to…

Methodology · Statistics 2024-09-10 Man Fung Leung , Kin Wai Chan

It is often of interest to make inference on an unknown function that is a local parameter of the data-generating mechanism, such as a density or regression function. Such estimands can typically only be estimated at a…

Methodology · Statistics 2021-05-17 Aaron Hudson , Marco Carone , Ali Shojaie

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

Machine Learning · Computer Science 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

We study semiparametric varying-coefficient partially linear models when some linear covariates are not observed, but ancillary variables are available. Semiparametric profile least-square based estimation procedures are developed for…

Statistics Theory · Mathematics 2009-03-04 Yong Zhou , Hua Liang