English
Related papers

Related papers: Asymptotically efficient estimation of linear func…

200 papers

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

Machine Learning · Statistics 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of…

Machine Learning · Statistics 2024-02-20 Jiading Liu , Lei Shi

Estimation of linear functionals from observed data is an important task in many subjects. Juditsky & Nemirovski [The Annals of Statistics 37.5A (2009): 2278-2300] propose a framework for non-parametric estimation of linear functionals in a…

Statistics Theory · Mathematics 2021-12-08 Akshay Seshadri , Stephen Becker

In this paper, we study parametric nonlinear regression under the Harris recurrent Markov chain framework. We first consider the nonlinear least squares estimators of the parameters in the homoskedastic case, and establish asymptotic theory…

Statistics Theory · Mathematics 2016-09-15 Degui Li , Dag Tjøstheim , Jiti Gao

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

Consider a nonparametric regression model with one-sided errors and regression function in a general H\"older class. We estimate the regression function via minimization of the local integral of a polynomial approximation. We show uniform…

Methodology · Statistics 2016-10-12 Holger Drees , Natalie Neumeyer , Leonie Selk

This paper studies the inference of the regression coefficient matrix under multivariate response linear regressions in the presence of hidden variables. A novel procedure for constructing confidence intervals of entries of the coefficient…

Methodology · Statistics 2022-01-21 Xin Bing , Wei Cheng , Huijie Feng , Yang Ning

In randomized controlled trials without interference, regression adjustment is widely used to enhance the efficiency of treatment effect estimation. This paper extends this efficiency principle to settings with network interference, where a…

Methodology · Statistics 2025-02-18 Xinyuan Fan , Chenlei Leng , Weichi Wu

Characterizing the distribution of high-dimensional statistical estimators is a challenging task, due to the breakdown of classical asymptotic theory in high dimension. This paper makes progress towards this by developing non-asymptotic…

Statistics Theory · Mathematics 2024-01-09 Gen Li , Yuting Wei

This work concerns the estimation of multidimensional nonlinear regression models using multilayer perceptrons (MLPs). The main problem with such models is that we need to know the covariance matrix of the noise to get an optimal estimator.…

Statistics Theory · Mathematics 2008-02-22 Joseph Rynkiewicz

In this paper, we propose the application of shrinkage strategies to estimate coefficients in the Bell regression models when prior information about the coefficients is available. The Bell regression models are well-suited for modeling…

Statistics Theory · Mathematics 2024-01-03 Solmaz Seifollahi , Hossein Bevrani , Zakariya Yahya Algamal

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

There has been a recent surge of interest in the study of asymptotic reconstruction performance in various cases of generalized linear estimation problems in the teacher-student setting, especially for the case of i.i.d standard normal…

Machine Learning · Statistics 2023-02-20 Cedric Gerbelot , Alia Abbara , Florent Krzakala

In this paper, we observe a fixed number of unknown $2\pi$-periodic functions differing from each other by both phases and amplitude. This semiparametric model appears in literature under the name "shape invariant model." While the common…

Statistics Theory · Mathematics 2010-10-06 Myriam Vimond

This paper is devoted to the estimation of the shift parameter in a semiparametric regression model when the distribution of the observation times is unknown. Hence, we propose to use a stochastic algorithm which takes into account the…

Statistics Theory · Mathematics 2013-12-23 Philippe Fraysse

The ill-posedness of the inverse problem of recovering a regression function in a nonparametric instrumental variable model leads to estimators that may suffer from a very slow, logarithmic rate of convergence. In this paper, we show that…

Applications · Statistics 2017-09-27 Denis Chetverikov , Daniel Wilhelm

We consider the problem of estimating smooth integrated functionals of a monotone nonincreasing density $f$ on $[0,\infty)$ using the nonparametric maximum likelihood based plug-in estimator. We find the exact asymptotic distribution of…

Statistics Theory · Mathematics 2019-04-16 Rajarshi Mukherjee , Bodhisattva Sen

The objective of this work is to propose an asymptotic correction method for the estimators of parameters from regression models with covariates subject to classification errors. A correction was developed based on the least squares…

Methodology · Statistics 2025-07-11 Alexandre Garcia Dias , Mariana Rodrigues Motta , Alexandre Hild Aono

In this paper we develop a nonparametric regression method that is simultaneously adaptive over a wide range of function classes for the regression function and robust over a large collection of error distributions, including those that are…

Statistics Theory · Mathematics 2008-10-28 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

We study iterative signal reconstruction in computed tomography (CT), wherein measurements are produced by a linear transformation of the unknown signal followed by an exponential nonlinear map. Approaches based on pre-processing the data…

Optimization and Control · Mathematics 2024-07-19 Vasileios Charisopoulos , Rebecca Willett