English
Related papers

Related papers: On prediction errors in regression models with non…

200 papers

The van Trees inequality relates the Ensemble Mean Squared Error of an estimator to a Bayesian version of the Fisher Information. The Ziv-Zakai inequality relates the Ensemble Mean Squared Error of an estimator to the Minimum Probability of…

Information Theory · Computer Science 2019-02-04 Eric Clarkson

This paper proposes a class of ratio type estimators of finite population variance, when the population variance of an auxiliary character is known. Asymptotic expression for mean square error (MSE) is derived and compared with the mean…

Statistics Theory · Mathematics 2013-11-27 Jayant Singh , Viplav K. Singh , Sachin Malik , Rajesh Singh

We study the asymptotic behavior of piecewise constant least squares regression estimates, when the number of partitions of the estimate is penalized. We show that the estimator is consistent in the relevant metric if the signal is in…

Statistics Theory · Mathematics 2009-09-29 Leif Boysen , Volkmar Liebscher , Axel Munk , Olaf Wittich

This paper studies the distributed adaptiveestimation problems for stochastic large regression modelswith an infinite number of parameters. By constructing a re-cursive local cost function, we propose a novel distributedrecursive least…

Systems and Control · Electrical Eng. & Systems 2026-04-29 Die Gan , Siyu Xie , Zhixin Liu , Xuebo Zhang

Computer simulations have proven a valuable tool for understanding complex phenomena across the sciences. However, the utility of simulators for modelling and forecasting purposes is often restricted by low data quality, as well as…

Machine Learning · Statistics 2022-10-14 Daniel Ward , Patrick Cannon , Mark Beaumont , Matteo Fasiolo , Sebastian M Schmon

We study a least squares estimator for an unknown parameter in the drift coefficient of a path- distribution dependent stochastic differential equation involving a small dispersion parameter epsilon greater than zero. The estimator, based…

Probability · Mathematics 2018-02-06 Panpan Ren , Jiang-Lun Wu

We study the statistical properties of the least squares estimator in unimodal sequence estimation. Although closely related to isotonic regression, unimodal regression has not been as extensively studied. We show that the unimodal least…

Statistics Theory · Mathematics 2017-05-10 Sabyasachi Chatterjee , John Lafferty

We consider the nonparametric estimation of an S-shaped regression function. The least squares estimator provides a very natural, tuning-free approach, but results in a non-convex optimisation problem, since the inflection point is unknown.…

Methodology · Statistics 2024-12-17 Oliver Y. Feng , Yining Chen , Qiyang Han , Raymond J. Carroll , Richard J. Samworth

We consider the random design regression model with square loss. We propose a method that aggregates empirical minimizers (ERM) over appropriately chosen random subsets and reduces to ERM in the extreme case, and we establish sharp oracle…

Statistics Theory · Mathematics 2017-07-04 Alexander Rakhlin , Karthik Sridharan , Alexandre B. Tsybakov

In this paper, we consider the estimation of the unknown parameters of the multiple chirp signal model in presence of additive error. The chirp signals are quite common in many areas of science and engineering, specially sonar, radar, audio…

Signal Processing · Electrical Eng. & Systems 2018-07-04 Swagata Nandi , Debasis Kundu

In the one-parameter regression model with AR(1) and AR(2) errors we find explicit expressions and a continuous approximation of the optimal discrete design for the signed least square estimator. The results are used to derive the optimal…

Statistics Theory · Mathematics 2016-02-12 Holger Dette , Andrey Pepelyshev , Anatoly Zhigljavsky

The main Theorem of Jain et al.[Jain, K., Singh, S., and Sharma, S. (2011), Re- stricted estimation in multivariate measurement error regression model; JMVA, 102, 2, 264-280] is established in its full generality. Namely, we derive the…

Statistics Theory · Mathematics 2017-06-22 Sévérien Nkurunziza , Youzhi Yu

This paper is an extension of Part I of a series about Nu-class multifunctions. A method is presented for computing the integrated mean-squared prediction error (IMSPE) in the design of computer experiments, when the prediction domain is a…

Methodology · Statistics 2019-05-21 Nikoloz Chkonia , Selden Crary

We consider the minimum error entropy (MEE) criterion and an empirical risk minimization learning algorithm in a regression setting. A learning theory approach is presented for this MEE algorithm and explicit error bounds are provided in…

Machine Learning · Computer Science 2013-02-26 Ting Hu , Jun Fan , Qiang Wu , Ding-Xuan Zhou

We study the problem of parameter estimation for discretely observed stochastic processes driven by additive small L\'{e}vy noises. We do not impose any moment condition on the driving L\'{e}vy process. Under certain regularity conditions…

Statistics Theory · Mathematics 2012-05-23 Hongwei Long , Yasutaka Shimizu , Wei Sun

We noisily observe solutions of an ordinary differential equation $\dot u = f(u)$ at given times, where $u$ lives in a $d$-dimensional state space. The model function $f$ is unknown and belongs to a H\"older-type smoothness class with…

Statistics Theory · Mathematics 2024-07-23 Christof Schötz , Maximilian Siebel

A partial least squares regression is proposed for estimating the function-on-function regression model where a functional response and multiple functional predictors consist of random curves with quadratic and interaction effects. The…

Methodology · Statistics 2020-12-11 Ufuk Beyaztas , Han Lin Shang

This paper studies adaptive first-order least-squares finite element methods for second-order elliptic partial differential equations in non-divergence form. Unlike the classical finite element method which uses weak formulations of PDEs…

Numerical Analysis · Mathematics 2019-06-28 Weifeng Qiu , Shun Zhang

We study asymptotic behavior of one-step $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent $M$-estimators. These…

Statistics Theory · Mathematics 2016-04-12 Yu. Yu. Linke

We consider estimation and inference in a single index regression model with an unknown but smooth link function. In contrast to the standard approach of using kernels or regression splines, we use smoothing splines to estimate the smooth…

Methodology · Statistics 2019-05-28 Arun Kumar Kuchibhotla , Rohit Kumar Patra