English
Related papers

Related papers: Nonparametric, tuning-free estimation of S-shaped …

200 papers

Mixed-effect models are widely used for the analysis of correlated data such as longitudinal data and repeated measures. In this article, we study an approach to the nonparametric estimation of mixed-effect models. We consider models with…

Statistics Theory · Mathematics 2007-06-13 Chong Gu , Ping Ma

M-type smoothing splines are a broad class of spline estimators that include the popular least-squares smoothing spline but also spline estimators that are less susceptible to outlying observations and model-misspecification. However,…

Statistics Theory · Mathematics 2025-03-06 Ioannis Kalogridis

We find the local rate of convergence of the least squares estimator (LSE) of a one dimensional convex regression function when (a) a certain number of derivatives vanish at the point of interest, and (b) the true regression function is…

Methodology · Statistics 2016-11-17 Promit Ghosal , Bodhisattva Sen

We consider the problem of estimating the slope parameter in circular functional linear regression, where scalar responses Y1,...,Yn are modeled in dependence of 1-periodic, second order stationary random functions X1,...,Xn. We consider an…

Statistics Theory · Mathematics 2010-10-01 Fabienne Comte , Jan Johannes

Predicting scalar outcomes using functional predictors is a classic problem in functional data analysis. In many applications, however, only specific locations or time-points of the functional predictors have an impact on the outcome. Such…

Statistics Theory · Mathematics 2020-07-14 Dominik Poß , Dominik Liebl , Alois Kneip , Hedwig Eisenbarth , Tor D. Wager , Lisa Feldman Barrett

We introduce a new convex optimization problem, termed quadratic decomposable submodular function minimization. The problem is closely related to decomposable submodular function minimization and arises in many learning on graphs and…

Machine Learning · Computer Science 2018-10-12 Pan Li , Niao He , Olgica Milenkovic

Necessary and sufficient conditions for the square-integrability of recently proposed unbiased estimators are established. A geometric characterization of a distribution that optimizes the performance of these estimators is given. An…

Statistics Theory · Mathematics 2019-09-09 Nabil Kahale

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

We investigate regularized algorithms combining with projection for least-squares regression problem over a Hilbert space, covering nonparametric regression over a reproducing kernel Hilbert space. We prove convergence results with respect…

Machine Learning · Statistics 2018-10-09 Junhong Lin , Volkan Cevher

We tackle estimation and prediction at non-visted sites in a spatial semi-functional linear regression model with derivatives that combines a functional linear model with a nonparametric regression one. The parametric part is estimated by a…

Statistics Theory · Mathematics 2022-11-22 Stéphane Bouka , Kowir Pambo Bello , Guy Martial Nkiet

This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least…

Methodology · Statistics 2016-05-11 Abhishek Kaul , Hira L. Koul , Akshita Chawla , Soumendra N. Lahiri

We consider estimation and inference in a single index regression model with an unknown but smooth link function. In contrast to the standard approach of using kernels or regression splines, we use smoothing splines to estimate the smooth…

Methodology · Statistics 2019-05-28 Arun Kumar Kuchibhotla , Rohit Kumar Patra

The function-on-function regression model is fundamental for analyzing relationships between functional covariates and responses. However, most existing function-on-function regression methodologies assume independence between observations,…

Methodology · Statistics 2025-12-02 Ufuk Beyaztas , Han Lin Shang , Gizel Bakicierler Sezer

In this paper, the estimation of parameters in the harmonic regression with cyclically dependent errors is addressed. Asymptotic properties of the least-squares estimates are analyzed by simulation experiments. By numerical simulation, we…

In this paper we develop a nonparametric regression method that is simultaneously adaptive over a wide range of function classes for the regression function and robust over a large collection of error distributions, including those that are…

Statistics Theory · Mathematics 2008-10-28 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

We consider a linear model where the coefficients - intercept and slopes - are random with a law in a nonparametric class and independent from the regressors. Identification often requires the regressors to have a support which is the whole…

Statistics Theory · Mathematics 2020-06-22 Christophe Gaillac , Eric Gautier

This paper presents uniform estimation and inference theory for a large class of nonparametric partitioning-based M-estimators. The main theoretical results include: (i) uniform consistency for convex and non-convex objective functions;…

Statistics Theory · Mathematics 2025-09-01 Matias D. Cattaneo , Yingjie Feng , Boris Shigida

We study harmonic map regression, a nonparametric estimator for manifold-valued responses, that penalizes the empirical Fr\'echet risk by the Dirichlet energy. By connecting penalized regression to the theory of harmonic maps, the estimator…

Statistics Theory · Mathematics 2026-04-13 Xiaoyu Chen

In this paper, we construct an estimator of an errors-in-variables linear regression model. The regression model leads to a constrained total least squares problems with row and column constraints. Although this problem can be numerically…

Numerical Analysis · Mathematics 2026-02-11 Kensuke Aishima