English
Related papers

Related papers: Local linear smoothing in additive models as data …

200 papers

We propose to smooth the entire objective function, rather than only the check function, in a linear quantile regression context. Not only does the resulting smoothed quantile regression estimator yield a lower mean squared error and a more…

Econometrics · Economics 2019-08-16 Marcelo Fernandes , Emmanuel Guerre , Eduardo Horta

We introduce a broad class of models called semiparametric spatial point process for making inference between spatial point patterns and spatial covariates. These models feature an intensity function with both parametric and nonparametric…

Methodology · Statistics 2025-09-24 Xindi Lin , Bumjun Park , Christopher Zahasky , Hyunseung Kang

We develop theory for nonlinear dimensionality reduction (NLDR). A number of NLDR methods have been developed, but there is limited understanding of how these methods work and the relationships between them. There is limited basis for using…

Machine Learning · Statistics 2018-03-08 Daniel Ting , Michael I. Jordan

The infrequent occurrence of overfitting in deep neural networks is perplexing: contrary to theoretical expectations, increasing model size often enhances performance in practice. But what if overfitting does occur, though restricted to…

Machine Learning · Computer Science 2025-01-08 Uri Stern , Tomer Yaacoby , Daphna Weinshall

The parameter fit from a model grid is limited by our capability to reduce the number of models, taking into account the number of parameters and the non linear variation of the models with the parameters. The Local MultiLinear Regression…

Astrophysics · Physics 2009-11-13 A. Bijaoui , A. Recio-Blanco , P. de Laverny

In this paper, we study the estimation for a partial-linear single-index model. A two-stage estimation procedure is proposed to estimate the link function for the single index and the parameters in the single index, as well as the…

Methodology · Statistics 2009-05-14 Jane-Ling Wang , Liugen Xue , Lixing Zhu , Yun Sam Chong

This paper presents a backfitting-type method for estimating and forecasting a periodically correlated partially linear model with exogeneous variables and heteroskedastic input noise. A rate of convergence of the estimator is given. The…

Statistics Theory · Mathematics 2011-02-23 Xavier Brossat , Georges Oppenheim , Marie-Claude Viano

This work extends local linear regression to Banach space-valued time series for estimating smoothly varying means and their derivatives in non-stationary data. The asymptotic properties of both the standard and bias-reduced Jackknife…

Statistics Theory · Mathematics 2025-03-20 Florian Heinrichs

The space time autoregressive model has been widely applied in science, in areas such as economics, public finance, political science, agricultural economics, environmental studies and transportation analyses. The classical space time…

Applications · Statistics 2019-05-14 Wenqian Wang , Beth Andrews

There has been substantial recent work on methods for estimating the slope function in linear regression for functional data analysis. However, as in the case of more conventional finite-dimensional regression, much of the practical…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Peter Hall

Nonparametric estimation of a mixing density based on observations from the corresponding mixture is a challenging statistical problem. This paper surveys the literature on a fast, recursive estimator based on the predictive recursion…

Methodology · Statistics 2022-09-15 Ryan Martin

Matrix approximation is a common tool in machine learning for building accurate prediction models for recommendation systems, text mining, and computer vision. A prevalent assumption in constructing matrix approximations is that the…

Machine Learning · Computer Science 2013-01-16 Joonseok Lee , Seungyeon Kim , Guy Lebanon , Yoram Singer

We consider nonparametric estimation of a regression curve when the data are observed with multiplicative distortion which depends on an observed confounding variable. We suggest several estimators, ranging from a relatively simple one that…

Statistics Theory · Mathematics 2016-01-13 Aurore Delaigle , Peter Hall , Wen-Xin Zhou

This paper investigates the nonparametric estimation of a circular regression function in an errors-in-variables framework. Two settings are studied, depending on whether the covariates are circular or linear. Adaptive estimators are…

Statistics Theory · Mathematics 2025-08-27 Tien Dat Nguyen , Thanh Mai Pham Ngoc

The change-plane Cox model is a popular tool for the subgroup analysis of survival data. Despite the rich literature on this model, there has been limited investigation into the asymptotic properties of the estimators of the…

Statistics Theory · Mathematics 2023-02-14 Shota Takeishi

For regression models, most of existing specification tests can be categorized into the class of local smoothing tests and of global smoothing tests. Compared with global smoothing tests, local smoothing tests can only detect local…

Methodology · Statistics 2017-10-18 Lingzhu Li , Lixing Zhu

Many pre-trained models (PTMs) are available in modern applications. Because different PTMs are often trained on different datasets, their performances can vary substantially for different new tasks, and the ranking of the candidates may…

Methodology · Statistics 2026-05-14 Ziwen Gao , Baihua He , Yuhong Yang

We investigate the local linear convergence properties of the Alternating Direction Method of Multipliers (ADMM) when applied to Semidefinite Programming (SDP). A longstanding belief suggests that ADMM is only capable of solving SDPs to…

Optimization and Control · Mathematics 2026-05-19 Shucheng Kang , Xin Jiang , Heng Yang

Functional linear regression has recently attracted considerable interest. Many works focus on asymptotic inference. In this paper we consider in a non asymptotic framework a simple estimation procedure based on functional Principal…

Statistics Theory · Mathematics 2013-01-16 Elodie Brunel , André Mas , Angelina Roche

We tackle estimation and prediction at non-visted sites in a spatial semi-functional linear regression model with derivatives that combines a functional linear model with a nonparametric regression one. The parametric part is estimated by a…

Statistics Theory · Mathematics 2022-11-22 Stéphane Bouka , Kowir Pambo Bello , Guy Martial Nkiet