English
Related papers

Related papers: Strong consistency of the local linear estimator f…

200 papers

Despite their simplicity, linear models perform well at time series forecasting, even when pitted against deeper and more expensive models. A number of variations to the linear model have been proposed, often including some form of feature…

Machine Learning · Computer Science 2024-03-26 William Toner , Luke Darlow

In this paper, we prove strong consistency of an estimator by the truncated singular value decomposition for a multivariate errors-in-variables linear regression model with collinearity. This result is an extension of Gleser's proof of the…

Statistics Theory · Mathematics 2026-02-11 Kensuke Aishima

The scalar-on-function regression model has become a popular analysis tool to explore the relationship between a scalar response and multiple functional predictors. Most of the existing approaches to estimate this model are based on the…

Methodology · Statistics 2022-03-11 Ufuk Beyaztas , Han Lin Shang

The propensity score is widely used for causal inference in observational studies, but common parametric estimators can produce biased and inefficient effect estimates when model assumptions are violated. Nonparametric approaches reduce…

Methodology · Statistics 2026-04-09 Maosen Peng , Yan Li , Chong Wu , Liang Li

In this paper, we study the estimation and inference of change points under a functional linear regression model with changes in the slope function. We present a novel Functional Regression Binary Segmentation (FRBS) algorithm which is…

Methodology · Statistics 2026-02-02 Shivam Kumar , Haotian Xu , Haeran Cho , Daren Wang

Discriminative latent-variable models are typically learned using EM or gradient-based optimization, which suffer from local optima. In this paper, we develop a new computationally efficient and provably consistent estimator for a mixture…

Machine Learning · Computer Science 2013-06-18 Arun Tejasvi Chaganty , Percy Liang

This article develops flexible methodology to study the association between scalar outcomes and functional predictors observed over time, at many instances, in longitudinal studies. We propose a parsimonious modeling framework to study…

Applications · Statistics 2018-01-25 Md Nazmul Islam , Ana-Maria Staicu , Eric van Heugten

We consider the regression model with errors-in-variables where we observe $n$ i.i.d. copies of $(Y,Z)$ satisfying $Y=f(X)+\xi, Z=X+\sigma\epsilon$, involving independent and unobserved random variables $X,\xi,\epsilon$. The density $g$ of…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Marie-Luce Taupin

Motivated by broad applications in reinforcement learning and federated learning, we study local stochastic approximation over a network of agents, where their goal is to find the root of an operator composed of the local operators at the…

Machine Learning · Computer Science 2020-06-25 Thinh T. Doan

Functional quadratic regression models postulate a polynomial relationship between a scalar response rather than a linear one. As in functional linear regression, vertical and specially high-leverage outliers may affect the classical…

Methodology · Statistics 2023-05-30 Graciela Boente , Daniela Parada

A power constrained sensor network that consists of multiple sensor nodes and a fusion center (FC) is considered, where the goal is to estimate a random parameter of interest. In contrast to the distributed framework, the sensor nodes may…

Information Theory · Computer Science 2012-07-03 Swarnendu Kar , Pramod K. Varshney

Linear regression is widely used to model relationships between responses and predictors. In modern applications, one encounters data where the responses are non-Euclidean random objects situated in a metric space, paired with Euclidean…

Methodology · Statistics 2026-05-20 Wookyeong Song , Paromita Dubey , Hans-Georg Müller , Alexander Petersen

While client sampling is a central operation of current state-of-the-art federated learning (FL) approaches, the impact of this procedure on the convergence and speed of FL remains under-investigated. In this work, we provide a general…

Machine Learning · Computer Science 2022-06-16 Yann Fraboni , Richard Vidal , Laetitia Kameni , Marco Lorenzi

We consider the problem of estimating smooth integrated functionals of a monotone nonincreasing density $f$ on $[0,\infty)$ using the nonparametric maximum likelihood based plug-in estimator. We find the exact asymptotic distribution of…

Statistics Theory · Mathematics 2019-04-16 Rajarshi Mukherjee , Bodhisattva Sen

In this paper, we introduce a family of robust estimates for the parametric and nonparametric components under a generalized partially linear model, where the data are modeled by $y_i|(\mathbf{x}_i,t_i)\sim F(\cdot,\mu_i)$ with…

Methodology · Statistics 2011-11-10 Graciela Boente , Xuming He , Jianhui Zhou

Nonparametric regression is a standard statistical tool with increased importance in the Big Data era. Boundary points pose additional difficulties but local polynomial regression can be used to alleviate them. Local linear regression, for…

Other Statistics · Statistics 2017-04-04 Srinjoy Das , Dimitris N. Politis

In this study, we propose a function-on-function linear quantile regression model that allows for more than one functional predictor to establish a more flexible and robust approach. The proposed model is first transformed into a…

Methodology · Statistics 2021-11-11 Ufuk Beyaztas , Han Lin Shang

Federated Learning (FL) enables statistical models to be built on user-generated data without compromising data security and user privacy. For this reason, FL is well suited for on-device learning from mobile devices where data is abundant…

Machine Learning · Computer Science 2021-03-23 Stefan Arnold , Dilara Yesilbas

In this paper we review existing methods for robust functional principal component analysis (FPCA) and propose a new method for FPCA that can be applied to longitudinal data where only a few observations per trajectory are available. This…

Methodology · Statistics 2020-12-04 Graciela Boente , Matias Salibian-Barrera

We propose a procedure for testing the linearity of a scalar-on-function regression relationship. To do so, we use the functional generalized additive model (FGAM), a recently developed extension of the functional linear model. For a…

Methodology · Statistics 2014-04-24 Mathew W. McLean , Giles Hooker , David Ruppert