English
Related papers

Related papers: Robust penalized estimators for functional linear …

200 papers

Penalized regression has become a standard tool for model building across a wide range of application domains. Common practice is to tune the amount of penalization to tradeoff bias and variance or to optimize some other measure of…

Methodology · Statistics 2018-04-05 Wenhao Hu , Eric Laber , Leonard Stefanski

The ordinary least squares estimate in linear regression is sensitive to the influence of errors with large variance, which reduces its robustness, especially when dealing with heavy-tailed errors or outliers frequently encountered in…

Methodology · Statistics 2025-05-01 Mengjiao Shi , Yunhai Xiao

We consider the estimation of the slope function in functional linear regression, where scalar responses are modeled in dependence of random functions. Cardot and Johannes [J. Multivariate Anal. 101 (2010) 395-408] have shown that a…

Statistics Theory · Mathematics 2013-02-19 Fabienne Comte , Jan Johannes

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

This paper provides robust estimators for the first canonical correlation and directions of random elements on Hilbert separable spaces by using robust association and scale measures combined with basis expansion and/or penalizations as a…

Statistics Theory · Mathematics 2020-11-24 Graciela Boente , Nadia Kudraszow

Penalized regression estimators are a popular tool for the analysis of sparse and high-dimensional data sets. However, penalized regression estimators defined using an unbounded loss function can be very sensitive to the presence of…

Statistics Theory · Mathematics 2015-10-19 Ezequiel Smucler , Víctor J. Yohai

The regression of a functional response on a set of scalar predictors can be a challenging task, especially if there is a large number of predictors, or the relationship between those predictors and the response is nonlinear. In this work,…

Machine Learning · Statistics 2023-08-24 Sidi Wu , Cédric Beaulac , Jiguo Cao

Seemingly unrelated regression models generalize linear regression models by considering multiple regression equations that are linked by contemporaneously correlated disturbances. Robust inference for seemingly unrelated regression models…

Methodology · Statistics 2018-05-15 Kris Peremans , Stefan Van Aelst

In many situations, data are recorded over a period of time and may be regarded as realizations of a stochastic process. In this paper, robust estimators for the principal components are considered by adapting the projection pursuit…

Statistics Theory · Mathematics 2012-03-12 Juan Lucas Bali , Graciela Boente , David E. Tyler , Jane-Ling Wang

This paper addresses the robust estimation of linear regression models in the presence of potentially endogenous outliers. Through Monte Carlo simulations, we demonstrate that existing $L_1$-regularized estimation methods, including the…

Econometrics · Economics 2024-08-08 Zhan Gao , Hyungsik Roger Moon

A function-on-function regression model with quadratic and interaction effects of the covariates provides a more flexible model. Despite several attempts to estimate the model's parameters, almost all existing estimation strategies are…

Methodology · Statistics 2024-10-25 Ufuk Beyaztas , Han Lin Shang , Abhijit Mandal

We consider the functional regression model with multivariate response and functional predictors. Compared to fitting each individual response variable separately, taking advantage of the correlation between the response variables can…

Methodology · Statistics 2026-02-04 Ruiyan Luo , Xin Qi

We present a robust regression estimator for longitudinal data, which is especially suited for functional data that has been observed on sparse or irregular time grids. We show by simulation that the proposed estimators possess good…

Methodology · Statistics 2012-12-03 Daniel Gervini

Performative prediction is an emerging paradigm in machine learning that addresses scenarios where the model's prediction may induce a shift in the distribution of the data it aims to predict. Current works in this field often rely on…

Machine Learning · Computer Science 2025-09-03 Guangzheng Zhong , Yang Liu , Jiming Liu

Data can be assumed to be continuous functions defined on an infinite-dimensional space for many phenomena. However, the infinite-dimensional data might be driven by a small number of latent variables. Hence, factor models are relevant for…

Methodology · Statistics 2022-05-18 Israel Martínez-Hernández , Jesús Gonzalo , Graciela González-Farías

We propose a robust variable selection procedure using a divergence based M-estimator combined with a penalty function. It produces robust estimates of the regression parameters and simultaneously selects the important explanatory…

Methodology · Statistics 2020-01-01 Abhijit Mandal , Samiran Ghosh

The generalised linear model (GLM) is a very important tool for analysing real data in biology, sociology, agriculture, engineering and many other application domain where the relationship between the response and explanatory variables may…

Methodology · Statistics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

This paper contributes to the literature on treatment effects estimation with machine learning inspired methods by studying the performance of different estimators based on the Lasso. Building on recent work in the field of high-dimensional…

Econometrics · Economics 2018-05-15 Michael Zimmert

Regressing a scalar response on a random function is nowadays a common situation. In the nonparametric setting, this paper paves the way for making the local linear regression based on a projection approach a prominent method for solving…

Methodology · Statistics 2019-07-19 Frédéric Ferraty , Stanislav Nagy

Current status data are commonly encountered in medical and epidemiological studies in which the failure time for study units is the outcome variable of interest. Data of this form are characterized by the fact that the failure time is not…

Methodology · Statistics 2019-04-25 Yan Liu , Minggen Lu , Christopher S. McMahan