English
Related papers

Related papers: The Function-on-Scalar LASSO with Applications to …

200 papers

The analysis of complex computer simulations, often involving functional data, presents unique statistical challenges. Conventional regression methods, such as function-on-function regression, typically associate functional outcomes with…

Methodology · Statistics 2026-02-11 R. Jacob Andros , Rajarshi Guhaniyogi , Devin Francom , Donatella Pasqualini

There are proposals that extend the classical generalized additive models (GAMs) to accommodate high-dimensional data ($p>>n$) using group sparse regularization. However, the sparse regularization may induce excess shrinkage when estimating…

Methodology · Statistics 2022-07-07 Boyi Guo , Byron C. Jaeger , A. K. M. Fazlur Rahman , D. Leann Long , Nengjun Yi

This paper presents a new algorithm for automatic variables selection. In particular, using the Graphical Models properties it is possible to develop a method that can be used in the contest of large dataset. The advantage of this algorithm…

Machine Learning · Statistics 2022-01-17 Luigi Riso

In high dimension, it is customary to consider Lasso-type estimators to enforce sparsity. For standard Lasso theory to hold, the regularization parameter should be proportional to the noise level, yet the latter is generally unknown in…

Machine Learning · Statistics 2017-10-19 Mathurin Massias , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We explore estimation and forecast accuracy for sparse linear models, focusing on scenarios where both predictors and errors carry serial correlations. We establish a clear link between predictor serial correlation and the performance of…

Statistics Theory · Mathematics 2026-01-27 Simone Tonini , Francesca Chiaromonte , Alessandro Giovannelli

Classical finite mixture regression is useful for modeling the relationship between scalar predictors and scalar responses arising from subpopulations defined by the differing associations between those predictors and responses. Here we…

Methodology · Statistics 2013-12-04 Adam Ciarleglio , R. Todd Ogden

In this article we propose a new variable selection method for analyzing data collected from longitudinal sample surveys. The procedure is based on the survey-weighted quadratic inference function, which was recently introduced as an…

Statistics Theory · Mathematics 2021-05-04 Laura Dumitrescu , Wei Qian , J. N. K. Rao

Selection of covariates is crucial in the estimation of average treatment effects given observational data with high or even ultra-high dimensional pretreatment variables. Existing methods for this problem typically assume sparse linear…

Methodology · Statistics 2023-03-20 Juan Chen , Yingchun Zhou

In many modern applications, a dependent functional response is observed for each subject over repeated time, leading to longitudinal functional data. In this paper, we propose a novel statistical procedure to test whether the mean function…

Methodology · Statistics 2024-01-17 Salil Koner , So Young Park , Ana-Maria Staicu

We consider the problem of identifying significant predictors in large data bases, where the response variable depends on the linear combination of explanatory variables through an unknown link function, corrupted with the noise from the…

Methodology · Statistics 2019-11-19 Wojciech Rejchel , Malgorzata Bogdan

We propose a novel method for variable selection in functional linear concurrent regression. Our research is motivated by a fisheries footprint study where the goal is to identify important time-varying socio-structural drivers influencing…

Applications · Statistics 2019-11-01 Rahul Ghosal , Arnab Maity , Timothy Clark , Stefano B Longo

The paper considers linear regression problems where the number of predictor variables is possibly larger than the sample size. The basic motivation of the study is to combine the points of view of model selection and functional regression…

Statistics Theory · Mathematics 2012-02-24 Alois Kneip , Pascal Sarda

The Temporal Group LASSO is an example of a multi-task, regularized regression approach for the prediction of response variables that vary over time. The aim of this work is to introduce the reader to the concepts behind the Temporal Group…

Machine Learning · Statistics 2017-04-13 Diego Saldana Miranda

We propose the Bayesian adaptive Lasso (BaLasso) for variable selection and coefficient estimation in linear regression. The BaLasso is adaptive to the signal level by adopting different shrinkage for different coefficients. Furthermore, we…

Methodology · Statistics 2010-09-14 Chenlei Leng , Minh Ngoc Tran , David Nott

A sparse modeling is a major topic in machine learning and statistics. LASSO (Least Absolute Shrinkage and Selection Operator) is a popular sparse modeling method while it has been known to yield unexpected large bias especially at a sparse…

Machine Learning · Computer Science 2018-08-23 Katsuyuki Hagiwara

A new sparse semiparametric model is proposed, which incorporates the influence of two functional random variables in a scalar response in a flexible and interpretable manner. One of the functional covariates is included through a…

Methodology · Statistics 2024-01-29 Silvia Novo , Philippe Vieu , Germán Aneiros

We consider a high-dimensional regression model with a possible change-point due to a covariate threshold and develop the Lasso estimator of regression coefficients as well as the threshold parameter. Our Lasso estimator not only selects…

Statistics Theory · Mathematics 2019-08-23 Sokbae Lee , Myung Hwan Seo , Youngki Shin

Large health surveys increasingly collect high-dimensional functional data from wearable devices, and function on scalar regression (FoSR) is often used to quantify the relationship between these functional outcomes and scalar covariates…

Methodology · Statistics 2025-11-10 Lily Koffman , Sunan Gao , Xinkai Zhou , Andrew Leroux , Ciprian Crainiceanu , John Muschelli

We propose a generalization of the lasso that allows the model coefficients to vary as a function of a general set of modifying variables. These modifiers might be variables such as gender, age or time. The paradigm is quite general, with…

Methodology · Statistics 2018-01-11 Robert Tibshirani , Jerome Friedman

In practical regression applications, multiple covariates are often measured, but not all may be associated with the response variable. Identifying and including only the relevant covariates in the model is crucial for improving prediction…

Methodology · Statistics 2026-03-10 Ana Carolina da Cruz , Camila P. E. de Souza , Pedro H. T. O. Sousa