English
Related papers

Related papers: New explanations and inference for least angle reg…

200 papers

Time series forecasting involves collecting and analyzing past observations to develop a model to extrapolate such observations into the future. Forecasting of future events is important in many fields to support decision making as it…

Machine Learning · Computer Science 2020-09-22 Igor Ilic , Berk Gorgulu , Mucahit Cevik , Mustafa Gokce Baydogan

We consider the problem of reconstructing rank-one matrices from random linear measurements, a task that appears in a variety of problems in signal processing, statistics, and machine learning. In this paper, we focus on the Alternating…

Machine Learning · Computer Science 2022-04-26 Kiryung Lee , Dominik Stöger

Fr\'echet regression has emerged as a promising approach for regression analysis involving non-Euclidean response variables. However, its practical applicability has been hindered by its reliance on ideal scenarios with abundant and…

Methodology · Statistics 2023-10-26 Kyunghee Han , Dogyoon Song

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

What should applied macroeconomists know about local projection (LP) and vector autoregression (VAR) impulse response estimators? The two methods share the same estimand, but in finite samples lie on opposite ends of a bias-variance…

Econometrics · Economics 2025-05-26 José Luis Montiel Olea , Mikkel Plagborg-Møller , Eric Qian , Christian K. Wolf

This article considers algorithmic and statistical aspects of linear regression when the correspondence between the covariates and the responses is unknown. First, a fully polynomial-time approximation scheme is given for the natural least…

Machine Learning · Computer Science 2017-11-09 Daniel Hsu , Kevin Shi , Xiaorui Sun

The Poisson log-normal model is a latent variable model that provides a generic framework for the analysis of multivariate count data. Inferring its parameters can be a daunting task since the conditional distribution of the latent…

Computation · Statistics 2026-05-19 Julien Stoehr , Stephane S. Robin

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

Vector autoregression (VAR) is a fundamental tool for modeling multivariate time series. However, as the number of component series is increased, the VAR model becomes overparameterized. Several authors have addressed this issue by…

Methodology · Statistics 2020-09-09 William B. Nicholson , Ines Wilms , Jacob Bien , David S. Matteson

Researchers now routinely use AI or other machine learning methods to estimate latent variables of economic interest, then plug-in the estimates as covariates in a regression. We show both theoretically and empirically that naively treating…

Econometrics · Economics 2025-05-01 Laura Battaglia , Timothy Christensen , Stephen Hansen , Szymon Sacher

Reduced-rank regression estimates regression coefficients by imposing a low-rank constraint on the matrix of regression coefficients, thereby accounting for correlations among response variables. To further improve predictive accuracy and…

Methodology · Statistics 2026-01-14 Kanji Goto , Shintaro Yuki , Kensuke Tanioka , Hiroshi Yadohisa

Partial least squares regression (PLSR) has been a popular technique to explore the linear relationship between two datasets. However, most of algorithm implementations of PLSR may only achieve a suboptimal solution through an optimization…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Haoran Chen , Yanfeng Sun , Junbin Gao , Yongli Hu , Baocai Yin

Event-related potentials (ERPs) extracted from electroencephalography (EEG) data in response to stimuli are widely used in psychological and neuroscience experiments. A major goal is to link ERP characteristic components to subject-level…

Methodology · Statistics 2024-06-11 Cheng-Han Yu , Meng Li , Marina Vannucci

Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as $l_0$ regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called…

Machine Learning · Statistics 2015-03-20 Kun Yang

Linear regression is one of the most prevalent techniques in machine learning, however, it is also common to use linear regression for its \emph{explanatory} capabilities rather than label prediction. Ordinary Least Squares (OLS) is often…

Data Structures and Algorithms · Computer Science 2017-08-23 Or Sheffet

In this paper, we propose a novel element-wise subset selection method for the alternating least squares (ALS) algorithm, focusing on low-rank matrix factorization involving matrices with missing values, as commonly encountered in…

Methodology · Statistics 2025-11-12 Dunyao Xue , Mengyu Li , Cheng Meng , Jingyi Zhang

Multi-view data have been routinely collected in various fields of science and engineering. A general problem is to study the predictive association between multivariate responses and multi-view predictor sets, all of which can be of high…

Methodology · Statistics 2018-07-30 Gen Li , Xiaokang Liu , Kun Chen

This paper presents the application of a new semi-analytical method of linear regression for Poisson count data to COVID-19 events. The regression is based on the Bonamente and Spence (2022) maximum-likelihood solution for the best-fit…

Methodology · Statistics 2023-06-29 M. Bonamente

Sequential recommender systems have become increasingly important in real-world applications that model user behavior sequences to predict their preferences. However, existing sequential recommendation methods predominantly rely on…

Information Retrieval · Computer Science 2025-06-05 Enze Liu , Bowen Zheng , Xiaolei Wang , Wayne Xin Zhao , Jinpeng Wang , Sheng Chen , Ji-Rong Wen

Linear regression is a fundamental modeling tool in statistics and related fields. In this paper, we study an important variant of linear regression in which the predictor-response pairs are partially mismatched. We use an optimization…

Optimization and Control · Mathematics 2022-11-01 Rahul Mazumder , Haoyue Wang