English
Related papers

Related papers: Modelling Interactions in High-dimensional Data wi…

200 papers

Standard approaches for variable selection in linear models are not tailored to deal properly with high-dimensional and incomplete data. Currently, methods dedicated to high-dimensional data handle missing values by ad-hoc strategies, like…

Methodology · Statistics 2021-06-09 Avner Bar-Hen , Vincent Audigier

Multivariate regression models are widely used in various fields such as biology and finance. In this paper, we focus on two key challenges: (a) When should we favor a multivariate model over a series of univariate models; (b) If the…

Methodology · Statistics 2020-03-25 Yuehan Yang , Siwei Xia , Hu Yang

The Lasso is a prominent algorithm for variable selection. However, its instability in the presence of correlated variables in the high-dimensional setting is well-documented. Although previous research has attempted to address this issue…

Methodology · Statistics 2025-05-28 Mahdi Nouraie , Connor Smith , Samuel Muller

Lasso is a popular and efficient approach to simultaneous estimation and variable selection in high-dimensional regression models. In this paper, a robust LAD-lasso method for multiple outcomes is presented that addresses the challenges of…

Methodology · Statistics 2022-12-02 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

Variable selection in relation to regression modeling has constituted a methodological problem for more than 60 years. Especially in the context of high-dimensional regression, developing stable and reliable methods, algorithms, and…

Methodology · Statistics 2024-04-04 Charlotte Castel , Zhi Zhao , Magne Thoresen

In high dimensional regression settings, sparsity enforcing penalties have proved useful to regularize the data-fitting term. A recently introduced technique called screening rules propose to ignore some variables in the optimization…

Machine Learning · Statistics 2017-12-29 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Particle dynamics and multi-agent systems provide accurate dynamical models for studying and forecasting the behavior of complex interacting systems. They often take the form of a high-dimensional system of differential equations…

Machine Learning · Computer Science 2023-08-09 Yuxuan Liu , Scott G. McCalla , Hayden Schaeffer

We address a classical problem in statistics: adding two-way interaction terms to a regression model. As the covariate dimension increases quadratically, we develop an estimator that adapts well to this increase, while providing accurate…

Methodology · Statistics 2023-09-26 Mark A. van de Wiel , Matteo Amestoy , Jeroen Hoogland

High-dimensional prediction typically comprises two steps: variable selection and subsequent least-squares refitting on the selected variables. However, the standard variable selection procedures, such as the lasso, hinge on tuning…

Methodology · Statistics 2017-06-07 Didier Chételat , Johannes Lederer , Joseph Salmon

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

We study high-dimensional regression with missing entries in the covariates. A common strategy in practice is to \emph{impute} the missing entries with an appropriate substitute and then implement a standard statistical procedure acting as…

Statistics Theory · Mathematics 2020-01-28 Kabir Aladin Chandrasekher , Ahmed El Alaoui , Andrea Montanari

We propose the variable selection procedure incorporating prior constraint information into lasso. The proposed procedure combines the sample and prior information, and selects significant variables for responses in a narrower region where…

Methodology · Statistics 2011-02-19 Shurong Zheng , Guodong Song , Ning-Zhong Shi

In many learning settings, it is beneficial to augment the main features with pairwise interactions. Such interaction models can be often enhanced by performing variable selection under the so-called strong hierarchy constraint: an…

Machine Learning · Statistics 2020-07-15 Hussein Hazimeh , Rahul Mazumder

Data types that lie in metric spaces but not in vector spaces are difficult to use within the usual regression setting, either as the response and/or a predictor. We represent the information in these variables using distance matrices which…

Methodology · Statistics 2016-01-20 Julian Faraway

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is done by solving an l_1-regularized linear regression problem, usually called Lasso. In this work we first combine the…

Information Theory · Computer Science 2010-03-02 Pablo Sprechmann , Ignacio Ramirez , Guillermo Sapiro , Yonina C. Eldar

In this work we address the problem of approximating high-dimensional data with a low-dimensional representation. We make the following contributions. We propose an inverse regression method which exchanges the roles of input and response,…

Machine Learning · Computer Science 2015-09-04 Antoine Deleforge , Florence Forbes , Radu Horaud

In this paper we explore how concepts of high-dimensional data compression via random projections onto lower-dimensional spaces can be applied for tractable simulation of certain dynamical systems modeling complex interactions. In such…

Dynamical Systems · Mathematics 2011-11-08 Massimo Fornasier , Jan Haskovec , Jan Vybiral

This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors…

Econometrics · Economics 2024-01-17 Ziwei Mei , Zhentao Shi

Recently, considerable interest has focused on variable selection methods in regression situations where the number of predictors, $p$, is large relative to the number of observations, $n$. Two commonly applied variable selection approaches…

Applications · Statistics 2011-04-19 Peter Radchenko , Gareth M. James

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

Methodology · Statistics 2011-11-21 Zhou Fang