English
Related papers

Related papers: Group Variable Selection via a Hierarchical Lasso …

200 papers

This study develops a data-driven group variable selection method for data envelopment analysis (DEA), a non-parametric linear programming approach to the estimation of production frontiers. The proposed method extends the group Lasso…

Optimization and Control · Mathematics 2014-02-18 Zhiwei Qin , Irene Song

Variable selection in linear regression models has been a problem since hypothesis testing began. Which variables to include or exclude from a model is not an easy task. Techniques such as Forward, Back ward, Stepwise Regression…

Methodology · Statistics 2026-05-01 By Riyadh Alrawkan , Edward Boone , Ryad Ghanam , Anton Westveld

The generalized outcome-adaptive lasso (GOAL) is a variable selection for high-dimensional causal inference proposed by Bald\'e et al. [2023, {\em Biometrics} {\bfseries 79(1)}, 514--520]. When the dimension is high, it is now well…

Statistics Theory · Mathematics 2024-06-11 Ismaila Baldé

We propose the variable selection procedure incorporating prior constraint information into lasso. The proposed procedure combines the sample and prior information, and selects significant variables for responses in a narrower region where…

Methodology · Statistics 2011-02-19 Shurong Zheng , Guodong Song , Ning-Zhong Shi

In variable selection, a selection rule that prescribes the permissible sets of selected variables (called a "selection dictionary") is desirable due to the inherent structural constraints among the candidate variables. Such selection rules…

Methodology · Statistics 2024-01-17 Guanbo Wang , Mireille E. Schnitzer , Tom Chen , Rui Wang , Robert W. Platt

Simultaneous feature selection and non-linear function estimation is challenging in modeling, especially in high-dimensional settings where the number of variables exceeds the available sample size. In this article, we investigate the…

Machine Learning · Statistics 2026-01-05 Bin Luo , Susan Halabi

We consider varying coefficient Cox models with high-dimensional covariates. We apply the group Lasso method to these models and propose a variable selection procedure. Our procedure copes with variable selection and structure…

Statistics Theory · Mathematics 2016-07-20 Toshio Honda , Ryota Yabe

This article investigates uncertainty quantification of the generalized linear lasso~(GLL), a popular variable selection method in high-dimensional regression settings. In many fields of study, researchers use data-driven methods to select…

Statistics Theory · Mathematics 2023-07-11 Quentin Duchemin , Yohann de Castro

Neural network potentials are a powerful tool for atomistic simulations, allowing to accurately reproduce \textit{ab initio} potential energy surfaces with computational performance approaching classical force fields. A central component of…

Disordered Systems and Neural Networks · Physics 2023-12-27 Johannes Sandberg , Thomas Voigtmann , Emilie Devijver , Noel Jakse

Motivation: Gene selection has become a common task in most gene expression studies. The objective of such research is often to identify the smallest possible set of genes that can still achieve good predictive performance. The problem of…

We study a norm for structured sparsity which leads to sparse linear predictors whose supports are unions of prede ned overlapping groups of variables. We call the obtained formulation latent group Lasso, since it is based on applying the…

Machine Learning · Statistics 2011-10-05 Guillaume Obozinski , Laurent Jacob , Jean-Philippe Vert

In genomic analysis, biomarker discovery, image recognition, and other systems involving machine learning, input variables can often be organized into different groups by their source or semantic category. Eliminating some groups of…

Machine Learning · Computer Science 2019-12-02 Beibin Li , Nicholas Nuechterlein , Erin Barney , Caitlin Hudac , Pamela Ventola , Linda Shapiro , Frederick Shic

Bayesian model selection, with precedents in George and McCulloch (1993) and Abramovich et al. (1998), support credibility measures that relate model uncertainty, but computation can be costly when sparse priors are approximate. We design…

Computation · Statistics 2023-03-13 Alan Lenarcic , William Valdar

Sparse prediction with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm for selection…

Methodology · Statistics 2021-12-22 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty.…

Methodology · Statistics 2016-12-23 Marbac Matthieu , Sedki Mohammed

We present a new algorithmic framework for grouped variable selection that is based on discrete mathematical optimization. While there exist several appealing approaches based on convex relaxations and nonconvex heuristics, we focus on…

Methodology · Statistics 2021-10-19 Hussein Hazimeh , Rahul Mazumder , Peter Radchenko

We propose a procedure which combines hierarchical clustering with a test of overidentifying restrictions for selecting valid instrumental variables (IV) from a large set of IVs. Some of these IVs may be invalid in that they fail the…

Methodology · Statistics 2024-07-19 Nicolas Apfel , Xiaoran Liang

We introduce an axiomatic approach to group recommendations, in line of previous work on the axiomatic treatment of trust-based recommendation systems, ranking systems, and other foundational work on the axiomatic approach to internet…

Social and Information Networks · Computer Science 2017-07-28 Omer Lev , Moshe Tennenholtz

While variable selection is essential to optimize the learning complexity by prioritizing features, automating the selection process is preferred since it requires laborious efforts with intensive analysis otherwise. However, it is not an…

Machine Learning · Computer Science 2019-10-29 Makiya Nakashima , Alex Sim , Youngsoo Kim , Jonghyun Kim , Jinoh Kim

This paper deals with the grouped variable selection problem. A widely used strategy is to augment the negative log-likelihood function with a sparsity-promoting penalty. Existing methods include the group Lasso, group SCAD, and group MCP.…

Methodology · Statistics 2023-11-14 Xiaoqian Liu , Aaron J. Molstad , Eric C. Chi