English
Related papers

Related papers: Fast Overlapping Group Lasso

200 papers

Motivation: Gene selection has become a common task in most gene expression studies. The objective of such research is often to identify the smallest possible set of genes that can still achieve good predictive performance. The problem of…

A reciprocal LASSO (rLASSO) regularization employs a decreasing penalty function as opposed to conventional penalization approaches that use increasing penalties on the coefficients, leading to stronger parsimony and superior model…

Methodology · Statistics 2021-09-17 Himel Mallick , Rahim Alhamzawi , Erina Paul , Vladimir Svetnik

After selection with the Group LASSO (or generalized variants such as the overlapping, sparse, or standardized Group LASSO), inference for the selected parameters is unreliable in the absence of adjustments for selection bias. In the…

Methodology · Statistics 2022-08-16 Snigdha Panigrahi , Peter W. MacDonald , Daniel Kessler

The integration of high-dimensional genomic data and clinical data into time-to-event prediction models has gained significant attention due to the growing availability of these datasets. Traditionally, a Cox regression model is employed,…

Methodology · Statistics 2025-04-03 Dayasri Ravi , Andreas Groll

We introduce a recursive adaptive group lasso algorithm for real-time penalized least squares prediction that produces a time sequence of optimal sparse predictor coefficient vectors. At each time index the proposed algorithm computes an…

Methodology · Statistics 2015-05-27 Yilun Chen , Alfred O. Hero

The graphical lasso \citep{FHT2007a} is an algorithm for learning the structure in an undirected Gaussian graphical model, using $\ell_1$ regularization to control the number of zeros in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$…

Machine Learning · Statistics 2012-08-09 Rahul Mazumder , Trevor Hastie

In [1], the distributed linear-quadratic problem with fixed communication topology (DFT-LQ) and the sparse feedback LQ problem (SF-LQ) are formulated into a nonsmooth and nonconvex optimization problem with affine constraints. Moreover, a…

Optimization and Control · Mathematics 2025-08-14 Lechen Feng , Xun Li , Yuan-Hua Ni

In this paper, we introduce various mechanisms to obtain accelerated first-order stochastic optimization algorithms when the objective function is convex or strongly convex. Specifically, we extend the Catalyst approach originally designed…

Optimization and Control · Mathematics 2019-10-10 Andrei Kulunchakov , Julien Mairal

We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The…

Machine Learning · Statistics 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

In this paper, we present a novel embedded feature selection method based on a Multi-layer Perceptron (MLP) network and generalize it for group-feature or sensor selection problems, which can control the level of redundancy among the…

Machine Learning · Computer Science 2024-09-26 Aytijhya Saha , Nikhil R. Pal

The paper revisits the Bayesian group lasso and uses spike and slab priors for group variable selection. In the process, the connection of our model with penalized regression is demonstrated, and the role of posterior median for…

Statistics Theory · Mathematics 2015-12-04 Xiaofan Xu , Malay Ghosh

The breakthrough ideas in the modern proximal splitting methodologies allow us to express the set of all minimizers of a superposition of multiple nonsmooth convex functions as the fixed point set of computable nonexpansive operators. In…

Optimization and Control · Mathematics 2022-07-01 Isao Yamada , Masao Yamagishi

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

We consider a method to jointly estimate sparse precision matrices and their underlying graph structures using dependent high-dimensional datasets. We present a penalized maximum likelihood estimator which encourages both sparsity and…

Applications · Statistics 2016-08-22 Adria Caballe , Natalia Bochkina , Claus Mayer

It is known that the Thresholded Lasso (TL), SCAD or MCP correct intrinsic estimation bias of the Lasso. In this paper we propose an alternative method of improving the Lasso for predictive models with general convex loss functions which…

Statistics Theory · Mathematics 2021-01-26 Piotr Pokarowski , Wojciech Rejchel , Agnieszka Soltys , Michal Frej , Jan Mielniczuk

In this paper, the fused graphical lasso (FGL) method is used to estimate multiple precision matrices from multiple populations simultaneously. The lasso penalty in the FGL model is a restraint on sparsity of precision matrices, and a…

Statistics Theory · Mathematics 2023-03-03 Qiuyan Zhang , Zhidong Bai , Lingrui Li , Hu Yang

A wide class of regularization problems in machine learning and statistics employ a regularization term which is obtained by composing a simple convex function \omega with a linear transformation. This setting includes Group Lasso methods,…

Machine Learning · Computer Science 2011-04-11 Andreas Argyriou , Charles A. Micchelli , Massimiliano Pontil , Lixin Shen , Yuesheng Xu

We propose networked exponential families to jointly leverage the information in the topology as well as the attributes (features) of networked data points. Networked exponential families are a flexible probabilistic model for heterogeneous…

Machine Learning · Computer Science 2019-09-26 Alexander Jung

Imposition of a lasso penalty shrinks parameter estimates toward zero and performs continuous model selection. Lasso penalized regression is capable of handling linear regression problems where the number of predictors far exceeds the…

Applications · Statistics 2008-12-18 Tong Tong Wu , Kenneth Lange

We consider a class of learning problems regularized by a structured sparsity-inducing norm defined as the sum of l_2- or l_infinity-norms over groups of variables. Whereas much effort has been put in developing fast optimization techniques…

Optimization and Control · Mathematics 2011-10-17 Julien Mairal , Rodolphe Jenatton , Guillaume Obozinski , Francis Bach