English
Related papers

Related papers: Screening Rules for Overlapping Group Lasso

200 papers

Group Ordered Weighted $L_{1}$-Norm (Group OWL) regularized models have emerged as a useful procedure for high-dimensional sparse multi-task learning with correlated features. Proximal gradient methods are used as standard approaches to…

Machine Learning · Computer Science 2025-04-09 Runxue Bao , Quanchao Lu , Yanfu Zhang

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm…

Methodology · Statistics 2022-11-14 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel , Agnieszka Sołtys

The detection of overlapping communities is a challenging problem which is gaining increasing interest in recent years because of the natural attitude of individuals, observed in real-world networks, to participate in multiple groups at the…

Social and Information Networks · Computer Science 2014-11-17 Alessia Amelio , Clara Pizzuti

Recent computational strategies based on screening tests have been proposed to accelerate algorithms addressing penalized sparse regression problems such as the Lasso. Such approaches build upon the idea that it is worth dedicating some…

Machine Learning · Statistics 2015-10-28 Antoine Bonnefoy , Valentin Emiya , Liva Ralaivola , Rémi Gribonval

Segmentation of overlapping convex objects has various applications, for example, in nanoparticles and cell imaging. Often the segmentation method has to rely purely on edges between the background and foreground making the analyzed images…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Sahar Zafari , Mariia Murashkina , Tuomas Eerola , Jouni Sampo , Heikki Kälviäinen , Heikki Haario

Large scale disease screening is a complicated process in which high costs must be balanced against pressing public health needs. When the goal is screening for infectious disease, one approach is group testing in which samples are…

Applications · Statistics 2021-03-02 Gregory Haber , Yaakov Malinovsky , Paul S. Albert

Community detection is a widely-studied unsupervised learning problem in which the task is to group similar entities together based on observed pairwise entity interactions. This problem has applications in diverse domains such as social…

Social and Information Networks · Computer Science 2020-04-21 Jimit Majmudar , Stephen Vavasis

Predictor screening rules, which discard predictors before fitting a model, have had considerable impact on the speed with which sparse regression problems, such as the lasso, can be solved. In this paper we present a new screening rule for…

Machine Learning · Statistics 2024-05-14 Johan Larsson , Jonas Wallin

High dimensional regression benefits from sparsity promoting regularizations. Screening rules leverage the known sparsity of the solution by ignoring some variables in the optimization, hence speeding up solvers. When the procedure is…

Machine Learning · Statistics 2015-11-19 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Extracting relevant features from data sets where the number of observations ($n$) is much smaller then the number of predictors ($p$) is a major challenge in modern statistics. Sorted L-One Penalized Estimation (SLOPE), a generalization of…

Machine Learning · Statistics 2024-05-14 Johan Larsson , Małgorzata Bogdan , Jonas Wallin

We introduce an application of the group lasso to design of experiments. Note that we are NOT trying to explain experimental design for the group lasso. Conversely, we explain how we can use the idea of the group lasso in experimental…

Machine Learning · Statistics 2018-02-26 Kentaro Tanaka , Masami Miyakawa

Tuning the regularization parameter in penalized regression models is an expensive task, requiring multiple models to be fit along a path of parameters. Strong screening rules drastically reduce computational costs by lowering the…

Machine Learning · Statistics 2025-05-07 Fabio Feser , Marina Evangelou

In a high-dimensional setting, sparse model has shown its power in computational and statistical efficiency. We consider variables selection problem with a broad class of simultaneous sparsity regularization, enforcing both feature-wise and…

Optimization and Control · Mathematics 2021-09-27 Xinyu Zhang

The lasso model has been widely used for model selection in data mining, machine learning, and high-dimensional statistical analysis. However, with the ultrahigh-dimensional, large-scale data sets now collected in many real-world…

Machine Learning · Statistics 2026-05-13 Yaohui Zeng , Tianbao Yang , Patrick Breheny

In this paper, we address the problem of detecting small, dense, and overlapping objects, a major challenge in computer vision. Our focus is on reviewing proposed methods based on deep learning supervised approaches. We provide a detailed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Oussama Messai , Abbass Zein-Eddine , Abdelouahid Bentamou , Mickael Picq , Nicolas Duquesne , Stéphane Puydarrieux , Yann Gavet

This paper deals with the GMANOVA model with a matrix of polynomial basis functions as a within-individual design matrix. The model involves two model selection problems: the selection of explanatory variables and the selection of the…

Methodology · Statistics 2025-10-23 M. Ohishi , I. Nagai , R. Oda , H. Yanagihara

Screening rules were recently introduced as a technique for explicitly identifying active structures such as sparsity, in optimization problem arising in machine learning. This has led to new methods of acceleration based on a substantial…

Machine Learning · Statistics 2020-09-08 Eugene Ndiaye , Olivier Fercoq , Joseph Salmon

Screening is the problem of finding a superset of the set of non-zero entries in an unknown p-dimensional vector \beta* given n noisy observations. Naturally, we want this superset to be as small as possible. We propose a novel framework…

Machine Learning · Statistics 2016-11-18 Divyanshu Vats

In this work, we propose a new segmentation algorithm for images containing convex objects present in multiple shapes with a high degree of overlap. The proposed algorithm is carried out in two steps, first we identify the visible contours,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Kumar Abhinav , Jaideep Singh Chauhan , Debasis Sarkar

We present a new optimization method for the group selection problem in linear regression. In this problem, predictors are assumed to have a natural group structure and the goal is to select a small set of groups that best fits the…

Methodology · Statistics 2024-04-23 Anant Mathur , Sarat Moka , Benoit Liquet , Zdravko Botev