English
Related papers

Related papers: A Convex-Nonconvex Strategy for Grouped Variable S…

200 papers

In this paper, we consider the joint task of simultaneously optimizing (i) the weights of a deep neural network, (ii) the number of neurons for each hidden layer, and (iii) the subset of active input features (i.e., feature selection).…

Machine Learning · Statistics 2017-02-14 Simone Scardapane , Danilo Comminiello , Amir Hussain , Aurelio Uncini

We propose a novel method for variable selection in functional linear concurrent regression. Our research is motivated by a fisheries footprint study where the goal is to identify important time-varying socio-structural drivers influencing…

Applications · Statistics 2019-11-01 Rahul Ghosal , Arnab Maity , Timothy Clark , Stefano B Longo

After selection with the Group LASSO (or generalized variants such as the overlapping, sparse, or standardized Group LASSO), inference for the selected parameters is unreliable in the absence of adjustments for selection bias. In the…

Methodology · Statistics 2022-08-16 Snigdha Panigrahi , Peter W. MacDonald , Daniel Kessler

In many statistical learning problems, it is desired that the optimal solution conforms to an a priori known sparsity structure represented by a directed acyclic graph. Inducing such structures by means of convex regularizers requires…

Optimization and Control · Mathematics 2020-10-20 Dewei Zhang , Yin Liu , Sam Davanloo Tajbakhsh

The $\ell_1$-penalized method, or the Lasso, has emerged as an important tool for the analysis of large data sets. Many important results have been obtained for the Lasso in linear regression which have led to a deeper understanding of…

Machine Learning · Statistics 2011-12-30 Jian Huang , Cun-Hui Zhang

We develop a set of variable selection methods for the Cox model under interval censoring, in the ultra-high dimensional setting where the dimensionality can grow exponentially with the sample size. The methods select covariates via a…

Methodology · Statistics 2024-05-03 Daewoo Pak , Jianrui Zhang , Di Wu , Haolei Weng , Chenxi Li

We study the Cox models with semiparametric relative risk, which can be partially linear with one nonparametric component, or multiple additive or nonadditive nonparametric components. A penalized partial likelihood procedure is proposed to…

Statistics Theory · Mathematics 2010-10-20 Pang Du , Shuangge Ma , Hua Liang

Sparse penalized quantile regression provides an effective framework for variable selection and robust estimation in high-dimensional data analysis. When ex planatory variables are organized into groups, achieving sparsity both within and…

Computation · Statistics 2026-04-23 Huayan Kou , Yuwen Gu , Yi Lian , Rui Zhang , Jun Fan

We consider a general decomposable convex optimization problem. By using right-hand side allocation technique, it can be transformed into a collection of small dimensional optimization problems. The master problem is a convex non-smooth…

Optimization and Control · Mathematics 2020-10-05 Igor V. Konnov

The smoothly clipped absolute deviation (SCAD) and the minimax concave penalty (MCP) penalized regression models are two important and widely used nonconvex sparse learning tools that can handle variable selection and parameter estimation…

Computation · Statistics 2019-07-11 Yueyong Shi , Jian Huang , Yuling Jiao , Qinglong Yang

One key challenge for solving a general stochastic optimization problem with expectations in the objective and constraint functions using ordinary stochastic iterative methods lies in the infeasibility issue caused by the randomness over…

Information Theory · Computer Science 2019-08-30 Chencheng Ye , Ying Cui

In this paper we consider high-dimensional multiclass classification by sparse multinomial logistic regression. We propose first a feature selection procedure based on penalized maximum likelihood with a complexity penalty on the model size…

Statistics Theory · Mathematics 2020-11-20 Felix Abramovich , Vadim Grinshtein , Tomer Levy

This paper deals with sparse feature selection and grouping for classification and regression. The classification or regression problems under consideration consists in minimizing a convex empirical risk function subject to an $\ell^1$…

Statistics Theory · Mathematics 2017-03-27 Michel Barlaud , Wafa Belhajali , Patrick L. Combettes , Lionel Fillatre

Stochastic composition optimization draws much attention recently and has been successful in many emerging applications of machine learning, statistical analysis, and reinforcement learning. In this paper, we focus on the composition…

Machine Learning · Computer Science 2018-01-01 Zhouyuan Huo , Bin Gu , Ji Liu , Heng Huang

Classification with a sparsity constraint on the solution plays a central role in many high dimensional machine learning applications. In some cases, the features can be grouped together so that entire subsets of features can be selected or…

Machine Learning · Computer Science 2014-09-05 Nikhil Rao , Robert Nowak , Christopher Cox , Timothy Rogers

The selection of Gaussian kernel parameters plays an important role in the applications of support vector classification (SVC). A commonly used method is the k-fold cross validation with grid search (CV), which is extremely time-consuming…

Machine Learning · Computer Science 2025-01-22 Linkai Luo , Qiaoling Yang , Hong Peng , Yiding Wang , Ziyang Chen

We introduce a doubly stochastic proximal gradient algorithm for optimizing a finite average of smooth convex functions, whose gradients depend on numerically expensive expectations. Our main motivation is the acceleration of the…

Machine Learning · Statistics 2016-11-09 Massil Achab , Agathe Guilloux , Stéphane Gaïffas , Emmanuel Bacry

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

The stochastic gradient (SG) method can minimize an objective function composed of a large number of differentiable functions, or solve a stochastic optimization problem, to a moderate accuracy. The block coordinate descent/update (BCD)…

Optimization and Control · Mathematics 2015-11-23 Yangyang Xu , Wotao Yin

Under the linear regression framework, we study the variable selection problem when the underlying model is assumed to have a small number of nonzero coefficients (i.e., the underlying linear model is sparse). Non-convex penalties in…

Statistics Theory · Mathematics 2018-12-19 Shanshan Cao , Xiaoming Huo , Jong-Shi Pang