中文
相关论文

相关论文: An Efficient and Globally Convergent Algorithm for…

200 篇论文

Nowadays an increasing amount of data is available and we have to deal with models in high dimension (number of covariates much larger than the sample size). Under sparsity assumption it is reasonable to hope that we can make a good…

统计理论 · 数学 2014-01-23 Mélanie Blazère , Jean-Michel Loubes , Fabrice Gamboa

We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse…

机器学习 · 统计学 2021-09-23 Antoine Dedieu

This paper develops a unified nonconvex optimization framework for the design of group-sparse feedback controllers in infinite-horizon linear-quadratic (LQ) problems. We address two prominent extensions of the classical LQ problem: the…

最优化与控制 · 数学 2025-08-06 Lechen Feng , Xun Li , Yuan-Hua Ni

We consider the general nonlinear optimization problem where the objective function has an additional term defined by the $ \ell_0 $-quasi-norm in order to promote sparsity of a solution. This problem is highly difficult due to its…

最优化与控制 · 数学 2023-12-27 Christian Kanzow , Felix Weiß

Sparse mapping has been a key methodology in many high-dimensional scientific problems. When multiple tasks share the set of relevant features, learning them jointly in a group drastically improves the quality of relevant feature selection.…

机器学习 · 统计学 2017-09-18 Meghana Kshirsagar , Eunho Yang , Aurélie C. Lozano

Many problems require the selection of a subset of variables from a full set of optimization variables. The computational complexity of an exhaustive search over all possible subsets of variables is, however, prohibitively expensive,…

信号处理 · 电气工程与系统科学 2022-01-27 Jonathan Dan , Simon Geirnaert , Alexander Bertrand

Sparse logistic regression is for classification and feature selection simultaneously. Although many studies have been done to solve $\ell_1$-regularized logistic regression, there is no equivalently abundant work on solving sparse logistic…

机器学习 · 计算机科学 2023-10-13 Mengyuan Zhang , Kai Liu

High-dimensional regression often suffers from heavy-tailed noise and outliers, which can severely undermine the reliability of least-squares based methods. To improve robustness, we adopt a non-smooth Wilcoxon score based rank objective…

机器学习 · 统计学 2026-01-29 Meixia Lin , Meijiao Shi , Yunhai Xiao , Qian Zhang

Sparse logistic regression, as an effective tool of classification, has been developed tremendously in recent two decades, from its origination the $\ell_1$-regularized version to the sparsity constrained models. This paper is carried out…

最优化与控制 · 数学 2021-11-23 Rui Wang , Naihua Xiu , Shenglong Zhou

Sparse learning has recently received increasing attention in many areas including machine learning, statistics, and applied mathematics. The mixed-norm regularization based on the l1q norm with q>1 is attractive in many applications of…

机器学习 · 计算机科学 2013-07-17 Jie Wang , Jun Liu , Jieping Ye

In the context of sparse recovery, it is known that most of existing regularizers such as $\ell_1$ suffer from some bias incurred by some leading entries (in magnitude) of the associated vector. To neutralize this bias, we propose a class…

最优化与控制 · 数学 2015-11-24 Zhaosong Lu , Xiaorui Li

We consider the sparse optimization problem with nonlinear constraints and an objective function, which is given by the sum of a general smooth mapping and an additional term defined by the $ \ell_0 $-quasi-norm. This term is used to obtain…

最优化与控制 · 数学 2022-10-19 Christian Kanzow , Alexandra Schwarz , Felix Weiß

Cutting planes are crucial for the performance of branch-and-cut algorithms for solving mixed-integer programming (MIP) problems, and linear row aggregation has been successfully applied to better leverage the potential of several major…

最优化与控制 · 数学 2025-02-05 Liding Xu , Gioni Mexi , Ksenia Bestuzheva

Sparse regression and classification estimators that respect group structures have application to an assortment of statistical and machine learning problems, from multitask learning to sparse additive modeling to hierarchical selection.…

统计方法学 · 统计学 2024-03-11 Ryan Thompson , Farshid Vahid

The popular Lasso approach for sparse estimation can be derived via marginalization of a joint density associated with a particular stochastic model. A different marginalization of the same probabilistic model leads to a different…

机器学习 · 统计学 2013-02-28 Aleksandr Y. Aravkin , James V. Burke , Alessandro Chiuso , Gianluigi Pillonetto

This paper studies the statistical properties of the group Lasso estimator for high dimensional sparse quantile regression models where the number of explanatory variables (or the number of groups of explanatory variables) is possibly much…

统计方法学 · 统计学 2011-03-28 Kengo Kato

In this paper, we propose a globally convergent Newton type method to solve $\ell_0$ regularized sparse optimization problem. In fact, a line search strategy is applied to the Newton method to obtain global convergence. The Jacobian matrix…

最优化与控制 · 数学 2025-11-26 Yuge Ye , Qingna Li

In this paper we consider the problem of grouped variable selection in high-dimensional regression using $\ell_1-\ell_q$ regularization ($1\leq q \leq \infty$), which can be viewed as a natural generalization of the $\ell_1-\ell_2$…

机器学习 · 统计学 2008-02-12 Han Liu , Jian Zhang

In stochastic optimization, the population risk is generally approximated by the empirical risk. However, in the large-scale setting, minimization of the empirical risk may be computationally restrictive. In this paper, we design an…

机器学习 · 统计学 2016-11-22 Murat A. Erdogdu , Mohsen Bayati , Lee H. Dicker

Sparse Group LASSO (SGL) is a regularized model for high-dimensional linear regression problems with grouped covariates. SGL applies $l_1$ and $l_2$ penalties on the individual predictors and group predictors, respectively, to guarantee…

统计理论 · 数学 2022-02-23 Kan Chen , Zhiqi Bu , Shiyun Xu