中文
相关论文

相关论文: A Screening Strategy for Structured Optimization I…

200 篇论文

Variable selection is a challenging problem in high-dimensional sparse learning, especially when group structures exist. Group SLOPE performs well for the adaptive selection of groups of predictors. However, the block non-separable group…

机器学习 · 计算机科学 2025-06-12 Runxue Bao , Quanchao Lu , Yanfu Zhang

This paper presents a regularization technique incorporating a non-convex and non-smooth term, $\ell_{1}^{2}-\eta\ell_{2}^{2}$, with parameters $0<\eta\leq 1$ designed to address ill-posed linear problems that yield sparse solutions. We…

最优化与控制 · 数学 2025-06-16 Long Li , Liang Ding

Sparse learning has recently received increasing attention in many areas including machine learning, statistics, and applied mathematics. The mixed-norm regularization based on the L1/Lq norm with q > 1 is attractive in many applications of…

机器学习 · 计算机科学 2010-09-27 Jun Liu , Jieping Ye

We consider the problem of minimizing a sum of several convex non-smooth functions. We introduce a new algorithm called the selective linearization method, which iteratively linearizes all but one of the functions and employs simple…

最优化与控制 · 数学 2016-08-16 Yu Du , Xiaodong Lin , Andrzej Ruszczynski

This paper investigates a general class of problems in which a lower bounded smooth convex function incorporating $\ell_{0}$ and $\ell_{2,0}$ regularization is minimized over a box constraint. Although such problems arise frequently in…

最优化与控制 · 数学 2025-11-26 Yuge Ye , Qingna Li

In logistic regression, it is often desirable to utilize regularization to promote sparse solutions, particularly for problems with a large number of features compared to available labels. In this paper, we present screening rules that…

机器学习 · 统计学 2022-02-02 Anna Deza , Alper Atamturk

This paper considers the regularization continuation method and the trust-region updating strategy for the nonlinearly equality-constrained optimization problem. Namely, it uses the inverse of the regularization quasi-Newton matrix as the…

最优化与控制 · 数学 2023-08-07 Xin-long Luo , Hang Xiao , Sen Zhang

Ordered Weighted $L_{1}$ (OWL) regularized regression is a new regression analysis for high-dimensional sparse learning. Proximal gradient methods are used as standard approaches to solve OWL regression. However, it is still a burning issue…

机器学习 · 计算机科学 2021-10-20 Runxue Bao , Bin Gu , Heng Huang

Matrix form data sets arise in many areas, so there are lots of works about the matrix regression models. One special model of these models is the adaptive nuclear norm regularized trace regression, which has been proven have good…

统计方法学 · 统计学 2024-04-16 Pan Shang , Lingchen Kong

Sparsity promoting regularizers are widely used to impose low-complexity structure (e.g. l1-norm for sparsity) to the regression coefficients of supervised learning. In the realm of deterministic optimization, the sequence generated by…

机器学习 · 计算机科学 2022-11-14 Jingwei Liang , Clarice Poon

One of the fundamental challenges for offline reinforcement learning (RL) is ensuring robustness to data distribution. Whether the data originates from a near-optimal policy or not, we anticipate that an algorithm should demonstrate its…

机器学习 · 计算机科学 2023-10-18 Xiaohan Hu , Yi Ma , Chenjun Xiao , Yan Zheng , Jianye Hao

Convex regularizers are often used for sparse learning. They are easy to optimize, but can lead to inferior prediction performance. The difference of $\ell_1$ and $\ell_2$ ($\ell_{1-2}$) regularizer has been recently proposed as a nonconvex…

机器学习 · 计算机科学 2017-06-21 Quanming Yao , James T. Kwok , Xiawei Guo

Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-smooth non-convex problem. In this paper, we investigate the dual forms of…

机器学习 · 计算机科学 2024-12-31 Shaogang Ren , Xiaoning Qian

Iteratively reweighted $\ell_1$ algorithm is a popular algorithm for solving a large class of optimization problems whose objective is the sum of a Lipschitz differentiable loss function and a possibly nonconvex sparsity inducing…

最优化与控制 · 数学 2017-11-21 Peiran Yu , Ting Kei Pong

Feature selection in learning to rank has recently emerged as a crucial issue. Whereas several preprocessing approaches have been proposed, only a few works have been focused on integrating the feature selection into the learning process.…

机器学习 · 计算机科学 2015-07-03 Léa Laporte , Rémi Flamary , Stephane Canu , Sébastien Déjean , Josiane Mothe

l1-norm quantile regression is a common choice if there exists outlier or heavy-tailed error in high-dimensional data sets. However, it is computationally expensive to solve this problem when the feature size of data is ultra high. As far…

统计方法学 · 统计学 2020-12-18 Pan Shang , Lingchen Kong

Sparsity and rank functions are important ways of regularizing under-determined linear systems. Optimization of the resulting formulations is made difficult since both these penalties are non-convex and discontinuous. The most common remedy…

最优化与控制 · 数学 2019-01-01 Carl Olsson , Marcus Carlsson , Daniele Gerosa

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

统计理论 · 数学 2007-06-13 Ana K. Fermin , Carenne Ludena

In this paper, we propose a double iteratively reweighted algorithm to solve nonconvex and nonsmooth optimization problems, where both the objectives and constraint functions are formulated by concave compositions to promote group-sparse…

最优化与控制 · 数学 2025-11-25 Wanqin Nie , Kai Tu , Minglu Ye , Shuqin Sun

In this paper we study the $\ell_p$-analysis optimization ($0<p\leq1$) problem for cosparse signal recovery. We establish a bound for recovery error via the restricted $p$-isometry property over any subspace. We further prove that the…

信息论 · 计算机科学 2018-08-28 Shubao Zhang , Hui Qian , Xiaojin Gong , Jianying Zhou