中文
相关论文

相关论文: Robust Low-Rank Matrix Completion via a New Sparsi…

200 篇论文

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

机器学习 · 计算机科学 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Regularization plays a pivotal role when facing the challenge of solving ill-posed inverse problems, where the number of observations is smaller than the ambient dimension of the object to be estimated. A line of recent work has studied…

最优化与控制 · 数学 2014-07-03 Samuel Vaiter , Mohammad Golbabaee , Jalal M. Fadili , Gabriel Peyré

Since introduced by Martinet and Rockafellar, the proximal point algorithm was generalized in many fruitful directions. More recently, in 2002, Pennanen studied the proximal point algorithm without monotonicity. A year later, Iusem and…

In this paper we study the convex envelopes of a new class of functions. Using this approach, we are able to unify two important classes of regularizers from unbiased non-convex formulations and weighted nuclear norm penalties. This opens…

最优化与控制 · 数学 2021-03-18 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

In this article we propose a method for solving unconstrained optimization problems with convex and Lipschitz continuous objective functions. By making use of the Moreau envelopes of the functions occurring in the objective, we smooth the…

最优化与控制 · 数学 2012-07-16 Radu Ioan Bot , Christopher Hendrich

During the past years there has been an explosion of interest in learning methods based on sparsity regularization. In this paper, we discuss a general class of such methods, in which the regularizer can be expressed as the composition of a…

机器学习 · 计算机科学 2013-03-26 Andreas Argyriou , Luca Baldassarre , Charles A. Micchelli , Massimiliano Pontil

This paper presents a novel hybrid algorithm for minimizing the sum of a continuously differentiable loss function and a nonsmooth, possibly nonconvex, sparse regularization function. The proposed method alternates between solving a…

最优化与控制 · 数学 2025-04-01 Hao Wang , Xiangyu Yang , Yichen Zhu

In this paper, we consider an unconstrained optimization model where the objective is a sum of a large number of possibly nonconvex functions, though overall the objective is assumed to be smooth and convex. Our bid to solving such model…

最优化与控制 · 数学 2022-03-15 Xi Chen , Bo Jiang , Tianyi Lin , Shuzhong Zhang

We consider the problem of robust matrix completion, which aims to recover a low rank matrix $L_*$ and a sparse matrix $S_*$ from incomplete observations of their sum $M=L_*+S_*\in\mathbb{R}^{m\times n}$. Algorithmically, the robust matrix…

机器学习 · 统计学 2020-03-25 Yunfeng Cai , Ping Li

Sparse regularization is fundamental in signal processing and feature extraction but often relies on non-differentiable penalties, conflicting with gradient-based optimizers. We propose WEEP (Weakly-convex Envelope of Piecewise Penalty), a…

机器学习 · 计算机科学 2026-01-21 Takanobu Furuhashi , Hidekata Hontani , Qibin Zhao , Tatsuya Yokota

In recent years, there has been a growing interest in mathematical models leading to the minimization, in a symmetric matrix space, of a Bregman divergence coupled with a regularization term. We address problems of this type within a…

最优化与控制 · 数学 2022-06-10 A. Benfenati , E. Chouzenoux , J. -C. Pesquet

Joint sparsity regularization in multi-task learning has attracted much attention in recent years. The traditional convex formulation employs the group Lasso relaxation to achieve joint sparsity across tasks. Although this approach leads to…

机器学习 · 计算机科学 2013-09-27 Krishnakumar Balasubramanian , Kai Yu , Tong Zhang

We present an adaptive regularization scheme for optimizing composite energy functionals arising in image analysis problems. The scheme automatically trades off data fidelity and regularization depending on the current data fit during the…

计算机视觉与模式识别 · 计算机科学 2017-05-10 Byung-Woo Hong , Ja-Keoung Koo , Martin Burger , Stefano Soatto

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

机器学习 · 计算机科学 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

We investigate a class of nonconvex optimization problems characterized by a feasible set consisting of level-bounded nonconvex regularizers, with a continuously differentiable objective. We propose a novel hybrid approach to tackle such…

最优化与控制 · 数学 2024-10-28 Xiangyu Yang , Hao Wang , Yichen Zhu , Xiao Wang

We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute),…

最优化与控制 · 数学 2018-05-29 Tianxiang Liu , Ting Kei Pong , Akiko Takeda

Robust low-rank matrix completion (RMC), or robust principal component analysis with partially observed data, has been studied extensively for computer vision, signal processing and machine learning applications. This problem aims to…

机器学习 · 计算机科学 2021-06-09 Minhui Huang , Shiqian Ma , Lifeng Lai

This paper addresses explainability of the operator-regularization approach under the use of monotone Lipschitz-gradient (MoL-Grad) denoiser -- an operator that can be expressed as the Lipschitz continuous gradient of a differentiable…

最优化与控制 · 数学 2025-09-26 Masahiro Yukawa , Isao Yamada

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

最优化与控制 · 数学 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

Standard complexity analyses for weakly convex optimization rely on the Moreau envelope technique proposed by Davis and Drusvyatskiy (2019). The main insight is that nonsmooth algorithms, such as proximal subgradient, proximal point, and…

最优化与控制 · 数学 2026-01-27 Qi Deng , Wenzhi Gao