中文
相关论文

相关论文: A proximal Newton framework for composite minimiza…

200 篇论文

This paper proposes a novel CTA (Combine-Then-Adapt)-based decentralized algorithm for solving convex composite optimization problems over undirected and connected networks. The local loss function in these problems contains both smooth and…

最优化与控制 · 数学 2023-03-07 Luyao Guo , Xinli Shi , Jinde Cao , Zihao Wang

This paper presents a stochastic block-coordinate proximal Newton method for minimizing the sum of a blockwise Lipschitz-continuously differentiable function and a separable nonsmooth convex function. At each iteration, the method randomly…

最优化与控制 · 数学 2026-03-25 Hong Zhu , Xun Qian

We consider network topology identification subject to a signal smoothness prior on the nodal observations. A fast dual-based proximal gradient algorithm is developed to efficiently tackle a strongly convex, smoothness-regularized network…

机器学习 · 计算机科学 2021-10-20 Seyed Saman Saboksayr , Gonzalo Mateos

Many scientific and engineering applications feature nonsmooth convex minimization problems over convex sets. In this paper, we address an important instance of this broad class where we assume that the nonsmooth objective is equipped with…

最优化与控制 · 数学 2014-06-23 Quoc Tran Dinh , Anastasios Kyrillidis , Volkan Cevher

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

机器学习 · 计算机科学 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

We propose a general learning based framework for solving nonsmooth and nonconvex image reconstruction problems. We model the regularization function as the composition of the $l_{2,1}$ norm and a smooth but nonconvex feature mapping…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Yunmei Chen , Hongcheng Liu , Xiaojing Ye , Qingchao Zhang

We introduce a notion of self-concordant smoothing for minimizing the sum of two convex functions, one of which is smooth and the other nonsmooth. The key highlight is a natural property of the resulting problem's structure that yields a…

最优化与控制 · 数学 2025-12-01 Adeyemi D. Adeoye , Alberto Bemporad

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

最优化与控制 · 数学 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

机器学习 · 计算机科学 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

最优化与控制 · 数学 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

最优化与控制 · 数学 2026-05-19 Hong Zhu

We propose a new proximal, path-following framework for a class of constrained convex problems. We consider settings where the nonlinear---and possibly non-smooth---objective part is endowed with a proximity operator, and the constraint set…

最优化与控制 · 数学 2016-12-28 Quoc Tran-Dinh , Anastasios Kyrillidis , Volkan Cevher

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

最优化与控制 · 数学 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

How to obtain a graph from data samples is an important problem in graph signal processing. One way to formulate this graph learning problem is based on Gaussian maximum likelihood estimation, possibly under particular topology constraints.…

信号处理 · 电气工程与系统科学 2017-11-02 Keng-Shih Lu , Antonio Ortega

This paper proposes new proximal Newton-type methods with a diagonal metric for solving composite optimization problems whose objective function is the sum of a twice continuously differentiable function and a proper closed directionally…

最优化与控制 · 数学 2023-10-11 Shotaro Yagishita , Shummin Nakayama

In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the…

信号处理 · 电气工程与系统科学 2022-05-11 Ghania Fatima , Aakash Arora , Prabhu Babu , Petre Stoica

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a common multivariate statistical model for learning a weighted sparse dependency graph from given data. This graph learning problem can be formulated as a maximum likelihood…

机器学习 · 计算机科学 2024-04-15 Yakov Medvedovsky , Eran Treister , Tirza Routtenberg

We consider minimization of a smooth nonconvex objective function using an iterative algorithm based on Newton's method and the linear conjugate gradient algorithm, with explicit detection and use of negative curvature directions for the…

最优化与控制 · 数学 2018-11-14 Clément W. Royer , Michael O'Neill , Stephen J. Wright

We present a convex formulation of dictionary learning for sparse signal decomposition. Convexity is obtained by replacing the usual explicit upper bound on the dictionary size by a convex rank-reducing term similar to the trace norm. In…

机器学习 · 计算机科学 2008-12-11 Francis Bach , Julien Mairal , Jean Ponce

We study a class of monotone inclusions called "self-concordant inclusion" which covers three fundamental convex optimization formulations as special cases. We develop a new generalized Newton-type framework to solve this inclusion. Our…

最优化与控制 · 数学 2017-07-25 Quoc Tran-Dinh , Tianxiao Sun , Shu Lu