中文
相关论文

相关论文: A proximal Newton framework for composite minimiza…

200 篇论文

We extend the standard notion of self-concordance to non-convex optimization and develop a family of second-order algorithms with global convergence guarantees. In particular, two function classes -- \textit{weakly self-concordant}…

最优化与控制 · 数学 2026-04-07 Donald Goldfarb , Lexiao Lai , Tianyi Lin , Jiayu Zhang

Graph learning problems are typically approached by focusing on learning the topology of a single graph when signals from all nodes are available. However, many contemporary setups involve multiple related networks and, moreover, it is…

信号处理 · 电气工程与系统科学 2022-12-06 Samuel Rey , Madeline Navarro , Andrei Buciulea , Santiago Segarra , Antonio G. Marques

We study the problem of prediction for evolving graph data. We formulate the problem as the minimization of a convex objective encouraging sparsity and low-rank of the solution, that reflect natural graph properties. The convex formulation…

机器学习 · 统计学 2012-05-10 Emile Richard , Pierre-Andre Savalle , Nicolas Vayatis

We introduce and analyze an algorithm for the minimization of convex functions that are the sum of differentiable terms and proximable terms composed with linear operators. The method builds upon the recently developed smoothed gap…

最优化与控制 · 数学 2017-06-20 Quang Van Nguyen , Olivier Fercoq , Volkan Cevher

A number of inference problems with sensor networks involve projecting a measured signal onto a given subspace. In existing decentralized approaches, sensors communicate with their local neighbors to obtain a sequence of iterates that…

Optimization algorithms for solving nonconvex inverse problem have attracted significant interests recently. However, existing methods require the nonconvex regularization to be smooth or simple to ensure convergence. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Qingchao Zhang , Xiaojing Ye , Hongcheng Liu , Yunmei Chen

We propose a unified derivative-free proximal Newton-type algorithm framework for solving composite optimization problems formulated as the sum of a black-box function and a known regularization term. We establish the iteration and oracle…

最优化与控制 · 数学 2026-05-08 Zekun Liu , Jinyan Fan

This work introduces a simple and efficient linesearch method for composite minimization that accelerates proximal-gradient iterations with fast Newton-type directions. Our algorithm is based on simple operations and only requires the…

最优化与控制 · 数学 2026-04-17 Alexander Bodard , Pieter Pas , Andreas Themelis , Panagiotis Patrinos

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

数值分析 · 计算机科学 2017-10-18 Hiva Ghanbari , Katya Scheinberg

A novel Gromov-Wasserstein learning framework is proposed to jointly match (align) graphs and learn embedding vectors for the associated graph nodes. Using Gromov-Wasserstein discrepancy, we measure the dissimilarity between two graphs and…

机器学习 · 计算机科学 2019-05-08 Hongteng Xu , Dixin Luo , Hongyuan Zha , Lawrence Carin

We consider the class of convex minimization problems, composed of a self-concordant function, such as the $\log\det$ metric, a convex data fidelity term $h(\cdot)$ and, a regularizing -- possibly non-smooth -- function $g(\cdot)$. This…

机器学习 · 统计学 2014-05-14 Anastasios Kyrillidis , Rabeeh Karimi Mahabadi , Quoc Tran-Dinh , Volkan Cevher

We consider concave minimization problems over non-convex sets.Optimization problems with this structure arise in sparse principal component analysis. We analyze both a gradient projection algorithm and an approximate Newton algorithm where…

数值分析 · 计算机科学 2019-04-09 William W. Hager , Dzung T. Phan , Jia-Jie Zhu

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

最优化与控制 · 数学 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

最优化与控制 · 数学 2024-10-25 Md Abu Talhamainuddin Ansary

Within the unmanageably large class of nonconvex optimization, we consider the rich subclass of nonsmooth problems that have composite objectives---this already includes the extensively studied convex, composite objective problems as a…

最优化与控制 · 数学 2012-09-18 Suvrit Sra

We propose a novel trust region method for solving a class of nonsmooth, nonconvex composite-type optimization problems. The approach embeds inexact semismooth Newton steps for finding zeros of a normal map-based stationarity measure for…

最优化与控制 · 数学 2023-10-04 Wenqing Ouyang , Andre Milzarek

We propose a conditional gradient framework for a composite convex minimization template with broad applications. Our approach combines smoothing and homotopy techniques under the CGM framework, and provably achieves the optimal…

最优化与控制 · 数学 2018-08-21 Alp Yurtsever , Olivier Fercoq , Francesco Locatello , Volkan Cevher

In this paper, a multi-parameterized proximal point algorithm combining with a relaxation step is developed for solving convex minimization problem subject to linear constraints. We show its global convergence and sublinear convergence rate…

数值分析 · 数学 2019-07-11 Jianchao Bai , Ke Guo , Xiaokai Chang

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the…

机器学习 · 统计学 2023-08-23 Xingyue Pu , Tianyue Cao , Xiaoyun Zhang , Xiaowen Dong , Siheng Chen

Sparse high dimensional graphical model selection is a popular topic in contemporary machine learning. To this end, various useful approaches have been proposed in the context of $\ell_1$-penalized estimation in the Gaussian framework.…

统计计算 · 统计学 2022-02-04 Sang-Yun Oh , Onkar Dalal , Kshitij Khare , Bala Rajaratnam