中文
相关论文

相关论文: Preconditioning of a Generalized Forward-Backward …

200 篇论文

The main result of the present theoretical paper is an original decomposition formula for the proximal operator of the sum of two proper, lower semicontinuous and convex functions $f$ and $g$. For this purpose, we introduce a new operator,…

最优化与控制 · 数学 2018-06-13 Samir Adly , Loïc Bourdin , Fabien Caubet

In this paper we consider the problem of distributed nonlinear optimisation of a separable convex cost function over a graph subject to cone constraints. We show how to generalise, using convex analysis, monotone operator theory and…

分布式、并行与集群计算 · 计算机科学 2024-05-16 Richard Heusdens , Guoqiang Zhang

In this paper, we consider solving a class of convex optimization problem which minimizes the sum of three convex functions $f(x)+g(x)+h(Bx)$, where $f(x)$ is differentiable with a Lipschitz continuous gradient, $g(x)$ and $h(x)$ have a…

最优化与控制 · 数学 2019-04-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

We consider the problem of solving dual monotone inclusions involving sums of composite parallel-sum type operators. A feature of this work is to exploit explicitly the cocoercivity of some of the operators appearing in the model. Several…

最优化与控制 · 数学 2011-10-11 Bang Cong Vu

We provide a comprehensive study of the convergence of the forward-backward algorithm under suitable geometric conditions, such as conditioning or {\L}ojasiewicz properties. These geometrical notions are usually local by nature, and may…

最优化与控制 · 数学 2023-12-25 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

Sparsity priors are commonly used in denoising and image reconstruction. For analysis-type priors, a dictionary defines a representation of signals that is likely to be sparse. In most situations, this dictionary is not known, and is to be…

最优化与控制 · 数学 2021-12-16 Hashem Ghanem , Joseph Salmon , Nicolas Keriven , Samuel Vaiter

We propose and analyze the convergence of a novel stochastic algorithm for solving monotone inclusions that are the sum of a maximal monotone operator and a monotone, Lipschitzian operator. The propose algorithm requires only unbiased…

最优化与控制 · 数学 2021-02-18 Nguyen Van Dung , Bang Cong Vu

We consider the setting of distributed empirical risk minimization where multiple machines compute the gradients in parallel and a centralized server updates the model parameters. In order to reduce the number of communications required to…

最优化与控制 · 数学 2020-02-26 Hadrien Hendrikx , Lin Xiao , Sebastien Bubeck , Francis Bach , Laurent Massoulie

We consider forward-backward greedy algorithms for solving sparse feature selection problems with general convex smooth functions. A state-of-the-art greedy method, the Forward-Backward greedy algorithm (FoBa-obj) requires to solve a large…

机器学习 · 统计学 2014-01-08 Ji Liu , Ryohei Fujimaki , Jieping Ye

Preconditioning is at the core of modern many-fermion Monte Carlo algorithms, such as Hybrid Monte Carlo, where the repeated solution of a linear problem involving an ill-conditioned matrix is needed. We report on a performance comparison…

高能物理 - 格点 · 物理学 2010-08-24 Timour Ten , Joaquín E. Drut , Timo A. Lähde

This paper proposes a universal algorithm for convex minimization problems of the composite form $g_0(x)+h(g_1(x),\dots, g_m(x)) + u(x)$. We allow each $g_j$ to independently range from being nonsmooth Lipschitz to smooth, from convex to…

最优化与控制 · 数学 2026-01-15 Aaron Zoll , Benjamin Grimmer

In this work, we study resolvent splitting algorithms for solving composite monotone inclusion problems. The objective of these general problems is finding a zero in the sum of maximally monotone operators composed with linear operators.…

最优化与控制 · 数学 2022-02-22 Francisco J. Aragón-Artacho , Radu I. Boţ , David Torregrosa-Belén

Polynomial preconditioning can improve the convergence of the Arnoldi method for computing eigenvalues. Such preconditioning significantly reduces the cost of orthogonalization; for difficult problems, it can also reduce the number of…

数值分析 · 数学 2018-06-22 Mark Embree , Jennifer A. Loe , Ronald B. Morgan

Transform-domain least mean squares (LMS) adaptive filters encompass the class of algorithms where the input data are subjected to a data-independent unitary transform followed by a power normalization stage as preprocessing steps. Because…

信号处理 · 电气工程与系统科学 2020-12-29 Tamal Batabyal , Daniel S. Weller , Jaideep Kapur , Scott T. Acton

Composite optimization problems involve minimizing the composition of a smooth map with a convex function. Such objectives arise in numerous data science and signal processing applications, including phase retrieval, blind deconvolution,…

最优化与控制 · 数学 2025-10-06 Mateo Díaz , Liwei Jiang , Abdel Ghani Labassi

Graph neural networks have emerged as a powerful tool for graph representation learning, but their performance heavily relies on abundant task-specific supervision. To reduce labeling requirement, the "pre-train, prompt" paradigms have…

机器学习 · 计算机科学 2024-08-27 Xingtong Yu , Zhenghao Liu , Yuan Fang , Zemin Liu , Sihong Chen , Xinming Zhang

In this paper, we propose variants of forward-backward splitting method for solving the system of splitting inclusion problem. We propose a conceptual algorithm containing three variants, each having a different projection steps. The…

最优化与控制 · 数学 2016-01-05 R. Díaz Millán

In this article, we study two methods for solving monotone inclusions in real Hilbert spaces involving the sum of a maximally monotone operator, a monotone-Lipschitzian operator, a cocoercive operator, and a normal cone to a vector…

最优化与控制 · 数学 2024-05-13 Fernando Roldán

In this paper, a conceptual algorithm modifying the forward-backward-half-forward (FBHF) splitting method for solving three operator monotone inclusion problems is investigated. The FBHF splitting method adjusts and improves Tseng's…

最优化与控制 · 数学 2021-04-28 Yunier Bello-Cruz , Oday Hazaimah

A common way of partitioning graphs is through minimum cuts. One drawback of classical minimum cut methods is that they tend to produce small groups, which is why more balanced variants such as normalized and ratio cuts have seen more…

机器学习 · 计算机科学 2024-10-07 Chakib Fettal , Lazhar Labiod , Mohamed Nadif