English
Related papers

Related papers: A variable metric forward--backward method with ex…

200 papers

The classical Krasnoselskii-Mann iteration is broadly used for approximating fixed points of nonexpansive operators. To accelerate the convergence of the Krasnoselskii-Mann iteration, the inertial methods were received much attention in…

Functional Analysis · Mathematics 2020-01-09 Fuying Cui , Yang Yang , Yuchao Tang , Chuanxi Zhu

This paper presents a multilevel framework for inertial and inexact proximal algorithms, that encompasses multilevel versions of classical algorithms such as forward-backward and FISTA. The methods are supported by strong theoretical…

Optimization and Control · Mathematics 2024-04-03 Guillaume Lauga , Elisa Riccietti , Nelly Pustelnik , Paulo Gonçalves

In this paper, we develop rapidly convergent forward-backward algorithms for computing zeroes of the sum of finitely many maximally monotone operators. A modification of the classical forward-backward method for two general operators is…

Optimization and Control · Mathematics 2021-07-22 Paul-Emile Maingé

We propose an extended primal-dual algorithm framework for solving a general nonconvex optimization model. This work is motivated by image reconstruction problems in a class of nonlinear imaging, where the forward operator can be formulated…

Optimization and Control · Mathematics 2024-08-28 Yu Gao , Xiaochuan Pan , Chong Chen

Forward and inverse models are used throughout different engineering fields to predict and understand the behaviour of systems and to find parameters from a set of observations. These models use root-finding and minimisation techniques…

Computational Engineering, Finance, and Science · Computer Science 2023-08-08 Preslav Aleksandrov

This research is concerned with evolution equations and their forward-backward discretizations. Our first contribution is an estimation for the distance between iterates of sequences generated by forward-backward schemes, useful in the…

Optimization and Control · Mathematics 2019-12-16 Andres Contreras , Juan Peypouquet

We investigate the convergence of a forward-backward-forward proximal-type algorithm with inertial and memory effects when minimizing the sum of a nonsmooth function with a smooth one in the absence of convexity. The convergence is obtained…

Optimization and Control · Mathematics 2014-06-04 Radu Ioan Bot , Ernö Robert Csetnek

We investigate an interpolation/extrapolation method that, given scattered observations of the Fourier transform, approximates its inverse. The interpolation algorithm takes advantage of modelling the available data via a shape-driven…

Numerical Analysis · Mathematics 2021-09-22 Emma Perracchione , Anna Maria Massone , Michele Piana

In this paper, we consider the minimization of a $C^2-$smooth and strongly convex objective depending on a given parameter, which is usually found in many practical applications. We suppose that we desire to solve the problem with some…

Optimization and Control · Mathematics 2025-03-14 Jean-Jacques Godeme

We consider the problem of reconstructing an infinite set of sparse, finite-dimensional vectors, that share a common sparsity pattern, from incomplete measurements. This is in contrast to the work [17], where the single vector signal can be…

Optimization and Control · Mathematics 2021-11-29 Nick Dexter , Hoang Tran , Clayton Webster

In this paper, we discuss numerical methods for the eigenvalue decomposition of real symmetric matrices. While many existing methods can compute approximate eigenpairs with sufficiently small backward errors, the magnitude of the resulting…

Numerical Analysis · Mathematics 2026-02-24 Takeshi Terao , Katsuhisa Ozaki

We provide a comprehensive study of the convergence of the forward-backward algorithm under suitable geometric conditions, such as conditioning or {\L}ojasiewicz properties. These geometrical notions are usually local by nature, and may…

Optimization and Control · Mathematics 2023-12-25 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

This paper proposes two proximal Newton-CG methods for convex nonsmooth optimization problems in composite form. The algorithms are based on a a reformulation of the original nonsmooth problem as the unconstrained minimization of a…

Optimization and Control · Mathematics 2014-03-03 Panagiotis Patrinos , Lorenzo Stella , Alberto Bemporad

We proposed an iterate scheme for solving convex-concave saddle-point problems associated with general convex-concave functions. We demonstrated that when our iterate scheme is applied to a special class of convex-concave functions, which…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang

Inverse imaging problems rely on limited and indirect measurements, making reconstruction highly dependent on both regularization and sample locations. We introduce a novel greedy framework for the optimal selection of indirect measurements…

Numerical Analysis · Mathematics 2025-12-04 L. Bruni Bruno , P. Massa , E. Perracchione , M. Trombini

We present an extension of two policy-iteration based algorithms on weighted graphs (viz., Markov Decision Problems and Max-Plus Algebras). This extension allows us to solve the following inverse problem: considering the weights of the…

Discrete Mathematics · Computer Science 2009-11-18 Laurent Fribourg , Etienne André

Variational inequalities play a key role in machine learning research, such as generative adversarial networks, reinforcement learning, adversarial training, and generative models. This paper is devoted to the constrained variational…

Machine Learning · Computer Science 2026-05-19 Mohammad S. Alkousa , Fedor S. Stonyakin , Belal A. Alashqar , Seydamet S. Ablaev

In this paper, we develop an optimization-based framework for solving coupled forward-backward stochastic differential equations. We introduce an integral-form objective function and prove its equivalence to the error between consecutive…

Optimization and Control · Mathematics 2025-07-22 Yutian Wang , Yuan-Hua Ni , Xun Li

Numerous tasks at the core of statistics, learning and vision areas are specific cases of ill-posed inverse problems. Recently, learning-based (e.g., deep) iterative methods have been empirically shown to be useful for these problems.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Risheng Liu , Shichao Cheng , Yi He , Xin Fan , Zhouchen Lin , Zhongxuan Luo

We propose a scalable Forward-Forward (FF) algorithm that eliminates the need for backpropagation by training each layer separately. Unlike backpropagation, FF avoids backward gradients and can be more modular and memory efficient, making…

Machine Learning · Computer Science 2025-01-07 Andrii Krutsylo