English
Related papers

Related papers: Degenerate preconditioned backward-backward splitt…

200 papers

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

We introduce and analyze an algorithm for the minimization of convex functions that are the sum of differentiable terms and proximable terms composed with linear operators. The method builds upon the recently developed smoothed gap…

Optimization and Control · Mathematics 2017-06-20 Quang Van Nguyen , Olivier Fercoq , Volkan Cevher

Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Dominikus Noll , Hung M. Phan

We extend the idea of automated debiased machine learning to the dynamic treatment regime and more generally to nested functionals. We show that the multiply robust formula for the dynamic treatment regime with discrete treatments can be…

Econometrics · Economics 2023-06-22 Victor Chernozhukov , Whitney Newey , Rahul Singh , Vasilis Syrgkanis

Incorporating a deep generative model as the prior distribution in inverse problems has established substantial success in reconstructing images from corrupted observations. Notwithstanding, the existing optimization approaches use gradient…

Machine Learning · Computer Science 2023-01-31 Tianci Liu , Tong Yang , Quan Zhang , Qi Lei

In this paper, for a convex-concave bilinear saddle point problem, we propose a Tikhonov regularized second-order primal-dual dynamical system with slow damping, extrapolation and general time scaling parameters. Depending on the vanishing…

Optimization and Control · Mathematics 2024-09-10 Xiangkai Sun , Liang He , Xian-Jun Long

Variational regularisation is the primary method for solving inverse problems, and recently there has been considerable work leveraging deeply learned regularisation for enhanced performance. However, few results exist addressing the…

Optimization and Control · Mathematics 2024-06-18 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

We introduce a framework for quasi-Newton forward--backward splitting algorithms (proximal quasi-Newton methods) with a metric induced by diagonal $\pm$ rank-$r$ symmetric positive definite matrices. This special type of metric allows for a…

Optimization and Control · Mathematics 2018-11-27 Stephen Becker , Jalal Fadili , Peter Ochs

Randomized iterative methods have gained recent interest in machine learning and signal processing for solving large-scale linear systems. One such example is the randomized Douglas-Rachford (RDR) method, which updates the iterate by…

Numerical Analysis · Mathematics 2025-06-13 Liqi Guo , Ruike Xiang , Deren Han , Jiaxin Xie

This work investigates a dynamical system functioning as a nonsmooth adaptation of the continuous Newton method, aimed at minimizing the sum of a primal lower-regular and a locally Lipschitz function, both potentially nonsmooth. The…

Optimization and Control · Mathematics 2024-12-10 Juan Guillermo Garrido , Pedro Pérez-Aros , Emilio Vilches

We investigate the modeling and the numerical solution of machine learning problems with prediction functions which are linear combinations of elements of a possibly infinite-dimensional dictionary. We propose a novel flexible composite…

Statistics Theory · Mathematics 2015-12-03 Patrick L. Combettes , Saverio Salzo , Silvia Villa

This work proposes an accelerated primal-dual dynamical system for affine constrained convex optimization and presents a class of primal-dual methods with nonergodic convergence rates. In continuous level, exponential decay of a novel…

Optimization and Control · Mathematics 2022-04-12 Hao Luo

The backward-backward algorithm is a tool for finding minima of a regularization of the sum of two convex functions in Hilbert spaces. We generalize this setting to Hadamard spaces and prove the convergence of an error-tolerant version of…

Optimization and Control · Mathematics 2013-10-01 Sebastian Banert

In this paper, a class of generalized backward doubly stochastic differential equations whose coefficient contains the subdifferential operators of two convex functions (also called generalized backward doubly stochastic variational…

Probability · Mathematics 2011-08-04 Yong Ren , Qing Zhou , Auguste Aman

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

We propose a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term, where the inertial term is introduced only for the primal variable, for the linearly constrained convex optimization problem in a…

Optimization and Control · Mathematics 2024-06-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

The Douglas--Rachford algorithm is a popular algorithm for solving both convex and nonconvex feasibility problems. While its behaviour is settled in the convex inconsistent case, the general nonconvex inconsistent case is far from being…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Scott B. Lindstrom

This paper addresses a new class of generalized Bolza problems governed by nonconvex integro-differential inclusions with endpoint constraints on trajectories, where the integral terms are given in the general (with time-dependent…

Optimization and Control · Mathematics 2024-10-07 Abderrahim Bouach , Tahar Haddad , Boris S. Mordukhovich

In this work, we are devoted to the reconstruction of an unknown initial value from the terminal data. The asymptotic and root-distribution properties of Mittag-Leffler functions are used to establish stability of the backward problem.…

Numerical Analysis · Mathematics 2025-06-24 Dakang Cen , Zhiyuan Li , Wenlong Zhang

We study in this paper a forward-backward-forward dynamical system for solving a mixed variational inequality problem in a real Hilbert space. For the convergence analysis of our proposed system, we apply the Lyapunov analysis to obtain the…

Optimization and Control · Mathematics 2025-11-25 Chidi Elijah Nwakpa , Chinedu Izuchukwu , Chibueze Christian Okeke