English
Related papers

Related papers: A Bregman Proximal Perspective on Classical and Qu…

200 papers

This article develops the numerical and theoretical study of a reconstruction algorithm of a potential in a wave equation from boundary measurements, using a cost functional built on weighted energy terms coming from a Carleman estimate.…

Numerical Analysis · Mathematics 2016-10-25 Lucie Baudouin , Maya de Buhan , Sylvain Ervedoza

This paper studies a novel algorithm for nonconvex composite minimization which can be interpreted in terms of dual space nonlinear preconditioning for the classical proximal gradient method. The proposed scheme can be applied to additive…

Optimization and Control · Mathematics 2024-12-24 Emanuel Laude , Panagiotis Patrinos

Bregman divergences generalize measures such as the squared Euclidean distance and the KL divergence, and arise throughout many areas of machine learning. In this paper, we focus on the problem of approximating an arbitrary Bregman…

Machine Learning · Statistics 2020-11-04 Ali Siahkamari , Xide Xia , Venkatesh Saligrama , David Castanon , Brian Kulis

We expose in a tutorial fashion the mechanisms which underlie the synthesis of optimization algorithms based on dynamic integral quadratic constraints. We reveal how these tools from robust control allow to design accelerated gradient…

Optimization and Control · Mathematics 2023-09-18 Carsten W. Scherer , Christian Ebenbauer , Tobias Holicki

We establish the convergence of the forward-backward splitting algorithm based on Bregman distances for the sum of two monotone operators in reflexive Banach spaces. Even in Euclidean spaces, the convergence of this algorithm has so far…

Optimization and Control · Mathematics 2020-09-29 Minh N. Bùi , Patrick L. Combettes

Stochastic optimization powers the scalability of modern artificial intelligence, spanning machine learning, deep learning, reinforcement learning, and large language model training. Yet, existing theory remains largely confined to Hilbert…

Machine Learning · Computer Science 2025-09-18 Johnny R. Zhang , Xiaomei Mi , Gaoyuan Du , Qianyi Sun , Shiqi Wang , Jiaxuan Li , Wenhua Zhou

In this paper, we analyze the local convergence rate of optimistic mirror descent methods in stochastic variational inequalities, a class of optimization problems with important applications to learning theory and machine learning. Our…

Optimization and Control · Mathematics 2021-07-06 Waïss Azizian , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

The problem of minimization of the sum of two convex functions has various theoretical and real-world applications. One of the popular methods for solving this problem is the proximal gradient method (proximal forward-backward algorithm). A…

Optimization and Control · Mathematics 2019-11-12 Daniel Reem , Simeon Reich , Alvaro De Pierro

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

We study quantum algorithms based on quantum (sub)gradient estimation using noisy function evaluation oracles, and demonstrate the first dimension-independent query complexities (up to poly-logarithmic factors) for zeroth-order convex…

We analyse the convergence of the proximal gradient algorithm for convex composite problems in the presence of gradient and proximal computational inaccuracies. We derive new tighter deterministic and probabilistic bounds that we use to…

Optimization and Control · Mathematics 2022-03-07 Anis Hamadouche , Yun Wu , Andrew M. Wallace , Joao F. C. Mota

We propose a new self-adaptive, double-loop smoothing algorithm to solve composite, nonsmooth, and constrained convex optimization problems. Our algorithm is based on Nesterov's smoothing technique via general Bregman distance functions. It…

Optimization and Control · Mathematics 2018-08-15 Quoc Tran-Dinh , Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

We study a stochastic first order primal-dual method for solving convex-concave saddle point problems over real reflexive Banach spaces using Bregman divergences and relative smoothness assumptions, in which we allow for stochastic error in…

Optimization and Control · Mathematics 2021-12-23 Antonio Silveti-Falls , Cesare Molinari , Jalal Fadili

Finding the stationary states of a free energy functional is an important problem in phase field crystal (PFC) models. Many efforts have been devoted for designing numerical schemes with energy dissipation and mass conservation properties.…

Numerical Analysis · Mathematics 2020-11-11 Kai Jiang , Wei Si , Chen Chang , Chenglong Bao

This paper presents a novel stochastic optimisation methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed…

Applications · Statistics 2024-03-12 Charlesquin Kemajou Mbakam , Marcelo Pereyra , Jean-François Giovannelli

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity…

Optimization and Control · Mathematics 2026-02-23 Matthew X. Burns , Jiaming Liang

This paper is devoted to the study of acceleration methods for an inequality constrained convex optimization problem by using Lyapunov functions. We first approximate such a problem as an unconstrained optimization problem by employing the…

Optimization and Control · Mathematics 2024-11-25 Juan Liu , Nan-Jing Huang , Xian-Jun Long , Xue-song Li

We propose a forward-backward splitting algorithm based on Bregman distances for composite minimization problems in general reflexive Banach spaces. The convergence is established using the notion of variable quasi-Bregman monotone…

Optimization and Control · Mathematics 2016-10-10 Quang Van Nguyen

Phase retrieval aims to recover a signal from magnitude or power spectra measurements. It is often addressed by considering a minimization problem involving a quadratic cost function. We propose a different formulation based on Bregman…

Sound · Computer Science 2020-12-01 Pierre-Hugo Vial , Paul Magron , Thomas Oberlin , Cédric Févotte