English
Related papers

Related papers: A Bregman Proximal Perspective on Classical and Qu…

200 papers

In this paper, we consider the online proximal mirror descent for solving the time-varying composite optimization problems. For various applications, the algorithm naturally involves the errors in the gradient and proximal operator. We…

Optimization and Control · Mathematics 2023-04-11 Woocheol Choi , Myeong-Su Lee , Seok-Bae Yun

In this paper, we propose the approximate Bregman proximal gradient algorithm (ABPG) for solving composite nonconvex optimization problems. ABPG employs a new distance that approximates the Bregman distance, making the subproblem of ABPG…

Optimization and Control · Mathematics 2024-11-25 Shota Takahashi , Akiko Takeda

We consider the convex minimization model with both linear equality and inequality constraints, and reshape the classic augmented Lagrangian method (ALM) by balancing its subproblems. As a result, one of its subproblems decouples the…

Optimization and Control · Mathematics 2021-08-20 Bingsheng He , Xiaoming Yuan

Modern statistical applications often involve minimizing an objective function that may be nonsmooth and/or nonconvex. This paper focuses on a broad Bregman-surrogate algorithm framework including the local linear approximation, mirror…

Optimization and Control · Mathematics 2021-12-20 Yiyuan She , Zhifeng Wang , Jiuwu Jin

We propose a novel Bregman descent algorithm for minimizing a convex function that is expressed as the sum of a differentiable part (defined over an open set) and a possibly nonsmooth term. The approach, referred to as the Variable Bregman…

Machine Learning · Computer Science 2025-02-06 Ségolène Martin , Jean-Christophe Pesquet , Gabriele Steidl , Ismail Ben Ayed

A broad class of hybrid quantum-classical algorithms known as "variational algorithms" have been proposed in the context of quantum simulation, machine learning, and combinatorial optimization as a means of potentially achieving a quantum…

Quantum Physics · Physics 2021-04-09 Aram Harrow , John Napp

We propose a new algorithm to the problem of polygonal curve approximation based on a multiresolution approach. This algorithm is suboptimal but still maintains some optimality between successive levels of resolution using dynamic…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Pierre-François Marteau , Gilbas Ménier

Convex optimization models find interesting applications, especially in signal/image processing and compressive sensing. We study some augmented convex models, which are perturbed by strongly convex functions, and propose a dual gradient…

Optimization and Control · Mathematics 2013-08-30 Hui Zhang , Lizhi Cheng , Wotao Yin

We study the Bregman Augmented Lagrangian method (BALM) for solving convex problems with linear constraints. For classical Augmented Lagrangian method, the convergence rate and its relation with the proximal point method is well-understood.…

Optimization and Control · Mathematics 2020-02-18 Shen Yan , Niao He

We propose efficient Langevin Monte Carlo algorithms for sampling distributions with nonsmooth convex composite potentials, which is the sum of a continuously differentiable function and a possibly nonsmooth function. We devise such…

Machine Learning · Statistics 2022-07-12 Tim Tsz-Kit Lau , Han Liu

This paper summarizes a quantum algorithm of [R.D. Somma, et.al., Phys. Rev. Lett. 101, 130504 (2008)] that simulates a classical annealing process for solving discrete optimization problems. The complexity of the quantum algorithm scales…

Quantum Physics · Physics 2015-12-16 Sergio Boixo , Rolando D. Somma

Recent successes in producing rigorous approximation algorithms for local Hamiltonian problems such as Quantum Max Cut have exploited connections to unconstrained classical discrete optimization problems. We initiate the study of…

Quantum Physics · Physics 2024-09-09 Ojas Parekh , Chaithanya Rayudu , Kevin Thompson

We study the variational inference problem of minimizing a regularized R\'enyi divergence over an exponential family. We propose to solve this problem with a Bregman proximal gradient algorithm. We propose a sampling-based algorithm to…

Statistics Theory · Mathematics 2024-10-17 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov

Recent progress in the development of quantum technologies has enabled the direct investigation of dynamics of increasingly complex quantum many-body systems. This motivates the study of the complexity of classical algorithms for this…

Quantum Physics · Physics 2023-07-12 Dominik S. Wild , Álvaro M. Alhambra

In this paper we introduce two conceptual algorithms for minimising abstract convex functions. Both algorithms rely on solving a proximal-type subproblem with an abstract Bregman distance based proximal term. We prove their convergence when…

Optimization and Control · Mathematics 2026-01-09 Reinier Díaz Millán , Julien Ugon

This paper considers convex programs with a general (possibly non-differentiable) convex objective function and Lipschitz continuous convex inequality constraint functions. A simple algorithm is developed and achieves an $O(1/t)$…

Optimization and Control · Mathematics 2017-08-01 Hao Yu , Michael J. Neely

We consider stochastic gradient methods under the interpolation regime where a perfect fit can be obtained (minimum loss at each observation). While previous work highlighted the implicit regularization of such algorithms, we consider an…

Optimization and Control · Mathematics 2020-04-01 Anant Raj , Francis Bach

This paper presents a comprehensive convergence analysis for the mirror descent (MD) method, a widely used algorithm in convex optimization. The key feature of this algorithm is that it provides a generalization of classical gradient-based…

Optimization and Control · Mathematics 2024-09-16 Mengmou Li , Khaled Laib , Takeshi Hatanaka , Ioannis Lestas

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li