English
Related papers

Related papers: Bregman Distances in Inverse Problems and Partial …

200 papers

This paper introduces adaptive Bregman proximal gradient algorithms for solving convex composite minimization problems without relying on global relative smoothness or strong convexity assumptions. Building upon recent advances in adaptive…

Optimization and Control · Mathematics 2025-08-05 Hongjia Ou , Puya Latafat , Andreas Themelis

We prove some sharp extremal distance results for functions in weighted Bergman spaces on the upper halfplane.We also prove such results in the context of bounded strictly pseudoconvex domains with smooth boundary

Complex Variables · Mathematics 2024-04-17 Romi Shamoyan , Milos Arsenovic

We show that the Bregman divergence provides a rich framework to estimate unnormalized statistical models for continuous or discrete random variables, that is, models which do not integrate or sum to one, respectively. We prove that recent…

Machine Learning · Computer Science 2012-02-20 Michael Gutmann , Jun-ichiro Hirayama

The focus of this book is on the analysis of regularization methods for solving \emph{nonlinear inverse problems}. Specifically, we place a strong emphasis on techniques that incorporate supervised or unsupervised data derived from prior…

Optimization and Control · Mathematics 2025-06-24 Clemens Kirisits , Bochra Mejri , Sergei Pereverzev , Otmar Scherzer , Cong Shi

Regularization by the Shannon entropy enables us to efficiently and approximately solve optimal transport problems on a finite set. This paper is concerned with regularized optimal transport problems via Bregman divergence. We introduce the…

Optimization and Control · Mathematics 2025-04-10 Keiichi Morikuni , Koya Sakakibara , Asuka Takatsu

We introduce a new system of split variational inequality problems which is a natural extension of split variational inequality problem in semi-inner product spaces. We use the retraction technique to propose an iterative algorithm for…

Functional Analysis · Mathematics 2017-01-20 K. R. Kazmi , Mohd Furkan

We study the variational inference problem of minimizing a regularized R\'enyi divergence over an exponential family. We propose to solve this problem with a Bregman proximal gradient algorithm. We propose a sampling-based algorithm to…

Statistics Theory · Mathematics 2024-10-17 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

We propose a new randomized method for solving systems of nonlinear equations, which can find sparse solutions or solutions under certain simple constraints. The scheme only takes gradients of component functions and uses Bregman…

Optimization and Control · Mathematics 2024-02-26 Robert Gower , Dirk A. Lorenz , Maximilian Winkler

Classic subdifferentials in variational analysis may fail to fully represent the Bregman proximal operator in the absence of convexity. In this paper, we fill this gap by introducing the left and right \emph{Bregman level proximal…

Optimization and Control · Mathematics 2026-04-14 Ziyuan Wang , Andreas Themelis

Bregman divergences play a pivotal role in statistics, machine learning and computational information geometry. Particularly in the context of machine learning, they are central to clustering, exponential families, parameter estimation and…

Machine Learning · Computer Science 2026-04-28 Russell Tsuchida , Frank Nielsen

In this paper, we consider the online proximal mirror descent for solving the time-varying composite optimization problems. For various applications, the algorithm naturally involves the errors in the gradient and proximal operator. We…

Optimization and Control · Mathematics 2023-04-11 Woocheol Choi , Myeong-Su Lee , Seok-Bae Yun

When considering fractional diffusion equation as model equation in analyzing anomalous diffusion processes, some important parameters in the model, for example, the orders of the fractional derivative or the source term, are often unknown,…

Analysis of PDEs · Mathematics 2019-04-15 Zhiyuan Li , Masahiro Yamamoto

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

Minimization of suitable statistical distances~(between the data and model densities) has proved to be a very useful technique in the field of robust inference. Apart from the class of $\phi$-divergences of \cite{a} and \cite{b}, the…

Statistics Theory · Mathematics 2021-01-25 Sancharee Basak , Ayanendranath Basu

We study the application of the Augmented Lagrangian Method to the solution of linear ill-posed problems. Previously, linear convergence rates with respect to the Bregman distance have been derived under the classical assumption of a…

Numerical Analysis · Mathematics 2015-06-04 Klaus Frick , Markus Grasmair

This paper revisits the convergence of Stochastic Mirror Descent (SMD) in the contemporary nonconvex optimization setting. Existing results for batch-free nonconvex SMD restrict the choice of the distance generating function (DGF) to be…

Optimization and Control · Mathematics 2024-02-28 Ilyas Fatkhullin , Niao He

Classical linear metric learning methods have recently been extended along two distinct lines: deep metric learning methods for learning embeddings of the data using neural networks, and Bregman divergence learning approaches for extending…

Machine Learning · Computer Science 2020-05-07 Kubra Cilingir , Rachel Manzelli , Brian Kulis

Distance Geometry is based on the inverse problem that asks to find the positions of points, in a Euclidean space of given dimension, that are compatible with a given set of distances. We briefly introduce the field, and discuss some open…

Metric Geometry · Mathematics 2016-10-04 Leo Liberti , Carlile Lavor

Solving the inverse kinematics problem is a fundamental challenge in motion planning, control, and calibration for articulated robots. Kinematic models for these robots are typically parametrized by joint angles, generating a complicated…

Robotics · Computer Science 2023-12-12 Filip Marić , Matthew Giamou , Adam W. Hall , Soroush Khoubyarian , Ivan Petrović , Jonathan Kelly

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov