English
Related papers

Related papers: Bregman Distances in Inverse Problems and Partial …

200 papers

In this paper, we propose the approximate Bregman proximal gradient algorithm (ABPG) for solving composite nonconvex optimization problems. ABPG employs a new distance that approximates the Bregman distance, making the subproblem of ABPG…

Optimization and Control · Mathematics 2024-11-25 Shota Takahashi , Akiko Takeda

The linearized Bregman iterations (LBreI) and its variants are powerful tools for finding sparse or low-rank solutions to underdetermined linear systems. In this study, we propose a cut-and-project perspective for the linearized Bregman…

Optimization and Control · Mathematics 2024-04-16 Yu-Hong Dai , Kangkang Deng , Hui Zhang

This paper explores a new framework for reinforcement learning based on online convex optimization, in particular mirror descent and related algorithms. Mirror descent can be viewed as an enhanced gradient method, particularly suited to…

Machine Learning · Computer Science 2012-10-19 Sridhar Mahadevan , Bo Liu

We propose a unifying algorithm for non-smooth non-convex optimization. The algorithm approximates the objective function by a convex model function and finds an approximate (Bregman) proximal point of the convex model. This approximate…

Optimization and Control · Mathematics 2018-06-27 Peter Ochs , Jalal Fadili , Thomas Brox

This paper develops a probabilistic numerical method for solution of partial differential equations (PDEs) and studies application of that method to PDE-constrained inverse problems. This approach enables the solution of challenging inverse…

Methodology · Statistics 2017-07-12 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

This work addresses the problem of error concealment in video transmission systems over noisy channels employing Bregman divergences along with regularization. Error concealment intends to improve the effects of disturbances at the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-11 Alessandra M. Coelho , Vania V. Estrela , Felipe P. do Carmo , Sandro R. Fernandes

We apply symmetry and invariance methods to analyse systems of difference equations. Non trivial symmetries are derived and their exact solutions obtained.

Dynamical Systems · Mathematics 2017-11-28 JJ Bashingwa , AH Kara , M Folly-Gbetoula

The main purpose of this paper is to propose a variance-based Bregman extragradient algorithm with line search for solving stochastic variational inequalities, which is robust with respect an unknown Lipschitz constant. We prove the almost…

Optimization and Control · Mathematics 2022-08-31 Xian-Jun Long , Yue-Hong He , Nan-Jing Huang

This paper focuses on the Bregman divergence defined by the reciprocal function, called the inverse divergence. For the loss function defined by the monotonically increasing function $f$ and inverse divergence, the conditions for the…

Information Theory · Computer Science 2024-08-22 Masahiro Kobayashi , Kazuho Watanabe

The proximal gradient method is a generic technique introduced to tackle the non-smoothness in optimization problems, wherein the objective function is expressed as the sum of a differentiable convex part and a non-differentiable…

Numerical Analysis · Mathematics 2024-01-19 Abdeslem Hafid Bentbib , Khalide Jbilou , Ridwane Tahiri

In this paper, first a great number of inverse problems which arise in instrumentation, in computer imaging systems and in computer vision are presented. Then a common general forward modeling for them is given and the corresponding…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari

The Bregman proximal mapping and Bregman-Moreau envelope are traditionally studied for functions defined on the entire space $\mathbb{R}^n$, even though these constructions depend only on the values of the function within (the interior of)…

Optimization and Control · Mathematics 2025-10-14 Andreas Themelis , Ziyuan Wang

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

Several recent works have explored stochastic gradient methods for variational inference that exploit the geometry of the variational-parameter space. However, the theoretical properties of these methods are not well-understood and these…

Machine Learning · Statistics 2016-08-15 Mohammad Emtiyaz Khan , Reza Babanezhad , Wu Lin , Mark Schmidt , Masashi Sugiyama

The Bayesian approach to inverse problems is widely used in practice to infer unknown parameters from noisy observations. In this framework, the ensemble Kalman inversion has been successfully applied for the quantification of uncertainties…

Numerical Analysis · Mathematics 2019-10-15 Neil K. Chada , Claudia Schillings , Simon Weissmann

We investigate Tikhonov regularization methods for nonlinear ill-posed problems in Banach spaces, where the penalty term is described by Bregman distances. We prove convergence and stability results. Moreover, using appropriate source…

Numerical Analysis · Mathematics 2020-12-22 I. R. Bleyer , A. Leitao

Optimal transport distances are powerful tools to compare probability distributions and have found many applications in machine learning. Yet their algorithmic complexity prevents their direct use on large scale datasets. To overcome this…

Machine Learning · Statistics 2021-10-14 Kilian Fatras , Younes Zine , Rémi Flamary , Rémi Gribonval , Nicolas Courty

We introduce a notion of variable quasi-Bregman monotone sequence which unifies the notion of variable metric quasi-Fej\'er monotone sequences and that of Bregman monotone sequences. The results are applied to analyze the asymptotic…

Optimization and Control · Mathematics 2015-05-19 Quang Van Nguyen

Approximation techniques have been historically important for solving differential equations, both as initial value problems and boundary value problems. The integration of numerical, analytic and perturbation methods and techniques can…

Classical Analysis and ODEs · Mathematics 2025-02-25 J. Nathan Kutz

Bayesian inverse problems use observed data to update a prior probability distribution for an unknown state or parameter of a scientific system to a posterior distribution conditioned on the data. In many applications, the unknown parameter…

Numerical Analysis · Mathematics 2026-05-12 Josie König , Elizabeth Qian , Melina A. Freitag