English
Related papers

Related papers: Generalized Bregman Projection Algorithms for Solv…

200 papers

We consider solving high-order semidefinite programming (SDP) relaxations of nonconvex polynomial optimization problems (POPs) that often admit degenerate rank-one optimal solutions. Instead of solving the SDP alone, we propose a new…

Optimization and Control · Mathematics 2021-10-27 Heng Yang , Ling Liang , Luca Carlone , Kim-Chuan Toh

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

A typical assumption for the analysis of first order optimization methods is the Lipschitz continuity of the gradient of the objective function. However, for many practical applications this assumption is violated, including loss functions…

Optimization and Control · Mathematics 2019-10-10 Mahesh Chandra Mukkamala , Felix Westerkamp , Emanuel Laude , Daniel Cremers , Peter Ochs

The paper focuses on the sparse approximation of signals using overcomplete representations, such that it preserves the (prior) structure of multi-dimensional signals. The underlying optimization problem is tackled using a multi-dimensional…

Data Structures and Algorithms · Computer Science 2015-03-11 Yoann Isaac , Quentin Barthélemy , Jamal Atif , Cédric Gouy-Pailler , Michèle Sebag

We consider Legendre-Bregman projections defined on the Hermitian matrix space and design iterative optimization algorithms based on them. A general duality theorem is established for Bregman divergences on Hermitian matrices, and it plays…

Quantum Physics · Physics 2022-09-29 Zhengfeng Ji

The effectiveness of projection methods for solving systems of linear inequalities is investigated. It is shown that they have a computational advantage over some alternatives and that this makes them successful in real-world applications.…

Optimization and Control · Mathematics 2009-12-23 Y. Censor , W. Chen , P. L. Combettes , R. Davidi , G. T. Herman

High dimensional and/or nonconvex optimization remains a challenging and important problem across a wide range of fields, such as machine learning, data assimilation, and partial differential equation (PDE) constrained optimization. Here we…

Optimization and Control · Mathematics 2025-08-29 Brian K. Tran , Ben S. Southworth , David B. Cavender , Sam Olivier , Syed A. Shah , Tommaso Buvoli

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

Methodology · Statistics 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

In this paper we develop a Bregman regularized proximal point algorithm for solving monotone equilibrium problems on Hadamard manifolds. It has been shown that the regularization term induced by a Bregman function is, in general, nonconvex…

Optimization and Control · Mathematics 2026-01-21 Shikher Sharma , Simeon Reich

This work investigates a Bregman and inertial extension of the forward-reflected-backward algorithm [Y. Malitsky and M. Tam, SIAM J. Optim., 30 (2020), pp. 1451--1472] applied to structured nonconvex minimization problems under relative…

Optimization and Control · Mathematics 2024-04-17 Ziyuan Wang , Andreas Themelis , Hongjia Ou , Xianfu Wang

We extend the result on the spectral projected gradient method by Birgin et al. in 2000 to a log-determinant semidefinite problem (SDP) with linear constraints and propose a spectral projected gradient method for the dual problem. Our…

Optimization and Control · Mathematics 2018-12-04 Takashi Nakagaki , Mituhiro Fukuda , Sunyoung Kim , Makoto Yamashita

This paper introduces sparse coding and dictionary learning for Symmetric Positive Definite (SPD) matrices, which are often used in machine learning, computer vision and related areas. Unlike traditional sparse coding schemes that work in…

Computer Vision and Pattern Recognition · Computer Science 2014-09-02 Mehrtash Harandi , Richard Hartley , Brian Lovell , Conrad Sanderson

Linear programming (LP) is an extremely useful tool and has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2020-03-19 Agniva Chowdhury , Palma London , Haim Avron , Petros Drineas

We propose a modified BFGS algorithm for multiobjective optimization problems with global convergence, even in the absence of convexity assumptions on the objective functions. Furthermore, we establish the superlinear convergence of the…

Optimization and Control · Mathematics 2024-04-12 L. F. Prudente , D. R. Souza

The Bayesian statistical framework provides a systematic approach to enhance the regularization model by incorporating prior information about the desired solution. For the Bayesian linear inverse problems with Gaussian noise and Gaussian…

Numerical Analysis · Mathematics 2024-05-21 Haibo Li

Variable projection solves structured optimization problems by completely minimizing over a subset of the variables while iterating over the remaining variables. Over the last 30 years, the technique has been widely used, with empirical and…

Optimization and Control · Mathematics 2020-11-23 Tristan van Leeuwen , Aleksandr Aravkin

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

Recently, Krukier et al. [Generalized skew-Hermitian triangular splitting iteration methods for saddle-point linear systems, Numer. Linear Algebra Appl. 21 (2014) 152-170] proposed an efficient generalized skew-Hermitian triangular…

Numerical Analysis · Mathematics 2014-02-25 Yan Dou , Ai-Li Yang , Yu-Jiang Wu

We study optimization problems on Hadamard manifolds, motivated by recent advances in geometric approaches to optimization on curved spaces, particularly those involving the structure of Busemann functions. We introduce a projection based…

Optimization and Control · Mathematics 2026-03-03 R. Díaz Millán , O. P. Ferreira , M. S. Louzeiro , J. Ugon

While several classes of integer linear optimization problems are known to be solvable in polynomial time, far fewer tractability results exist for integer nonlinear optimization. In this work, we narrow this gap by identifying a broad…

Optimization and Control · Mathematics 2026-02-09 Alberto Del Pia