English
Related papers

Related papers: Generalized Bregman Projection Algorithms for Solv…

200 papers

Along with developing of Peaceman-Rachford Splittling Method (PRSM), many batch algorithms based on it have been studied very deeply. But almost no algorithm focused on the performance of stochastic version of PRSM. In this paper, we…

Machine Learning · Statistics 2018-02-13 Sen Na , Mingyuan Ma , Mladen Kolar

In this paper, we propose new extragradient algorithms for solving a split equilibrium and nonexpansive mapping SEPNM($C, Q, A, f, g, S, T)$ where $C, Q$ are nonempty closed convex subsets in real Hilbert spaces $\mathcal{H}_1,…

Optimization and Control · Mathematics 2015-09-17 Bui Van Dinh , Dang Xuan Son , Tran Viet Anh

We propose a new subgradient method for the minimization of nonsmooth convex functions over a convex set. To speed up computations we use adaptive approximate projections only requiring to move within a certain distance of the exact…

Optimization and Control · Mathematics 2015-03-19 Dirk A. Lorenz , Marc E. Pfetsch , Andreas M. Tillmann

This paper presents the first generic bi-objective binary linear branch-and-cut algorithm. Studying the impact of valid inequalities in solution and objective spaces, two cutting frameworks are proposed. The multi-point separation problem…

Discrete Mathematics · Computer Science 2024-10-14 Pierre Fouilhoux , Lucas Létocart , Yue Zhang

A numerical method is developed to solve linear semi-infinite programming problem (LSIP) in which the iterates produced by the algorithm are feasible for the original problem. This is achieved by constructing a sequence of standard linear…

Optimization and Control · Mathematics 2021-01-26 Shuxiong Wang

We present a new, stochastic variant of the projective splitting (PS) family of algorithms for monotone inclusion problems. It can solve min-max and noncooperative game formulations arising in applications such as robust ML without the…

Optimization and Control · Mathematics 2021-06-25 Patrick R. Johnstone , Jonathan Eckstein , Thomas Flynn , Shinjae Yoo

We investigate convergence of alternating Bregman projections between non-convex sets and prove convergence to a point in the intersection, or to points realizing a gap between the two sets. The speed of convergence is generally sub-linear,…

Statistics Theory · Mathematics 2025-07-30 Dominikus Noll

In this paper, we investigate a class of non-convex sum-of-ratios programs relevant to decision-making in key areas such as product assortment and pricing, and facility location and cost planning. These optimization problems, characterized…

Optimization and Control · Mathematics 2026-01-13 Hoang Giang Pham , Ngan Ha Duong , Tien Mai , Thuy Anh Ta , Minh Hoang Ha

A wide variety of (fixed-point) iterative methods for the solution of nonlinear equations (in Hilbert spaces) exists. In many cases, such schemes can be interpreted as iterative local linearization methods, which, as will be shown, can be…

Numerical Analysis · Mathematics 2019-10-16 Pascal Heid , Thomas P. Wihler

In this work we propose a batch version of the Greenkhorn algorithm for multimarginal regularized optimal transport problems. Our framework is general enough to cover, as particular cases, some existing algorithms like Sinkhorn and…

Machine Learning · Statistics 2021-12-07 Vladimir Kostic , Saverio Salzo , Massimilano Pontil

The MM principle is a device for creating optimization algorithms satisfying the ascent or descent property. The current survey emphasizes the role of the MM principle in nonlinear programming. For smooth functions, one can construct an…

Optimization and Control · Mathematics 2015-07-29 Kenneth Lange , Kevin L. Keys

An algorithm for the systematic analytical approximation of multi-scale Feynman integrals is presented. The algorithm produces algebraic expressions as functions of the kinematical parameters and mass scales appearing in the Feynman…

High Energy Physics - Phenomenology · Physics 2018-09-26 Sophia Borowka , Thomas Gehrmann , Daniel Hulme

Splitting schemes are a class of powerful algorithms that solve complicated monotone inclusions and convex optimization problems that are built from many simpler pieces. They give rise to algorithms in which the simple pieces of the…

Optimization and Control · Mathematics 2015-05-19 Damek Davis , Wotao Yin

In this paper, we provide a simple convergence analysis of proximal gradient algorithm with Bregman distance, which provides a tighter bound than existing result. In particular, for the problem of minimizing a class of convex objective…

Optimization and Control · Mathematics 2017-12-19 Yi Zhou , Yingbin Liang , Lixin Shen

Large-scale unconstrained optimization is a fundamental and important class of, yet not well-solved problems in numerical optimization. The main challenge in designing an algorithm is to require a few storage locations or very inexpensive…

Optimization and Control · Mathematics 2020-01-24 Zheng Li , Shi Shu , Jian-Ping Zhang

The forward-backward splitting method (FBS) for minimizing a nonsmooth composite function can be interpreted as a (variable-metric) gradient method over a continuously differentiable function which we call forward-backward envelope (FBE).…

Optimization and Control · Mathematics 2019-11-11 Lorenzo Stella , Andreas Themelis , Panagiotis Patrinos

This work is concerned with the optimization of nonconvex, nonsmooth composite optimization problems, whose objective is a composition of a nonlinear mapping and a nonsmooth nonconvex function, that can be written as an infimal convolution…

Optimization and Control · Mathematics 2018-03-28 Emanuel Laude , Daniel Cremers

Matrix Factorization is a popular non-convex optimization problem, for which alternating minimization schemes are mostly used. They usually suffer from the major drawback that the solution is biased towards one of the optimization…

Optimization and Control · Mathematics 2019-12-09 Mahesh Chandra Mukkamala , Peter Ochs

Robust estimation is essential in computer vision, robotics, and navigation, aiming to minimize the impact of outlier measurements for improved accuracy. We present a fast algorithm for Geman-McClure robust estimation, FracGM, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Bang-Shien Chen , Yu-Kai Lin , Jian-Yu Chen , Chih-Wei Huang , Jann-Long Chern , Ching-Cherng Sun

We develop a new variational approach on level sets aiming towards convergence rate analysis of a variable Bregman proximal gradient (VBPG) method for a broad class of nonsmooth and nonconvex optimization problems. With this new approach,…

Optimization and Control · Mathematics 2019-09-05 Daoli Zhu , Sien Deng