English
Related papers

Related papers: A Unified Bregman Alternating Minimization Algorit…

200 papers

By exploiting the property that the RBM log-likelihood function is the difference of convex functions, we formulate a stochastic variant of the difference of convex functions (DC) programming to minimize the negative log-likelihood.…

Machine Learning · Computer Science 2017-10-06 Vidyadhar Upadhya , P. S. Sastry

Regularisation theory in Banach spaces, and non--norm-squared regularisation even in finite dimensions, generally relies upon Bregman divergences to replace norm convergence. This is comparable to the extension of first-order optimisation…

Optimization and Control · Mathematics 2021-03-19 Tuomo Valkonen

(Block-)coordinate minimization is an iterative optimization method which in every iteration finds a global minimum of the objective over a variable or a subset of variables, while keeping the remaining variables constant. While for some…

Optimization and Control · Mathematics 2019-10-22 Tomáš Werner , Daniel Průša

Most methods for Bundle Adjustment (BA) in computer vision are either centralized or operate incrementally. This leads to poor scaling and affects the quality of solution as the number of images grows in large scale structure from motion…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Karthikeyan Natesan Ramamurthy , Chung-Ching Lin , Aleksandr Aravkin , Sharath Pankanti , Raphael Viguier

The rotation averaging problem is a fundamental task in computer vision applications. It is generally very difficult to solve due to the nonconvex rotation constraints. While a sufficient optimality condition is available in the literature,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Yihong Dong , Lunchen Xie , Qingjiang Shi

The aim of this manuscript is to approach by means of first order differential equations/inclusions convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the…

Optimization and Control · Mathematics 2020-05-21 Sandy Bitterlich , Ernö Robert Csetnek , Gert Wanka

Under consideration are multicomponent minimization problems involving a separable nonsmooth convex function penalizing the components individually, and nonsmooth convex coupling terms penalizing linear mixtures of the components. We…

Optimization and Control · Mathematics 2021-08-27 Minh N. Bùi , Patrick L. Combettes , Zev C. Woodstock

Block-coordinate descent algorithms and alternating minimization methods are fundamental optimization algorithms and an important primitive in large-scale optimization and machine learning. While various block-coordinate-descent-type…

Optimization and Control · Mathematics 2019-07-02 Jelena Diakonikolas , Lorenzo Orecchia

This paper proposes a provably convergent multiblock ADMM for nonconvex optimization with nonlinear dynamics constraints, overcoming the divergence issue in classical extensions. We consider a class of optimization problems that arise from…

Optimization and Control · Mathematics 2025-06-24 Bowen Li , Ya-xiang Yuan

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

Optimization and Control · Mathematics 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

We propose BIBPA, a block inertial Bregman proximal algorithm for minimizing the sum of a block relatively smooth function (that is, relatively smooth concerning each block) and block separable nonsmooth nonconvex functions. We prove that…

Optimization and Control · Mathematics 2020-05-11 Masoud Ahookhosh , Le Thi Khanh Hien , Nicolas Gillis , Panagiotis Patrinos

The unit commitment problem (UC) is an optimization problem concerning the operation of electrical generators. Many algorithms have been proposed for the UC and in recent years a more decentralized approach, by solving the UC with…

Optimization and Control · Mathematics 2023-11-23 Rogier Hans Wuijts , Marjan van den Akker , Machteld van den Broek

We consider the hybrid problem of reconstructing the isotropic electric conductivity of a body $\Omega$ from interior Current Density Imaging data obtainable using MRI measurements. We only require knowledge of the magnitude $|J|$ of one…

Analysis of PDEs · Mathematics 2015-06-03 Amir Moradifam , Adrian Nachman , Alexandre Timonov

Combined optimization problems that couple data-fidelity and regularization terms arise naturally in a wide range of inverse problems. In this paper, we study an adaptive randomized averaging block extended Bregman-Kaczmarz (aRABEBK) method…

Numerical Analysis · Mathematics 2026-01-19 Zeyu Dong , Aqin Xiao , Guojian Yin , Junfeng Yin

Minimax optimization plays an important role in many machine learning tasks such as generative adversarial networks (GANs) and adversarial training. Although recently a wide variety of optimization methods have been proposed to solve the…

Optimization and Control · Mathematics 2023-04-24 Feihu Huang , Songcan Chen

We introduce a new weighted averaging scheme using "Fenchel-type" operators to recover primal solutions in the alternating minimization-type algorithm (AMA) for prototype constrained convex optimization. Our approach combines the classical…

Optimization and Control · Mathematics 2020-08-11 Quoc Tran-Dinh

This paper discusses a consensus-based alternating direction method of multipliers (ADMM) approach to solve the multi-area coordinated network-constrained unit commitment (NCUC) problem in a distributed manner. Due to political and…

Optimization and Control · Mathematics 2018-01-23 Yamin Wang , Lei Wu , Jie Li

In this paper, we propose new operator-splitting algorithms for the total variation regularized infimal convolution (TV-IC) model [4] in order to remove mixed Poisson-Gaussian(MPG) noise. In the existing splitting algorithm for TV-IC, an…

Optimization and Control · Mathematics 2020-01-29 Jie Zhang , Yuping Duan , Yue Lu , Michael K. Ng , Huibin Chang

The possibilities of exploiting the special structure of d.c. programs, which consist of optimizing the difference of convex functions, are currently more or less limited to variants of the DCA proposed by Pham Dinh Tao and Le Thi Hoai An…

Optimization and Control · Mathematics 2016-10-21 Sebastian Banert , Radu Ioan Bot

We consider the problem of minimizing block-separable convex functions subject to linear constraints. While the Alternating Direction Method of Multipliers (ADMM) for two-block linear constraints has been intensively studied both…

Optimization and Control · Mathematics 2014-09-15 Huahua Wang , Arindam Banerjee , Zhi-Quan Luo