English
Related papers

Related papers: The Augmented Mixing Method: Computing High-Accura…

200 papers

We develop a decomposition method based on the augmented Lagrangian framework to solve a broad family of semidefinite programming problems, possibly with nonlinear objective functions, nonsmooth regularization, and general linear…

Optimization and Control · Mathematics 2023-03-08 Yifei Wang , Kangkang Deng , Haoyang Liu , Zaiwen Wen

We introduce Power Bundle Adjustment as an expansion type algorithm for solving large-scale bundle adjustment problems. It is based on the power series expansion of the inverse Schur complement and constitutes a new family of solvers that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Simon Weber , Nikolaus Demmel , Tin Chon Chan , Daniel Cremers

Within the framework of the augmented Lagrangian (AL), we propose a novel distributed optimization method, termed Distributed Augmented Lagrangian Decomposition (DALD), and provide a rigorous convergence proof for its standard version. To…

Optimization and Control · Mathematics 2025-10-07 Wenyou Guo , Ting Qu , Hainan Huang , Yafeng Wei

We study the online estimation of the optimal policy of a Markov decision process (MDP). We propose a class of Stochastic Primal-Dual (SPD) methods which exploit the inherent minimax duality of Bellman equations. The SPD methods update a…

Machine Learning · Statistics 2016-12-09 Yichen Chen , Mengdi Wang

This paper investigates the convex optimization problem with general convex inequality constraints. To cope with this problem, a discrete-time algorithm, called augmented primal-dual gradient algorithm (Aug-PDG), is studied and analyzed. It…

Optimization and Control · Mathematics 2020-11-18 Min Meng , Xiuxian Li

We propose an inexact proximal augmented Lagrangian method (P-ALM) for nonconvex structured optimization problems. The proposed method features an easily implementable rule not only for updating the penalty parameters, but also for…

Optimization and Control · Mathematics 2025-09-04 Adeyemi D. Adeoye , Puya Latafat , Alberto Bemporad

This paper introduces two decomposition-based methods for two-block mixed-integer linear programs (MILPs), which aim to take advantage of separable structures of the original problem by solving a sequence of lower-dimensional MILPs. The…

Optimization and Control · Mathematics 2024-01-03 Kaizhao Sun , Mou Sun , Wotao Yin

We develop a first-order accelerated algorithm for a class of constrained bilinear saddle-point problems with applications to network systems. The algorithm is a modified time-varying primal-dual version of an accelerated mirror-descent…

Optimization and Control · Mathematics 2024-10-04 Weijian Li , Xianlin Zeng , Lacra Pavel

We present a numerical method for the local solution of nonlinear programming problems. The SUMT approach of Fiacco and McCormick results in a merit function with quadratic penalties and logarithmic barriers. Our NLP solver works by…

Numerical Analysis · Mathematics 2018-06-12 Martin Neuenhofen

Local convergence analysis of the augmented Lagrangian method (ALM) is established for a large class of composite optimization problems with nonunique Lagrange multipliers under a second-order sufficient condition. We present a new…

Optimization and Control · Mathematics 2023-10-23 Nguyen T. V. Hang , Ebrahim Sarabi

Second-order sufficient conditions for local optimality have been playing an important role in local convergence analysis of optimization algorithms. In this paper, we demonstrate that this condition alone suffices to justify the linear…

Optimization and Control · Mathematics 2021-05-04 Nguyen T. V. Hang , M. Ebrahim Sarabi

In this work, we propose a preconditioned augmented Lagrangian method (ALM) for solving semidefinite programming (SDP) problems. The preconditioner is implemented via a weighted penalty function in the ALM subproblem, with the weight matrix…

Optimization and Control · Mathematics 2026-05-19 Tianyun Tang , Kim-Chuan Toh

In many applications, it is desired to obtain extreme eigenvalues and eigenvectors of large Hermitian matrices by efficient and compact algorithms. In particular, orthogonalization-free methods are preferred for large-scale problems for…

Numerical Analysis · Mathematics 2023-12-05 Shixin Zheng , Haizhao Yang , Xiangxiong Zhang

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

We present two modified versions of the primal-dual splitting algorithm relying on forward-backward splitting proposed in \cite{vu} for solving monotone inclusion problems. Under strong monotonicity assumptions for some of the operators…

Optimization and Control · Mathematics 2013-03-13 Radu Ioan Bot , Ernö Robert Csetnek , Andre Heinrich

The Augmented Lagrangian Method (ALM) is an iterative method for the solution of equality-constrained non-linear programming problems. In contrast to the quadratic penalty method, the ALM can satisfy equality constraints in an exact way.…

Numerical Analysis · Mathematics 2018-04-24 Martin Neuenhofen

We solve large-scale mixed-integer linear programs (MILPs) via distributed asynchronous saddle point computation. This is motivated by the MILPs being able to model problems in multi-agent autonomy, e.g., task assignment problems and…

Optimization and Control · Mathematics 2022-11-23 Luke Fina , Matthew Hale

Polyhedral compilers can perform complex loop optimizations that improve parallelism and cache behaviour of loops in the input program. These transformations result in significant performance gains on modern processors which have large…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-29 Aravind Acharya , Uday Bondhugula , Albert Cohen

In this paper, based a novel primal-dual dynamical model with adaptive scaling parameters and Bregman divergences, we propose new accelerated primal-dual proximal gradient splitting methods for solving bilinear saddle-point problems with…

Optimization and Control · Mathematics 2024-09-04 Hao Luo

In this paper we propose two different primal-dual splitting algorithms for solving inclusions involving mixtures of composite and parallel-sum type monotone operators which rely on an inexact Douglas-Rachford splitting method, however…

Optimization and Control · Mathematics 2012-12-04 Radu Ioan Bot , Christopher Hendrich