English
Related papers

Related papers: Convergence Analysis of Generalized ADMM with Majo…

200 papers

In this paper, we study a class of non-convex optimization problems known as multi-affine quadratic equality constrained problems, which appear in various applications--from generating feasible force trajectories in robotic locomotion and…

Optimization and Control · Mathematics 2026-03-13 Yutong Chao , Michal Ciebielski , Jalal Etesami , Majid Khadiv

Consider the minimization of a nonconvex differentiable function over a polyhedron. A popular primal-dual first-order method for this problem is to perform a gradient projection iteration for the augmented Lagrangian function and then…

Optimization and Control · Mathematics 2020-08-05 Jiawei Zhang , Zhi-Quan Luo

This paper studies a proximal alternating direction method of multipliers (ADMM) with variable metric indefinite proximal terms for linearly constrained convex optimization problems. The proximal ADMM plays an important role in many…

Optimization and Control · Mathematics 2019-07-01 Yan Gu , Nobuo Yamashita

We expand the scope of the alternating direction method of multipliers (ADMM). Specifically, we show that ADMM, when employed to solve problems with multiaffine constraints that satisfy certain verifiable assumptions, converges to the set…

Optimization and Control · Mathematics 2019-10-24 Wenbo Gao , Donald Goldfarb , Frank E. Curtis

We present an alternating augmented Lagrangian method for convex optimization problems where the cost function is the sum of two terms, one that is separable in the variable blocks, and a second that is separable in the difference between…

Machine Learning · Statistics 2012-03-09 Bo Wahlberg , Stephen Boyd , Mariette Annergren , Yang Wang

The nonconvex and nonsmooth finite-sum optimization problem with linear constraint has attracted much attention in the fields of artificial intelligence, computer, and mathematics, due to its wide applications in machine learning and the…

Optimization and Control · Mathematics 2023-07-11 Yuxuan Zeng , Zhiguo Wang , Jianchao Bai , Xiaojing Shen

Recently, the alternating direction method of multipliers (ADMM) has found many efficient applications in various areas; and it has been shown that the convergence is not guaranteed when it is directly extended to the multiple-block case of…

Optimization and Control · Mathematics 2016-11-15 Min Tao , Xiaoming Yuan

This work proposes a novel adaptive linearized alternating direction multiplier method (LADMM) to convex optimization, which improves the convergence rate of the LADMM-based algorithm by adjusting step-size iteratively.The innovation of…

Optimization and Control · Mathematics 2024-07-04 Boran Wang

This paper introduces a parallel and distributed extension to the alternating direction method of multipliers (ADMM) for solving convex problem: minimize $\sum_{i=1}^N f_i(x_i)$ subject to $\sum_{i=1}^N A_i x_i=c, x_i\in \mathcal{X}_i$. The…

Optimization and Control · Mathematics 2014-03-20 Wei Deng , Ming-Jun Lai , Zhimin Peng , Wotao Yin

This paper aims to develop distributed algorithms for nonconvex optimization problems with complicated constraints associated with a network. The network can be a physical one, such as an electric power network, where the constraints are…

Optimization and Control · Mathematics 2022-11-21 Kaizhao Sun , X. Andy Sun

In this paper, we consider a proximal linearized alternating direction method of multipliers (PL-ADMM) for solving linearly constrained nonconvex and possibly nonsmooth optimization problems. The algorithm is generalized by using variable…

Optimization and Control · Mathematics 2021-07-06 Maryam Yashtini

We consider a class of integer-constrained optimization problems governed by partial differential equation (PDE) constraints and regularized via total variation (TV) in the context of topology optimization. The presence of discrete design…

Optimization and Control · Mathematics 2025-09-25 Harsh Choudhary , Sven Leyffer , Dominic Yang

The alternating direction method of multipliers (ADMM) is a most widely used optimization scheme for solving linearly constrained separable convex optimization problems. The convergence of the ADMM can be guaranteed when the dual step…

Optimization and Control · Mathematics 2020-06-23 Guoyong Gu , Junfeng Yang

The Alternating Direction Method of Multipliers (ADMM) is widely used for linearly constrained convex problems. It is proven to have an $o(1/\sqrt{K})$ nonergodic convergence rate and a faster $O(1/K)$ ergodic rate after ergodic averaging,…

Numerical Analysis · Mathematics 2018-12-13 Huan Li , Zhouchen Lin

The alternating direction method of multipliers (ADMM) is a widely used method for solving many convex minimization models arising in signal and image processing. In this paper, we propose an inertial ADMM for solving a two-block separable…

Optimization and Control · Mathematics 2021-04-02 Yang Yang , Yuchao Tang

Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several…

Machine Learning · Statistics 2019-07-11 Andre Goncalves , Xiaoli Liu , Arindam Banerjee

We study connections between Dykstra's algorithm for projecting onto an intersection of convex sets, the augmented Lagrangian method of multipliers or ADMM, and block coordinate descent. We prove that coordinate descent for a regularized…

Computation · Statistics 2017-05-16 Ryan J. Tibshirani

This paper is devoted to the design of an efficient and convergent {semi-proximal} alternating direction method of multipliers (ADMM) for finding a solution of low to medium accuracy to convex quadratic conic programming and related…

Optimization and Control · Mathematics 2014-09-10 Xudong Li , Defeng Sun , Kim-Chuan Toh

Recently, many variance reduced stochastic alternating direction method of multipliers (ADMM) methods (e.g.\ SAG-ADMM, SDCA-ADMM and SVRG-ADMM) have made exciting progress such as linear convergence rates for strongly convex problems.…

Machine Learning · Computer Science 2017-07-12 Yuanyuan Liu , Fanhua Shang , James Cheng

We propose an alternating direction method of multipliers (ADMM) to solve an optimization problem stemming from inverse lithography. The objective functional of the optimization problem includes three terms: the misfit between the imaging…

Numerical Analysis · Mathematics 2026-04-21 Junqing Chen , Haibo Liu
‹ Prev 1 3 4 5 6 7 10 Next ›