中文
相关论文

相关论文: Convergence rate bounds for a proximal ADMM with o…

200 篇论文

The classic Alternating Direction Method of Multipliers (ADMM) is a popular framework to solve linear-equality constrained problems. In this paper, we extend the ADMM naturally to nonlinear equality-constrained problems, called neADMM. The…

最优化与控制 · 数学 2021-03-17 Junxiang Wang , Liang Zhao

The alternating direction method of multipliers (ADMM) is a most widely used optimization scheme for solving linearly constrained separable convex optimization problems. The convergence of the ADMM can be guaranteed when the dual step…

最优化与控制 · 数学 2020-06-23 Guoyong Gu , Junfeng Yang

The alternating direction method of multipliers (ADMM) is a common optimization tool for solving constrained and non-differentiable problems. We provide an empirical study of the practical performance of ADMM on several nonconvex…

最优化与控制 · 数学 2016-12-13 Zheng Xu , Soham De , Mario Figueiredo , Christoph Studer , Tom Goldstein

The 0/1 D-optimality problem and the Maximum-Entropy Sampling problem are two well-known NP-hard discrete maximization problems in experimental design. Algorithms for exact optimization (of moderate-sized instances) are based on…

最优化与控制 · 数学 2025-03-26 Gabriel Ponte , Marcia Fampa , Jon Lee , Luze Xu

The framework of Integral Quadratic Constraints (IQC) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to a semi-definite program (SDP). In the case of over-relaxed Alternating Direction…

机器学习 · 统计学 2018-03-06 Guilherme França , José Bento

Linearized alternating direction method of multipliers (ADMM) as an extension of ADMM has been widely used to solve linearly constrained problems in signal processing, machine leaning, communications, and many other fields. Despite its…

最优化与控制 · 数学 2017-11-02 Qinghua Liu , Xinyue Shen , Yuantao Gu

The alternating direction method of multipliers (ADMM) has been widely adopted in low-rank approximation and low-order model identification tasks; however, the performance of nonconvex ADMM is highly reliant on the choice of penalty…

最优化与控制 · 数学 2023-09-11 Qingyuan Liu , Zhengchao Huang , Hao Ye , Dexian Huang , Chao Shang

This paper establishes the iteration-complexity of a Jacobi-type non-Euclidean proximal alternating direction method of multipliers (ADMM) for solving multi-block linearly constrained nonconvex programs. The subproblems of this ADMM variant…

最优化与控制 · 数学 2017-05-23 Jefferson G. Melo , Renato D. C. Monteiro

Recently, semidefinite programming performance estimation has been employed as a strong tool for the worst-case performance analysis of first order methods. In this paper, we derive new non-ergodic convergence rates for the alternating…

最优化与控制 · 数学 2023-05-25 Moslem Zamani , Hadi Abbaszadehpeivasti , Etienne de Klerk

In this paper, a stochastic alternating direction method of multipliers (ADMM) is proposed for a class of nonsmooth composite and stochastic convex optimization problems in Hilbert space, motivated by optimization problems constrained by…

最优化与控制 · 数学 2026-05-18 Weihua Deng , Haiming Song , Hao Wang , Jinda Yang

The Alternating Direction Method of Multipliers (ADMM) is widely used for linearly constrained convex problems. It is proven to have an $o(1/\sqrt{K})$ nonergodic convergence rate and a faster $O(1/K)$ ergodic rate after ergodic averaging,…

数值分析 · 数学 2018-12-13 Huan Li , Zhouchen Lin

The alternating direction method of multipliers (ADMM) is commonly used for distributed model fitting problems, but its performance and reliability depend strongly on user-defined penalty parameters. We study distributed ADMM methods that…

机器学习 · 计算机科学 2017-06-21 Zheng Xu , Gavin Taylor , Hao Li , Mario Figueiredo , Xiaoming Yuan , Tom Goldstein

This work investigates the theoretical performance of the alternating-direction method of multipliers (ADMM) as it applies to nonconvex optimization problems, and in particular, problems with nonconvex constraint sets. The alternating…

最优化与控制 · 数学 2022-03-16 Stuart M. Harwood

From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse…

最优化与控制 · 数学 2023-11-23 Zisheng Liu , Ting Zhang

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

机器学习 · 计算机科学 2013-08-19 Leon Wenliang Zhong , James T. Kwok

This paper presents optimal scaling of the alternating directions method of multipliers (ADMM) algorithm for a class of distributed quadratic programming problems. The scaling corresponds to the ADMM step-size and relaxation parameter, as…

最优化与控制 · 数学 2016-11-15 André Teixeira , Euhanna Ghadimi , Iman Shames , Henrik Sandberg , Mikael Johansson

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

最优化与控制 · 数学 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

In this paper, we propose an inertial alternating direction method of multipliers for solving a class of non-convex multi-block optimization problems with \emph{nonlinear coupling constraints}. Distinctive features of our proposed method,…

最优化与控制 · 数学 2024-02-22 Le Thi Khanh Hien , Dimitri Papadimitriou

In this paper, we establish the convergence of the proximal alternating direction method of multipliers (ADMM) and block coordinate descent (BCD) for nonseparable minimization models with quadratic coupling terms. The novel convergence…

最优化与控制 · 数学 2017-03-16 Caihua Chen , Min Li , Xin Liu , Yinyu Ye

In this paper, we establish the convergence properties for a majorized alternating direction method of multipliers (ADMM) for linearly constrained convex optimization problems whose objectives contain coupled functions. Our convergence…

最优化与控制 · 数学 2017-01-18 Ying Cui , Xudong Li , Defeng Sun , Kim-Chuan Toh