中文
相关论文

相关论文: On the Linear Convergence Rate of Generalized ADMM…

200 篇论文

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

计算机视觉与模式识别 · 计算机科学 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

In this paper, we analyze the convergence of the alternating direction method of multipliers (ADMM) for minimizing a nonconvex and possibly nonsmooth objective function, $\phi(x_0,\ldots,x_p,y)$, subject to coupled linear equality…

最优化与控制 · 数学 2018-05-31 Yu Wang , Wotao Yin , Jinshan Zeng

This paper introduces a novel approach to solving multi-block nonconvex composite optimization problems through a proximal linearized Alternating Direction Method of Multipliers (ADMM). This method incorporates an Increasing Penalization…

最优化与控制 · 数学 2025-04-01 Ganzhao Yuan

We consider minimax (saddle-point) problems of the form max_{c \in C} min_{\beta \in S} g(c; \beta), where C and S are compact convex sets, and g is concave-convex. Applying the Alternating Direction Method of Multipliers (ADMM) requires…

最优化与控制 · 数学 2026-04-23 Bob Wilson

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

机器学习 · 计算机科学 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

In this paper, we consider nonconvex optimization problems with nonsmooth nonconvex objective function and nonlinear equality constraints. We assume that both the objective function and the functional constraints can be separated into 2…

最优化与控制 · 数学 2025-03-04 Lahcen El Bourkhissi , Ion Necoara

In this paper, we consider solving multiple-block separable convex minimization problems using alternating direction method of multipliers (ADMM). Motivated by the fact that the existing convergence theory for ADMM is mostly limited to the…

最优化与控制 · 数学 2013-08-27 Xiangfeng Wang , Mingyi Hong , Shiqian Ma , Zhi-Quan Luo

This paper investigates solving convex composite optimization on an undirected network, where each node, privately endowed with a smooth component function and a nonsmooth one, is required to minimize the sum of all the component functions…

最优化与控制 · 数学 2021-08-13 Xuyang Wu , Jie Lu

We present a flexible Alternating Direction Method of Multipliers (F-ADMM) algorithm for solving optimization problems involving a strongly convex objective function that is separable into $n \geq 2$ blocks, subject to (non-separable)…

最优化与控制 · 数学 2015-03-24 Daniel P. Robinson , Rachael E. H. Tappenden

From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse…

最优化与控制 · 数学 2023-11-23 Zisheng Liu , Ting Zhang

In this paper, we consider a prototypical convex optimization problem with multi-block variables and separable structures. By adding the Logarithmic Quadratic Proximal (LQP) regularizer with suitable proximal parameter to each of the first…

数值分析 · 数学 2021-04-01 Jianchao Bai , Yuxue Ma , Hao Sun , Miao Zhang

This work investigates the theoretical performance of the alternating-direction method of multipliers (ADMM) as it applies to nonconvex optimization problems, and in particular, problems with nonconvex constraint sets. The alternating…

最优化与控制 · 数学 2022-03-16 Stuart M. Harwood

The alternating direction method of multipliers (ADMM) is widely used in solving structured convex optimization problems due to its superior practical performance. On the theoretical side however, a counterexample was shown in [7]…

最优化与控制 · 数学 2015-05-20 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with general convex penalty term. When the data is given exactly, we give a…

数值分析 · 数学 2016-01-13 Yuling Jiao , Qinian Jin , Xiliang Lu , Weijie Wang

This paper introduces a parallel and distributed extension to the alternating direction method of multipliers (ADMM) for solving convex problem: minimize $\sum_{i=1}^N f_i(x_i)$ subject to $\sum_{i=1}^N A_i x_i=c, x_i\in \mathcal{X}_i$. The…

最优化与控制 · 数学 2014-03-20 Wei Deng , Ming-Jun Lai , Zhimin Peng , Wotao Yin

The alternating direction method of multipliers (ADMM) is a powerful optimization solver in machine learning. Recently, stochastic ADMM has been integrated with variance reduction methods for stochastic gradient, leading to SAG-ADMM and…

机器学习 · 计算机科学 2016-10-18 Shuai Zheng , James T. Kwok

This paper considers decentralized consensus optimization problems where nodes of a network have access to different summands of a global objective function. Nodes cooperate to minimize the global objective by exchanging information with…

最优化与控制 · 数学 2016-09-21 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

The alternating direction method of multipliers (ADMM) is a common optimization tool for solving constrained and non-differentiable problems. We provide an empirical study of the practical performance of ADMM on several nonconvex…

最优化与控制 · 数学 2016-12-13 Zheng Xu , Soham De , Mario Figueiredo , Christoph Studer , Tom Goldstein

This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop…

系统与控制 · 计算机科学 2016-11-15 Tsung-Hui Chang