中文
相关论文

相关论文: Convergence analysis on the alternating direction …

200 篇论文

The alternating direction method of multipliers (ADMM) is a most widely used optimization scheme for solving linearly constrained separable convex optimization problems. The convergence of the ADMM can be guaranteed when the dual step…

最优化与控制 · 数学 2020-06-23 Guoyong Gu , Junfeng Yang

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

最优化与控制 · 数学 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

计算机视觉与模式识别 · 计算机科学 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

Alternating Direction Method of Multipliers (ADMM) algorithm has been widely adopted for solving the distributed optimization problem (DOP). In this paper, a new distributed parallel ADMM algorithm is proposed, which allows the agents to…

最优化与控制 · 数学 2021-11-23 Ziye Liu , Fanghong Guo , Wei Wang , Xiaoqun Wu

We present a powerful and easy-to-implement iterative algorithm for solving large-scale optimization problems that involve $L_1$/total-variation (TV) regularization. The method is based on combining the Alternating Directions Method of…

最优化与控制 · 数学 2016-02-23 Musa Maharramov , Stewart A. Levin

The objective of this paper is to design an efficient and convergent alternating direction method of multipliers (ADMM) for finding a solution of medium accuracy to conic programming problems whose constraints consist of linear equalities,…

最优化与控制 · 数学 2014-12-02 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

This paper proposes and analyzes a dampened proximal alternating direction method of multipliers (DP.ADMM) for solving linearly-constrained nonconvex optimization problems where the smooth part of the objective function is nonseparable.…

最优化与控制 · 数学 2023-01-05 Weiwei Kong , Renato D. C. Monteiro

Alternating direction method of multipliers (ADMM) is a popular optimization tool for the composite and constrained problems in machine learning. However, in many machine learning problems such as black-box attacks and bandit feedback, ADMM…

最优化与控制 · 数学 2019-07-31 Feihu Huang , Shangqian Gao , Songcan Chen , Heng Huang

In this paper, we analyze the convergence of the alternating direction method of multipliers (ADMM) for minimizing a nonconvex and possibly nonsmooth objective function, $\phi(x_0,\ldots,x_p,y)$, subject to coupled linear equality…

最优化与控制 · 数学 2018-05-31 Yu Wang , Wotao Yin , Jinshan Zeng

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

机器学习 · 统计学 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this…

最优化与控制 · 数学 2024-01-17 Bowen Li , Bin Shi

We consider a convex relaxation of sparse principal component analysis proposed by d'Aspremont et al. in (d'Aspremont et al. SIAM Rev 49:434-448, 2007). This convex relaxation is a nonsmooth semidefinite programming problem in which the…

最优化与控制 · 数学 2011-11-30 Shiqian Ma

In this paper, we consider nonconvex optimization problems with nonsmooth nonconvex objective function and nonlinear equality constraints. We assume that both the objective function and the functional constraints can be separated into 2…

最优化与控制 · 数学 2025-03-04 Lahcen El Bourkhissi , Ion Necoara

This paper investigates the collision-free control problem for multi-agent systems. For such multi-agent systems, it is the typical situation where conventional methods using either the usual centralized model predictive control (MPC), or…

多智能体系统 · 计算机科学 2024-02-07 Zilong Cheng , Jun Ma , Wenxin Wang , Zicheng Zhu , Clarence W. de Silva , Tong Heng Lee

This paper introduces a novel approach to solving multi-block nonconvex composite optimization problems through a proximal linearized Alternating Direction Method of Multipliers (ADMM). This method incorporates an Increasing Penalization…

最优化与控制 · 数学 2025-04-01 Ganzhao Yuan

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

最优化与控制 · 数学 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

We present an alternating direction method of multipliers (ADMM) for a generic overlapping group lasso problem, where the groups can be overlapping in an arbitrary way. Meanwhile, we prove the lower bounds and upper bounds for both the…

统计理论 · 数学 2023-10-31 Youming Zhao

Spike and slab priors play a key role in inducing sparsity for sparse signal recovery. The use of such priors results in hard non-convex and mixed integer programming problems. Most of the existing algorithms to solve the optimization…

统计方法学 · 统计学 2019-04-02 Fekadu L. Bayisa , Zhiyong Zhou , Ottmar Cronie , Jun Yu

We consider a class of structured, nonconvex, nonsmooth optimization problems under orthogonality constraints, where the objectives combine a smooth function, a nonsmooth concave function, and a nonsmooth weakly convex function. This class…

最优化与控制 · 数学 2025-01-14 Ganzhao Yuan

Recently, many variance reduced stochastic alternating direction method of multipliers (ADMM) methods (e.g.\ SAG-ADMM, SDCA-ADMM and SVRG-ADMM) have made exciting progress such as linear convergence rates for strongly convex problems.…

机器学习 · 计算机科学 2017-07-12 Yuanyuan Liu , Fanhua Shang , James Cheng