中文
相关论文

相关论文: Bregman Alternating Direction Method of Multiplier…

200 篇论文

We consider a class of Riemannian optimization problems where the objective is the sum of a smooth function and a nonsmooth function, considered in the ambient space. This class of problems finds important applications in machine learning…

最优化与控制 · 数学 2024-11-27 Jiaxiang Li , Shiqian Ma , Tejes Srivastava

We consider a 3-block Alternating Direction Method of Multipliers (ADMM) for solving nonconvex nonseparable problems with a linear constraint. Inspired by \cite[Sun, Toh and Yang, \textit{SIAM Journal on Optimization}, 25 (2015),…

最优化与控制 · 数学 2025-07-21 Zekun Liu

In this paper, we study efficient differentially private alternating direction methods of multipliers (ADMM) via gradient perturbation for many machine learning problems. For smooth convex loss functions with (non)-smooth regularization, we…

机器学习 · 计算机科学 2020-11-03 Tao Xu , Fanhua Shang , Yuanyuan Liu , Hongying Liu , Longjie Shen , Maoguo Gong

The alternating direction method of multipliers (ADMM) is widely used in solving structured convex optimization problems. Despite of its success in practice, the convergence properties of the standard ADMM for minimizing the sum of $N$…

最优化与控制 · 数学 2015-07-10 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

In this paper, we review the parallel and distributed optimization algorithms based on the alternating direction method of multipliers (ADMM) for solving "big data" optimization problems in modern communication networks. We first introduce…

数值分析 · 计算机科学 2015-04-09 Lanchao Liu , Zhu Han

We introduce Wasserstein consensus alternating direction method of multipliers (ADMM) and its entropic-regularized version: Sinkhorn consensus ADMM, to solve measure-valued optimization problems with convex additive objectives. Several…

最优化与控制 · 数学 2023-09-15 Iman Nodozi , Abhishek Halder

In image processing, Total Variation (TV) regularization models are commonly used to recover blurred images. One of the most efficient and popular methods to solve the convex TV problem is the Alternating Direction Method of Multipliers…

最优化与控制 · 数学 2019-10-02 Tao Sun , Roberto Barrio , Marcos Rodriguez , Hao Jiang

This paper considers a convex optimization problem with cost and constraints that evolve over time. The function to be minimized is strongly convex and possibly non-differentiable, and variables are coupled through linear constraints. In…

系统与控制 · 电气工程与系统科学 2021-01-13 Yijian Zhang , Emiliano Dall'Anese , Mingyi Hong

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functionals with block…

图像与视频处理 · 电气工程与系统科学 2026-04-21 Luke Lozenski , Michael T. McCann , Brendt Wohlberg

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

机器学习 · 计算机科学 2020-05-19 Zonghao Huang , Yanmin Gong

Embedding randomization procedures in the Alternating Direction Method of Multipliers (ADMM) has recently attracted an increasing amount of interest as a remedy to the fact that the direct multi-block generalization of ADMM is not…

最优化与控制 · 数学 2021-07-09 Stefano Cipolla , Jacek Gondzio

Alternating direction method of multipliers (ADMM) is a powerful first order methods for various applications in signal processing and imaging. However, there is no clear result on the weak convergence of ADMM with relaxation studied by…

最优化与控制 · 数学 2017-11-21 Hongpeng Sun

In recent years, several convergent multi-block variants of the alternating direction method of multipliers (ADMM) have been proposed for solving the convex quadratic semidefinite programming via its dual, which is naturally a 3-block…

最优化与控制 · 数学 2018-07-06 Xiaokai Chang , Liang Chen , Sanyang Liu

When the data is distributed across multiple servers, lowering the communication cost between the servers (or workers) while solving the distributed learning problem is an important problem and is the focus of this paper. In particular, we…

机器学习 · 计算机科学 2020-03-25 Anis Elgabli , Jihong Park , Amrit S. Bedi , Mehdi Bennis , Vaneet Aggarwal

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

机器学习 · 统计学 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

This paper describes a regularized variant of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex programs. It is shown that the pointwise iteration-complexity of the new method is better than the…

最优化与控制 · 数学 2017-01-09 Max L. N. Goncalves , Jefferson G. Melo , Renato D. C. Monteiro

We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sampling from an…

最优化与控制 · 数学 2022-02-21 Iman Nodozi , Abhishek Halder

In this paper, we review the parallel and distributed optimization algorithms based on alternating direction method of multipliers (ADMM) for solving "big data" optimization problem in smart grid communication networks. We first introduce…

系统与控制 · 计算机科学 2015-03-03 Lanchao Liu , Zhu Han

Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several…

机器学习 · 统计学 2019-07-11 Andre Goncalves , Xiaoli Liu , Arindam Banerjee

Constrained competitive optimization involves multiple agents trying to minimize conflicting objectives, subject to constraints. This is a highly expressive modeling language that subsumes most of modern machine learning. In this work we…

最优化与控制 · 数学 2020-06-19 Florian Schäfer , Anima Anandkumar , Houman Owhadi