中文
相关论文

相关论文: Bregman Parallel Direction Method of Multipliers f…

200 篇论文

This work addresses decentralized online optimization in non-stationary environments. A network of agents aim to track the minimizer of a global time-varying convex function. The minimizer evolves according to a known dynamics corrupted by…

最优化与控制 · 数学 2016-09-12 Shahin Shahrampour , Ali Jadbabaie

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

机器学习 · 计算机科学 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

We provide a new proof of the linear convergence of the alternating direction method of multipliers (ADMM) when one of the objective terms is strongly convex. Our proof is based on a framework for analyzing optimization algorithms…

最优化与控制 · 数学 2015-05-20 Robert Nishihara , Laurent Lessard , Benjamin Recht , Andrew Packard , Michael I. Jordan

We address the problem of finding the optimal policy of a constrained Markov decision process (CMDP) using a gradient descent-based algorithm. Previous results have shown that a primal-dual approach can achieve an $\mathcal{O}(1/\sqrt{T})$…

机器学习 · 计算机科学 2022-02-07 Tao Liu , Ruida Zhou , Dileep Kalathil , P. R. Kumar , Chao Tian

In this paper, a centralized two-block separable optimization is considered for which a fully parallel primal-dual discrete-time algorithm with fixed step size is derived based on monotone operator splitting method. In this algorithm, the…

最优化与控制 · 数学 2020-09-30 S. Sh. Alaviani , A. G. Kelkar

This paper proposes a partially inexact alternating direction method of multipliers for computing approximate solution of a linearly constrained convex optimization problem. This method allows its first subproblem to be solved inexactly…

最优化与控制 · 数学 2018-05-21 Vando A. Adona , Max L. N. Goncalves , Jefferson G. Melo

In this paper, we investigate regrets of an online semi-proximal alternating direction method of multiplier (Online-spADMM) for solving online linearly constrained convex composite optimization problems. Under mild conditions, we establish…

最优化与控制 · 数学 2024-02-09 Yule Zhang , Zehao Xiao , Jia Wu , Liwei Zhang

In this paper we consider the problem of distributed nonlinear optimisation of a separable convex cost function over a graph subject to cone constraints. We show how to generalise, using convex analysis, monotone operator theory and…

分布式、并行与集群计算 · 计算机科学 2024-05-16 Richard Heusdens , Guoqiang Zhang

Distributed optimization often requires finding the minimum of a global objective function written as a sum of local functions. A group of agents work collectively to minimize the global function. We study a continuous-time decentralized…

最优化与控制 · 数学 2020-11-25 Youbang Sun , Shahin Shahrampour

In this paper we consider from two different aspects the proximal alternating direction method of multipliers (ADMM) in Hilbert spaces. We first consider the application of the proximal ADMM to solve well-posed linearly constrained…

最优化与控制 · 数学 2023-10-11 Qinian Jin

The ability of widely distributed radar systems to capture diverse spatial scattering properties substantially improves radar imaging performance. Traditional imaging methods leverage regularized optimization techniques to reconstruct…

信号处理 · 电气工程与系统科学 2023-07-18 Ahmed Murtada , Bhavani Shankar Mysore Rama Rao , Udo Schroeder

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

最优化与控制 · 数学 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

The alternating direction method of multipliers (ADMM) is a flexible method to solve a large class of convex minimization problems. Particular features are its unconditional convergence with respect to the involved step size and its direct…

数值分析 · 数学 2017-04-21 Sören Bartels , Marijo Milicevic

This paper presents a comprehensive convergence analysis for the mirror descent (MD) method, a widely used algorithm in convex optimization. The key feature of this algorithm is that it provides a generalization of classical gradient-based…

最优化与控制 · 数学 2024-09-16 Mengmou Li , Khaled Laib , Takeshi Hatanaka , Ioannis Lestas

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

机器学习 · 统计学 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

Distributed optimization consists of multiple computation nodes working together to minimize a common objective function through local computation iterations and network-constrained communication steps. In the context of robotics,…

机器人学 · 计算机科学 2021-03-25 Trevor Halsted , Ola Shorinwa , Javier Yu , Mac Schwager

This paper presents a tutorial on the Consensus Alternating Direction Method of Multipliers (Consensus ADMM) for distributed optimization, with a specific focus on applications in multi-robot systems. In this tutorial, we derive the…

最优化与控制 · 数学 2024-10-08 Jushan Chen

In this paper, we first propose a general inertial proximal point method for the mixed variational inequality (VI) problem. Based on our knowledge, without stronger assumptions, convergence rate result is not known in the literature for…

最优化与控制 · 数学 2014-08-04 Caihua Chen , Shiqian Ma , Junfeng Yang

Convergence rates are established for an inexact accelerated alternating direction method of multipliers (I-ADMM) for general separable convex optimization with a linear constraint. Both ergodic and non-ergodic iterates are analyzed.…

数值分析 · 数学 2021-07-20 William W. Hager , Hongchao Zhang

We present a powerful and easy-to-implement iterative algorithm for solving large-scale optimization problems that involve $L_1$/total-variation (TV) regularization. The method is based on combining the Alternating Directions Method of…

最优化与控制 · 数学 2016-02-23 Musa Maharramov , Stewart A. Levin