English
Related papers

Related papers: A Distributed Parallel Optimization Algorithm via …

200 papers

We formulate an Alternating Direction Method of Mul-tipliers (ADMM) that systematically distributes the computations of any technique for optimizing pairwise functions, including non-submodular potentials. Such discrete functions are very…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Jose Dolz , Ismail Ben Ayed , Christian Desrosiers

In this paper we propose an efficient distributed algorithm for solving loosely coupled convex optimization problems. The algorithm is based on a primal-dual interior-point method in which we use the alternating direction method of…

Optimization and Control · Mathematics 2015-02-10 Mariette Annergren , Sina Khoshfetrat Pakazad , Anders Hansson , Bo Wahlberg

By coordinating terminal smart devices or microprocessors to engage in cooperative computation to achieve systemlevel targets, distributed optimization is incrementally favored by both engineering and computer science. The well-known…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-24 Yu Yang , Xiaohong Guan , Qing-Shan Jia , Liang Yu , Bolun Xu , Costas J. Spanos

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

Optimization and Control · Mathematics 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

In this paper we propose an Alternating Direction Method of Multipliers (ADMM) algorithm for solving a Model Predictive Control (MPC) optimization problem, in which the system has state and input constraints and a nonlinear input map. The…

Optimization and Control · Mathematics 2018-07-30 Sebastian East , Mark Cannon

The electrical network reconfiguration problem aims to minimize losses in a distribution system by adjusting switches while ensuring radial topology. The growing use of renewable energy and the complexity of managing modern power grids make…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Yacine Mokhtari , Patrick Coirault , Emmanuel Moulay , Jérôme Le Ny , Didier Larraillet

Online multi-task learning (OMTL) enhances streaming data processing by leveraging the inherent relations among multiple tasks. It can be described as an optimization problem in which a single loss function is defined for multiple tasks.…

Machine Learning · Computer Science 2024-11-12 Ruiyu Li , Peilin Zhao , Guangxia Li , Zhiqiang Xu , Xuewei Li

Bregman parallel direction method of multipliers (BPDMM) efficiently solves distributed optimization over a network, which arises in a wide spectrum of collaborative multi-agent learning applications. In this paper, we generalize BPDMM to…

Optimization and Control · Mathematics 2019-03-05 Yue Yu , Behçet Açıkmeşe

This paper presents optimal scaling of the alternating directions method of multipliers (ADMM) algorithm for a class of distributed quadratic programming problems. The scaling corresponds to the ADMM step-size and relaxation parameter, as…

Optimization and Control · Mathematics 2016-11-15 André Teixeira , Euhanna Ghadimi , Iman Shames , Henrik Sandberg , Mikael Johansson

In distributed optimization and federated learning, asynchronous alternating direction method of multipliers (ADMM) serves as an attractive option for large-scale optimization, data privacy, straggler nodes and variety of objective…

Machine Learning · Computer Science 2025-08-19 Sagar Shrestha

In this paper, we propose and analyze an inexact version of the symmetric proximal alternating direction method of multipliers (ADMM) for solving linearly constrained optimization problems. Basically, the method allows its first subproblem…

Optimization and Control · Mathematics 2020-06-05 Vando A. Adona , Max L. N. Gonçalves

Distributed optimization aims to optimize a global objective formed by a sum of coupled local convex functions over a graph via only local computation and communication. In this paper, we propose the Bregman parallel direction method of…

Optimization and Control · Mathematics 2018-05-03 Yue Yu , Behçet Açıkmeşe , Mehran Mesbahi

This paper proposes a parallel optimization algorithm for cooperative automation of large-scale connected vehicles. The task of cooperative automation is formulated as a centralized optimization problem taking the whole decision space of…

Systems and Control · Computer Science 2018-08-01 Zhitao Wang , Yang Zheng , Shengbo Eben Li , Keyou You , Keqiang Li

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

Optimization and Control · Mathematics 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

Due to the limited energy of sensor nodes in wireless sensor networks, extending the networks lifetime is a major challenge that can be formulated as an optimization problem. In this paper, we propose a distributed iterative algorithm based…

Networking and Internet Architecture · Computer Science 2018-07-31 Farzad Tashtarian , Ahmadreza Montazerolghaem , Amir Varasteh

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the…

Optimization and Control · Mathematics 2015-06-16 Wei Shi , Qing Ling , Kun Yuan , Gang Wu , Wotao Yin

The Alternating Direction Method of Multipliers (ADMM) and its distributed version have been widely used in machine learning. In the iterations of ADMM, model updates using local private data and model exchanges among agents impose critical…

Machine Learning · Computer Science 2020-08-12 Jiahao Ding , Jingyi Wang , Guannan Liang , Jinbo Bi , Miao Pan

Distributed optimization consists of multiple computation nodes working together to minimize a common objective function through local computation iterations and network-constrained communication steps. In the context of robotics,…

Robotics · Computer Science 2021-03-25 Trevor Halsted , Ola Shorinwa , Javier Yu , Mac Schwager