English
Related papers

Related papers: Asynchronous Distributed Optimization using a Rand…

200 papers

This paper develops efficient algorithms for distributed average consensus with quantized communication using the alternating direction method of multipliers (ADMM). We first study the effects of probabilistic and deterministic…

Systems and Control · Computer Science 2016-12-05 Shengyu Zhu , Biao Chen

Tensor factorization has proven useful in a wide range of applications, from sensor array processing to communications, speech and audio signal processing, and machine learning. With few recent exceptions, all tensor factorization…

Numerical Analysis · Computer Science 2015-10-28 Athanasios P. Liavas , Nicholas D. Sidiropoulos

We formulate the control of reactive power generation by photovoltaic inverters in a power distribution circuit as a constrained optimization that aims to minimize reactive power losses subject to finite inverter capacity and upper and…

Optimization and Control · Mathematics 2014-12-31 Petr Šulc , Scott Backhaus , Michael Chertkov

Cooperative control is crucial for the effective operation of dynamical multi-agent systems. Especially for distributed control schemes, it is essential to exchange data between the agents. This becomes a privacy threat if the data is…

Systems and Control · Electrical Eng. & Systems 2024-12-19 Philipp Binfet , Janis Adamek , Nils Schlüter , Moritz Schulze Darup

Due to the explosion in size and complexity of modern data sets and privacy concerns of data holders, it is increasingly important to be able to solve machine learning problems in distributed manners. The Alternating Direction Method of…

Networking and Internet Architecture · Computer Science 2021-04-27 Saeedeh Parsaeefard , Alberto Leon Garcia

Smart devices, storage and other distributed technologies have the potential to greatly improve the utilisation of network infrastructure and renewable generation. Decentralised control of these technologies overcomes many scalability and…

Optimization and Control · Mathematics 2024-10-30 Paul Scott , Sylvie Thiébaux

We consider cooperative multi-agent resource sharing problems over time-varying communication networks, where only local communications are allowed. The objective is to minimize the sum of agent-specific composite convex functions subject…

Optimization and Control · Mathematics 2019-08-27 Necdet Serhat Aybat , Erfan Yazdandoost Hamedani

Distributed optimization is fundamental to large-scale machine learning and control applications. Among existing methods, the alternating direction method of multipliers (ADMM) has gained popularity due to its strong convergence guarantees…

Machine Learning · Computer Science 2026-04-15 Henri Doerks , Paul Häusner , Daniel Hernández Escobar , Jens Sjölund

When the data is distributed across multiple servers, lowering the communication cost between the servers (or workers) while solving the distributed learning problem is an important problem and is the focus of this paper. In particular, we…

Machine Learning · Computer Science 2020-03-25 Anis Elgabli , Jihong Park , Amrit S. Bedi , Mehdi Bennis , Vaneet Aggarwal

We consider a class of multi-agent cooperative consensus optimization problems with local nonlinear convex constraints where only those agents connected by an edge can directly communicate, hence, the optimal consensus decision lies in the…

Optimization and Control · Mathematics 2023-02-23 Nazanin Abolfazli , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

We address the problem of solving convex optimization problems with many convex constraints in a distributed setting. Our approach is based on an extension of the alternating direction method of multipliers (ADMM) that recently gained a lot…

Optimization and Control · Mathematics 2018-04-09 Joachim Giesen , Sören Laue

The alternating direction method of multipliers (ADMM) has recently been recognized as a promising approach for large-scale machine learning models. However, very few results study ADMM from the aspect of communication costs, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-25 Yu Ye , Hao Chen , Zheng Ma , Ming Xiao

In this paper we consider the problem of distributed nonlinear optimisation of a separable convex cost function over a graph subject to cone constraints. We show how to generalise, using convex analysis, monotone operator theory and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-16 Richard Heusdens , Guoqiang Zhang

This paper proposes a parallel optimization algorithm for cooperative automation of large-scale connected vehicles. The task of cooperative automation is formulated as a centralized optimization problem taking the whole decision space of…

Systems and Control · Computer Science 2018-08-01 Zhitao Wang , Yang Zheng , Shengbo Eben Li , Keyou You , Keqiang Li

This paper presents a distributed optimization algorithm tailored for solving optimal control problems arising in multi-building coordination. The buildings coordinated by a grid operator, join a demand response program to balance the…

Optimization and Control · Mathematics 2021-01-14 Junyan Su , Yuning Jiang , Altug Bitlislioglu , Colin N. Jones , Boris Houska

The alternating direction method of multipliers (ADMM) has emerged as a powerful technique for large-scale structured optimization. Despite many recent results on the convergence properties of ADMM, a quantitative characterization of the…

Optimization and Control · Mathematics 2016-11-17 Euhanna Ghadimi , André Teixeira , Iman Shames , Mikael Johansson

In this paper, we address the problem of how a network of agents can collaboratively fit a linear model when each agent only ever has an arbitrary summand of the regression data. This problem generalizes previously studied…

Optimization and Control · Mathematics 2014-08-06 François D. Côté , Ioannis N. Psaromiligkos , Warren J. Gross

In this paper, we analyze the convergence of a distributed Robbins-Monro algorithm for both constrained and unconstrained optimization in multi-agent systems. The algorithm searches for local minima of a (nonconvex) objective function which…

Information Theory · Computer Science 2011-04-20 Pascal Bianchi , Jérémie Jakubowicz

This paper investigates the distributed online optimization problem over a multi-agent network subject to local set constraints and coupled inequality constraints, which has a lot of applications in many areas, such as wireless sensor…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Xinlei Yi , Lihua Xie

Recently, there has been an increasing interest in using tools from dynamical systems to analyze the behavior of simple optimization algorithms such as gradient descent and accelerated variants. This paper strengthens such connections by…

Optimization and Control · Mathematics 2018-08-02 Guilherme França , Daniel P. Robinson , René Vidal