English
Related papers

Related papers: Distributed Optimization with Efficient Communicat…

200 papers

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

The presence of embedded electronics and communication capabilities as well as sensing and control in smart devices has given rise to the novel concept of cyber-physical networks, in which agents aim at cooperatively solving complex tasks…

Systems and Control · Electrical Eng. & Systems 2020-10-28 Giuseppe Notarstefano , Ivano Notarnicola , Andrea Camisa

We consider a distributed stochastic optimization problem in networks with finite number of nodes. Each node adjusts its action to optimize the global utility of the network, which is defined as the sum of local utilities of all nodes.…

Information Theory · Computer Science 2018-07-31 Wenjie Li , Mohamad Assaad

In this paper we analyze the problem of optimal task scheduling for data centers. Given the available resources and tasks, we propose a fast distributed iterative algorithm which operates over a large scale network of nodes and allows each…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-08 Apostolos I. Rikos , Andreas Grammenos , Evangelia Kalyvianaki , Christoforos N. Hadjicostis , Themistoklis Charalambous , Karl H. Johansson

Distributed optimization and learning algorithms are designed to operate over large scale networks enabling processing of vast amounts of data effectively and efficiently. One of the main challenges for ensuring a smooth learning process in…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Apostolos I. Rikos , Nicola Bastianello , Themistoklis Charalambous , Karl H. Johansson

In the distributed optimization problem for a multi-agent system, each agent knows a local function and must find a minimizer of the sum of all agents' local functions by performing a combination of local gradient evaluations and…

Optimization and Control · Mathematics 2022-06-16 Bryan Van Scoy , Laurent Lessard

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

Optimization and Control · Mathematics 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

Motivated by recent development in networking and parallel data-processing, we consider a distributed and localized finite-sum (or fixed-sum) allocation technique to solve resource-constrained convex optimization problems over multi-agent…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Mohammadreza Doostmohammadian , Maria Vrakopoulou , Alireza Aghasi , Themistoklis Charalambous

In this paper, we focus on the problem of data sharing over a wireless computer network (i.e., a wireless grid). Given a set of available data, we present a distributed algorithm which operates over a dynamically changing network, and…

Systems and Control · Electrical Eng. & Systems 2022-07-19 Apostolos I. Rikos , Christoforos N. Hadjicostis , Karl H. Johansson

We propose a new distributed optimization algorithm for solving a class of constrained optimization problems in which (a) the objective function is separable (i.e., the sum of local objective functions of agents), (b) the optimization…

Optimization and Control · Mathematics 2021-06-16 Van Sy Mai , Richard J. La , Tao Zhang , Abdella Battou

This paper considers distributed nonconvex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents…

Optimization and Control · Mathematics 2022-10-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

In this paper, we consider a network of processors aiming at cooperatively solving mixed-integer convex programs subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2022-07-19 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Francesco Sasso , Roland Bouffanais

In this paper we consider a novel partitioned framework for distributed optimization in peer-to-peer networks. In several important applications the agents of a network have to solve an optimization problem with two key features: (i) the…

Systems and Control · Computer Science 2018-05-23 Ivano Notarnicola , Ruggero Carli , Giuseppe Notarstefano

Distributed locking mechanisms are fundamental to ensuring data consistency and integrity in distributed systems. This paper presents a comprehensive analysis of distributed locking algorithms, focusing on their performance characteristics…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-07 Andre Rodriguez , William Osborn

In this paper, we focus on an asynchronous distributed optimization problem. In our problem, each node is endowed with a convex local cost function, and is able to communicate with its neighbors over a directed communication network.…

Optimization and Control · Mathematics 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

In various online/offline multi-agent networked environments, it is very popular that the system can benefit from coordinating actions of two interacting agents at some cost of coordination. In this paper, we first formulate an optimization…

Systems and Control · Computer Science 2018-09-14 Hyeryung Jang , Jinwoo Shin , Yung Yi

Distributed resource allocation is a central task in network systems such as smart grids, water distribution networks, and urban transportation systems. When solving such problems in practice it is often important to have nonasymptotic…

Optimization and Control · Mathematics 2021-03-30 Xuyang Wu , Sindri Magnusson , Mikael Johansson

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

This paper proposes a fully distributed termination method for distributed optimization algorithms solved by multiple agents. The proposed method guarantees terminating a distributed optimization algorithm after satisfying the global…

Optimization and Control · Mathematics 2024-01-31 Mohannad Alkhraijah , Daniel K. Molzahn

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný