English
Related papers

Related papers: Communication efficient quasi-Newton distributed o…

200 papers

Information compression is essential to reduce communication cost in distributed optimization over peer-to-peer networks. This paper proposes a communication-efficient linearly convergent distributed (COLD) algorithm to solve strongly…

Optimization and Control · Mathematics 2021-05-17 Jiaqi Zhang , Keyou You , Lihua Xie

This paper investigates distributed resource allocation optimization over directed graphs with limited communication bandwidth. We develop a novel distributed algorithm that integrates the centralized Proximal Jacobian Alternating Direction…

Optimization and Control · Mathematics 2026-04-17 Xu Du , Boyu Han , Ivano Notarnicola , Karl H. Johansson , Apostolos I. Rikos

We propose a distributed cubic regularization of the Newton method for solving (constrained) empirical risk minimization problems over a network of agents, modeled as undirected graph. The algorithm employs an inexact, preconditioned Newton…

Optimization and Control · Mathematics 2021-06-21 Amir Daneshmand , Gesualdo Scutari , Pavel Dvurechensky , Alexander Gasnikov

In this paper, we consider the problem of clustering graph nodes and sparsifying graph edges over distributed graphs, when graph edges with possibly edge duplicates are observed at physically remote sites. Although edge duplicates across…

Data Structures and Algorithms · Computer Science 2023-02-21 Chun Jiang Zhu

Motivated by potential applications in power systems, we study a problem of optimizing a sum of $n$ convex functions on dynamic networks of $n$ nodes when each function is known to only a single node. The nodes' variables, while satisfy…

Optimization and Control · Mathematics 2016-10-04 Thinh T. Doan , Alex Olshevsky

We present a novel communication-efficient Newton-type algorithm for finite-sum optimization over a distributed computing environment. Our method, named DINO, overcomes both theoretical and practical shortcomings of similar existing…

Optimization and Control · Mathematics 2020-06-09 Rixon Crane , Fred Roosta

We present and analyze a stochastic distributed method (S-NEAR-DGD) that can tolerate inexact computation and inaccurate information exchange to alleviate the problems of costly gradient evaluations and bandwidth-limited communication in…

Optimization and Control · Mathematics 2021-02-02 Charikleia Iakovidou , Ermin Wei

This paper introduces the distributed Halpern Peaceman--Rachford (dHPR) method, an efficient algorithm for solving distributed convex composite optimization problems with non-smooth objectives, which achieves a non-ergodic $O(1/k)$…

Optimization and Control · Mathematics 2025-11-14 Zhangcheng Feng , Defeng Sun , Yancheng Yuan , Guojun Zhang

In this paper, we focus on an aggregative optimization problem under the communication bottleneck. The aggregative optimization is to minimize the sum of local cost functions. Each cost function depends on not only local state variables but…

Optimization and Control · Mathematics 2022-01-07 Ziqin Chen , Shu Liang

A new result in convex analysis on the calculation of proximity operators in certain scaled norms is derived. We describe efficient implementations of the proximity calculation for a useful class of functions; the implementations exploit…

Optimization and Control · Mathematics 2013-03-04 Stephen Becker , M. Jalal Fadili

In this paper, we propose a fully distributed algorithm for second-order continuous-time multi-agent systems to solve the distributed optimization problem. The global objective function is a sum of private cost functions associated with the…

Optimization and Control · Mathematics 2019-04-15 Xinlei Yi , Lisha Yao , Tao Yang , Jemin George , Karl H. Johansson

In this work we study the problem of unconstrained convex-optimization in a fully distributed multi-agent setting which includes asynchronous computation and lossy communication. In particular, we extend a recently proposed algorithm named…

Optimization and Control · Mathematics 2017-07-31 Nicoletta Bof , Ruggero Carli , Giuseppe Notarstefano , Luca Schenato , Damiano Varagnolo

This paper investigates the problem of resource allocation for a wireless communication network with distributed reconfigurable intelligent surfaces (RISs). In this network, multiple RISs are spatially distributed to serve wireless users…

Signal Processing · Electrical Eng. & Systems 2020-05-04 Zhaohui Yang , Mingzhe Chen , Walid Saad , Wei Xu , Mohammad Shikh-Bahaei , H. Vincent Poor , Shuguang Cui

A multi-agent optimization problem motivated by the management of energy systems is discussed. The associated cost function is separable and convex although not necessarily strongly convex and there exist edge-based coupling equality…

Optimization and Control · Mathematics 2022-06-03 Wicak Ananduta , Angelia Nedić , Carlos Ocampo-Martinez

We consider the problem of communication efficient distributed optimization where multiple nodes exchange important algorithm information in every iteration to solve large problems. In particular, we focus on the stochastic variance-reduced…

Machine Learning · Computer Science 2020-03-16 Hossein S. Ghadikolaei , Sindri Magnusson

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

We propose a novel stochastic distributed method for both monotone and strongly monotone variational inequalities with Lipschitz operator and proper convex regularizers arising in various applications from game theory to adversarial…

Optimization and Control · Mathematics 2024-10-07 Aleksandr Beznosikov , Darina Dvinskikh , Dmitry Bylinkin , Andrei Semenov , Alexander Gasnikov

This paper addresses coordinated downlink beamforming optimization in multicell time-division duplex (TDD) systems where a small number of parameters are exchanged between cells but with no data sharing. With the goal to reach the point on…

Information Theory · Computer Science 2016-11-17 Yongming Huang , Gan Zheng , Mats Bengtsson , Kai-Kit Wong , Luxi Yang , Bjorn Ottersten

This paper proposes a novel family of primal-dual-based distributed algorithms for smooth, convex, multi-agent optimization over networks that uses only gradient information and gossip communications. The algorithms can also employ…

Optimization and Control · Mathematics 2020-03-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

Consider a set of networked agents endowed with private cost functions and seeking to find a consensus on the minimizer of the aggregate cost. A new class of random asynchronous distributed optimization methods is introduced. The methods…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-13 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem