English
Related papers

Related papers: Optimal Communication for Classic Functions in the…

200 papers

Data aggregation is a fundamental primitive in distributed computing wherein a network computes a function of every nodes' input. However, while compute time is non-negligible in modern systems, standard models of distributed computing do…

Data Structures and Algorithms · Computer Science 2019-11-14 Bernhard Haeupler , D Ellis Hershkowitz , Anson Kahng , Ariel D. Procaccia

We study the decentralized optimization problem $\min_{{\bf x}\in{\mathbb R}^d} f({\bf x})\triangleq \frac{1}{m}\sum_{i=1}^m f_i({\bf x})$, where the local function on the $i$-th agent has the form of $f_i({\bf x})\triangleq…

Optimization and Control · Mathematics 2025-01-14 Luo Luo , Yunyan Bai , Lesi Chen , Yuxing Liu , Haishan Ye

We call $F:\{0, 1\}^n\times \{0, 1\}^n\to\{0, 1\}$ a symmetric XOR function if for a function $S:\{0, 1, ..., n\}\to\{0, 1\}$, $F(x, y)=S(|x\oplus y|)$, for any $x, y\in\{0, 1\}^n$, where $|x\oplus y|$ is the Hamming weight of the bit-wise…

Quantum Physics · Physics 2008-08-20 Yaoyun Shi , Zhiqiang Zhang

We present a new method that includes three key components of distributed optimization and federated learning: variance reduction of stochastic gradients, partial participation, and compressed communication. We prove that the new method has…

Machine Learning · Computer Science 2024-01-04 Alexander Tyurin , Peter Richtárik

Large data sets often require performing distributed statistical estimation, with a full data set split across multiple machines and limited communication between machines. To study such scenarios, we define and study some refinements of…

Information Theory · Computer Science 2014-06-24 John C. Duchi , Michael I. Jordan , Martin J. Wainwright , Yuchen Zhang

Graph clustering problems typically aim to partition the graph nodes such that two nodes belong to the same partition set if and only if they are similar. Correlation Clustering is a graph clustering formulation which: (1) takes as input a…

Social and Information Networks · Computer Science 2021-10-19 Jimit Majmudar , Stephen Vavasis

We study the maximum weight matching problem in the random-order semi-streaming model and in the robust communication model. Unlike many other sublinear models, in these two frameworks, there is a large gap between the guarantees of the…

Data Structures and Algorithms · Computer Science 2024-08-29 Diba Hashemi , Weronika Wrzos-Kaminska

We consider the scenario of $n$ sensor nodes observing streams of data. The nodes are connected to a central server whose task it is to compute some function over all data items observed by the nodes. In our case, there exists a total order…

Data Structures and Algorithms · Computer Science 2017-09-22 Felix Biermeier , Björn Feldkord , Manuel Malatyali , Friedhelm Meyer auf der Heide

Graph partitioning schedules parallel calculations like sparse matrix-vector multiply (SpMV). We consider contiguous partitions, where the $m$ rows (or columns) of a sparse matrix with $N$ nonzeros are split into $K$ parts without…

Data Structures and Algorithms · Computer Science 2024-10-30 Willow Ahrens

We study nonconvex distributed optimization in multi-agent networks with time-varying (nonsymmetric) connectivity. We introduce the first algorithmic framework for the distributed minimization of the sum of a smooth (possibly nonconvex and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-02 Paolo Di Lorenzo , Gesualdo Scutari

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

Graph Neural Networks (GNNs) unlock new ways of learning from graph-structured data, proving highly effective in capturing complex relationships and patterns. Federated GNNs (FGNNs) have emerged as a prominent distributed learning paradigm…

Machine Learning · Computer Science 2026-01-23 Xiuling Wang , Xin Huang , Haibo Hu , Jianliang Xu

This paper focuses on decentralized composite optimization over networks without a central coordinator. We propose a novel decentralized symmetric ADMM algorithm that incorporates multiple communication rounds within each iteration, derived…

Optimization and Control · Mathematics 2026-03-06 Jinrui Huang , Xueqin Wang , Dong Liu , Jingguo Lan , Runxiong Wu

This paper considers the minimization of a sum of smooth and strongly convex functions dispatched over the nodes of a communication network. Previous works on the subject either focus on synchronous algorithms, which can be heavily slowed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-09 Mathieu Even , Hadrien Hendrikx , Laurent Massoulié

The classical problem in network coding theory considers communication over multicast networks. Multiple transmitters send independent messages to multiple receivers which decode the same set of messages. In this work, computation over…

Information Theory · Computer Science 2016-02-18 Changho Suh , Naveen Goela , Michael Gastpar

In order to mitigate the high communication cost in distributed and federated learning, various vector compression schemes, such as quantization, sparsification and dithering, have become very popular. In designing a compression method, one…

Machine Learning · Computer Science 2021-05-04 Mher Safaryan , Egor Shulgin , Peter Richtárik

In communication networks, cooperative strategies are coding schemes where network nodes work together to improve network performance metrics such as the total rate delivered across the network. This work studies encoder cooperation in the…

Information Theory · Computer Science 2019-11-26 Parham Noorzad , Michael Langberg , Michelle Effros

We fully determine the communication complexity of approximating matrix rank, over any finite field $\mathbb{F}$. We study the most general version of this problem, where $0\leq r<R\leq n$ are given integers, Alice and Bob's inputs are…

Computational Complexity · Computer Science 2024-10-29 Alexander A. Sherstov , Andrey A. Storozhenko

We study distributed composite optimization over networks: agents minimize the sum of a smooth (strongly) convex function, the agents' sum-utility, plus a non-smooth (extended-valued) convex one. We propose a general algorithmic framework…

Optimization and Control · Mathematics 2019-10-23 Jinming Xu , Ying Sun , Ye Tian , Gesualdo Scutari

In this paper, we investigate the approximate consensus problem in highly dynamic networks in which topology may change continually and unpredictably. We prove that in both synchronous and partially synchronous systems, approximate…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-11-13 Bernadette Charron-Bost , Matthias Függer , Thomas Nowak