English
Related papers

Related papers: Communication Bounds for the Distributed Experts P…

200 papers

Communication on heterogeneous edge networks is a fundamental bottleneck in Federated Learning (FL), restricting both model capacity and user participation. To address this issue, we introduce two novel strategies to reduce communication…

Machine Learning · Computer Science 2019-01-09 Sebastian Caldas , Jakub Konečny , H. Brendan McMahan , Ameet Talwalkar

The paper deals with the distributed minimum sharing problem: a set of decision-makers compute the minimum of some local quantities of interest in a distributed and decentralized way by exchanging information through a communication…

Systems and Control · Electrical Eng. & Systems 2021-06-28 Michelangelo Bin , Thomas Parisini

We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept…

Machine Learning · Computer Science 2018-11-14 Michael Kamp , Linara Adilova , Joachim Sicking , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

Communication efficiency arises as a necessity in federated learning due to limited communication bandwidth. To this end, the present paper develops an algorithmic framework where an ensemble of pre-trained models is learned. At each…

Machine Learning · Computer Science 2022-03-01 Pouya M Ghari , Yanning Shen

The rapidly increasing complexity of (mainly wireless) ad-hoc networks stresses the need of reliable distributed estimation of several variables of interest. The widely used centralized approach, in which the network nodes communicate their…

Information Theory · Computer Science 2015-03-20 K. Dedecius , V. Sečkárová

We review distributed algorithms for transmitting data ($n$ real numbers) under a broadcast communication model, as well as for maximum finding and for sorting. Our interest is in the basics of recursive formulas and corresponding…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-16 Steven Finch

In this paper, we explore statistical versus computational trade-off to address a basic question in the application of a distributed algorithm: what is the minimal computational cost in obtaining statistical optimality? In smoothing spline…

Statistics Theory · Mathematics 2017-07-25 Zuofeng Shang , Guang Cheng

Existing dialogue models may encounter scenarios which are not well-represented in the training data, and as a result generate responses that are unnatural, inappropriate, or unhelpful. We propose the "Ask an Expert" framework in which the…

Computation and Language · Computer Science 2023-05-30 Qiang Zhang , Jason Naradowsky , Yusuke Miyao

We consider a problem where multiple agents must learn an action profile that maximises the sum of their utilities in a distributed manner. The agents are assumed to have no knowledge of either the utility functions or the actions and…

Systems and Control · Computer Science 2016-03-31 Chithrupa Ramesh , Marius Schmitt , John Lygeros

In this paper, we consider the problem of clustering graph nodes and sparsifying graph edges over distributed graphs, when graph edges with possibly edge duplicates are observed at physically remote sites. Although edge duplicates across…

Data Structures and Algorithms · Computer Science 2023-02-21 Chun Jiang Zhu

We consider the point-to-point message passing model of communication in which there are $k$ processors with individual private inputs, each $n$-bit long. Each processor is located at the node of an underlying undirected graph and has…

Computational Complexity · Computer Science 2016-02-22 Arkadev Chattopadhyay , Sagnik Mukhopadhyay

This paper studies fundamental limitations of performance for distributed decision-making in robotic networks. The class of decision-making problems we consider encompasses a number of prototypical problems such as average-based consensus…

Multiagent Systems · Computer Science 2017-08-15 Federico Rossi , Marco Pavone

In this paper, we study unconstrained distributed optimization strongly convex problems, in which the exchange of information in the network is captured by a directed graph topology over digital channels that have limited capacity (and…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

A matching in a two-sided market often incurs an externality: a matched resource may become unavailable to the other side of the market, at least for a while. This is especially an issue in online platforms involving human experts as the…

Artificial Intelligence · Computer Science 2018-10-30 Virag Shah , Lennart Gulikers , Laurent Massoulie , Milan Vojnovic

Mass spectrometry (MS) based omics data analysis require significant time and resources. To date, few parallel algorithms have been proposed for deducing peptides from mass spectrometry-based data. However, these parallel algorithms were…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-12 Fahad Saeed , Muhammad Haseeb , SS Iyengar

In multiple domains, statistical tasks are performed in distributed settings, with data split among several end machines that are connected to a fusion center. In various applications, the end machines have limited bandwidth and power, and…

Machine Learning · Computer Science 2026-01-05 Rodney Fonseca , Boaz Nadler

This work addresses the problem of distributed computation of linearly separable functions, where a master node with access to $K$ datasets, employs $N$ servers to compute $L$ user-requested functions, each defined over the datasets.…

Information Theory · Computer Science 2025-09-30 K. K. Krishnan Namboodiri , Elizabath Peter , Derya Malak , Petros Elia

Parallel applications are often unable to take full advantage of emerging parallel architectures due to scaling limitations, which arise due to inter-process communication. Performance models are used to analyze the sources of communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-07 Amanda Bienz , William D. Gropp , Luke N. Olson

We study distributed (strongly convex) optimization problems over a network of agents, with no centralized nodes. The loss functions of the agents are assumed to be \textit{similar}, due to statistical data similarity or otherwise. In order…

Optimization and Control · Mathematics 2022-04-12 Ye Tian , Gesualdo Scutari , Tianyu Cao , Alexander Gasnikov

Consensus-based distributed optimization methods have recently been advocated as alternatives to parameter server and ring all-reduce paradigms for large scale training of machine learning models. In this case, each worker maintains a local…

Machine Learning · Computer Science 2020-03-02 Giovanni Neglia , Chuan Xu , Don Towsley , Gianmarco Calbi