English
Related papers

Related papers: Communication Bounds for the Distributed Experts P…

200 papers

We investigate whether in a distributed setting, adaptive estimation of a smooth function at the optimal rate is possible under minimal communication. It turns out that the answer depends on the risk considered and on the number of servers…

Statistics Theory · Mathematics 2020-03-31 Botond Szabo , Harry van Zanten

We compare communication efficiencies of two compelling distributed machine learning approaches of split learning and federated learning. We show useful settings under which each method outperforms the other in terms of communication…

Machine Learning · Computer Science 2019-09-23 Abhishek Singh , Praneeth Vepakomma , Otkrist Gupta , Ramesh Raskar

Vertical distributed learning exploits the local features collected by multiple learning workers to form a better global model. However, the exchange of data between the workers and the model aggregator for parameter training incurs a heavy…

Networking and Internet Architecture · Computer Science 2022-09-07 Idan Achituve , Wenbo Wang , Ethan Fetaya , Amir Leshem

We define the Streaming Communication model that combines the main aspects of communication complexity and streaming. We consider two agents that want to compute some function that depends on inputs that are distributed to each agent. The…

Computational Complexity · Computer Science 2016-09-23 Lucas Boczkowski , Iordanis Kerenidis , Frédéric Magniez

The emergent behavior of a distributed system is conditioned by the information available to the local decision-makers. Therefore, one may expect that providing decision-makers with more information will improve system performance; in this…

Computer Science and Game Theory · Computer Science 2023-06-23 Bryce L. Ferguson , Dario Paccagnan , Jason R. Marden

The problem of communicating sensor measurements over shared networks is prevalent in many modern large-scale distributed systems such as cyber-physical systems, wireless sensor networks, and the internet of things. Due to bandwidth…

Systems and Control · Electrical Eng. & Systems 2021-12-14 Marcos M. Vasconcelos

The emergence of distributed Mixture-of-Experts (DMoE) systems, which deploy expert models at edge nodes, offers a pathway to achieving connected intelligence in sixth-generation (6G) mobile networks and edge artificial intelligence (AI).…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-18 Shengling Qin , Hai Wu , Hongyang Du , Kaibin Huang

The distributed optimization problem has become increasingly relevant recently. It has a lot of advantages such as processing a large amount of data in less time compared to non-distributed methods. However, most distributed approaches…

Optimization and Control · Mathematics 2024-03-27 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov , Alexander Gasnikov

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

In many real-world scenarios, experts must convey complex information with limited message capacity. This paper explores how the availability of messages influences an expert's persuasive ability. We develop a geometric representation of…

Theoretical Economics · Economics 2024-05-09 Yunus C. Aybas , Eray Turkel

The distributed setting for Saddle Problems (SPs) has recently emerged as a framework for various modern applications in machine learning and multiagent systems. Despite its relevance, the theoretical foundations of this setting have not…

Optimization and Control · Mathematics 2026-05-19 Ruichen Luo , Anton Rodomanov , Sebastian U. Stich

Data shuffling between distributed cluster of nodes is one of the critical steps in implementing large-scale learning algorithms. Randomly shuffling the data-set among a cluster of workers allows different nodes to obtain fresh data…

Information Theory · Computer Science 2018-01-08 Mohamed A. Attia , Ravi Tandon

We consider a standard distributed optimisation setting where $N$ machines, each holding a $d$-dimensional function $f_i$, aim to jointly minimise the sum of the functions $\sum_{i = 1}^N f_i (x)$. This problem arises naturally in…

Machine Learning · Computer Science 2021-12-08 Dan Alistarh , Janne H. Korhonen

Nowadays, large and complex deep learning (DL) models are increasingly trained in a distributed manner across multiple worker machines, in which extensive communications between workers pose serious scaling problems. In this article, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-10 Shaohuai Shi , Zhenheng Tang , Xiaowen Chu , Chengjian Liu , Wei Wang , Bo Li

Consider the communication-constrained estimation of discrete distributions under $\ell^p$ losses, where each distributed terminal holds multiple independent samples and uses limited number of bits to describe the samples. We obtain the…

Machine Learning · Computer Science 2024-11-11 Deheng Yuan , Tao Guo , Zhongyi Huang

This thesis is concerned with distributed control and coordination of networks consisting of multiple, potentially mobile, agents. This is motivated mainly by the emergence of large scale networks characterized by the lack of centralized…

Optimization and Control · Mathematics 2010-10-01 Alex Olshevsky

We propose a framework for the derivation and evaluation of distributed iterative algorithms for receiver cooperation in interference-limited wireless systems. Our approach views the processing within and collaboration between receivers as…

Information Theory · Computer Science 2012-04-18 Mihai-Alin Badiu , Carles Navarro Manchón , Vasile Bota , Bernard Henri Fleury

Mixture-of-Experts (MoE) has become a popular architecture for scaling large models. However, the rapidly growing scale outpaces model training on a single DC, driving a shift toward a more flexible, cross-DC training paradigm. Under this,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-23 Weihao Yang , Hao Huang , Donglei Wu , Ningke Li , Yanqi Pan , Qiyang Zheng , Wen Xia , Shiyi Li , Qiang Wang

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Shiqiang Wang , Tiffany Tuor , Theodoros Salonidis , Kin K. Leung , Christian Makaya , Ting He , Kevin Chan

We study how we can adapt a predictor to a non-stationary environment with advises from multiple experts. We study the problem under complete feedback when the best expert changes over time from a decision theoretic point of view. Proposed…

Machine Learning · Computer Science 2017-08-08 Vishnu Raj , Sheetal Kalyani