English
Related papers

Related papers: Communication-Efficient Training Workload Balancin…

200 papers

We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning…

Artificial Intelligence · Computer Science 2017-12-25 Saurabh Kumar , Pararth Shah , Dilek Hakkani-Tur , Larry Heck

The rapid growth of data across fields of science and industry has increased the need to improve the performance of end-to-end data transfers while using the resources more efficiently. In this paper, we present a dynamic, multiparameter…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Hasibul Jamil , Jacob Goldverg , Elvis Rodrigues , MD S Q Zulkar Nine , Tevfik Kosar

This paper presents the network load balancing problem, a challenging real-world task for multi-agent reinforcement learning (MARL) methods. Traditional heuristic solutions like Weighted-Cost Multi-Path (WCMP) and Local Shortest Queue (LSQ)…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Zhiyuan Yao , Zihan Ding , Thomas Clausen

One of the challenges for multi-agent reinforcement learning (MARL) is designing efficient learning algorithms for a large system in which each agent has only limited or partial information of the entire system. While exciting progress has…

Machine Learning · Computer Science 2022-02-22 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

Machine Learning · Computer Science 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

Distributed machine learning (DML) techniques, such as federated learning, partitioned learning, and distributed reinforcement learning, have been increasingly applied to wireless communications. This is due to improved capabilities of…

Machine Learning · Computer Science 2020-12-04 S. Hu , X. Chen , W. Ni , E. Hossain , X. Wang

Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of large models on resource-constraint edge devices and protect…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-26 Mingjin Zhang , Jiannong Cao , Yuvraj Sahni , Xiangchun Chen , Shan Jiang

Inter-agent communication can significantly increase performance in multi-agent tasks that require co-ordination to achieve a shared goal. Prior work has shown that it is possible to learn inter-agent communication protocols using…

Artificial Intelligence · Computer Science 2021-12-09 Varun Kumar Vijay , Hassam Sheikh , Somdeb Majumdar , Mariano Phielipp

Training large language models (LLMs) requires massive computational resources, often necessitating the aggregation of geographically distributed data centers (\ie, cross-region training). However, the high communication latency in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-25 Ying Zhu , Yang Xu , Hongli Xu , Yunming Liao , Zhiwei Yao , Liusheng Huang

Deep Metric Learning (DML) models often require strong local and global representations, however, effective integration of local and global features in DML model training is a challenge. DML models are often trained with specific loss…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Mohammad K. Ebrahimpour , Gang Qian , Allison Beach

Federated Learning (FL) empowers multiple clients to collaboratively train machine learning models without sharing local data, making it highly applicable in heterogeneous Internet of Things (IoT) environments. However, intrinsic…

Machine Learning · Computer Science 2025-01-29 Xi Chen , Qin Li , Haibin Cai , Ting Wang

This work presents a novel communication framework for decentralized multi-agent systems operating in dynamic network environments. Integrated into a multi-agent reinforcement learning system, the framework is designed to enhance…

Multiagent Systems · Computer Science 2025-01-03 Ben McClusky

Decentralized learning provides a scalable alternative to parameter-server-based training, yet its performance is often hindered by limited peer-to-peer communication. In this paper, we study how communication should be scheduled over time,…

Machine Learning · Computer Science 2026-04-28 Tongtian Zhu , Tianyu Zhang , Mingze Wang , Zhanpeng Zhou , Can Wang

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

Machine Learning · Computer Science 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

Recently using machine learning (ML) based techniques to optimize modern database management systems has attracted intensive interest from both industry and academia. With an objective to tune a specific component of a DBMS (e.g., index…

Databases · Computer Science 2023-03-13 Xinyi Zhang , Zhuo Chang , Hong Wu , Yang Li , Jia Chen , Jian Tan , Feifei Li , Bin Cui

Federated learning is a recent development in the machine learning area that allows a system of devices to train on one or more tasks without sharing their data to a single location or device. However, this framework still requires a…

Machine Learning · Computer Science 2024-01-11 Guangyao Zheng , Michael A. Jacobs , Vladimir Braverman , Vishwa S. Parekh

In this paper, we propose a learning-based framework to simultaneously learn the communication and distributed control policies for a heterogeneous multi-agent system (MAS) under complex mission requirements from Capability Temporal Logic…

Machine Learning · Computer Science 2022-12-23 Wenliang Liu , Kevin Leahy , Zachary Serlin , Calin Belta

How to train a machine learning model while keeping the data private and secure? We present CodedPrivateML, a fast and scalable approach to this critical problem. CodedPrivateML keeps both the data and the model information-theoretically…

Machine Learning · Computer Science 2021-02-23 Jinhyun So , Basak Guler , A. Salman Avestimehr

Centralized Training with Decentralized Execution (CTDE) has recently emerged as a popular framework for cooperative Multi-Agent Reinforcement Learning (MARL), where agents can use additional global state information to guide training in a…

Artificial Intelligence · Computer Science 2025-05-14 Yihe Zhou , Shunyu Liu , Yunpeng Qing , Kaixuan Chen , Tongya Zheng , Jie Song , Mingli Song

The vulnerability of machine learning models to adversarial attacks has been attracting considerable attention in recent years. Most existing studies focus on the behavior of stand-alone single-agent learners. In comparison, this work…

Machine Learning · Computer Science 2025-05-13 Ying Cao , Elsa Rizk , Stefan Vlaski , Ali H. Sayed