中文
相关论文

相关论文: Communication-Efficient Training Workload Balancin…

200 篇论文

We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning…

人工智能 · 计算机科学 2017-12-25 Saurabh Kumar , Pararth Shah , Dilek Hakkani-Tur , Larry Heck

The rapid growth of data across fields of science and industry has increased the need to improve the performance of end-to-end data transfers while using the resources more efficiently. In this paper, we present a dynamic, multiparameter…

分布式、并行与集群计算 · 计算机科学 2026-03-27 Hasibul Jamil , Jacob Goldverg , Elvis Rodrigues , MD S Q Zulkar Nine , Tevfik Kosar

This paper presents the network load balancing problem, a challenging real-world task for multi-agent reinforcement learning (MARL) methods. Traditional heuristic solutions like Weighted-Cost Multi-Path (WCMP) and Local Shortest Queue (LSQ)…

分布式、并行与集群计算 · 计算机科学 2022-08-23 Zhiyuan Yao , Zihan Ding , Thomas Clausen

One of the challenges for multi-agent reinforcement learning (MARL) is designing efficient learning algorithms for a large system in which each agent has only limited or partial information of the entire system. While exciting progress has…

机器学习 · 计算机科学 2022-02-22 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

机器学习 · 计算机科学 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

Distributed machine learning (DML) techniques, such as federated learning, partitioned learning, and distributed reinforcement learning, have been increasingly applied to wireless communications. This is due to improved capabilities of…

机器学习 · 计算机科学 2020-12-04 S. Hu , X. Chen , W. Ni , E. Hossain , X. Wang

Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of large models on resource-constraint edge devices and protect…

分布式、并行与集群计算 · 计算机科学 2024-03-26 Mingjin Zhang , Jiannong Cao , Yuvraj Sahni , Xiangchun Chen , Shan Jiang

Inter-agent communication can significantly increase performance in multi-agent tasks that require co-ordination to achieve a shared goal. Prior work has shown that it is possible to learn inter-agent communication protocols using…

人工智能 · 计算机科学 2021-12-09 Varun Kumar Vijay , Hassam Sheikh , Somdeb Majumdar , Mariano Phielipp

Training large language models (LLMs) requires massive computational resources, often necessitating the aggregation of geographically distributed data centers (\ie, cross-region training). However, the high communication latency in…

分布式、并行与集群计算 · 计算机科学 2025-04-25 Ying Zhu , Yang Xu , Hongli Xu , Yunming Liao , Zhiwei Yao , Liusheng Huang

Deep Metric Learning (DML) models often require strong local and global representations, however, effective integration of local and global features in DML model training is a challenge. DML models are often trained with specific loss…

计算机视觉与模式识别 · 计算机科学 2021-12-30 Mohammad K. Ebrahimpour , Gang Qian , Allison Beach

Federated Learning (FL) empowers multiple clients to collaboratively train machine learning models without sharing local data, making it highly applicable in heterogeneous Internet of Things (IoT) environments. However, intrinsic…

机器学习 · 计算机科学 2025-01-29 Xi Chen , Qin Li , Haibin Cai , Ting Wang

This work presents a novel communication framework for decentralized multi-agent systems operating in dynamic network environments. Integrated into a multi-agent reinforcement learning system, the framework is designed to enhance…

多智能体系统 · 计算机科学 2025-01-03 Ben McClusky

Decentralized learning provides a scalable alternative to parameter-server-based training, yet its performance is often hindered by limited peer-to-peer communication. In this paper, we study how communication should be scheduled over time,…

机器学习 · 计算机科学 2026-04-28 Tongtian Zhu , Tianyu Zhang , Mingze Wang , Zhanpeng Zhou , Can Wang

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

机器学习 · 计算机科学 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

Recently using machine learning (ML) based techniques to optimize modern database management systems has attracted intensive interest from both industry and academia. With an objective to tune a specific component of a DBMS (e.g., index…

数据库 · 计算机科学 2023-03-13 Xinyi Zhang , Zhuo Chang , Hong Wu , Yang Li , Jia Chen , Jian Tan , Feifei Li , Bin Cui

Federated learning is a recent development in the machine learning area that allows a system of devices to train on one or more tasks without sharing their data to a single location or device. However, this framework still requires a…

机器学习 · 计算机科学 2024-01-11 Guangyao Zheng , Michael A. Jacobs , Vladimir Braverman , Vishwa S. Parekh

In this paper, we propose a learning-based framework to simultaneously learn the communication and distributed control policies for a heterogeneous multi-agent system (MAS) under complex mission requirements from Capability Temporal Logic…

机器学习 · 计算机科学 2022-12-23 Wenliang Liu , Kevin Leahy , Zachary Serlin , Calin Belta

How to train a machine learning model while keeping the data private and secure? We present CodedPrivateML, a fast and scalable approach to this critical problem. CodedPrivateML keeps both the data and the model information-theoretically…

机器学习 · 计算机科学 2021-02-23 Jinhyun So , Basak Guler , A. Salman Avestimehr

Centralized Training with Decentralized Execution (CTDE) has recently emerged as a popular framework for cooperative Multi-Agent Reinforcement Learning (MARL), where agents can use additional global state information to guide training in a…

人工智能 · 计算机科学 2025-05-14 Yihe Zhou , Shunyu Liu , Yunpeng Qing , Kaixuan Chen , Tongya Zheng , Jie Song , Mingli Song

The vulnerability of machine learning models to adversarial attacks has been attracting considerable attention in recent years. Most existing studies focus on the behavior of stand-alone single-agent learners. In comparison, this work…

机器学习 · 计算机科学 2025-05-13 Ying Cao , Elsa Rizk , Stefan Vlaski , Ali H. Sayed