English
Related papers

Related papers: Distributed Training for Deep Learning Models On A…

200 papers

Deep Reinforcement Learning (DRL) has emerged as a powerful solution for meeting the growing demands for connectivity, reliability, low latency and operational efficiency in advanced networks. However, most research has focused on…

Networking and Internet Architecture · Computer Science 2025-07-21 Haiyuan Li , Hari Madhukumar , Peizheng Li , Yuelin Liu , Yiran Teng , Yulei Wu , Ning Wang , Shuangyi Yan , Dimitra Simeonidou

5G and edge computing will serve various emerging use cases that have diverse requirements of multiple resources, e.g., radio, transportation, and computing. Network slicing is a promising technology for creating virtual networks that can…

Networking and Internet Architecture · Computer Science 2020-03-31 Qiang Liu , Tao Han , Ephraim Moges

Federated Learning is a new learning scheme for collaborative training a shared prediction model while keeping data locally on participating devices. In this paper, we study a new model of multiple federated learning services at the…

Machine Learning · Computer Science 2020-12-01 Minh N. H. Nguyen , Nguyen H. Tran , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

Network slicing enables the operator to configure virtual network instances for diverse services with specific requirements. To achieve the slice-aware radio resource scheduling, dynamic slicing resource partitioning is needed to…

Networking and Internet Architecture · Computer Science 2022-02-28 Tianlun Hu , Qi Liao , Qiang Liu , Dan Wellington , Georg Carle

Dynamic resource allocation plays a critical role in the next generation of intelligent wireless communication systems. Machine learning has been leveraged as a powerful tool to make strides in this domain. In most cases, the progress has…

Machine Learning · Computer Science 2022-04-12 Jithin Jagannath , Kian Hamedani , Collin Farquhar , Keyvan Ramezanpour , Anu Jagannath

Coflow is a recently proposed networking abstraction to help improve the communication performance of data-parallel computing jobs. In multi-stage jobs, each job consists of multiple coflows and is represented by a Directed Acyclic Graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-22 Xin Wang , Hong Shen

Task scheduling is a critical problem when one user offloads multiple different tasks to the edge server. When a user has multiple tasks to offload and only one task can be transmitted to server at a time, while server processes tasks…

Machine Learning · Computer Science 2022-08-05 Xiucheng Wang , Longfei Ma , Haocheng Li , Zhisheng Yin , Tom. Luan , Nan Cheng

The increasing complexity of deep neural networks poses significant barriers to democratizing them to resource-limited edge devices. To address this challenge, split federated learning (SFL) has emerged as a promising solution by of…

Machine Learning · Computer Science 2025-06-05 Zheng Lin , Guanqiao Qu , Wei Wei , Xianhao Chen , Kin K. Leung

Deep Neural Network (DNN)-based video analytics significantly improves recognition accuracy in computer vision applications. Deploying DNN models at edge nodes, closer to end users, reduces inference delay and minimizes bandwidth costs.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-25 Guanyu Gao , Yuqi Dong , Ran Wang , Xin Zhou

This paper explores the application of a federated learning-based multi-agent reinforcement learning (MARL) strategy to enhance physical-layer security (PLS) in a multi-cellular network within the context of beyond 5G networks. At each…

Signal Processing · Electrical Eng. & Systems 2025-07-10 Deemah H. Tashman , Soumaya Cherkaoui , Walaa Hamouda

Decentralized cooperative multi-agent deep reinforcement learning (MARL) can be a versatile learning framework, particularly in scenarios where centralized training is either not possible or not practical. One of the critical challenges in…

Multi-agent reinforcement learning (MARL) has long been a significant and everlasting research topic in both machine learning and control. With the recent development of (single-agent) deep RL, there is a resurgence of interests in…

Machine Learning · Computer Science 2019-12-10 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

Many of the machine learning (ML) tasks are focused on centralized learning (CL), which requires the transmission of local datasets from the clients to a parameter server (PS) leading to a huge communication overhead. Federated learning…

Machine Learning · Computer Science 2021-02-17 Ahmet M. Elbir , Sinem Coleri , Kumar Vijay Mishra

Cooperative multi-robot teams need to be able to explore cluttered and unstructured environments while dealing with communication dropouts that prevent them from exchanging local information to maintain team coordination. Therefore, robots…

Robotics · Computer Science 2024-02-27 Aaron Hao Tan , Federico Pizarro Bejarano , Yuhan Zhu , Richard Ren , Goldie Nejat

Distributed deep learning workloads include throughput-intensive training tasks on the GPU clusters, where the Distributed Stochastic Gradient Descent (SGD) incurs significant communication delays after backward propagation, forces workers…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-16 Cheng Luo , Lei Qu , Youshan Miao , Peng Cheng , Yongqiang Xiong

Distributed machine learning (DML) technology makes it possible to train large neural networks in a reasonable amount of time. Meanwhile, as the computing power grows much faster than network capacity, network communication has gradually…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-11 Xinchi Han , Weihao Jiang , Peirui Cao , Qinwei Yang , Yunzhuo Liu , Shuyao Qi , Shengkai Lin , Shizhen Zhao

With the continuous growth of mobile data and the unprecedented demand for computing power, resource-constrained edge devices cannot effectively meet the requirements of Internet of Things (IoT) applications and Deep Neural Network (DNN)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-02 Guanjin Qu , Huaming Wu

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

Machine Learning · Computer Science 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

Deep Reinforcement Learning (DRL) has recently witnessed significant advances that have led to multiple successes in solving sequential decision-making problems in various domains, particularly in wireless communications. The future…

Machine Learning · Computer Science 2020-11-10 Amal Feriani , Ekram Hossain

This paper proposes Load-aware Tram-FL, an extension of Tram-FL that introduces a training scheduling mechanism to minimize total training time in decentralized federated learning by accounting for both computational and communication…

Machine Learning · Computer Science 2025-06-12 Haruki Kainuma , Takayuki Nishio