English
Related papers

Related papers: Distributed Training for Deep Learning Models On A…

200 papers

Federated learning (FL) enables collaborative model training without centralizing data. However, the traditional FL framework is cloud-based and suffers from high communication latency. On the other hand, the edge-based FL framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-28 Zhenxiao Zhang , Zhidong Gao , Yuanxiong Guo , Yanmin Gong

Accommodating long-running deep learning (DL) training and inference jobs is challenging on GPU clusters that use traditional batch schedulers, such as Slurm. Given fixed wall clock time limits, DL researchers usually need to run a sequence…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-27 Qiyang Ding , Pengfei Zheng , Shreyas Kudari , Shivaram Venkataraman , Zhao Zhang

The increasing complexity of Intelligent Transportation Systems (ITS) has led to significant interest in computational offloading to external infrastructures such as edge servers, vehicular nodes, and UAVs. These dynamic and heterogeneous…

Machine Learning · Computer Science 2026-05-27 Ashab Uddin , Ahmed Hamdi Sakr , Ning Zhang

The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making purposes. However,…

Machine Learning · Computer Science 2021-04-07 Mingzhe Chen , Deniz Gündüz , Kaibin Huang , Walid Saad , Mehdi Bennis , Aneta Vulgarakis Feljan , H. Vincent Poor

Federated Learning (FL) is a machine learning paradigm in which many clients cooperatively train a single centralized model while keeping their data private and decentralized. FL is commonly used in edge computing, which involves placing…

The ever-increasing number of Internet of Things (IoT) devices has created a new computing paradigm, called edge computing, where most of the computations are performed at the edge devices, rather than on centralized servers. An edge device…

Machine Learning · Computer Science 2019-10-24 Sahar Voghoei , Navid Hashemi Tonekaboni , Jason G. Wallace , Hamid R. Arabnia

In recent years, Deep Reinforcement Learning (DRL) has emerged as an effective approach to solving real-world tasks. However, despite their successes, DRL-based policies suffer from poor reliability, which limits their deployment in…

Machine Learning · Computer Science 2024-06-24 Davide Corsi , Guy Amir , Andoni Rodriguez , Cesar Sanchez , Guy Katz , Roy Fox

Scaling reinforcement learning (RL) has shown strong promise for enhancing the reasoning abilities of large language models (LLMs), particularly in tasks requiring long chain-of-thought generation. However, RL training efficiency is often…

Machine Learning · Computer Science 2026-03-25 Yiqi Zhang , Huiqiang Jiang , Xufang Luo , Zhihe Yang , Chengruidong Zhang , Yifei Shen , Dongsheng Li , Yuqing Yang , Lili Qiu , Yang You

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

Split learning (SL) is a privacy-preserving distributed deep learning method used to train a collaborative model without the need for sharing of patient's raw data between clients. In split learning, an additional privacy-preserving…

Machine Learning · Computer Science 2021-03-29 Harshit Madaan , Manish Gawali , Viraj Kulkarni , Aniruddha Pant

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized…

Multiagent Systems · Computer Science 2019-06-07 Maximilian Hüttenrauch , Adrian Šošić , Gerhard Neumann

We consider a multi-user multi-server mobile edge computing (MEC) system, in which users arrive on a network randomly over time and generate computation tasks, which will be computed either locally on their own computing devices or be…

Signal Processing · Electrical Eng. & Systems 2024-02-28 Muhammad Sohaib , Sang-Woon Jeon , Wei Yu

Recent years have witnessed a large amount of decentralized data in multiple (edge) devices of end-users, while the aggregation of the decentralized data remains difficult for machine learning jobs due to laws or regulations. Federated…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-16 Chendi Zhou , Ji Liu , Juncheng Jia , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Dejing Dou

The Internet of Vehicles (IoV) enables real-time data exchange among vehicles and roadside units and thus provides a promising solution to alleviate traffic jams in the urban area. Meanwhile, better traffic management via efficient traffic…

Multiagent Systems · Computer Science 2021-01-06 Pengyuan Zhou , Xianfu Chen , Zhi Liu , Tristan Braud , Pan Hui , Jussi Kangasharju

Recent advances in parallel computing and GPU acceleration have created new opportunities for computation-intensive learning problems such as Active SLAM -- where actions are selected to reduce uncertainty and improve joint mapping and…

Robotics · Computer Science 2026-03-30 Martín Arce Llobera , Julio A. Placed , Mariano De Paula , Pablo De Cristóforis

Decentralized federated learning (DFL) is a promising machine learning paradigm for bringing artificial intelligence (AI) capabilities to the network edge. Running DFL on top of edge networks, however, faces severe performance challenges…

Networking and Internet Architecture · Computer Science 2025-04-22 Tingyang Sun , Tuan Nguyen , Ting He

Distributed machine learning training is one of the most common and important workloads running on data centers today, but it is rarely executed alone. Instead, to reduce costs, computing resources are consolidated and shared by different…

Machine Learning · Computer Science 2019-09-12 Michael Kaufmann , Kornilios Kourtis , Celestine Mendler-Dünner , Adrian Schüpbach , Thomas Parnell

Dependency-aware job scheduling in the cluster is NP-hard. Recent work shows that Deep Reinforcement Learning (DRL) is capable of solving it. It is difficult for the administrator to understand the DRL-based policy even though it achieves…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-21 Shaojun Zhang , Chen Wang , Albert Zomaya

We apply deep reinforcement learning (DRL) to design of a networked controller with network delays to complete a temporal control task that is described by a signal temporal logic (STL) formula. STL is useful to deal with a specification…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Junya Ikemoto , Toshimitsu Ushio

This work considers the problem of control and resource scheduling in networked systems. We present DIRA, a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is…

Systems and Control · Computer Science 2019-09-24 Adrian Redder , Arunselvan Ramaswamy , Daniel E. Quevedo
‹ Prev 1 8 9 10 Next ›