English

Poster: Flexible Scheduling of Network and Computing Resources for Distributed AI Tasks

Networking and Internet Architecture 2024-07-09 v1
Authors: Ruikun Wang , Jiawei Zhang , Qiaolun Zhang , Bojun Zhang , Zhiqun Gu , Aryanaz Attarpour , Yuefeng Ji , Massimo Tornatore
View on arXiv ↗ PDF ↗

Abstract

Many emerging Artificial Intelligence (AI) applications require on-demand provisioning of large-scale computing, which can only be enabled by leveraging distributed computing services interconnected through networking. To address such increasing demand for networking to serve AI tasks, we investigate new scheduling strategies to improve communication efficiency and test them on a programmable testbed. We also show relevant challenges and research directions.

Keywords

distributed computing distributed optimization scheduling

Cite

@article{arxiv.2407.04845,
  title  = {Poster: Flexible Scheduling of Network and Computing Resources for Distributed AI Tasks},
  author = {Ruikun Wang and Jiawei Zhang and Qiaolun Zhang and Bojun Zhang and Zhiqun Gu and Aryanaz Attarpour and Yuefeng Ji and Massimo Tornatore},
  journal= {arXiv preprint arXiv:2407.04845},
  year   = {2024}
}

Related papers

View all related →
Machine Learning · Computer Science
Adaptive Scheduling for Machine Learning Tasks over Networks
Konstantinos Gatsis
2021-01-26
Distributed, Parallel, and Cluster Computing · Computer Science
A Dynamic Distributed Scheduler for Computing on the Edge
Fei Hu, Kunal Mehta, Shivakant Mishra, Mohammad AlMutawa
2023-08-15
Machine Learning · Computer Science
A Survey on Distributed Machine Learning
Joost Verbraeken, Matthijs Wolting, Jonathan Katzy, Jeroen Kloppenburg +2
2022-11-28
Distributed, Parallel, and Cluster Computing · Computer Science
Scheduling of Distributed Applications on the Computing Continuum: A Survey
Narges Mehran, Dragi Kimovski, Hermann Hellwagner, Dumitru Roman +2
2024-05-02
Machine Learning · Computer Science
Scalable, Distributed AI Frameworks: Leveraging Cloud Computing for Enhanced Deep Learning Performance and Efficiency
Neelesh Mungoli
2023-04-28
Networking and Internet Architecture · Computer Science
Optimizing Distributed Networking with Big Data Scheduling and Cloud Computing
Wenbo Zhu
2023-11-09
Quantum Physics · Physics
Resource Allocation in Quantum Networks for Distributed Quantum Computing
Claudio Cicconetti, Marco Conti, Andrea Passarella
2022-08-29
Systems and Control · Electrical Eng. & Systems
Distributed Intelligence in Wireless Networks
Xiaolan Liu, Jiadong Yu, Yuanwei Liu, Yue Gao +3
2022-08-02
Information Theory · Computer Science
6G: Connectivity in the Era of Distributed Intelligence
Shilpa Talwar, Nageen Himayat, Hosein Nikopour, Feng Xue +2
2021-10-22
Distributed, Parallel, and Cluster Computing · Computer Science
Task Scheduling in Geo-Distributed Computing: A Survey
Yujian Wu, Shanjiang Tang, Ce Yu, Bin Yang +3
2025-01-28
Networking and Internet Architecture · Computer Science
INSIGHT: A Survey of In-Network Systems for Intelligent, High-Efficiency AI and Topology Optimization
Aleksandr Algazinov, Joydeep Chandra, Matt Laing
2025-08-19
Networking and Internet Architecture · Computer Science
GPUs, CPUs, and... NICs: Rethinking the Network's Role in Serving Complex AI Pipelines
Mike Wong, Ulysses Butler, Emma Farkash, Praveen Tammana +2
2025-02-25
Networking and Internet Architecture · Computer Science
AI-enabled Future Wireless Networks: Challenges, Opportunities and Open Issues
Medhat Elsayed, Melike Erol-Kantarci
2021-03-09
Quantum Physics · Physics
Advanced Scheduling Strategies for Distributed Quantum Computing Jobs
Gongyu Ni, Davide Ferrari, Lester Ho, Michele Amoretti
2026-03-23
Networking and Internet Architecture · Computer Science
Applications of Distributed Machine Learning for the Internet-of-Things: A Comprehensive Survey
Mai Le, Thien Huynh-The, Tan Do-Duy, Thai-Hoc Vu +2
2023-10-17
Data Structures and Algorithms · Computer Science
Towards a Centralized Scheduling Framework for Communication Flows in Distributed Systems
Mugurel Ionut Andreica, Eliana-Dina Tirsa, Nicolae Tapus, Florin Pop +1
2009-06-02
Distributed, Parallel, and Cluster Computing · Computer Science
Ray: A Distributed Framework for Emerging AI Applications
Philipp Moritz, Robert Nishihara, Stephanie Wang, Alexey Tumanov +7
2018-10-02
Distributed, Parallel, and Cluster Computing · Computer Science
Communication-Aware Scheduling of Serial Tasks for Dispersed Computing
Chien-Sheng Yang, Ramtin Pedarsani, A. Salman Avestimehr
2019-05-28
Networking and Internet Architecture · Computer Science
Slicing-Based AI Service Provisioning on Network Edge
Mushu Li, Jie Gao, Conghao Zhou, Xuemin +2
2021-05-18
Artificial Intelligence · Computer Science
A Research Agenda for AI Planning in the Field of Flexible Production Systems
Aljosha Köcher, Rene Heesch, Niklas Widulle, Anna Nordhausen +3
2022-07-26
Distributed, Parallel, and Cluster Computing · Computer Science
Scheduling in distributed systems: A cloud computing perspective
Luiz F. Bittencourt, Alfredo Goldman, Edmundo R. M. Madeira, Nelson L. S. da Fonseca +1
2019-01-11
Distributed, Parallel, and Cluster Computing · Computer Science
Resource Allocation and Workload Scheduling for Large-Scale Distributed Deep Learning: A Survey
Feng Liang, Zhen Zhang, Haifeng Lu, Chengming Li +3
2024-06-13
Distributed, Parallel, and Cluster Computing · Computer Science
Optimal Resource Scheduling and Allocation in Distributed Computing Systems
Wei Ren, Eleftherios Vlahakis, Nikolaos Athanasopoulos, Raphael Jungers
2021-12-02
Information Theory · Computer Science
Personalized Resource Allocation in Wireless Networks: An AI-Enabled and Big Data-Driven Multi-Objective Optimization
Rawan Alkurd, Ibrahim Abualhaol, Halim Yanikomeroglu
2023-07-11
Machine Learning · Computer Science
Machine Learning and CPU (Central Processing Unit) Scheduling Co-Optimization over a Network of Computing Centers
Mohammadreza Doostmohammadian, Zulfiya R. Gabidullina, Hamid R. Rabiee
2025-10-30
R2 v1 2026-06-28T17:30:53.323Z