English
Related papers

Related papers: Network Contention-Aware Cluster Scheduling with R…

200 papers

Train timetable rescheduling (TTR) aims to promptly restore the original operation of trains after unexpected disturbances or disruptions. Currently, this work is still done manually by train dispatchers, which is challenging to maintain…

Machine Learning · Computer Science 2024-01-17 Peng Yue , Yaochu Jin , Xuewu Dai , Zhenhua Feng , Dongliang Cui

As emerging deep neural network (DNN) models continue to grow in size, using large GPU clusters to train DNNs is becoming an essential requirement to achieving acceptable training times. In this paper, we consider the case where future…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-25 Seo Jin Park , Joshua Fried , Sunghyun Kim , Mohammad Alizadeh , Adam Belay

Replay methods are known to be successful at mitigating catastrophic forgetting in continual learning scenarios despite having limited access to historical data. However, storing historical data is cheap in many real-world settings, yet…

Machine Learning · Computer Science 2023-11-22 Marcus Klasson , Hedvig Kjellström , Cheng Zhang

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

Machine Learning · Computer Science 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

Distributed training of deep nets is an important technique to address some of the present day computing challenges like memory consumption and computational demands. Classical distributed approaches, synchronous or asynchronous, are based…

Machine Learning · Computer Science 2019-01-14 Youjie Li , Mingchao Yu , Songze Li , Salman Avestimehr , Nam Sung Kim , Alexander Schwing

Migrating heterogeneous high-performance computing (HPC) systems to resource-aware scheduling introduces both technical and behavioral challenges, particularly in production environments with established user workflows. This paper presents…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-31 Glen MacLachlan , Joseph Creech , Rubeel Muhammad Iqbal , Clark Gaylord , Jake Messick

Job shop scheduling problems represent a significant and complex facet of combinatorial optimization problems, which have traditionally been addressed through either exact or approximate solution methodologies. However, the practical…

Artificial Intelligence · Computer Science 2024-03-19 Jaejin Lee , Seho Kee , Mani Janakiram , George Runger

Cloud computing is a reliable solution to provide distributed computation power. However, real-time response is still challenging regarding the enormous amount of data generated by the IoT devices in 5G and 6G networks. Thus, multi-access…

Artificial Intelligence · Computer Science 2022-11-03 Anahita Mazloomi , Hani Sami , Jamal Bentahar , Hadi Otrok , Azzam Mourad

Increasing interest in integrating advanced robotics within manufacturing has spurred a renewed concentration in developing real-time scheduling solutions to coordinate human-robot collaboration in this environment. Traditionally, the…

Robotics · Computer Science 2020-06-30 Zheyuan Wang , Matthew Gombolay

Modern machine learning frameworks can train neural networks using multiple nodes in parallel, each computing parameter updates with stochastic gradient descent (SGD) and sharing them asynchronously through a central parameter server. Due…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-02 Zhuojin Li , Wumo Yan , Marco Paolieri , Leana Golubchik

Modern computing platforms tend to deploy multiple GPUs (2, 4, or more) on a single node to boost system performance, with each GPU having a large capacity of global memory and streaming multiprocessors (SMs). GPUs are an expensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-20 Chao Chen , Chris Porter , Santosh Pande

We consider the classical problem of scheduling task graphs corresponding to complex applications on distributed computing systems. A number of heuristics have been previously proposed to optimize task scheduling with respect to metrics…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-25 Mehrdad Kiamari , Bhaskar Krishnamachari

The Resource-Constrained Project Scheduling Problem (RCPSP) is a classical scheduling problem that has received significant attention due to of its numerous applications in industry. However, in practice, task durations are subject to…

Artificial Intelligence · Computer Science 2025-11-18 Guillaume Infantes , Stéphanie Roussel , Antoine Jacquet , Emmanuel Benazera

Cloud computing is one of the most used distributed systems for data processing and data storage. Due to the continuous increase in the size of the data processed by cloud computing, scheduling multiple tasks to maintain efficiency while…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-24 Mahdi Manavi , Yunpeng Zhang , Guoning Chen

This paper considers the problem of resource allocation in stream processing, where continuous data flows must be processed in real time in a large distributed system. To maximize system throughput, the resource allocation strategy that…

Machine Learning · Computer Science 2019-11-21 Xiang Ni , Jing Li , Mo Yu , Wang Zhou , Kun-Lung Wu

Deep Learning has been recently recognized as one of the feasible solutions to effectively address combinatorial optimization problems, which are often considered important yet challenging in various research domains. In this work, we first…

Artificial Intelligence · Computer Science 2020-12-15 Hyunsung Lee , Michael Wang , Honguk Woo

We investigate the performance of the concurrency mechanisms available on NVIDIA's new Ampere GPU microarchitecture under deep learning training and inference workloads. In contrast to previous studies that treat the GPU as a black box, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-04 Guin Gilman , Robert J. Walls

Multi-server jobs that request multiple computing resources and hold onto them during their execution dominate modern computing clusters. When allocating the multi-type resources to several co-located multi-server jobs simultaneously in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-08 Hailiang Zhao , Shuiguang Deng , Zhengzhe Xiang , Xueqiang Yan , Jianwei Yin , Schahram Dustdar , Albert Y. Zomaya

We consider the problem of designing a packet-level congestion control and scheduling policy for datacenter networks. Current datacenter networks primarily inherit the principles that went into the design of Internet, where congestion…

Networking and Internet Architecture · Computer Science 2017-10-10 Devavrat Shah , Qiaomin Xie

This paper proposes Load-aware Tram-FL, an extension of Tram-FL that introduces a training scheduling mechanism to minimize total training time in decentralized federated learning by accounting for both computational and communication…

Machine Learning · Computer Science 2025-06-12 Haruki Kainuma , Takayuki Nishio