English
Related papers

Related papers: Learning Interpretable Scheduling Algorithms for D…

200 papers

Scheduling computational tasks represented by directed acyclic graphs (DAGs) is challenging because of its complexity. Conventional scheduling algorithms rely heavily on simple heuristics such as shortest job first (SJF) and critical path…

Machine Learning · Computer Science 2021-03-08 Zhigang Hua , Feng Qi , Gan Liu , Shuang Yang

In the field of high-performance computing (HPC), there has been recent exploration into the use of deep reinforcement learning for cluster scheduling (DRL scheduling), which has demonstrated promising outcomes. However, a significant…

Machine Learning · Computer Science 2024-03-26 Boyang Li , Zhiling Lan , Michael E. Papka

In practice, it is quite common to face combinatorial optimization problems which contain uncertainty along with non-determinism and dynamicity. These three properties call for appropriate algorithms; reinforcement learning (RL) is dealing…

Artificial Intelligence · Computer Science 2020-11-10 Nathan Grinsztajn , Olivier Beaumont , Emmanuel Jeannot , Philippe Preux

Directed acyclic graph (DAG) tasks are currently adopted in the real-time domain to model complex applications from the automotive, avionics, and industrial domains that implement their functionalities through chains of intercommunicating…

Machine Learning · Computer Science 2024-01-12 Binqi Sun , Mirco Theile , Ziyuan Qin , Daniele Bernardini , Debayan Roy , Andrea Bastoni , Marco Caccamo

Efficiently scheduling data processing jobs on distributed compute clusters requires complex algorithms. Current systems, however, use simple generalized heuristics and ignore workload characteristics, since developing and tuning a…

Machine Learning · Computer Science 2019-08-23 Hongzi Mao , Malte Schwarzkopf , Shaileshh Bojja Venkatakrishnan , Zili Meng , Mohammad Alizadeh

Coflow is a recently proposed networking abstraction to help improve the communication performance of data-parallel computing jobs. In multi-stage jobs, each job consists of multiple coflows and is represented by a Directed Acyclic Graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-22 Xin Wang , Hong Shen

Deep Reinforcement Learning (DRL) is a frequently employed technique to solve scheduling problems. Although DRL agents ace at delivering viable results in short computing times, their reasoning remains opaque. We conduct a case study where…

Artificial Intelligence · Computer Science 2024-09-02 Daniel Fischer , Hannah M. Hüsener , Felix Grumbach , Lukas Vollenkemper , Arthur Müller , Pascal Reusch

Deep Reinforcement Learning (DRL) techniques have been successfully applied for solving complex decision-making and control tasks in multiple fields including robotics, autonomous driving, healthcare and natural language processing. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-07 Amanda Jayanetti , Saman Halgamuge , Rajkumar Buyya

This study addresses the challenge of resource scheduling optimization in edge-cloud collaborative computing using deep reinforcement learning (DRL). The proposed DRL-based approach improves task processing efficiency, reduces overall…

Machine Learning · Computer Science 2025-04-30 Yuqing Wang , Xiao Yang

Dependency-aware job scheduling in the cluster is NP-hard. Recent work shows that Deep Reinforcement Learning (DRL) is capable of solving it. It is difficult for the administrator to understand the DRL-based policy even though it achieves…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-21 Shaojun Zhang , Chen Wang , Albert Zomaya

Cloud computing has revolutionized the provisioning of computing resources, offering scalable, flexible, and on-demand services to meet the diverse requirements of modern applications. At the heart of efficient cloud operations are job…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yan Gu , Zhaoze Liu , Shuhong Dai , Cong Liu , Ying Wang , Shen Wang , Georgios Theodoropoulos , Long Cheng

Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced…

Soft real-time applications are becoming increasingly complex, posing significant challenges for scheduling offloaded tasks in edge computing environments while meeting task timing constraints. Moreover, the exponential growth of the search…

Machine Learning · Computer Science 2025-06-11 Amin Avan , Akramul Azim , Qusay Mahmoud

We are interested in the optimal scheduling of a collection of multi-component application jobs in an edge computing system that consists of geo-distributed edge computing nodes connected through a wide area network. The scheduling and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-24 Zhi Cao , Honggang Zhang , Yu Cao , Benyuan Liu

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

Machine Learning · Computer Science 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

As the quantity and complexity of information processed by software systems increase, large-scale software systems have an increasing requirement for high-performance distributed computing systems. With the acceleration of the Internet in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Guangyao Zhou , Wenhong Tian , Rajkumar Buyya , Ruini Xue , Liang Song

In scheduling problems common in the industry and various real-world scenarios, responding in real-time to disruptive events is essential. Recent methods propose the use of deep reinforcement learning (DRL) to learn policies capable of…

Artificial Intelligence · Computer Science 2024-01-31 Imanol Echeverria , Maialen Murua , Roberto Santana

Edge computing plays an essential role in the vehicle-to-infrastructure (V2I) networks, where vehicles offload their intensive computation tasks to the road-side units for saving energy and reduce the latency. This paper designs the optimal…

Networking and Internet Architecture · Computer Science 2025-12-08 Xinyu You , Haojie Yan , Yuedong Xu , Lifeng Wang , Liangui Dai

Discovering causal structure among a set of variables is a fundamental problem in many empirical sciences. Traditional score-based casual discovery methods rely on various local heuristics to search for a Directed Acyclic Graph (DAG)…

Machine Learning · Computer Science 2020-06-09 Shengyu Zhu , Ignavier Ng , Zhitang Chen

Many real-time applications (e.g., Augmented/Virtual Reality, cognitive assistance) rely on Deep Neural Networks (DNNs) to process inference tasks. Edge computing is considered a key infrastructure to deploy such applications, as moving…

‹ Prev 1 2 3 10 Next ›