English
Related papers

Related papers: Learning to Optimize DAG Scheduling in Heterogeneo…

200 papers

A growing number of applications like probabilistic machine learning, sparse linear algebra, robotic navigation, etc., exhibit irregular data flow computation that can be modeled with directed acyclic graphs (DAGs). The irregularity arises…

Hardware Architecture · Computer Science 2022-10-25 Nimish Shah , Wannes Meert , Marian Verhelst

CPU-GPU heterogeneous architectures are now commonly used in a wide variety of computing systems from mobile devices to supercomputers. Maximizing the throughput for multi-programmed workloads on such systems is indispensable as one single…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Issa Saba , Eishi Arima , Dai Liu , Martin Schulz

We consider the problem of learning multiple tasks in a continual learning setting in which data from different tasks is presented to the learner in a streaming fashion. A key challenge in this setting is the so-called "catastrophic…

Machine Learning · Computer Science 2023-09-22 Christiaan Lamers , Rene Vidal , Nabil Belbachir , Niki van Stein , Thomas Baeck , Paris Giampouras

This work studies fixed priority (FP) scheduling of real-time jobs with end-to-end deadlines in a distributed system. Specifically, given a multi-stage pipeline with multiple heterogeneous resources of the same type at each stage, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-21 Niraj Kumar , Chuanchao Gao , Arvind Easwaran

Recently, coding has been a useful technique to mitigate the effect of stragglers in distributed computing. However, coding in this context has been mainly explored under the assumption of homogeneous workers, although the real-world…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-18 DaeJin Kim , Hyegyeong Park , Junkyun Choi

Recovering underlying Directed Acyclic Graph (DAG) structures from observational data is highly challenging due to the combinatorial nature of the DAG-constrained optimization problem. Recently, DAG learning has been cast as a continuous…

Machine Learning · Computer Science 2022-12-23 Zhen Zhang , Ignavier Ng , Dong Gong , Yuhang Liu , Ehsan M Abbasnejad , Mingming Gong , Kun Zhang , Javen Qinfeng Shi

In this paper, we~present a novel scheduling solution for a class of System-on-Chip (SoC) systems where heterogeneous chip resources (DSP, FPGA, GPU, etc.) must be efficiently scheduled for continuously arriving hierarchical jobs with their…

Artificial Intelligence · Computer Science 2020-06-08 Tegg Taekyong Sung , Jeongsoo Ha , Jeewoo Kim , Alex Yahja , Chae-Bong Sohn , Bo Ryu

Background: Clustering of nodes in Bayesian Networks (BNs) and related graphical models such as Dynamic BNs (DBNs) has been demonstrated to enhance computational efficiency and improve model learning. It typically involves partitioning the…

Data Structures and Algorithms · Computer Science 2025-12-24 Paul Pao-Yen Wu , Fabrizio Ruggeri , Kerrie Mengersen

Multi-access edge computing (MEC) aims to extend cloud service to the network edge to reduce network traffic and service latency. A fundamental problem in MEC is how to efficiently offload heterogeneous tasks of mobile applications from…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-27 Jin Wang , Jia Hu , Geyong Min , Albert Y. Zomaya , Nektarios Georgalas

The increased use of deep learning (DL) in academia, government and industry has, in turn, led to the popularity of on-premise and cloud-hosted deep learning platforms, whose goals are to enable organizations utilize expensive resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Vaibhav Saxena , K. R. Jayaram , Saurav Basu , Yogish Sabharwal , Ashish Verma

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance limitation. To this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou

This work addresses the problem of learning directed acyclic graphs (DAGs) from nodal observations generated by a linear structural equation model. DAG learning is a central task in signal processing, machine learning, and causal inference,…

Machine Learning · Computer Science 2026-05-20 Samuel Rey , Madeline navarro , Gonzalo Mateos

In the era of Internet of Things, there is an increasing demand for networked computing to support the requirements of the time-constrained, compute-intensive distributed applications such as multi-camera video processing and data fusion…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-24 Pradipta Ghosh , Quynh Nguyen , Pranav K Sakulkar , Aleksandra Knezevic , Jason A. Tran , Jiatong Wang , Zhifeng Lin , Bhaskar Krishnamachari , Murali Annavaram , Salman Avestimehr

Effective resource utilization and decreased makespan in heterogeneous High Performance Computing (HPC) environments are key benefits of workload mapping and scheduling. Tools such as Snakemake, a workflow management solution, employ…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-03 Aasish Kumar Sharma , Julian Kunkel

Distributed applications, such as database queries and distributed training, consist of both compute and network tasks. DAG-based abstraction primarily targets compute tasks and has no explicit network-level scheduling. In contrast, Coflow…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-16 Weitao Wang , Sushovan Das , Xinyu Crystal Wu , Zhuang Wang , Ang Chen , T. S. Eugene Ng

Federated Learning provides new opportunities for training machine learning models while respecting data privacy. This technique is based on heterogeneous devices that work together to iteratively train a model while never sharing their own…

Artificial Intelligence · Computer Science 2020-10-02 Laércio Lima Pilla

Modern embedded systems have made the transition from single-core to multi-core architectures, providing performance improvement via parallelism rather than higher clock frequencies. DAGs are considered among the most generic task models in…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-05 José Marinho , Stefan M. Petters

As wireless services and applications become more sophisticated and require faster and higher-capacity networks, there is a need for an efficient management of the execution of increasingly complex tasks based on the requirements of each…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-22 Jungyeon Baek , Georges Kaddoum

Federated Learning (FL) enables collaborative intelligence across decentralized data source devices in a privacy-preserving way. While substantial research attention has been drawn to optimizing the learning process for an individual task,…

Machine Learning · Computer Science 2026-05-04 Md Sirajul Islam , Isabelle G Chapman , N I Md Ashafuddula , Xu Yuan , Li Chen , Nian-Feng Tzeng , Klara Nahrstedt

Artificial intelligence and distributed algorithms have been widely used in mechanical fault diagnosis with the explosive growth of diagnostic data. A novel intelligent fault diagnosis system framework that allows intelligent terminals to…

Information Theory · Computer Science 2023-02-16 Liang Yu , Qixin Guo , Rui Wang , Minyan Shi , Fucheng Yan , Ran Wang