English
Related papers

Related papers: Memory-aware Adaptive Scheduling of Scientific Wor…

200 papers

Taskflow aims to streamline the building of parallel and heterogeneous applications using a lightweight task graph-based approach. Taskflow introduces an expressive task graph programming model to assist developers in the implementation of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-08 Tsung-Wei Huang , Dian-Lun Lin , Chun-Xun Lin , Yibo Lin

Recent advances demonstrate that irregularly wired neural networks from Neural Architecture Search (NAS) and Random Wiring can not only automate the design of deep neural networks but also emit models that outperform previous manual…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-06 Byung Hoon Ahn , Jinwon Lee , Jamie Menjay Lin , Hsin-Pai Cheng , Jilei Hou , Hadi Esmaeilzadeh

Scientific workflow management systems like Nextflow support large-scale data analysis by abstracting away the details of scientific workflows. In these systems, workflows consist of several abstract tasks, of which instances are run in…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-20 Jonathan Bader , Lauritz Thamsen , Svetlana Kulagina , Jonathan Will , Henning Meyerhenke , Odej Kao

We present a number of novel algorithms, based on mathematical optimization formulations, in order to solve a homogeneous multiprocessor scheduling problem, while minimizing the total energy consumption. In particular, for a system with a…

Operating Systems · Computer Science 2015-11-13 Mason Thammawichai , Eric C. Kerrigan

Distributed applications, such as database queries and distributed training, consist of both compute and network tasks. DAG-based abstraction primarily targets compute tasks and has no explicit network-level scheduling. In contrast, Coflow…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-16 Weitao Wang , Sushovan Das , Xinyu Crystal Wu , Zhuang Wang , Ang Chen , T. S. Eugene Ng

We present DataFlow, a computational framework for building, testing, and deploying high-performance machine learning systems on unbounded time-series data. Traditional data science workflows assume finite datasets and require substantial…

Machine Learning · Computer Science 2026-01-01 Giacinto Paolo Saggese , Paul Smith

With the increasing amount of data available to scientists in disciplines as diverse as bioinformatics, physics, and remote sensing, scientific workflow systems are becoming increasingly important for composing and executing scalable data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-20 Jonathan Bader , Nils Diedrich , Lauritz Thamsen , Odej Kao

Task offloading and scheduling in Mobile Edge Computing (MEC) are vital for meeting the low-latency demands of modern IoT and dynamic task scheduling scenarios. MEC reduces the processing burden on resource-constrained devices by enabling…

Networking and Internet Architecture · Computer Science 2026-01-23 Arild Yonkeu , Mohammadreza Amini , Burak Kantarci

Effective resource utilization and decreased makespan in heterogeneous High Performance Computing (HPC) environments are key benefits of workload mapping and scheduling. Tools such as Snakemake, a workflow management solution, employ…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-03 Aasish Kumar Sharma , Julian Kunkel

Graph Neural Networks (GNNs) have shown significant promise in various domains, such as recommendation systems, bioinformatics, and network analysis. However, the irregularity of graph data poses unique challenges for efficient computation,…

Machine Learning · Computer Science 2024-11-26 Pol Puigdemont , Enrico Russo , Axel Wassington , Abhijit Das , Sergi Abadal , Maurizio Palesi

Task and motion planning (TAMP) for multi-robot systems, which integrates discrete task planning with continuous motion planning, remains a challenging problem in robotics. Existing TAMP approaches often struggle to scale effectively for…

Robotics · Computer Science 2025-04-30 Zhongqi Wei , Xusheng Luo , Changliu Liu

In this paper, to analyze end-to-end timing behavior in heterogeneous processor and network environments accurately, we adopt a heterogeneous selection value on communication contention (HSV_CC) algorithm, which can synchronize tasks and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-12 Jaeyong Rho , Takuya Azumi , Mayo Nakagawa , Kenya Sato , Nobuhiko Nishio

Modern computing paradigms, such as cloud computing, are increasingly adopting GPUs to boost their computing capabilities primarily due to the heterogeneous nature of AI/ML/deep learning workloads. However, the energy consumption of GPUs is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-29 Shashikant Ilager , Rajeev Muralidhar , Kotagiri Rammohanrao , Rajkumar Buyya

Datacenter networks routinely support the data transfers of distributed computing frameworks in the form of coflows, i.e., sets of concurrent flows related to a common task. The vast majority of the literature has focused on the problem of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-04 Quang-Trung Luu , Olivier Brun , Rachid El-Azouzi , Francesco De Pellegrini , Balakrishna J. Prabhu , Cédric Richier

Modern Hybrid Transactional/Analytical Processing (HTAP) systems use an integrated data processing engine that performs analytics on fresh data, which are ingested from a transactional engine. HTAP systems typically consider data freshness…

Databases · Computer Science 2020-04-15 Aunn Raza , Periklis Chrysogelos , Angelos Christos Anadiotis , Anastasia Ailamaki

Large language model systems are increasingly deployed as agentic workflows that interleave reasoning, tool use, memory, and iterative refinement. These systems are effective at producing answers, but they often rely on implicit…

Artificial Intelligence · Computer Science 2026-05-08 Josh Rosen , Seth Rosen

With the fast development of mobile edge computing (MEC), there is an increasing demand for running complex applications on the edge. These complex applications can be represented as workflows where task dependencies are explicitly…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-25 Xuejun Li , Tianxiang Chen , Dong Yuan , Jia Xu , Xiao Liu

We study the problem of efficiently scheduling a computational DAG on multiple processors. The majority of previous works have developed and compared algorithms for this problem in relatively simple models; in contrast to this, we analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-24 Pál András Papp , Georg Anegg , Aikaterini Karanasiou , A. N. Yzelman

Memory retrieval in agentic large language model (LLM) systems is often treated as a static lookup problem, relying on flat vector search or fixed binary relational graphs. However, fixed graph structures cannot capture the varying…

Artificial Intelligence · Computer Science 2026-05-12 Dongming Jiang , Yi Li , Guanpeng Li , Qiannan Li , Bingzhe Li

A variety of computing platform like Field Programmable Gate Array (FPGA), Graphics Processing Unit (GPU) and multicore Central Processing Unit (CPU) in data centers are suitable for acceleration of data-intensive workloads. Especially,…

Hardware Architecture · Computer Science 2023-11-21 Rourab Paul , Marco Danelutto