English
Related papers

Related papers: Trustworthy Scheduling for Big Data Applications

200 papers

Large data and computing centers consume a significant share of the world's energy consumption. A prominent subset of the workloads in such centers are workflows with interdependent tasks, usually represented as directed acyclic graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Dominik Schweisgut , Anne Benoit , Yves Robert , Henning Meyerhenke

This paper presents Block, a distributed scheduling framework designed to optimize load balancing and auto-provisioning across instances in large language model serving frameworks by leveraging contextual information from incoming requests.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-14 Wei Da , Evangelia Kalyvianaki

Resource selection and task placement for distributed execution poses conceptual and implementation difficulties. Although resource selection and task placement are at the core of many tools and workflow systems, the methods are ad hoc…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-04 Matteo Turilli , Yadu Nand Babuji , Andre Merzky , Ming Tai Ha , Michael Wilde , Daniel S. Katz , Shantenu Jha

Many academic disciplines - including information systems, computer science, and operations management - face scheduling problems as important decision making tasks. Since many scheduling problems are NP-hard in the strong sense, there is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-26 Gerhard Rauchecker , Guido Schryen

A current trend in networking and cloud computing is to provide compute resources over widely dispersed places exemplified by initiatives like Network Function Virtualisation. This paves the way for a widespread service deployment and can…

Networking and Internet Architecture · Computer Science 2016-05-31 Matthias Keller , Holger Karl

Transaction scheduling is crucial to efficiently allocate shared resources in a conflict-free manner in distributed systems. We investigate the efficient scheduling of transactions in a network of fog-cloud computing model, where…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-14 Ramesh Adhikari , Costas Busch , Pavan Poudel

With rapidly increasing distributed deep learning workloads in large-scale data centers, efficient distributed deep learning framework strategies for resource allocation and workload scheduling have become the key to high-performance deep…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Feng Liang , Zhen Zhang , Haifeng Lu , Chengming Li , Victor C. M. Leung , Yanyi Guo , Xiping Hu

The availability of powerful microprocessors and high-speed networks as commodity components has enabled high performance computing on distributed systems (wide-area cluster computing). In this environment, as the resources are usually…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Rajkumar Buyya , David Abramson , Jon Giddy

Modern big data systems run on cloud environments where resources are shared amongst several users and applications. As a result, declarative user queries in these environments need to be optimized and executed over resources that…

Databases · Computer Science 2019-06-18 Alekh Jindal , Lalitha Viswanathan , Konstantinos Karanasos

In Cloud computing environment the resources are managed dynamically based on the need and demand for resources for a particular task. With a lot of challenges to be addressed our concern is Load balancing where load balancing is done for…

Networking and Internet Architecture · Computer Science 2020-10-02 Mohammad Riyaz Belgaum , Safeeullah Soomro , Zainab Alansari , Shahrulniza Musa , Muhammad Alam , Mazliham Mohd Su'ud

Scheduling Bag-of-Tasks (BoT) applications on the cloud can be more challenging than grid and cluster environ- ments. This is because a user may have a budgetary constraint or a deadline for executing the BoT application in order to keep…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-15 Long Thai , Blesson Varghese , Adam Barker

Industrial timetabling is a critical task for decision-makers across various sectors to ensure efficient system operation. In real-world settings, it remains challenging because unexpected events often disrupt execution. When such events…

Human-Computer Interaction · Computer Science 2026-01-13 Kévin Ducharlet , Liwen Zhang , Sara Maqrot , Houssem Saidi

Cloud Computing is the latest blooming technology in the era of Computer Science and Information Technology domain. There is an enormous pool of data centres, which are termed as Clouds where the services and associated data are being…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-30 Nallakumar R. , Sruthi Priya K. S

Crowdsourced software development (CSD) offers a series of specified tasks to a large crowd of trustworthy software workers. Topcoder is a leading platform to manage the whole process of CSD. While increasingly accepted as a realistic…

Software Engineering · Computer Science 2016-10-14 Muhammad Rezaul Karim , David Messinger , Ye Yang , Guenther Ruhe

Task and Motion Planning combines high-level task sequencing (what to do) with low-level motion planning (how to do it) to generate feasible, collision-free execution plans. However, in many real-world domains, such as automated warehouses,…

Robotics · Computer Science 2026-03-20 Elisa Tosello , Arthur Bit-Monnot , Davide Lusuardi , Alessandro Valentini , Andrea Micheli

We present a number of novel algorithms, based on mathematical optimization formulations, in order to solve a homogeneous multiprocessor scheduling problem, while minimizing the total energy consumption. In particular, for a system with a…

Operating Systems · Computer Science 2015-11-13 Mason Thammawichai , Eric C. Kerrigan

In this paper, a method for efficient scheduling to obtain optimum job throughput in a distributed campus grid environment is presented; Traditional job schedulers determine job scheduling using user and job resource attributes. User…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-07-15 Srirangam V Addepallil , Per Andersen , George L Barnes

Advance reservation is important to guarantee the quality of services of jobs by allowing exclusive access to resources over a defined time interval on resources. It is a challenge for the scheduler to organize available resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-06 Bo Li , Yijian Pei , Bin Shen , Hao Wu , Min He , Jundong Yang

Edge computing decentralizes computing resources, allowing for novel applications in domains such as the Internet of Things (IoT) in healthcare and agriculture by reducing latency and improving performance. This decentralization is achieved…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-17 Suhrid Gupta , Muhammed Tawfiqul Islam , Rajkumar Buyya

Many organizations routinely analyze large datasets using systems for distributed data-parallel processing and clusters of commodity resources. Yet, users need to configure adequate resources for their data processing jobs. This requires…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Jonathan Bader , Odej Kao