English
Related papers

Related papers: Scheduling Data Intensive Workloads through Virtua…

200 papers

Nowadays, data-centers are largely under-utilized because resource allocation is based on reservation mechanisms which ignore actual resource utilization. Indeed, it is common to reserve resources for peak demand, which may occur only for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-03 Francesco Pace , Dimitrios Milios , Damiano Carra , Daniele Venzano , Pietro Michiardi

Hadoop is an open source implementation of the MapReduce Framework in the realm of distributed processing. A Hadoop cluster is a unique type of computational cluster designed for storing and analyzing large data sets across cluster of…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-11-10 Muralikrishnan Ramane , Sharmila Krishnamoorthy , Sasikala Gowtham

Scheduling is important in Edge computing. In contrast to the Cloud, Edge resources are hardware limited and cannot support workload-driven infrastructure scaling. Hence, resource allocation and scheduling for the Edge requires a fresh…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-27 Arkadiusz Madej , Nan Wang , Nikolaos Athanasopoulos , Rajiv Ranjan , Blesson Varghese

We consider a distributed server system consisting of a large number of servers, each with limited capacity on multiple resources (CPU, memory, disk, etc.). Jobs with different rewards arrive over time and require certain amounts of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Konstantinos Psychas , Javad Ghaderi

Real-time systems are intrinsic components of many pivotal applications, such as self-driving vehicles, aerospace and defense systems. The trend in these applications is to incorporate multiple tasks onto fewer, more powerful hardware…

Operating Systems · Computer Science 2024-10-03 V. Gabriel Moyano , Zain A. H. Hammadeh , Selma Saidi , Daniel Lüdtke

Datacenter-based Cloud Computing services provide a flexible, scalable and yet economical infrastructure to host online services such as multimedia streaming, email and bulk storage. Many such services perform geo-replication to provide…

Networking and Internet Architecture · Computer Science 2018-01-16 Mohammad Noormohammadpour , Cauligi S. Raghavendra , Sriram Rao , Asad M. Madni

In data-intensive applications data transfer is a primary cause of job execution delay. Data access time depends on bandwidth. The major bottleneck to supporting fast data access in Grids is the high latencies of Wide Area Networks and…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-10-05 Somayeh Abdi , Hossein Pedram , Somayeh Mohamadi

The Hadoop scheduler is a centerpiece of Hadoop, the leading processing framework for data-intensive applications in the cloud. Given the impact of failures on the performance of applications running on Hadoop, testing and verifying the…

Software Engineering · Computer Science 2021-09-10 Mbarka Soualhia , Foutse Khomh , Sofiene Tahar

Current approaches to scheduling workloads on heterogeneous systems with specialized accelerators often rely on manual partitioning, offloading tasks with specific compute patterns to accelerators. This method requires extensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-12 Zhenyu Bai , Dan Wu , Pranav Dangi , Dhananjaya Wijerathne , Venkata Pavan Kumar Miriyala , Tulika Mitra

Large multi-tenant production clusters often have to handle a variety of jobs and applications with a variety of complex resource usage characteristics. It is non-trivial and non-optimal to manually create placement rules for scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-31 Subrata Mitra , Shanka Subhra Mondal , Nikhil Sheoran , Neeraj Dhake , Ravinder Nehra , Ramanuja Simha

When a computer system schedules jobs there is typically a significant cost associated with preempting a job during execution. This cost can be from the expensive task of saving the memory's state and loading data into and out of memory. It…

Data Structures and Algorithms · Computer Science 2018-03-01 Giorgio Lucarelli , Benjamin Moseley , Nguyen Kim Thang , Abhinav Srivastav , Denis Trystram

Optimizing data transfers is critical for improving job performance in data-parallel frameworks. In the hybrid data center with both wired and wireless links, reconfigurable wireless links can provide additional bandwidth to speed up job…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-26 Binquan Guo , Zhou Zhang , Ye Yan , Hongyan Li

Efficient task scheduling in large-scale distributed systems presents significant challenges due to dynamic workloads, heterogeneous resources, and competing quality-of-service requirements. Traditional centralized approaches face…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Daniel Benniah John

This paper proposes a novel approach to address the challenges of deploying complex robotic software in large-scale systems, i.e., Centralized Nonlinear Model Predictive Controllers (CNMPCs) for multi-agent systems. The proposed approach is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Achilleas Santi Seisa , Sumeet Gajanan Satpute , George Nikolakopoulos

In heterogeneous distributed computing (HC) systems, diversity can exist in both computational resources and arriving tasks. In an inconsistently heterogeneous computing system, task types have different execution times on heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-29 James Gentry , Chavit Denninnart , Mohsen Amini Salehi

Job scheduling for a MapReduce cluster has been an active research topic in recent years. However, measurement traces from real-world production environment show that the duration of tasks within a job vary widely. The overall elapsed time…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-13 Huanle Xu , Wing Cheong Lau

The operating system's role in a computer system is to manage the various resources. One of these resources is the Central Processing Unit. It is managed by a component of the operating system called the CPU scheduler. Schedulers are…

Operating Systems · Computer Science 2010-11-09 George Anderson , Tshilidzi Marwala , Fulufhelo V. Nelwamondo

Scheduling problems are a fundamental class of combinatorial optimization problems that underpin operational efficiency in manufacturing, logistics, and service systems. While operations research has traditionally developed solver-centric…

Optimization and Control · Mathematics 2026-02-03 Anbang Liu , Shaochong Lin , Jingchuan Chen , Peng Wu , Zuojun Max Shen

In a warehouse environment, tasks appear dynamically. Consequently, a task management system that matches them with the workforce too early (e.g., weeks in advance) is necessarily sub-optimal. Also, the rapidly increasing size of the action…

Machine Learning · Computer Science 2022-03-08 Diogo S. Carvalho , Biswa Sengupta

Performance-, power-, and energy-aware scheduling techniques play an essential role in optimally utilizing processing elements (PEs) of heterogeneous systems. List schedulers, a class of low-complexity static schedulers, have commonly been…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-17 Joshua Mack , Samet E. Arda , Umit Y. Ogras , Ali Akoglu