English
Related papers

Related papers: Trustworthy Scheduling for Big Data Applications

200 papers

Stream processing is a computing paradigm that supports real-time data processing for a wide variety of applications. At Meta, it's used across the company for various tasks such as deriving product insights, providing and improving user…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-09 Animesh Dangwal , Yufeng Jiang , Charlie Arnold , Jun Fan , Mohamed Bassem , Aish Rajagopal

We study size-based schedulers, and focus on the impact of inaccurate job size information on response time and fairness. Our intent is to revisit previous results, which allude to performance degradation for even small errors on job size…

Data Structures and Algorithms · Computer Science 2014-07-28 Matteo Dell'Amico , Damiano Carra , Mario Pastorelli , Pietro Michiardi

Many modern schedulers can dynamically adjust their service capacity to match the incoming workload. At the same time, however, unpredictability and instability in service capacity often incur operational and infrastructure costs. In this…

Optimization and Control · Mathematics 2020-05-12 Yorie Nakahira , Andres Ferragut , Adam Wierman

In this paper we consider several constrained activity scheduling problems in the time and space domains, like finding activity orderings which optimize the values of several objective functions (time scheduling) or finding optimal…

Data Structures and Algorithms · Computer Science 2009-06-09 Madalina Ecaterina Andreica , Mugurel Ionut Andreica , Angela Andreica

In industrial contexts, effective workforce allocation is crucial for operational efficiency. This paper presents an ongoing project focused on developing a decision-making tool designed for workforce allocation, emphasising the…

The advantages of distributing workloads and utilizing multiple distributed resources are now well established. The type and degree of heterogeneity of distributed resources is increasing, and thus determining how to distribute the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-10 Ming Tai Ha , Matteo Turilli , Andre Merzky , Shantenu Jha

Many emerging Artificial Intelligence (AI) applications require on-demand provisioning of large-scale computing, which can only be enabled by leveraging distributed computing services interconnected through networking. To address such…

Networking and Internet Architecture · Computer Science 2024-07-09 Ruikun Wang , Jiawei Zhang , Qiaolun Zhang , Bojun Zhang , Zhiqun Gu , Aryanaz Attarpour , Yuefeng Ji , Massimo Tornatore

We consider a distributed computing network consisting of a master and multiple workers processing tasks of different types. The master is running multiple applications. Each application stochastically generates real-time jobs with a strict…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-31 Yu-Pin Hsu , Yu-Chih Huang , Shin-Lin Shieh

Algorithms for scheduling structured parallel computations have been widely studied in the literature. For some time now, Work Stealing is one of the most popular for scheduling such computations, and its performance has been studied in…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-26 Guilherme Rito , Hervé Paulino

We propose three novel mathematical optimization formulations that solve the same two-type heterogeneous multiprocessor scheduling problem for a real-time taskset with hard constraints. Our formulations are based on a global scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-13 Mason Thammawichai , Eric C. Kerrigan

Recently, physical layer security based approaches have drawn considerable attentions and are envisaged to provide secure communications in the wireless networks. However, most existing literatures only focus on the physical layer. Thus,…

Information Theory · Computer Science 2013-08-19 Jun Wang , Pengfei Huang , Xudong Wang

Large multi-tenant production clusters often have to handle a variety of jobs and applications with a variety of complex resource usage characteristics. It is non-trivial and non-optimal to manually create placement rules for scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-31 Subrata Mitra , Shanka Subhra Mondal , Nikhil Sheoran , Neeraj Dhake , Ravinder Nehra , Ramanuja Simha

Due to the increasing complexity seen in both workloads and hardware resources in state-of-the-art embedded systems, developing efficient real-time schedulers and the corresponding schedulability tests becomes rather challenging. Although…

Operating Systems · Computer Science 2020-07-13 Zelun Kong , Yaswanth Yadlapalli , Soroush Bateni , Junfeng Guo , Cong Liu

Making it intelligent is a promising way in System/OS design. This paper proposes OSML+, a new ML-based resource scheduling mechanism for co-located cloud services. OSML+ intelligently schedules the cache and main memory bandwidth resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-22 Xinglei Dou , Lei Liu , Limin Xiao

To improve the environmental implications of the growing demand of computing, future applications need to improve the carbon-efficiency of computing infrastructures. State-of-the-art approaches, however, do not consider the intermittent…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Young Geun Kim , Udit Gupta , Andrew McCrabb , Yonglak Son , Valeria Bertacco , David Brooks , Carole-Jean Wu

The design space of networked embedded systems is very large, posing challenges to the optimisation of such platforms when it comes to support applications with real-time guarantees. Recent research has shown that a number of inter-related…

Performance · Computer Science 2020-07-21 Leandro Soares Indrusiak , Robert I. Davis , Piotr Dziurzanski

Diverse workloads such as interactive supercomputing, big data analysis, and large-scale AI algorithm development, requires a high-performance scheduler. This paper presents a novel node-based scheduling approach for large scale simulations…

This paper proposes a novel approach to address the challenges of deploying complex robotic software in large-scale systems, i.e., Centralized Nonlinear Model Predictive Controllers (CNMPCs) for multi-agent systems. The proposed approach is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Achilleas Santi Seisa , Sumeet Gajanan Satpute , George Nikolakopoulos

Heterogeneity has grown in popularity both at the core and server level as a way to improve both performance and energy efficiency. However, despite these benefits, scheduling applications in heterogeneous machines remains challenging.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-19 Francisco Romero , Christina Delimitrou

Wireless powered mobile edge computing has been envisioned as a promising paradigm to enhance the computation capability of low-power wireless devices in Industrial Internet of Things. An efficient resource scheduling method is critical yet…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Hao Wu , Hui Tian , Shaoshuai Fan , Jiazhi Ren