English
Related papers

Related papers: Hybrid Job-driven Scheduling for Virtual MapReduce…

200 papers

When parallelizing a set of jobs across many servers, one must balance a trade-off between granting priority to short jobs and maintaining the overall efficiency of the system. When the goal is to minimize the mean flow time of a set of…

Performance · Computer Science 2020-11-24 Benjamin Berg , Rein Vesilo , Mor Harchol-Balter

Many cluster management systems (CMSs) have been proposed to share a single cluster with multiple distributed computing systems. However, none of the existing approaches can handle distributed machine learning (ML) workloads given the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-19 Peng Sun , Yonggang Wen , Ta Nguyen Binh Duong , Shengen Yan

As grids are in essence heterogeneous, dynamic, shared and distributed environments, managing these kinds of platforms efficiently is extremely complex. A promising scalable approach to deal with these intricacies is the design of…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-04 Sanjay Patel , Madhuri Bhavsar

Network virtualization is a way to simultaneously run multiple heterogeneous architectures on a shared substrate. The main issue in the virtualization of networks is the problem of mapping virtual networks to the substrate network. How to…

Networking and Internet Architecture · Computer Science 2020-05-18 Amir Javadpour , Guojun Wang , Xiaofei Xing

By opportunistically engaging mobile users (workers), mobile crowdsensing (MCS) networks have emerged as important approach to facilitate sharing of sensed/gathered data of heterogeneous mobile devices. To assign tasks among workers and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-21 Houyi Qi , Minghui Liwang , Seyyedali Hosseinalipour , Xiaoyu Xia , Zhipeng Cheng , Xianbin Wang , Zhenzhen Jiao

As more IoT applications gradually move towards the cloud-edge collaborative mode, the containerized scheduling of workflows extends from the cloud to the edge. However, given the high delay of the communication network, loose coupling of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-03 Chenggang Shan , Runze Gao , Qinghua Han , Zhen Yang , Jinhui Zhang , Yuanqing Xia

This paper proposes a novel Variational Graph-to-Scheduler (VG2S) framework for solving the Job Shop Scheduling Problem (JSSP), a critical task in manufacturing that directly impacts operational efficiency and resource utilization.…

Machine Learning · Computer Science 2026-02-04 Seung Heon Oh , Jiwon Baek , Ki Young Cho , Hee Chang Yoon , Jong Hun Woo

Extreme dynamic heterogeneity in high performance computing systems and the convergence of traditional HPC with new simulation, analysis, and data science approaches impose increasingly more complex requirements on resource and job…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-09 Daniel J. Milroy , Claudia Misale , Stephen Herbein , Dong H. Ahn

Several works related to spatial crowdsourcing have been proposed in the direction where the task executers are to perform the tasks within the stipulated deadlines. Though the deadlines are set, it may be a practical scenario that majority…

Computational Engineering, Finance, and Science · Computer Science 2024-02-08 Naren Debnath , Sajal Mukhopadhyay , Fatos Xhafa

We consider a scheduling problem where machines need to be rented from the cloud in order to process jobs. There are two types of machines available which can be rented for machine-type dependent prices and for arbitrary durations. However,…

Data Structures and Algorithms · Computer Science 2016-12-22 Alexander Mäcker , Manuel Malatyali , Friedhelm Meyer auf der Heide , Sören Riechers

Cloud-based computing infrastructure provides an efficient means to support real-time processing workloads, e.g., virtualized base station processing, and collaborative video conferencing. This paper addresses resource allocation for a…

Networking and Internet Architecture · Computer Science 2016-03-08 Yuhuan Du , Gustavo de Veciana

The demand for stringent interactive quality-of-service has intensified in both mobile edge computing (MEC) and cloud systems, driven by the imperative to improve user experiences. As a result, the processing of computation-intensive tasks…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-28 Ngoc Hung Nguyen , Van-Dinh Nguyen , Anh Tuan Nguyen , Nguyen Van Thieu , Hoang Nam Nguyen , Symeon Chatzinotas

MapReduce is emerged as a prominent programming model for data-intensive computation. In this work, we study power-aware MapReduce scheduling in the speed scaling setting first introduced by Yao et al. [FOCS 1995]. We focus on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-13 Evripidis Bampis , Vincent Chau , Dimitrios Letsios , Giorgio Lucarelli , Ioannis Milis , Georgios Zois

Distributed computing enables Internet of vehicle (IoV) services by collaboratively utilizing the computing resources from the network edge and the vehicles. However, the computing interruption issue caused by frequent edge network…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-09 Qiqi Ren , Omid Abbasi , Gunes Karabulut Kurt , Halim Yanikomeroglu , Jian Chen

With the rapid proliferation of streaming services, network load exhibits highly time-varying and bursty behavior, posing serious challenges for maintaining Quality of Service (QoS) in Crowdsourced Cloud-Edge Platforms (CCPs). While CCPs…

Machine Learning · Computer Science 2025-08-20 Tiancheng Zhang , Cheng Zhang , Shuren Liu , Xiaofei Wang , Shaoyuan Huang , Wenyu Wang

Scheduling Bag-of-Tasks (BoT) applications on the cloud can be more challenging than grid and cluster environ- ments. This is because a user may have a budgetary constraint or a deadline for executing the BoT application in order to keep…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-15 Long Thai , Blesson Varghese , Adam Barker

This paper addresses key challenges in task scheduling for multi-tenant distributed systems, including dynamic resource variation, heterogeneous tenant demands, and fairness assurance. An adaptive scheduling method based on reinforcement…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-13 Xiaopei Zhang , Xingang Wang , Xin Wang

MapReduce framework is the de facto in big data and its applications where a big data-set is split into small data chunks that are replicated on different servers among thousands of servers. The heterogeneous server structure of the system…

Performance · Computer Science 2019-04-02 Amir Moaddeli , Iman Nabati Ahmadi , Negin Abhar

Task scheduling as an effective strategy can improve application performance on computing resource-limited devices over distributed networks. However, existing evaluation mechanisms fail to depict the complexity of diverse applications,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-01 Xuwei Fan , Zhipeng Cheng , Ning Chen , Lianfen Huang , Xianbin Wang

Computational Grid is enormous environments with heterogeneous resources and stable infrastructures among other Internet-based computing systems. However, the managing of resources in such systems has its special problems. Scheduler systems…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-07 Asgarali Bouyer , Mohammad Javad hoseyni , Abdul Hanan Abdullah