English
Related papers

Related papers: Trustworthy Scheduling for Big Data Applications

200 papers

We propose an approach to utilize idle computational resources of supercomputers. The idea is to maintain an additional queue of low-priority non-parallel jobs and execute them in containers, using container migration tools to break the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Julia Dubenskaya , Stanislav Polyakov

Scheduled batch jobs have been widely used on the asynchronous computing platforms to execute various enterprise applications, including the scheduled notifications and the candidate pre-computation for the modern recommender systems. It is…

Machine Learning · Computer Science 2022-12-06 Yang Liu , Juan Wang , Zhengxing Chen , Ian Fox , Imani Mufti , Jason Sukumaran , Baokun He , Xiling Sun , Feng Liang

After the advent of the Internet of Things and 5G networks, edge computing became the center of attraction. The tasks demanding high computation are generally offloaded to the cloud since the edge is resource-limited. The Edge Cloud is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-21 Hassan Asghar , Eun-Sung Jung

High performance computing (HPC) is undergoing significant changes. The emerging HPC applications comprise both compute- and data-intensive applications. To meet the intense I/O demand from emerging data-intensive applications, burst…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-11 Yuping Fan , Zhiling Lan , Paul Rich , William E. Allcock , Michael E. Papka , Brian Austin , David Paul

Modern applications increasingly rely on inference serving systems to provide low-latency insights with a diverse set of machine learning models. Existing systems often utilize resource elasticity to scale with demand. However, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Joel Wolfrath , Daniel Frink , Abhishek Chandra

Cloud computing is a new archetype that provides dynamic computing services to cloud users through the support of datacenters that employs the services of datacenter brokers which discover resources and assign them Virtually. The focus of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-29 J. Kok Konjaang , J. Y. Maipan-uku , Kumangkem Kennedy Kubuga

With the increasing and elastic demand for cloud resources, finding an optimal task scheduling mechanism become a challenge for cloud service providers. Due to the time-varying nature of resource demands in length and processing over time…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-14 Seyedakbar Mostafavi , Vesal Hakami

Virtualization technology has enabled applications to be decoupled from the underlying hardware providing the benefits of portability, better control over execution environment and isolation. It has been widely adopted in scientific grids…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-09-27 Omer Khalid , Ivo Maljevic , Richard Anthony , Miltos Petridis , Kevin Parrot , Markus Schulz

The primary motivation for uptake of virtualization has been resource isolation, capacity management and resource customization allowing resource providers to consolidate their resources in virtual machines. Various approaches have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-09-27 Omer Khalid , Ivo Maljevic , Richard Anthony , Miltos Petridis , Kevin Parrot , Markus Schulz

Task graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-18 Jakub Beránek , Stanislav Böhm , Vojtěch Cima

Multi-access Edge Computing (MEC) is a type of network architecture that provides cloud computing capabilities at the edge of the network. We consider the use case of video surveillance for an university campus running on a 5G-MEC…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-28 Ricardo N. Boing , Hugo Vaz Sampaio , Fernando Koch , Rene N. S. Cruz , Carlos B. Westphall

Lightweight containers provide an efficient approach for deploying computation-intensive applications in network edge. The layered storage structure of container images can further reduce the deployment cost and container startup time.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-05 Zhiqing Tang , Wentao Peng , Jianxiong Guo , Jiong Lou , Hanshuai Cui , Tian Wang , Yuan Wu , Weijia Jia

In the past few years, we have envisioned an increasing number of businesses start driving by big data analytics, such as Amazon recommendations and Google Advertisements. At the back-end side, the businesses are powered by big data…

Performance · Computer Science 2021-10-26 Ying Mao , Victoria Green , Jiayin Wang , Haoyi Xiong , Zhishan Guo

Organizations around the world schedule jobs (programs) regularly to perform various tasks dictated by their end users. With the major movement towards using a cloud computing infrastructure, our organization follows a hybrid approach with…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-23 Sunandita Patra , Mehtab Pathan , Mahmoud Mahfouz , Parisa Zehtabi , Wided Ouaja , Daniele Magazzeni , Manuela Veloso

The efficient management of complex distributed applications in the Cloud-Edge continuum, including their deployment on heterogeneous computing resources and run-time operations, presents significant challenges. Resource management…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-02 Amjad Ullah , Andras Markus , Hacı İsmail Aslan , Tamas Kiss , Jozsef Kovacs , James Deslauriers , Amy L. Murphy , Yiming Wang Odej Kao

Intelligent robots are designed to effectively navigate dynamic and unpredictable environments laden with moving mechanical elements and objects. Such environment-induced dynamics, including moving obstacles, can readily alter the…

Robotics · Computer Science 2023-08-30 Zexin Li , Tao Ren , Xiaoxi He , Cong Liu

With the explosive growth of big data, workloads tend to get more complex and computationally demanding. Such applications are processed on distributed interconnected resources that are becoming larger in scale and computational capacity.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Georgios L. Stavrinides , Helen D. Karatza

With the proliferation of the Internet of Things (IoT) and the wide penetration of wireless networks, the surging demand for data communications and computing calls for the emerging edge computing paradigm. By moving the services and…

Networking and Internet Architecture · Computer Science 2021-08-19 Quyuan Luo , Shihong Hu , Changle Li , Guanghui Li , Weisong Shi

Cloud computing is an attractive technology for providing computing resources over the Internet. Task scheduling is a critical issue in cloud computing, where an efficient task scheduling method can improve overall cloud performance. Since…

Multiagent Systems · Computer Science 2024-01-05 Yikun Yang , Fenghui Ren , Minjie Zhang

This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-26 Rajkumar Buyya , Maria A. Rodriguez , Adel Nadjaran Toosi , Jaeman Park