English
Related papers

Related papers: Data-Intensive Workload Consolidation on Hadoop Di…

200 papers

This paper investigates co-scheduling algorithms for processing a set of parallel applications. Instead of executing each application one by one, using a maximum degree of parallelism for each of them, we aim at scheduling several…

Data Structures and Algorithms · Computer Science 2013-05-01 Guillaume Aupy , Manu Shantharam , Anne Benoit , Yves Robert , Padma Raghavan

In an edge-cloud system, mobile devices can offload their computation intensive tasks to an edge or cloud server to guarantee the quality of service or satisfy task deadline requirements. However, it is challenging to determine where tasks…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-08 Chuanchao Gao , Aryaman Shaan , Arvind Easwaran

We consider the problem of stragglers in distributed computing systems. Stragglers, which are compute nodes that unpredictably slow down, often increase the completion times of tasks. One common approach to mitigating stragglers is work…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-07 Tharindu Adikari , Haider Al-Lawati , Jason Lam , Zhenhua Hu , Stark C. Draper

Modern Infrastructure-as-a-Service Clouds operate in a competitive environment that caters to any user's requirements for computing resources. The sharing of the various types of resources by diverse applications poses a series of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-28 Evangelos Angelou , Konstantinos Kaffes , Athanasia Asiki , Georgios Goumas , Nectarios Koziris

The growing complexity and variety of Big Data platforms makes it both difficult and time consuming for all system users to properly setup and operate the systems. Another challenge is to compare the platforms in order to choose the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-28 Todor Ivanov , Sead Izberovic

With the explosive growth of big data, workloads tend to get more complex and computationally demanding. Such applications are processed on distributed interconnected resources that are becoming larger in scale and computational capacity.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Georgios L. Stavrinides , Helen D. Karatza

This survey article reviews the challenges associated with deploying and optimizing big data applications and machine learning algorithms in cloud data centers and networks. The MapReduce programming model and its widely-used open-source…

Networking and Internet Architecture · Computer Science 2019-10-03 Sanaa Hamid Mohamed , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

Consolidation of loose packages into transport units is a fundamental activity offered by logistics service-providers. Moving the transport units instead of loose packages is faster (with one movement only, multiple packages are loaded…

Optimization and Control · Mathematics 2022-10-24 Enrico Angelelli , Claudia Archetti , Lorenzo Peirano

We study the problem of optimizing the cost of content delivery in a cooperative network of caches at end-nodes. The caches could be, for example, within the computers of users downloading videos from websites (such as Netflix, Blockbuster…

Networking and Internet Architecture · Computer Science 2012-09-11 A. Majumder , Sharad Jaiswal , K. V. M. Naidu , Nisheeth Shrivastava

Underutilization of computing resources and high power consumption are two primary challenges in the domain of Cloud resource management. This paper deals with these challenges through offline, migration impact-aware, multi-objective…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-22 Md Hasanul Ferdaus , Manzur Murshed , Rodrigo N. Calheiros , Rajkumar Buyya

Cloud service providers are distributing data centers geographically to minimize energy costs through intelligent workload distribution. With increasing data volumes in emerging cloud workloads, it is critical to factor in the network costs…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-02 Ninad Hogade , Sudeep Pasricha , Howard Jay Siegel

As cloud computing services rapidly expand their customer base, it has become important to share cloud resources, so as to provide them economically. In cloud computing services, multiple types of resources, such as processing ability,…

Networking and Internet Architecture · Computer Science 2012-04-06 Shin-ichi Kuribayashi

The trend of massive connectivity pushes forward the explosive growth of end devices. The emergence of various applications has prompted a demand for pervasive connectivity and more efficient computing paradigms. On the other hand, the lack…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Zelin Ji , Zhijin Qin

While advanced analysis of large dataset is in high demand, data sizes have surpassed capabilities of conventional software and hardware. Hadoop framework distributes large datasets over multiple commodity servers and performs parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-17 Woo-Hyun Lee , Hee-Gook Jun , Hyoung-Joo Kim

Analyzing large datasets with distributed dataflow systems requires the use of clusters. Public cloud providers offer a large variety and quantity of resources that can be used for such clusters. However, picking the appropriate resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-28 Jonathan Will , Jonathan Bader , Lauritz Thamsen

Capability jobs (e.g., large, long-running tasks) and capacity jobs (e.g., small, short-running tasks) are two common types of workloads in high-performance computing (HPC). Different HPC systems are typically deployed to handle distinct…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-23 Zhong Zheng , Michael E. Papka , Zhiling Lan

Multicore processors constitute the main architecture choice for modern computing systems in different market segments. Despite their benefits, the contention that naturally appears when multiple applications compete for the use of shared…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-13 Adrián García-García , Juan Carlos Sáez , Fernando Castro , Manuel Prieto-Matías

We consider a parallel system of $m$ identical machines prone to unpredictable crashes and restarts, trying to cope with the continuous arrival of tasks to be executed. Tasks have different computational requirements (i.e., processing time…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-21 Elli Zavou , Antonio Fernández Anta

Despite file-distribution applications are responsible for a major portion of the current Internet traffic, so far little effort has been dedicated to study file distribution from the point of view of energy efficiency. In this paper, we…

Networking and Internet Architecture · Computer Science 2011-11-22 Kshitiz Verma , Gianluca Rizzo , Antonio Fernández Anta , Rubén Cuevas Rumín , Arturo Azcorra

Mobile edge computing provides users with a cloud environment close to the edge of the wireless network, supporting the computing intensive applications that have low latency requirements. The combination of offloading with the wireless…

Systems and Control · Electrical Eng. & Systems 2021-03-08 Ruoyun Chen , Hancheng Lu , Pengfei Ma