English
Related papers

Related papers: Resource Management and Scheduling for Big Data Ap…

200 papers

Big data dictate their requirements to the hardware and software. Simple migration to the cloud data processing, while solving the problem of increasing computational capabilities, however creates some issues: the need to ensure the safety,…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-03 E. Nikulchev , E. Pluzhnik , D. Biryukov , O. Lukyanchikov , S. Payain

With the rapid growth and increasing complexity of industrial big data, traditional data processing methods are facing many challenges. This article takes an in-depth look at the application of cloud computing technology in industrial big…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-16 Ziyan Yao

This survey article reviews the challenges associated with deploying and optimizing big data applications and machine learning algorithms in cloud data centers and networks. The MapReduce programming model and its widely-used open-source…

Networking and Internet Architecture · Computer Science 2019-10-03 Sanaa Hamid Mohamed , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

Cloud computing is an established technology allowing users to share resources on a large scale, never before seen in IT history. A cloud system connects multiple individual servers in order to process related tasks in several environments…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Leszek Sliwko

Cloud Robotics is helping to create a new generation of robots that leverage the nearly unlimited resources of large data centers (i.e., the cloud), overcoming the limitations imposed by on-board resources. Different processing power,…

Robotics · Computer Science 2024-12-03 Saeid Alirezazadeh , Luís A. Alexandre

The soaring energy demands of large-scale software ecosystems and cloud data centers, accelerated by the intensive training and deployment of large language models, have driven energy consumption and carbon footprint to unprecedented…

Software Engineering · Computer Science 2025-08-11 Jialin Yang , Zainab Saad , Jiajun Wu , Xiaoguang Niu , Henry Leung , Steve Drew

Nowadays, an important topic that is considered a lot is how to integrate Machine Learning(ML) to cloud resources management. In this study, our goal is to explore the most important cloud resources management issues that have been combined…

Machine Learning · Computer Science 2021-01-29 V. N. Tsakalidou , P. Mitsou , G. A. Papakostas

Cloud computing has grown to become a popular distributed computing service offered by commercial providers. More recently, Edge and Fog computing resources have emerged on the wide-area network as part of Internet of Things (IoT)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-16 Prateeksha Varshney , Yogesh Simmhan

The widespread adoption of the large language model (LLM), e.g. Generative Pre-trained Transformer (GPT), deployed on cloud computing environment (e.g. Azure) has led to a huge increased demand for resources. This surge in demand poses…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-08 Yongkang Dang , Minxian Xu , Kejiang Ye

In cloud computing resource management plays a significant role in data centres and it is directly dependent on the application workload. Various services such as Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-26 Smruti Rekha Swain , Ashutosh Kumar Singh , Chung Nan Lee

As cloud computing usage grows, cloud data centers play an increasingly important role. To maximize resource utilization, ensure service quality, and enhance system performance, it is crucial to allocate tasks and manage performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-21 Nidhika Chauhan , Navneet Kaur , Kamaljit Singh Saini , Sahil Verma , Abdulatif Alabdulatif , Ruba Abu Khurma , Maribel Garcia-Arenas , Pedro A. Castillo

In Cloud computing environment the resources are managed dynamically based on the need and demand for resources for a particular task. With a lot of challenges to be addressed our concern is Load balancing where load balancing is done for…

Networking and Internet Architecture · Computer Science 2020-10-02 Mohammad Riyaz Belgaum , Safeeullah Soomro , Zainab Alansari , Shahrulniza Musa , Muhammad Alam , Mazliham Mohd Su'ud

The emergence of cloud computing over the past five years is potentially one of the breakthrough advances in the history of computing. It delivers hardware and software resources as virtualization-enabled services and in which…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-19 Rajiv Ranjan , Boualem Benatallah

Cloud data centers face increasing pressure to reduce operational energy consumption as big data workloads continue to grow in scale and complexity. This paper presents a workload aware and energy efficient scheduling framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Milan Parikh , Aniket Abhishek Soni , Sneja Mitinbhai Shah , Ayush Raj Jha

This document reports the sequence of practices and methodologies implemented during the Big Data course. It details the workflow beginning with the processing of the Epsilon dataset through group and individual strategies, followed by text…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-12 Julian Rodriguez , Piotr Lopez , Emiliano Lerma , Rafael Medrano , Jacobo Hernandez

Scheduling in Grid computing has been active area of research since its beginning. However, beginners find very difficult to understand related concepts due to a large learning curve of Grid computing. Thus, there is a need of concise…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-16 Harshadkumar B. Prajapati , Vipul A. Shah

This paper explores the essential areas of cybersecurity management for big data systems. Big data platform stems its complexity from being a collection of interrelated non-standardized systems that interact with each other to process large…

Cryptography and Security · Computer Science 2019-12-18 Shakir A. Almasaari

Cloud computing has motivated renewed interest in resource allocation problems with new consumption models. A common goal is to share a resource, such as CPU or I/O bandwidth, among distinct users with different demand patterns as well as…

Data Structures and Algorithms · Computer Science 2021-01-27 Sebastian Perez-Salazar , Ishai Menache , Mohit Singh , Alejandro Toriello

Big Data processing systems handle huge unstructured and structured data to store, process, and analyze through cluster analysis which helps in identifying unseen patterns to find the relationships between them. Clustering analysis over the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-11 Dipesh Gyawali

Recently, we have been witnessing huge advancements in the scale of data we routinely generate and collect in pretty much everything we do, as well as our ability to exploit modern technologies to process, analyze and understand this data.…

Databases · Computer Science 2017-09-25 Radwa Elshawi , Sherif Sakr