English
Related papers

Related papers: Optimization Opportunities for Cloud-Based Data Pi…

200 papers

Modern organizations manage their data with a wide variety of specialized cloud database engines (e.g., Aurora, BigQuery, etc.). However, designing and managing such infrastructures is hard. Developers must consider many possible designs…

Databases · Computer Science 2024-07-31 Geoffrey X. Yu , Ziniu Wu , Ferdi Kossmann , Tianyu Li , Markos Markakis , Amadou Ngom , Samuel Madden , Tim Kraska

In recent past, big data opportunities have gained much momentum to enhance knowledge management in organizations. However, big data due to its various properties like high volume, variety, and velocity can no longer be effectively stored…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-16 Mohammad Shorfuzzaman

Cloud data pipelines increasingly operate under dynamic workloads, evolving schemas, cost constraints, and strict governance requirements. Despite advances in cloud-native orchestration frameworks, most production pipelines rely on static…

In recent years, cloud computing has been widely used. Cloud computing refers to the centralized computing resources, users through the access to the centralized resources to complete the calculation, the cloud computing center will return…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-28 Yifan Zhang , Bo Liu , Yulu Gong , Jiaxin Huang , Jingyu Xu , Weixiang Wan

In today's information technology (IT) era, a major part of the costs is being spent on computational needs. Enterprises are in efforts to increase their Return on Investment (ROI) and individuals are trying to reduce their costs. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-05 Amin Keshavarzi , Abolfazl T. Haghighat , Mahdi Bohlouli

After the advent of the Internet of Things and 5G networks, edge computing became the center of attraction. The tasks demanding high computation are generally offloaded to the cloud since the edge is resource-limited. The Edge Cloud is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-21 Hassan Asghar , Eun-Sung Jung

The introduction of cloud data centres has opened new possibilities for the storage and processing of data, augmenting the limited capabilities of peripheral devices. Large data centres tend to be located away from the end users which…

Networking and Internet Architecture · Computer Science 2020-04-14 Fatemah S. Behbehani , Mohamed Musa , Taisir Elgorashi , J. M. H. Elmirghani

Cloud Computing holds the potential to eliminate the requirements for setting up of high-cost computing infrastructure for the IT-based solutions and services that the industry uses. It promises to provide a flexible IT architecture,…

Cryptography and Security · Computer Science 2013-05-22 Rohit Bhadauria , Rituparna Chaki , Nabendu Chaki , Sugata Sanyal

Intelligent manufacturing is a new model that uses advanced technologies such as the Internet of Things, big data, and artificial intelligence to improve the efficiency and quality of manufacturing production. As an important support to…

Artificial Intelligence · Computer Science 2024-08-06 Cuixia Li , Liqiang Liu , Li Shi

Data pipelines are an integral part of various modern data-driven systems. However, despite their importance, they are often unreliable and deliver poor-quality data. A critical step toward improving this situation is a solid understanding…

Software Engineering · Computer Science 2023-09-14 Harald Foidl , Valentina Golendukhina , Rudolf Ramler , Michael Felderer

In this article we look at the potential of cloud containers and we provide some guidelines for companies and organisations that are starting to look at how to migrate their legacy infrastructure to something modern, reliable and scalable.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-04 Damiano Perri , Marco Simonetti , Sergio Tasso , Federico Ragni , Osvaldo Gervasi

The input data pipeline is an essential component of each machine learning (ML) training job. It is responsible for reading massive amounts of training data, processing batches of samples using complex transformations, and loading them onto…

Machine Learning · Computer Science 2024-11-28 Mark Zhao , Emanuel Adamiak , Christos Kozyrakis

Data warehouse performance is usually achieved through physical data structures such as indexes or materialized views. In this context, cost models can help select a relevant set ofsuch performance optimization structures. Nevertheless,…

The landscape of cloud computing has significantly changed over the last decade. Not only have more providers and service offerings crowded the space, but also cloud infrastructure that was traditionally limited to single provider data…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-11 Blesson Varghese , Rajkumar Buyya

Nowadays cloud computing adoption as a form of hosted application and services is widespread due to decreasing costs of hardware, software, and maintenance. Cloud enables access to a shared pool of virtual resources hosted in large…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-14 Niloofar Gholipour , Ehsan Arianyan , Rajkumar Buyya

Despite the de-facto technological uniformity fostered by the cloud and edge computing paradigms, resource fragmentation across isolated clusters hinders the dynamism in application placement, leading to suboptimal performance and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-26 Marco Iorio , Fulvio Risso , Alex Palesandro , Leonardo Camiciotti , Antonio Manzalini

The convergence of IoT, Edge, Cloud, and HPC technologies creates a compute continuum that merges cloud scalability and flexibility with HPC's computational power and specialized optimizations. However, integrating cloud and HPC resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-20 Aasish Kumar Sharma , Christian Boehme , Patrick Gelß , Ramin Yahyapour , Julian Kunkel

Cloud computing is offering utility-oriented IT services to users worldwide. Based on a pay-as-you-go model, it enables hosting of pervasive applications from consumer, scientific, and business domains. However, data centers hosting Cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-06-03 Rajkumar Buyya , Anton Beloglazov , Jemal Abawajy

Cloud Computing is a paradigm of both parallel processing and distributed computing. It offers computing facilities as a utility service in pay as par use manner. Virtualization, self service provisioning, elasticity and pay per use are the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-20 Syed Arshad Ali , Mansaf Alam

This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-26 Rajkumar Buyya , Maria A. Rodriguez , Adel Nadjaran Toosi , Jaeman Park