English
Related papers

Related papers: Reproducible and Portable Big Data Analytics in th…

200 papers

As the Lakehouse architecture becomes more widespread, ensuring the reproducibility of data workloads over data lakes emerges as a crucial concern for data engineers. However, achieving reproducibility remains challenging. The size of data…

Databases · Computer Science 2024-04-23 Jacopo Tagliabue , Ciro Greco

Whole Tale http://wholetale.org is a web-based, open-source platform for reproducible research supporting the creation, sharing, execution, and verification of "Tales" for the scientific research community. Tales are executable research…

With rapid growth in the amount of unstructured data produced by memory-intensive applications, large scale data analytics has recently attracted increasing interest. Processing, managing and analyzing this huge amount of data poses several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-29 Farshid Farhat , Diman Zad Tootaghaj , Mohammad Arjomand

Serverless computing is a widely adopted cloud execution model composed of Function-as-a-Service (FaaS) and Backend-as-a-Service (BaaS) offerings. The increased level of abstraction makes vendor lock-in inherent to serverless computing,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-29 Haidong Zhao , Zakaria Benomar , Tobias Pfandzelter , Nikolaos Georgantas

Cloud computing provides a great opportunity for scientists, as it enables large-scale experiments that cannot are too long to run on local desktop machines. Cloud-based computations can be highly parallel, long running and data-intensive,…

Software Engineering · Computer Science 2016-12-07 Maria Spichkova , Heinz W. Schmidt , Ian E. Thomas , Iman I. Yusuf , Steve Androulakis , Grischa R. Meyer

The execution of decentralized applications on blockchains is limited today by technical and organizational barriers, including scalability and the high complexity to specify execution correctly for developers as well as for domain experts…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-14 Felix Härer

There are many science applications that require scalable task-level parallelism and support for flexible execution and coupling of ensembles of simulations. Most high-performance system software and middleware, however, are designed to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-29 Vivekanandan Balasubramanian , Antons Treikalis , Ole Weidner , Shantenu Jha

The increasing availability of cloud computing services for science has changed the way scientific code can be developed, deployed, and run. Many modern scientific workflows are capable of running on cloud computing resources. Consequently,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-11 Peter Vaillancourt , Bennett Wineholt , Brandon Barker , Plato Deliyannis , Jackie Zheng , Akshay Suresh , Adam Brazier , Rich Knepper , Rich Wolski

Nearly twenty years after the launch of AWS, it remains difficult for most developers to harness the enormous potential of the cloud. In this paper we lay out an agenda for a new generation of cloud programming research aimed at bringing…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-13 Alvin Cheung , Natacha Crooks , Joseph M. Hellerstein , Mae Milano

Reproducibility remains a central challenge in computational social science, where complex workflows, evolving software ecosystems, and inconsistent documentation hinder researchers ability to re-execute published methods. This study…

Human-Computer Interaction · Computer Science 2026-03-04 Fakhri Momeni , Sarah Sajid , Johannes Kiesel

Cloud-native applications are intentionally designed for the cloud in order to leverage cloud platform features like horizontal scaling and elasticity - benefits coming along with cloud platforms. In addition to classical (and very often…

Software Engineering · Computer Science 2018-02-13 Peter-Christian Quint , Nane Kratzke

Moving legacy software systems to cloud platforms is an ever popular option. But, such an endeavour may not be hazard-free and demands a proper understanding of requirements and risks involved prior to taking any actions. The time is indeed…

Software Engineering · Computer Science 2020-04-24 Mahdi Fahmideh , Ghassan Beydoun

Science reproducibility is a cornerstone feature in scientific workflows. In most cases, this has been implemented as a way to exactly reproduce the computational steps taken to reach the final results. While these steps are often…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-21 Karan Vahi , Mats Rynge , George Papadimitriou , Duncan A. Brown , Rajiv Mayani , Rafael Ferreira da Silva , Ewa Deelman , Anirban Mandal , Eric Lyons , Michael Zink

Nowadays, the rapid increases of the scale and complexity of the controlled plants bring new challenges such as computing power and storage for conventional control systems. Cloud computing is concerned as a powerful solution to handle the…

Systems and Control · Electrical Eng. & Systems 2023-03-06 Runze Gao , Yuanqing Xia , Li Dai , Zhongqi Sun

The dynamic nature of resource allocation and runtime conditions on Cloud can result in high variability in a job's runtime across multiple iterations, leading to a poor experience. Identifying the sources of such variation and being able…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-10 Yiwen Zhu , Rathijit Sen , Robert Horton , John Mark , Agosta

Control planes of cloud frameworks trade off between scheduling granularity and performance. Centralized systems schedule at task granularity, but only schedule a few thousand tasks per second. Distributed systems schedule hundreds of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-05 Omid Mashayekhi , Hang Qu , Chinmayee Shah , Philip Levis

Cloud computing provisions computer resources at a cost-effective way based on demand. Therefore it has become a viable solution for big data analytics and artificial intelligence which have been widely adopted in various domain science.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-30 Naweiluo Zhou , Florent Dufour , Vinzent Bode , Peter Zinterhof , Nicolay J Hammer , Dieter Kranzlmüller

Cloud-based software systems are increasingly becoming complex and operating in highly dynamic environments. Self-adaptivity and self-awareness have recently emerged to cope with such level of dynamicity and scalability. Meanwhile,…

Software Engineering · Computer Science 2019-12-12 Maria Salama , Rami Bahsoon , Rajkumar Buyya

We consider robust resource allocation of services in Clouds. More specifically, we consider the case of a large public or private Cloud platform that runs a relatively small set of large and independent services. These services are…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-22 Olivier Beaumont , Lionel Eyraud-Dubois , Paul Renaud-Goud

Much like on-premises systems, the natural choice for running database analytics workloads in the cloud is to provision a cluster of nodes to run a database instance. However, analytics workloads are often bursty or low volume, leaving…

Databases · Computer Science 2019-11-27 Matthew Perron , Raul Castro Fernandez , David DeWitt , Samuel Madden