English
Related papers

Related papers: Using Cloud-Aware Provenance to Reproduce Scientif…

200 papers

Increasingly, more software services have been published onto the Internet, making it a big challenge to recommend services in the process of a scientific workflow composition. In this paper, a novel context-aware approach is proposed to…

Software Engineering · Computer Science 2024-04-02 Xihao Xie , Jia Zhang , Rahul Ramachandran , Tsengdar J. Lee , Seungwon Lee

Ensuring the reproducibility of scientific work is crucial as it allows the consistent verification of scientific claims and facilitates the advancement of knowledge by providing a reliable foundation for future research. However,…

Software Engineering · Computer Science 2025-04-14 Lázaro Costa , Susana Barbosa , Jácome Cunha

Realistic, relevant, and reproducible experiments often need input traces collected from real-world environments. We focus in this work on traces of workflows---common in datacenters, clouds, and HPC infrastructures. We show that the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-12 Laurens Versluis , Roland Mathá , Sacheendra Talluri , Tim Hegeman , Radu Prodan , Ewa Deelman , Alexandru Iosup

Providing an appropriate level of accessibility to and tracking of data or process elements in large volumes of medical data, is an essential requirement in the Big Data era. Researchers require systems that provide traceability of…

Databases · Computer Science 2015-12-01 Richard McClatchey , Jetendr Shamdasani , Andrew Branson , Kamran Munir , Zsolt Kovacs

Reproducibility is a fundamental requirement of the scientific process since it enables outcomes to be replicated and verified. Computational scientific experiments can benefit from improved reproducibility for many reasons, including…

Databases · Computer Science 2019-09-04 Maria Luiza Mondelli , A. Townsend Peterson , Luiz M. R. Gadelha

Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define multiple processing steps into a single script and let the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Dong Dai , Robert Ross , Dounia Khaldi , Yonghong Yan , Matthieu Dorier , Neda Tavakoli , Yong Chen

With the growing amount of data, data processing workloads and the management of their resource usage becomes increasingly important. Since managing a dedicated infrastructure is in many situations infeasible or uneconomical, users…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-19 Dominik Scheinert , Alireza Alamgiralem , Jonathan Bader , Jonathan Will , Thorsten Wittkopp , Lauritz Thamsen

To reproduce eScience, several challenges need to be solved: scientific workflows need to be automated; the involved software versions need to be provided in an unambiguous way; input data needs to be easily accessible; High-Performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Kessy Abarenkov , Anne Fouilloux , Helmut Neukirchen , Abdulrahman Azab

Workflow provenance typically assumes that each module is a "black-box", so that each output depends on all inputs (coarse-grained dependencies). Furthermore, it does not model the internal state of a module, which can change between…

Databases · Computer Science 2012-01-04 Yael Amsterdamer , Susan B. Davidson , Daniel Deutch , Tova Milo , Julia Stoyanovich , Val Tannen

Provenance is an increasing concern due to the ongoing revolution in sharing and processing scientific data on the Web and in other computer systems. It is proposed that many computer systems will need to become provenance-aware in order to…

Programming Languages · Computer Science 2014-01-06 Umut A. Acar , Amal Ahmed , James Cheney , Roly Perera

Recent reproducibility case studies have raised concerns showing that much of the deposited research has not been reproducible. One of their conclusions was that the way data repositories store research data and code cannot fully facilitate…

Digital Libraries · Computer Science 2020-06-18 Ana Trisovic , Philip Durbin , Tania Schlatter , Gustavo Durand , Sonia Barbosa , Danny Brooke , Mercè Crosas

Function-as-a-Service is a novel type of cloud service used for creating distributed applications and utilizing computing resources. Application developer supplies source code of cloud functions, which are small applications or application…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 Maciej Pawlik , Kamil Figiela , Maciej Malawski

Recent trends within computational and data sciences show an increasing recognition and adoption of computational workflows as tools for productivity and reproducibility that also democratize access to platforms and processing know-how. As…

In recent years the need to simplify or to hide sensitive information in provenance has given way to research on provenance abstraction. In the context of scientific workflows, existing research provides techniques to semi automatically…

Software Engineering · Computer Science 2016-05-24 Pinar Alper , Khalid Belhajjame , Carole A. Goble

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

The method of flow tracing follows the power flow from net-generating sources through the network to the net-consuming sinks, which allows to assign the usage of the underlying transmission infrastructure to the system participants. This…

Physics and Society · Physics 2017-11-09 Jonas Hörsch , Mirko Schäfer , Sarah Becker , Stefan Schramm , Martin Greiner

Scientists today collect, analyze, and generate TeraBytes and PetaBytes of data. These data are often shared and further processed and analyzed among collaborators. In order to facilitate sharing and data interpretations, data need to carry…

Instrumentation and Methods for Astrophysics · Physics 2010-05-18 Ewa Deelman , Bruce Berriman , Ann Chervenak , Oscar Corcho , Paul Groth , Luc Moreau

The proliferation of commercial cloud computing providers has generated significant interest in the scientific computing community. Much recent research has attempted to determine the benefits and drawbacks of cloud computing for scientific…

Instrumentation and Methods for Astrophysics · Physics 2016-11-15 Gideon Juve , Ewa Deelman , Karan Vahi , Gaurang Mehta , Bruce Berriman , Benjamin P. Berman , Phil Maechling

Scientific research increasingly depends on robust and scalable IT infrastructures to support complex computational workflows. With the proliferation of services provided by research infrastructures, NRENs, and commercial cloud providers,…

Cloud computing has emerged as a crucial solution for handling data- and compute-intensive workflows, offering scalability to address dynamic demands. However, ensuring the secure execution of workflows in the untrusted multi-cloud…

Cryptography and Security · Computer Science 2023-10-04 Nafiseh Soveizi , Dimka Karastoyanova