English
Related papers

Related papers: Using Cloud-Aware Provenance to Reproduce Scientif…

200 papers

Scientists rely on simulations to study natural phenomena. Trusting the simulation results is vital to develop sciences in any field. One approach to build trust is to ensure the reproducibility and traceability of the simulations through…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-21 Paula Olaya , Jay Lofstead , Michela Taufer

The increasing availability of cloud computing services for science has changed the way scientific code can be developed, deployed, and run. Many modern scientific workflows are capable of running on cloud computing resources. Consequently,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-11 Peter Vaillancourt , Bennett Wineholt , Brandon Barker , Plato Deliyannis , Jackie Zheng , Akshay Suresh , Adam Brazier , Rich Knepper , Rich Wolski

Machine Learning (ML) has already fundamentally changed several businesses. More recently, it has also been profoundly impacting the computational science and engineering domains, like geoscience, climate science, and health science. In…

The reproducibility of scientific experiment is vital for the advancement of disciplines based on previous work. To achieve this goal, many researchers focus on complex methodology and self-invented tools which have difficulty in practical…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-29 Feng Zhao , Xingzhi Niu , Shao-Lun Huang , Lin Zhang

Cloud-native is an approach to building and running scalable applications in modern cloud infrastructures, with the Kubernetes container orchestration platform being often considered as a fundamental cloud-native building block. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-29 Michal Orzechowski , Bartosz Balis , Krzysztof Janecki

Capturing the history of operations and activities during a computational workflow is significantly important for Earth Observation (EO). The data provenance helps to collect the metadata that records the lineage of data products, providing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-11 H. Omidi , L. Sacco , V. Hutter , G. Irsiegler , M. Claus , M. Schobben , A. Jacob , M. Schramm , S. Fiore

Provenance is derivative journal information about the origin and activities of system data and processes. For a highly dynamic system like the cloud, provenance can be accurately detected and securely used in cloud digital forensic…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-22 Asif Imran , Nadia Nahar , Kazi Sakib

Conducting experiments and documenting results is daily business of scientists. Good and traceable documentation enables other scientists to confirm procedures and results for increased credibility. Documentation and scientific conduct are…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-12-15 Miriam Ney , Guy K. Kloss , Andreas Schreiber

Infrastructure as a service clouds hide the complexity of maintaining the physical infrastructure with a slight disadvantage: they also hide their internal working details. Should users need knowledge about these details e.g., to increase…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-20 Gabor Kecskemeti , Zsolt Nemeth , Attila Kertesz , Rajiv Ranjan

Provenance is the derivation history of information about the origin of data and processes. For a highly dynamic system such as the cloud, provenance must be effectively detected to be used as proves to ensure accountability during digital…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-22 Asif Imran , Emon Kumar Dey , Kazi Sakib

Reproducibility of computationally-derived scientific discoveries should be a certainty. As the product of several person-years' worth of effort, results -- whether disseminated through academic journals, conferences or exploited through…

Computational Engineering, Finance, and Science · Computer Science 2015-06-17 Tom Crick , Benjamin A. Hall , Samin Ishtiaq

Modern scientific workflows require hybrid infrastructures combining numerous decentralized resources on the IoT/Edge interconnected to Cloud/HPC systems (aka the Computing Continuum) to enable their optimized execution. Understanding and…

The rapid growth of global data volumes has created a demand for scalable distributed systems that can maintain a high quality of service. Data replication is a widely used technique that provides fault tolerance, improved performance and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-25 Amir Najjar , Riad Mokadem , Jean-Marc Pierson

We outline the approach being developed in the neuGRID project to use provenance management techniques for the purposes of capturing and preserving the provenance data that emerges in the specification and execution of workflows in…

We outline the approach being developed in the neuGRID project to use provenance management techniques for the purposes of capturing and preserving the provenance data that emerges in the specification and execution of workflows in…

Sharing provenance across workflow management systems automatically is not currently possible, but the value of such a capability is high since it could greatly reduce the amount of duplicated workflows, accelerate the discovery of new…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-17 Jay Jay Billings

Advances in sequencing techniques have led to exponential growth in biological data, demanding the development of large-scale bioinformatics experiments. Because these experiments are computation- and data-intensive, they require…

Ensuring the trustworthiness and long-term verifiability of scientific data is a foundational challenge in the era of data-intensive, collaborative research. Provenance metadata plays a key role in this context, capturing the origin,…

Networking and Internet Architecture · Computer Science 2025-06-02 Nicola Giuseppe Marchioro , Yannis Velegrakis , Valentine Anantharaj , Ian Foster , Sandro Luigi Fiore

Progress in science is deeply bound to the effective use of high-performance computing infrastructures and to the efficient extraction of knowledge from vast amounts of data. Such data comes from different sources that follow a cycle…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-15 Rosa M Badia , Jorge Ejarque , Francesc Lordan , Daniele Lezzi , Javier Conejero , Javier Álvarez Cid-Fuentes , Yolanda Becerra , Anna Queralt

Scientific workflows are widely used to automate scientific data analysis and often involve processing large quantities of data on compute clusters. As such, their execution tends to be long-running and resource intensive, leading to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Kathleen West , Fabian Lehmann , Vasilis Bountris , Ulf Leser , Yehia Elkhatib , Lauritz Thamsen