English
Related papers

Related papers: Using Provenance to support Good Laboratory Practi…

200 papers

To benefit from the abundance of data and the insights it brings data processing pipelines are being used in many areas of research and development in both industry and academia. One approach to automating data processing pipelines is the…

Cryptography and Security · Computer Science 2023-10-18 Ludwig Stage , Dimka Karastoyanova

Provenance for database queries or scientific workflows is often motivated as providing explanation, increasing understanding of the underlying data sources and processes used to compute the query, and reproducibility, the capability to…

Programming Languages · Computer Science 2014-08-13 James Cheney , Amal Ahmed , Umut A. Acar

Recently the International Virtual Observatory Alliance (IVOA) released a standard to structure provenance metadata, and several implementations are in development in order to capture, store, access and visualize the provenance of astronomy…

Instrumentation and Methods for Astrophysics · Physics 2021-01-22 Mathieu Servillat , François Bonnarel , Mireille Louys , Michèle Sanguillon

The recent approval of the General Data Protection Regulation (GDPR) imposes new data protection requirements on data controllers and processors with respect to the processing of European Union (EU) residents' data. These requirements…

Cryptography and Security · Computer Science 2017-06-15 Ricardo Neisse , Gary Steri , Igor Nai-Fovino

Despite the widespread adoption of computational notebooks, little is known about best practices for their usage in collaborative contexts. In this paper, we fill this gap by eliciting a catalog of best practices for collaborative data…

Human-Computer Interaction · Computer Science 2022-02-16 Luigi Quaranta , Fabio Calefato , Filippo Lanubile

A standard model for exposing structured provenance metadata of scientific assertions on the Semantic Web would increase interoperability, discoverability, reliability, as well as reproducibility for scientific discourse and evidence-based…

As the demand for large scale AI models continues to grow, the optimization of their training to balance computational efficiency, execution time, accuracy and energy consumption represents a critical multidimensional challenge. Achieving…

Machine Learning · Computer Science 2025-07-03 Gabriele Padovani , Valentine Anantharaj , Sandro Fiore

Researchers and scientists use aggregations of data from a diverse combination of sources, including partners, open data providers and commercial data suppliers. As the complexity of such data ecosystems increases, and in turn leads to the…

Computers and Society · Computer Science 2019-04-10 Iain Barclay , Alun Preece , Ian Taylor , Dinesh Verma

Interactive notebooks, such as Jupyter, have revolutionized the field of data science by providing an integrated environment for data, code, and documentation. However, their adoption by robotics researchers and model developers has been…

Computational Engineering, Finance, and Science · Computer Science 2024-05-15 Rolando Garcia

Provenance encodes information that connects datasets, their generation workflows, and associated metadata (e.g., who or when executed a query). As such, it is instrumental for a wide range of critical governance applications (e.g.,…

Research is an incremental, iterative process, with new results relying and building upon previous ones. Scientists need to find, retrieve, understand, and verify results in order to confidently extend them, even when the results are their…

Computation · Statistics 2023-06-30 Gabriel Becker , Sara E. Moore , Michael Lawrence

Trusting simulation output is crucial for Sandia's mission objectives. We rely on these simulations to perform our high-consequence mission tasks given national treaty obligations. Other science and modeling applications, while they may…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-13 Jay Lofstead , Joshua Baker , Andrew Younge

Visualisation facilitates the understanding of scientific data both through exploration and explanation of visualised data. Provenance contributes to the understanding of data by containing the contributing factors behind a result. With the…

Databases · Computer Science 2015-02-06 Bilal Arshad , Kamran Munir , Richard McClatchey , Saad Liaquat

Machine learning (ML) is an increasingly important scientific tool supporting decision making and knowledge generation in numerous fields. With this, it also becomes more and more important that the results of ML experiments are…

Machine Learning · Computer Science 2020-06-23 Sheeba Samuel , Frank Löffler , Birgitta König-Ries

Recording the provenance of scientific computation results is key to the support of traceability, reproducibility and quality assessment of data products. Several data models have been explored to address this need, providing…

Reproducibility is a fundamental requirement of the scientific process since it enables outcomes to be replicated and verified. Computational scientific experiments can benefit from improved reproducibility for many reasons, including…

Databases · Computer Science 2019-09-04 Maria Luiza Mondelli , A. Townsend Peterson , Luiz M. R. Gadelha

The laboratories and research institutes are the major places for cutting-edge scientific exploration. Hundreds of millions of research papers were formed from front-line labs. Behind this glorious achievement were unsustainable facts. More…

Signal Processing · Electrical Eng. & Systems 2022-03-03 Nan Xu , Jingchen Li , Yue Yu , Yang Li , Jinglei Yang

In recent years, the research community has raised serious questions about the reproducibility of scientific work. In particular, since many studies include some kind of computing work, reproducibility is also a technological challenge, not…

Software Engineering · Computer Science 2023-08-03 Lázaro Costa , Susana Barbosa , Jácome Cunha

For data-centric systems, provenance tracking is particularly important when the system is open and decentralised, such as the Web of Linked Data. In this paper, a concise but expressive calculus which models data updates is presented. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-08-24 Gabriel Ciobanu , Ross Horne