English
Related papers

Related papers: Fast Capture of Cell-Level Provenance in Numpy

200 papers

Data provenance strives for explaining how the computation was performed by recording a trace of the execution. The provenance trace is useful across a wide-range of workflows to improve the dependability, security, and efficiency of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-03 Jörg Thalheim , Pramod Bhatotia , Christof Fetzer

The transformations, analyses and interpretations of data in scientific workflows are vital for the repeatability and reliability of scientific workflows. This provenance of scientific workflows has been effectively carried out in Grid…

Databases · Computer Science 2016-11-18 Khawar Hasham , Kamran Munir , Jetendr Shamdasani , Richard McClatchey

Nowadays, quickly evolving and delivering software through a continuous delivery process is a competitive advantage and a way to keep software updated in response to the frequent changes in customers' requirements. However, the faster the…

Software Engineering · Computer Science 2018-09-28 Felipe Curty , Troy Kohwalter , Vanessa Braganholo , Leonardo Murta

One of the most time-consuming tasks for developers is the comprehension of new code bases. An effective approach to aid this process is to label source code files with meaningful annotations, which can help developers understand the…

Software Engineering · Computer Science 2023-12-01 Cezar Sas , Andrea Capiluppi

Even though computational reproducibility is widely accepted as necessary for research validation and reuse, it is often not considered during the research process. This is because reproducibility tools are typically stand-alone and require…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-04 Ana Trisovic , Chris R. Jones , Ben Couturier , Marco Clemencic

Provenance is information about the origin, derivation, ownership, or history of an object. It has recently been studied extensively in scientific databases and other settings due to its importance in helping scientists judge data validity,…

Programming Languages · Computer Science 2008-12-03 James Cheney , Umut Acar , Amal Ahmed

Recent research in the field of computer vision strongly focuses on deep learning architectures to tackle image processing problems. Deep neural networks are often considered in complex image processing scenarios since traditional computer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Marcel P. Schilling , Luca Rettenberger , Friedrich Münke , Haijun Cui , Anna A. Popova , Pavel A. Levkin , Ralf Mikut , Markus Reischl

Conducting experiments and documenting results is daily business of scientists. Good and traceable documentation enables other scientists to confirm procedures and results for increased credibility. Documentation and scientific conduct are…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-12-15 Miriam Ney , Guy K. Kloss , Andreas Schreiber

We establish a translation between a formalism for dynamic programming over hypergraphs and the computation of semiring-based provenance for Datalog programs. The benefit of this translation is a new method for computing provenance for a…

Databases · Computer Science 2021-12-03 Yann Ramusat , Silviu Maniu , Pierre Senellart

Science is conducted collaboratively, often requiring the sharing of knowledge about computational experiments. When experiments include only datasets, they can be shared using Uniform Resource Identifiers (URIs) or Digital Object…

Databases · Computer Science 2018-06-19 Zhihao Yuan , Dai Hai Ton That , Siddhant Kothari , Gabriel Fils , Tanu Malik

Modern workflows run on increasingly heterogeneous computing architectures and with this heterogeneity comes additional complexity. We aim to apply the FAIR principles for research reproducibility by developing software to collect metadata…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-19 Polina Shpilker , Line Pouchard

Advances in sequencing techniques have led to exponential growth in biological data, demanding the development of large-scale bioinformatics experiments. Because these experiments are computation- and data-intensive, they require…

We introduce provenance networks, a novel class of neural models designed to provide end-to-end, training-data-driven explainability. Unlike conventional post-hoc methods, provenance networks learn to link each prediction directly to its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ali Kayyam , Anusha Madan Gopal , M. Anthony Lewis

Analytic provenance can be visually encoded to help users track their ongoing analysis trajectories, recall past interactions, and inform new analytic directions. Despite its significance, provenance is often hardwired into analytics…

Human-Computer Interaction · Computer Science 2025-05-20 Arpit Narechania , Shunan Guo , Eunyee Koh , Alex Endert , Jane Hoffswell

Provenance plays a crucial role in scientific workflow execution, for instance by providing data for failure analysis, real-time monitoring, or statistics on resource utilization for right-sizing allocations. The workflows themselves,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Vasilis Bountris , Lauritz Thamsen , Ulf Leser

We outline the approach being developed in the neuGRID project to use provenance management techniques for the purposes of capturing and preserving the provenance data that emerges in the specification and execution of workflows in…

We outline the approach being developed in the neuGRID project to use provenance management techniques for the purposes of capturing and preserving the provenance data that emerges in the specification and execution of workflows in…

With the ubiquity of computer vision in industry, the importance of image provenance is becoming more apparent. Provenance provides information about the origin and derivation of some resource, e.g., an image dataset, enabling users to…

Machine Learning · Computer Science 2026-03-31 Lynn Vonderhaar , Timothy Elvira , Tyler Thomas Procko , Omar Ochoa

Demand is growing for more accountability regarding the technological systems that increasingly occupy our world. However, the complexity of many of these systems - often systems-of-systems - poses accountability challenges. A key reason…

Computers and Society · Computer Science 2019-11-18 Jatinder Singh , Jennifer Cobbe , Chris Norval

Recording the provenance of scientific computation results is key to the support of traceability, reproducibility and quality assessment of data products. Several data models have been explored to address this need, providing…