English
Related papers

Related papers: Provenance Tracking in Large-Scale Machine Learnin…

200 papers

Provenance information are essential for the traceability of scientific studies or experiments and thus crucial for ensuring the credibility and reproducibility of research findings. This paper discusses a comprehensive provenance framework…

Databases · Computer Science 2025-04-16 Tanja Auge , Sascha Genehr , Meike Klettke and , Frank Krüger , Max Schröder

Data provenance (the process of determining the origin and derivation of data outputs) has applications across multiple domains including explaining database query results and auditing scientific workflows. Despite decades of research,…

Databases · Computer Science 2026-05-15 Chrysanthi Kosyfaki , Ruiyuan Zhang , Nikos Mamoulis , Xiaofang Zhou

In the world of science new technology have opened up the possibility to rely on advanced computational methods and models to conduct and produce scientific research. An important aspect of scientific and business workflows is provenance -…

Software Engineering · Computer Science 2025-04-01 Ludwig Stage , Julia Dahlberg , Dimka Karastoyanova

Machine learning (ML) has the potential to revolutionize a wide range of research areas and industries, but many ML projects never progress past the proof-of-concept stage. To address this issue, we introduce Model Share AI (AIMS), an…

Software Engineering · Computer Science 2023-09-28 Heinrich Peters , Michael Parrott

Provenance has been thought of a mechanism to verify a workflow and to provide workflow reproducibility. This provenance of scientific workflows has been effectively carried out in Grid based scientific workflow systems. However, recent…

Databases · Computer Science 2015-12-01 Khawar Hasham , Kamran Munir , Richard McClatchey

Large-scale Machine Learning (ML) based Software Systems are increasingly developed by distributed teams situated in different trust domains. Insider threats can launch attacks from any domain to compromise ML assets (models and datasets).…

Software Engineering · Computer Science 2022-06-22 Nguyen Khoi Tran , Bushra Sabir , M. Ali Babar , Nini Cui , Mehran Abolhasan , Justin Lipman

Provenance refers to the documentation of an object's lifecycle. This documentation (often represented as a graph) should include all the information necessary to reproduce a certain piece of data or the process that led to it. In a dynamic…

Databases · Computer Science 2012-11-22 Seyed-Mehdi-Reza Beheshti , Hamid Reza Motahari-Nezhad , Boualem Benatallah

Effective provenance tracking enhances reproducibility, governance, and data quality in array workflows. However, significant challenges arise in capturing this provenance, including: (1) rapidly evolving APIs, (2) diverse operation types,…

Databases · Computer Science 2025-06-24 Jinjin Zhao , Sanjay Krishnan

With the ubiquity of computer vision in industry, the importance of image provenance is becoming more apparent. Provenance provides information about the origin and derivation of some resource, e.g., an image dataset, enabling users to…

Machine Learning · Computer Science 2026-03-31 Lynn Vonderhaar , Timothy Elvira , Tyler Thomas Procko , Omar Ochoa

Requirements traceability, the process of establishing and maintaining relationships between requirements and various software development artifacts, is paramount for ensuring system integrity and fulfilling requirements throughout the…

Software Engineering · Computer Science 2026-05-25 Nouf Alturayeif , Irfan Ahmad , Jameleddine Hassine

Large language models (LLMs) are trained through multi-stage pipelines over heterogeneous data sources, yet developers lack a principled way to pinpoint the specific data responsible for an observed behavior. This lack of observability…

Computation and Language · Computer Science 2026-03-19 Wenjie Jacky Mo , Qin Liu , Xiaofei Wen , Wenxuan Zhou , Zhe Zhao , Muhao Chen

The emergence of Cloud computing provides a new computing paradigm for scientific workflow execution. It provides dynamic, on-demand and scalable resources that enable the processing of complex workflow-based experiments. With the ever…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-20 Khawar Hasham , Kamran Munir , Richard McClatchey

Data provenance is essential for debugging query results, auditing data in cloud environments, and explaining outputs of Big Data analytics. A well-established technique is to represent provenance as annotations on data and to instrument…

Databases · Computer Science 2017-01-20 Xing Niu , Boris Glavic

LLMs have achieved remarkable fluency and coherence in text generation, yet their widespread adoption has raised concerns about content reliability and accountability. In high-stakes domains, it is crucial to understand where and how the…

Computation and Language · Computer Science 2025-06-02 Junnan Zhu , Min Xiao , Yining Wang , Feifei Zhai , Yu Zhou , Chengqing Zong

Modern scientific discovery increasingly relies on workflows that process data across the Edge, Cloud, and High Performance Computing (HPC) continuum. Comprehensive and in-depth analyses of these data are critical for hypothesis validation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-24 Renan Souza , Timothy Poteet , Brian Etz , Daniel Rosendo , Amal Gueroudji , Woong Shin , Prasanna Balaprakash , Rafael Ferreira da Silva

Understanding the life cycle of the machine learning (ML) model is an intriguing area of research (e.g., understanding where the model comes from, how it is trained, and how it is used). This paper focuses on a novel problem within this…

Machine Learning · Computer Science 2024-07-19 Xin Mu , Yu Wang , Yehong Zhang , Jiaqi Zhang , Hui Wang , Yang Xiang , Yue Yu

Multimodal large language models increasingly solve vision-centric tasks by calling external tools for visual inspection, OCR, retrieval, calculation, and multi-step reasoning. Current tool-using agents usually expose the executed tool…

Computation and Language · Computer Science 2026-05-12 Bihui Yu , Caijun Jia , Jing Chi , Xiaohan Liu , Yining Wang , He Bai , Yuchen Liu , Jingxuan Wei , Junnan Zhu

There has recently been a lot of ongoing research in the areas of fairness, bias and explainability of machine learning (ML) models due to the self-evident or regulatory requirements of various ML applications. We make the following…

Provenance for database queries or scientific workflows is often motivated as providing explanation, increasing understanding of the underlying data sources and processes used to compute the query, and reproducibility, the capability to…

Programming Languages · Computer Science 2014-08-13 James Cheney , Amal Ahmed , Umut A. Acar

Data provenance strives for explaining how the computation was performed by recording a trace of the execution. The provenance trace is useful across a wide-range of workflows to improve the dependability, security, and efficiency of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-03 Jörg Thalheim , Pramod Bhatotia , Christof Fetzer