English

Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them?

Artificial Intelligence 2024-09-04 v2 Computers and Society

Abstract

New capabilities in foundation models are owed in large part to massive, widely-sourced, and under-documented training data collections. Existing practices in data collection have led to challenges in tracing authenticity, verifying consent, preserving privacy, addressing representation and bias, respecting copyright, and overall developing ethical and trustworthy foundation models. In response, regulation is emphasizing the need for training data transparency to understand foundation models' limitations. Based on a large-scale analysis of the foundation model training data landscape and existing solutions, we identify the missing infrastructure to facilitate responsible foundation model development practices. We examine the current shortcomings of common tools for tracing data authenticity, consent, and documentation, and outline how policymakers, developers, and data creators can facilitate responsible foundation model development by adopting universal data provenance standards.

Keywords

Cite

@article{arxiv.2404.12691,
  title  = {Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them?},
  author = {Shayne Longpre and Robert Mahari and Naana Obeng-Marnu and William Brannon and Tobin South and Katy Gero and Sandy Pentland and Jad Kabbara},
  journal= {arXiv preprint arXiv:2404.12691},
  year   = {2024}
}

Comments

ICML 2024 camera-ready version (Spotlight paper). 9 pages, 2 tables