English
Related papers

Related papers: Efficiently Verifiable Proofs of Data Attribution

200 papers

As large language models are increasingly trained and fine-tuned, practitioners need methods to identify which training data drive specific behaviors, particularly unintended ones. Training Data Attribution (TDA) methods address this by…

Attribution explanation is a typical approach for explaining deep neural networks (DNNs), inferring an importance or contribution score for each input variable to the final output. In recent years, numerous attribution methods have been…

Machine Learning · Computer Science 2025-08-12 Huiqi Deng , Hongbin Pei , Quanshi Zhang , Mengnan Du

In an emerging computing paradigm, computational capabilities, from processing power to storage capacities, are offered to users over communication networks as a cloud-based service. There, demanding computations are outsourced in order to…

Symbolic Computation · Computer Science 2018-07-24 Jean-Guillaume Dumas

Real-world data is often incomplete and contains missing values. To train accurate models over real-world datasets, users need to spend a substantial amount of time and resources imputing and finding proper values for missing data items. In…

Machine Learning · Statistics 2024-03-05 Cheng Zhen , Nischal Aryal , Arash Termehchy , Alireza Aghasi , Amandeep Singh Chabada

Feature attribution methods are popular in interpretable machine learning. These methods compute the attribution of each input feature to represent its importance, but there is no consensus on the definition of "attribution", leading to…

Machine Learning · Computer Science 2021-12-16 Yilun Zhou , Serena Booth , Marco Tulio Ribeiro , Julie Shah

Goldwasser et al. (2021) recently proposed the setting of PAC verification, where a hypothesis (machine learning model) that purportedly satisfies the agnostic PAC learning objective is verified using an interactive proof. In this paper we…

Machine Learning · Statistics 2023-09-06 Saachi Mutreja , Jonathan Shafer

Trustworthy answer content is abundant in many high-resource languages and is instantly accessible through question answering systems, yet this content can be hard to access for those that do not speak these languages. The leap forward in…

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

As statistical analyses become more central to science, industry and society, there is a growing need to ensure correctness of their results. Approximate correctness can be verified by replicating the entire analysis, but can we verify…

Computational Complexity · Computer Science 2024-09-11 Tal Herman , Guy Rothblum

The goal of data attribution is to trace model predictions back to training data. Despite a long line of work towards this goal, existing approaches to data attribution tend to force users to choose between computational tractability and…

Machine Learning · Statistics 2023-04-04 Sung Min Park , Kristian Georgiev , Andrew Ilyas , Guillaume Leclerc , Aleksander Madry

The utility of an explanation method critically depends on its fidelity to the underlying machine learning model. Especially in high-stakes medical settings, clinicians and regulators require explanations that faithfully reflect the model's…

Machine Learning · Computer Science 2025-11-27 Kevin Iselborn , David Dembinsky , Adriano Lucieri , Andreas Dengel

We continue the study of doubly-efficient proof systems for verifying agnostic PAC learning, for which we obtain the following results. - We construct an interactive protocol for learning the $t$ largest Fourier characters of a given…

Computational Complexity · Computer Science 2024-04-15 Tom Gur , Mohammad Mahdi Jahanara , Mohammad Mahdi Khodabandeh , Ninad Rajgopal , Bahar Salamatian , Igor Shinkar

As the cloud computing paradigm has gained prominence, the need for verifiable computation has grown increasingly urgent. The concept of verifiable computation enables a weak client to outsource difficult computations to a powerful, but…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-02-23 Justin Thaler , Mike Roberts , Michael Mitzenmacher , Hanspeter Pfister

Online reinforcement learning (RL) excels in complex, safety-critical domains but suffers from sample inefficiency, training instability, and limited interpretability. Data attribution provides a principled way to trace model behavior back…

Machine Learning · Computer Science 2025-10-07 Yuzheng Hu , Fan Wu , Haotian Ye , David Forsyth , James Zou , Nan Jiang , Jiaqi W. Ma , Han Zhao

Machine learning systems are increasingly used to make decisions about people's lives, such as whether to give someone a loan or whether to interview someone for a job. This has led to considerable interest in making such machine learning…

Machine Learning · Computer Science 2017-10-13 Daniel McNamara , Cheng Soon Ong , Robert C. Williamson

Following the wide-spread adoption of machine learning models in real-world applications, the phenomenon of performativity, i.e. model-dependent shifts in the test distribution, becomes increasingly prevalent. Unfortunately, since models…

Machine Learning · Statistics 2026-01-21 Ivan Kirev , Lyuben Baltadzhiev , Nikola Konstantinov

How does the training data affect a model's behavior? This is the question we seek to answer with data attribution. The leading practical approaches to data attribution are based on influence functions (IF). IFs utilize a first-order Taylor…

Machine Learning · Computer Science 2025-09-11 Ittai Rubinstein , Samuel B. Hopkins

We study the role of interactivity in distributed statistical inference under information constraints, e.g., communication constraints and local differential privacy. We focus on the tasks of goodness-of-fit testing and estimation of…

Data Structures and Algorithms · Computer Science 2021-10-26 Jayadev Acharya , Clément L. Canonne , Yuhan Liu , Ziteng Sun , Himanshu Tyagi

The increasing complexity of AI systems has made understanding their behavior critical. Numerous interpretability methods have been developed to attribute model behavior to three key aspects: input features, training data, and internal…

Machine Learning · Computer Science 2025-05-30 Shichang Zhang , Tessa Han , Usha Bhalla , Himabindu Lakkaraju

Cloud computing platforms have created the possibility for computationally limited users to delegate demanding tasks to strong but untrusted servers. Verifiable computing algorithms help build trust in such interactions by enabling the…

Computational Complexity · Computer Science 2019-07-10 Saeid Sahraei , Mohammad Ali Maddah-Ali , Salman Avestimehr