中文
相关论文

相关论文: Scalability vs. Utility: Do We Have to Sacrifice O…

200 篇论文

The Shapley value has become popular in the Explainable AI (XAI) literature, thanks, to a large extent, to a solid theoretical foundation, including four "favourable and fair" axioms for attribution in transferable utility games. The…

机器学习 · 计算机科学 2021-02-23 Daniel Fryer , Inga Strümke , Hien Nguyen

Large language models (LLMs) excel on new tasks without additional training, simply by providing natural language prompts that demonstrate how the task should be performed. Prompt ensemble methods comprehensively harness the knowledge of…

计算与语言 · 计算机科学 2024-12-17 Hanxi Liu , Xiaokai Mao , Haocheng Xia , Jian Lou , Jinfei Liu , Kui Ren

Model interpretability is one of the most intriguing problems in most of the Machine Learning models, particularly for those that are mathematically sophisticated. Computing Shapley Values are arguably the best approach so far to find the…

机器学习 · 统计学 2022-04-15 Indranil Basu , Subhadip Maji

Shapley values are widely used for model-agnostic data valuation and feature attribution, yet they implicitly assume contributors are interchangeable. This can be problematic when contributors are dependent (e.g., reused/augmented data or…

机器学习 · 计算机科学 2026-02-11 Kiljae Lee , Ziqi Liu , Weijing Tang , Yuan Zhang

Shapley data valuation provides a principled, axiomatic framework for assigning importance to individual datapoints, and has gained traction in dataset curation, pruning, and pricing. However, it is a combinatorial measure that requires…

机器学习 · 计算机科学 2025-11-05 Rodrigo Mendoza-Smith

The increasing complexity of foundational models underscores the necessity for explainability, particularly for fine-tuning, the most widely used training method for adapting models to downstream tasks. Instance attribution, one type of…

机器学习 · 计算机科学 2024-06-10 Jingtan Wang , Xiaoqiang Lin , Rui Qiao , Chuan-Sheng Foo , Bryan Kian Hsiang Low

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

机器学习 · 计算机科学 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

As data emerges as a vital driver of technological and economic advancements, a key challenge is accurately quantifying its value in algorithmic decision-making. The Shapley value, a well-established concept from cooperative game theory,…

计算机科学与博弈论 · 计算机科学 2025-11-20 Xi Zheng , Xiangyu Chang , Ruoxi Jia , Yong Tan

We consider the dataset valuation problem, that is, the problem of quantifying the incremental gain, to some relevant pre-defined utility of a machine learning task, of aggregating an individual dataset to others. The Shapley value is a…

人工智能 · 计算机科学 2025-02-25 Felipe Garrido-Lucero , Benjamin Heymann , Maxime Vono , Patrick Loiseau , Vianney Perchet

The Shapley value (SV) and Least core (LC) are classic methods in cooperative game theory for cost/profit sharing problems. Both methods have recently been proposed as a principled solution for data valuation tasks, i.e., quantifying the…

机器学习 · 计算机科学 2022-04-08 Tianhao Wang , Yu Yang , Ruoxi Jia

Shapley values are one of the main tools used to explain predictions of tree ensemble models. The main alternative to Shapley values are Banzhaf values that have not been understood equally well. In this paper we make a step towards filling…

机器学习 · 计算机科学 2021-08-10 Adam Karczmarz , Anish Mukherjee , Piotr Sankowski , Piotr Wygocki

Scalable oversight studies methods of training and evaluating AI systems in domains where human judgment is unreliable or expensive, such as scientific research and software engineering in complex codebases. Most work in this area has…

机器学习 · 计算机科学 2024-10-22 Alex Mallen , Nora Belrose

Data valuation aims to quantify the usefulness of individual data sources in training machine learning (ML) models, and is a critical aspect of data-centric ML research. However, data valuation faces significant yet frequently overlooked…

机器学习 · 计算机科学 2023-11-28 Jiachen T. Wang , Yuqing Zhu , Yu-Xiang Wang , Ruoxi Jia , Prateek Mittal

A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game…

机器学习 · 计算机科学 2020-06-29 Luke Merrick , Ankur Taly

Shapley-based data valuation provides a principled way to quantify the contribution of training data, but its high computational cost makes it impractical in dynamic settings where tasks and training players evolve. Existing methods treat…

机器学习 · 计算机科学 2026-05-21 Xuan Yang , Hsi-Wen Chen , Ming-Syan Chen , Jian Pei

The Shapley value---probably the most important normative payoff division scheme in coalitional games---has recently been advocated as a useful measure of centrality in networks. However, although this approach has a variety of real-world…

计算机科学与博弈论 · 计算机科学 2014-02-05 Tomasz Pawel Michalak , Karthik V Aadithya , Piotr L. Szczepanski , Balaraman Ravindran , Nicholas R. Jennings

Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive…

机器学习 · 统计学 2023-06-01 Salim I. Amoukou , Nicolas J-B. Brunel , Tangi Salaün

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

机器学习 · 计算机科学 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee

Structured pruning is a well-known technique to reduce the storage size and inference cost of neural networks. The usual pruning pipeline consists of ranking the network internal filters and activations with respect to their contributions…

机器学习 · 计算机科学 2020-06-03 Marco Ancona , Cengiz Öztireli , Markus Gross

The complex nature of artificial neural networks raises concerns on their reliability, trustworthiness, and fairness in real-world scenarios. The Shapley value -- a solution concept from game theory -- is one of the most popular explanation…

机器学习 · 计算机科学 2023-12-29 Jacopo Teneggi , Beepul Bharti , Yaniv Romano , Jeremias Sulam