English
Related papers

Related papers: Play Fair: Frame Attributions in Video Models

200 papers

Accurate video understanding involves reasoning about the relationships between actors, objects and their environment, often over long temporal intervals. In this paper, we propose a message passing graph neural network that explicitly…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Anurag Arnab , Chen Sun , Cordelia Schmid

Explaining machine learning models is an important and increasingly popular area of research interest. The Shapley value from game theory has been proposed as a prime approach to compute feature importance towards model predictions on…

Machine Learning · Computer Science 2023-01-02 Shichang Zhang , Yozen Liu , Neil Shah , Yizhou Sun

Many existing approaches for estimating feature importance are problematic because they ignore or hide dependencies among features. A causal graph, which encodes the relationships among input variables, can aid in assigning feature…

Machine Learning · Computer Science 2021-03-01 Jiaxuan Wang , Jenna Wiens , Scott Lundberg

As diffusion models are deployed in real-world settings, and their performance is driven by training data, appraising the contribution of data contributors is crucial to creating incentives for sharing quality data and to implementing…

Machine Learning · Computer Science 2025-03-05 Chris Lin , Mingyu Lu , Chanwoo Kim , Su-In Lee

Image attribution analysis seeks to highlight the feature representations learned by visual models such that the highlighted feature maps can reflect the pixel-wise importance of inputs. Gradient integration is a building block in the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Róisín Luo , James McDermott , Colm O'Riordan

Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning. In this paper, we first discuss fundamental concepts of cooperative game theory and axiomatic…

Machine Learning · Computer Science 2022-05-27 Benedek Rozemberczki , Lauren Watson , Péter Bayer , Hao-Tsung Yang , Olivér Kiss , Sebastian Nilsson , Rik Sarkar

Shapley values are great analytical tools in game theory to measure the importance of a player in a game. Due to their axiomatic and desirable properties such as efficiency, they have become popular for feature importance analysis in data…

Machine Learning · Computer Science 2020-10-26 Ramin Okhrati , Aldo Lipani

The Shapley value is arguably the most central normative solution concept in cooperative game theory. It specifies a unique way in which the reward from cooperation can be "fairly" divided among players. While it has a wide range of real…

Computer Science and Game Theory · Computer Science 2014-02-14 Sasan Maleki , Long Tran-Thanh , Greg Hines , Talal Rahwan , Alex Rogers

Valuation problems, such as feature interpretation, data valuation and model valuation for ensembles, become increasingly more important in many machine learning applications. Such problems are commonly solved by well-known game-theoretic…

Machine Learning · Computer Science 2022-05-13 Yatao Bian , Yu Rong , Tingyang Xu , Jiaxiang Wu , Andreas Krause , Junzhou Huang

Cooperative game theory has become a cornerstone of post-hoc interpretability in machine learning, largely through the use of Shapley values. Yet, despite their widespread adoption, Shapley-based methods often rest on axiomatic…

Machine Learning · Statistics 2025-06-18 Marouane Il Idrissi , Agathe Fernandes Machado , Arthur Charpentier

Game-theoretic formulations of feature importance have become popular as a way to "explain" machine learning models. These methods define a cooperative game between the features of a model and distribute influence among these input elements…

Artificial Intelligence · Computer Science 2020-07-01 I. Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , Sorelle Friedler

In this paper, we address the problem of fair sharing of the total value of a crowd-sourced network system between major participants (founders) and minor participants (crowd) using cooperative game theory. Shapley allocation is regarded as…

Computer Science and Game Theory · Computer Science 2023-05-23 Mishal Assif P K , William Kennedy , Iraj Saniee

In this article, we provide an axiomatic characterization of feature attribution for multi-output predictors within the Shapley framework. While SHAP explanations are routinely computed independently for each output coordinate, the…

The latest developments in AI focus on agentic systems where artificial and human agents cooperate to realize global goals. An example is collaborative learning, which aims to train a global model based on data from individual agents. A…

Computer Science and Game Theory · Computer Science 2025-08-20 Björn Filter , Ralf Möller , Özgür Lütfü Özçep

The Shapley value (SV) and Least core (LC) are classic methods in cooperative game theory for cost/profit sharing problems. Both methods have recently been proposed as a principled solution for data valuation tasks, i.e., quantifying the…

Machine Learning · Computer Science 2022-04-08 Tianhao Wang , Yu Yang , Ruoxi Jia

Recent action recognition models have achieved impressive results by integrating objects, their locations and interactions. However, obtaining dense structured annotations for each frame is tedious and time-consuming, making these methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Elad Ben-Avraham , Roei Herzig , Karttikeya Mangalam , Amir Bar , Anna Rohrbach , Leonid Karlinsky , Trevor Darrell , Amir Globerson

Social intelligence, the ability to navigate complex interpersonal interactions, presents a fundamental challenge for language agents. Training such agents via reinforcement learning requires solving the credit assignment problem:…

Artificial Intelligence · Computer Science 2026-04-22 Xiachong Feng , Yi Jiang , Xiaocheng Feng , Deyi Yin , Libo Qin , Yangfan Ye , Lei Huang , Weitao Ma , Yuxuan Gu , Chonghan Qin , Bing Qin , Lingpeng Kong

The problem of explaining the behavior of deep neural networks has recently gained a lot of attention. While several attribution methods have been proposed, most come without strong theoretical foundations, which raises questions about…

Machine Learning · Computer Science 2019-06-24 Marco Ancona , Cengiz Öztireli , Markus Gross

In this paper, we develop an efficient multi-scale network to predict action classes in partial videos in an end-to-end manner. Unlike most existing methods with offline feature generation, our method directly takes frames as input and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Xiaofa Liu , Jianqin Yin , Yuan Sun , Zhicheng Zhang , Jin Tang

For feature selection and related problems, we introduce the notion of classification game, a cooperative game, with features as players and hinge loss based characteristic function and relate a feature's contribution to Shapley value based…

Machine Learning · Statistics 2021-04-27 Sandhya Tripathi , N. Hemachandra , Prashant Trivedi