English
Related papers

Related papers: Disentangling Interactions and Dependencies in Fea…

200 papers

We consider a global representation of a regression or classification function by decomposing it into the sum of main and interaction components of arbitrary order. We propose a new identification constraint that allows for the extraction…

Machine Learning · Computer Science 2023-02-24 Munir Hiabu , Joseph T. Meyer , Marvin N. Wright

When a machine-learning algorithm makes biased decisions, it can be helpful to understand the sources of disparity to explain why the bias exists. Towards this, we examine the problem of quantifying the contribution of each individual…

Machine Learning · Computer Science 2022-06-20 Sanghamitra Dutta , Praveen Venkatesh , Pulkit Grover

Feature importance (FI) measures are widely used to assess the contributions of predictors to an outcome, but they may target different notions of relevance. When predictors are correlated, traditional statistical FI methods are often…

Machine Learning · Statistics 2026-03-17 Jin-Hong Du , Kathryn Roeder , Larry Wasserman

We offer a new formalism for global explanations of pairwise feature dependencies and interactions in supervised models. Building upon SHAP values and SHAP interaction values, our approach decomposes feature contributions into synergistic,…

Machine Learning · Computer Science 2021-07-28 Jan Ittner , Lukasz Bolikowski , Konstantin Hemker , Ricardo Kennedy

In this paper, we introduce Partial Information Decomposition of Features (PIDF), a new paradigm for simultaneous data interpretability and feature selection. Contrary to traditional methods that assign a single importance value, our…

Machine Learning · Computer Science 2025-11-17 Charles Westphal , Stephen Hailes , Mirco Musolesi

The rapid advancement and widespread adoption of machine learning-driven technologies have underscored the practical and ethical need for creating interpretable artificial intelligence systems. Feature importance, a method that assigns…

Machine Learning · Computer Science 2023-12-07 Nimrod Harel , Uri Obolski , Ran Gilad-Bachrach

Leveraging the large body of work devoted in recent years to describe redundancy and synergy in multivariate interactions among random variables, we propose a novel approach to quantify cooperative effects in feature importance, one of the…

Data Analysis, Statistics and Probability · Physics 2025-03-14 Marlis Ontivero-Ortega , Luca Faes , Jesus M Cortes , Daniele Marinazzo , Sebastiano Stramaglia

Global model-agnostic feature importance measures either quantify whether features are directly used for a model's predictions (direct importance) or whether they contain prediction-relevant information (associative importance). Direct…

Machine Learning · Statistics 2021-06-16 Gunnar König , Timo Freiesleben , Bernd Bischl , Giuseppe Casalicchio , Moritz Grosse-Wentrup

We propose an approach to learn image representations that consist of disentangled factors of variation without exploiting any manual labeling or data domain knowledge. A factor of variation corresponds to an image attribute that can be…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Qiyang Hu , Attila Szabó , Tiziano Portenier , Matthias Zwicker , Paolo Favaro

In person re-identification (ReID) tasks, many works explore the learning of part features to improve the performance over global image features. Existing methods explicitly extract part features by either using a hand-designed image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Dengjie Li , Siyu Chen , Yujie Zhong , Lin Ma

Motivated by the need to audit complex and black box models, there has been extensive research on quantifying how data features influence model predictions. Feature influence can be direct (a direct influence on model outcomes) and indirect…

The interpretation of feature importance in machine learning models is challenging when features are dependent. Permutation feature importance (PFI) ignores such dependencies, which can cause misleading interpretations due to extrapolation.…

Machine Learning · Statistics 2023-11-09 Christoph Molnar , Gunnar König , Bernd Bischl , Giuseppe Casalicchio

In this study, Disentanglement in Difference(DiD) is proposed to address the inherent inconsistency between the statistical independence of latent variables and the goal of semantic disentanglement in disentanglement representation…

Machine Learning · Computer Science 2025-04-04 Xingshen Zhang , Lin Wang , Shuangrong Liu , Xintao Lu , Chaoran Pang , Bo Yang

This paper aims to define, quantify, and analyze the feature complexity that is learned by a DNN. We propose a generic definition for the feature complexity. Given the feature of a certain layer in the DNN, our method disentangles feature…

Machine Learning · Computer Science 2023-12-04 Jie Ren , Mingjie Li , Zexu Liu , Quanshi Zhang

A central goal of eXplainable Artificial Intelligence (XAI) is to assign relative importance to the features of a Machine Learning (ML) model given some prediction. The importance of this task of explainability by feature attribution is…

Artificial Intelligence · Computer Science 2024-05-21 Olivier Letoffe , Xuanxiang Huang , Nicholas Asher , Joao Marques-Silva

Multi-agent reinforcement learning (MARL) is a promising framework for solving complex tasks with many agents. However, a key challenge in MARL is defining private utility functions that ensure coordination when training decentralized…

Multiagent Systems · Computer Science 2022-02-17 Seung Hyun Kim , Neale Van Stralen , Girish Chowdhary , Huy T. Tran

Cooperative multi-agent reinforcement learning (MARL) is a challenging task, as agents must learn complex and diverse individual strategies from a shared team reward. However, existing methods struggle to distinguish and exploit important…

Multiagent Systems · Computer Science 2023-05-26 Xunhan Hu , Jian Zhao , Wengang Zhou , Ruili Feng , Houqiang Li

Recovering the latent factors of variation of high dimensional data has so far focused on simple synthetic settings. Mostly building on unsupervised and weakly-supervised objectives, prior work missed out on the positive implications for…

We introduce a simple and intuitive framework that provides quantitative explanations of statistical models through the probabilistic assessment of input feature importance. The core idea comes from utilizing the Dirichlet distribution to…

Machine Learning · Statistics 2022-09-20 Kamil Adamczewski , Frederik Harder , Mijung Park

This paper deals with a new measure of the influence of each feature on the response variable in classification problems, accounting for potential dependencies among certain feature subsets. Within this framework, we consider a sample of…

Optimization and Control · Mathematics 2024-08-06 Laura Davila-Pena , Alejandro Saavedra-Nieves , Balbina Casas-Méndez
‹ Prev 1 2 3 10 Next ›