English
Related papers

Related papers: Model-agnostic Feature Importance and Effects with…

200 papers

A common problem in machine learning is determining if a variable significantly contributes to a model's prediction performance. This problem is aggravated for datasets, such as gene expression datasets, that suffer the worst case of…

Methodology · Statistics 2023-10-13 Yue Wu , Ted Spaide , Kenji Nakamichi , Russell Van Gelder , Aaron Lee

Feature importance methods using unrestricted permutations are flawed due to extrapolation errors; such errors appear in all non-trivial variable importance approaches. We propose three new approaches: conditional model reliance and…

Machine Learning · Statistics 2026-04-14 Emanuele Borgonovo , Francesco Cappelli , Xuefei Lu , Elmar Plischke , Cynthia Rudin

We introduce a simple and intuitive framework that provides quantitative explanations of statistical models through the probabilistic assessment of input feature importance. The core idea comes from utilizing the Dirichlet distribution to…

Machine Learning · Statistics 2022-09-20 Kamil Adamczewski , Frederik Harder , Mijung Park

We introduce instancewise feature selection as a methodology for model interpretation. Our method is based on learning a function to extract a subset of features that are most informative for each given example. This feature selector is…

Machine Learning · Computer Science 2018-06-15 Jianbo Chen , Le Song , Martin J. Wainwright , Michael I. Jordan

When used in the context of decision theory, feature importance expresses how much changing the value of a feature can change the model outcome (or the utility of the outcome), compared to other features. Feature importance should not be…

Artificial Intelligence · Computer Science 2023-08-08 Kary Främling

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to…

Machine Learning · Statistics 2025-09-22 Tiffany M. Tang , Elizaveta Levina , Ji Zhu

Machine learning models can automatically learn complex relationships, such as non-linear and interaction effects. Interpretable machine learning methods such as partial dependence plots visualize marginal feature effects but may lead to…

Machine Learning · Statistics 2022-02-16 Julia Herbinger , Bernd Bischl , Giuseppe Casalicchio

The majority of existing post-hoc explanation approaches for machine learning models produce independent, per-variable feature attribution scores, ignoring a critical inherent characteristics of homogeneously structured data, such as visual…

Machine Learning · Computer Science 2023-02-14 Vadim Borisov , Gjergji Kasneci

Feature attribution XAI algorithms enable their users to gain insight into the underlying patterns of large datasets through their feature importance calculation. Existing feature attribution algorithms treat all features in a dataset…

Artificial Intelligence · Computer Science 2022-03-25 Veera Raghava Reddy Kovvuri , Siyuan Liu , Monika Seisenberger , Berndt Müller , Xiuyi Fan

Species sampling processes have long served as the fundamental framework for modeling random discrete distributions and exchangeable sequences. However, data arising from distinct but related sources require a broader notion of…

Statistics Theory · Mathematics 2026-02-03 Beatrice Franzolini , Antonio Lijoi , Igor Prünster , Giovanni Rebaudo

Shapley values have seen widespread use in machine learning as a way to explain model predictions and estimate the importance of covariates. Accurately explaining models is critical in real-world models to both aid in decision making and to…

Machine Learning · Statistics 2024-08-19 Daniel de Marchi , Michael Kosorok , Scott de Marchi

Anomaly Detection (AD) focuses on identifying unusual behaviors in complex datasets. Machine Learning (ML) algorithms and Decision Support Systems (DSSs) provide effective solutions for AD, but detecting anomalies alone may not be enough,…

Machine Learning · Statistics 2024-10-10 Alessio Arcudi , Davide Frizzo , Chiara Masiero , Gian Antonio Susto

Predictable Feature Analysis (PFA) (Richthofer, Wiskott, ICMLA 2015) is an algorithm that performs dimensionality reduction on high dimensional input signal. It extracts those subsignals that are most predictable according to a certain…

Machine Learning · Computer Science 2017-12-05 Stefan Richthofer , Laurenz Wiskott

Learning the cumulative distribution function (CDF) of an outcome variable conditional on a set of features remains challenging, especially in high-dimensional settings. Conditional transformation models provide a semi-parametric approach…

Machine Learning · Computer Science 2021-10-05 Philipp F. M. Baumann , Torsten Hothorn , David Rügamer

One of the key elements of explanatory analysis of a predictive model is to assess the importance of individual variables. Rapid development of the area of predictive model exploration (also called explainable artificial intelligence or…

Machine Learning · Computer Science 2021-04-09 Katarzyna Pekala , Katarzyna Woznica , Przemyslaw Biecek

Model selection requires repeatedly evaluating models on a given dataset and measuring their relative performances. In modern applications of machine learning, the models being considered are increasingly more expensive to evaluate and the…

Machine Learning · Computer Science 2020-10-21 Anant Raj , Cameron Musco , Lester Mackey , Nicolo Fusi

The increasing number of regulations and expectations of predictive machine learning models, such as so called right to explanation, has led to a large number of methods promising greater interpretability. High demand has led to a…

Interpretability is a pressing issue for machine learning. Common approaches to interpretable machine learning constrain interactions between features of the input, rendering the effects of those features on a model's output comprehensible…

Machine Learning · Computer Science 2023-05-11 Kieran A. Murphy , Dani S. Bassett

The principal contribution of this paper is a conceptual framework for off-policy reinforcement learning, based on conditional expectations of importance sampling ratios. This framework yields new perspectives and understanding of existing…

Machine Learning · Computer Science 2020-07-31 Mark Rowland , Anna Harutyunyan , Hado van Hasselt , Diana Borsa , Tom Schaul , Rémi Munos , Will Dabney

The representational capacity of modern neural network architectures has made them a default choice in various applications with high dimensional feature sets. But these high dimensional and potentially noisy features combined with the…

Machine Learning · Computer Science 2020-10-13 Vinay Varma K