English
Related papers

Related papers: Challenges in Variable Importance Ranking Under Co…

200 papers

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to…

Machine Learning · Statistics 2025-09-22 Tiffany M. Tang , Elizaveta Levina , Ji Zhu

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal effect of a feature…

Machine Learning · Computer Science 2023-04-11 Jiuyong Li , Lin Liu , Ziqi Xu , Ha Xuan Tran , Thuc Duy Le , Jixue Liu

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

In this paper, we present a new explainability formalism designed to shed light on how each input variable of a test set impacts the predictions of machine learning models. Hence, we propose a group explainability formalism for trained…

Machine Learning · Statistics 2022-08-12 François Bachoc , Fabrice Gamboa , Max Halford , Jean-Michel Loubes , Laurent Risser

Hierarchical models represent a challenging setting for inference algorithms. MCMC methods struggle to scale to large models with many local variables and observations, and variational inference (VI) may fail to provide accurate…

Machine Learning · Computer Science 2022-07-27 Tomas Geffner , Justin Domke

Principal component analysis (PCA) aims at estimating the direction of maximal variability of a high-dimensional dataset. A natural question is: does this task become easier, and estimation more accurate, when we exploit additional…

Information Theory · Computer Science 2014-06-19 Andrea Montanari , Emile Richard

In this paper, we investigate the impact of high-dimensional Principal Component (PC) adjustments on inferring the effects of variables on outcomes, with a focus on applications in genetic association studies where PC adjustment is commonly…

Statistics Theory · Mathematics 2025-06-30 Sohom Bhattacharya , Rounak Dey , Rajarshi Mukherjee

This paper develops a rigorous argument for why the use of Shapley values in explainable AI (XAI) will necessarily yield provably misleading information about the relative importance of features for predictions. Concretely, this paper…

Machine Learning · Computer Science 2023-02-17 Xuanxiang Huang , Joao Marques-Silva

In explainable machine learning, global feature importance methods try to determine how much each individual feature contributes to predicting the target variable, resulting in one importance score for each feature. But often, predicting…

Machine Learning · Computer Science 2024-11-01 Gunnar König , Eric Günther , Ulrike von Luxburg

In the field of Explainable AI, multiples evaluation metrics have been proposed in order to assess the quality of explanation methods w.r.t. a set of desired properties. In this work, we study the articulation between the stability,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Romain Xu-Darme , Jenny Benois-Pineau , Romain Giot , Georges Quénot , Zakaria Chihani , Marie-Christine Rousset , Alexey Zhukov

Gradient Boosting Machines (GBM) are among the go-to algorithms on tabular data, which produce state of the art results in many prediction tasks. Despite its popularity, the GBM framework suffers from a fundamental flaw in its base…

Machine Learning · Computer Science 2021-09-14 Afek Ilay Adler , Amichai Painsky

This paper deals with an important subject in classification problems addressed by machine learning techniques: the evaluation of the influence of each of the features on the classification of individuals. Specifically, a measure of that…

Machine Learning · Statistics 2023-04-21 L. Davila-Pena , Ignacio García-Jurado , B. Casas-Méndez

Machine learning transparency calls for interpretable explanations of how inputs relate to predictions. Feature attribution is a way to analyze the impact of features on predictions. Feature interactions are the contextual dependence…

Machine Learning · Statistics 2020-06-22 Michael Tsang , Sirisha Rambhatla , Yan Liu

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Machine learning (ML) models are becoming increasingly common in the atmospheric science community with a wide range of applications. To enable users to understand what an ML model has learned, ML explainability has become a field of active…

Machine Learning · Computer Science 2022-11-21 Montgomery Flora , Corey Potvin , Amy McGovern , Shawn Handler

In multi-criteria decision analysis workshops, participants often appraise the options individually before discussing the scoring as a group. The individual appraisals lead to score ranges within which the group then seeks the necessary…

General Economics · Economics 2020-12-29 Tom Pape

A fundamental question on the use of ML models concerns the explanation of their predictions for increasing transparency in decision-making. Although several interpretability methods have emerged, some gaps regarding the reliability of…

Machine Learning · Statistics 2022-09-13 Gilson Y. Shimizu , Rafael Izbicki , Andre C. P. L. F. de Carvalho

Interpretability of machine learning is defined as the extent to which humans can comprehend the reason of a decision. However, a neural network is not considered interpretable due to the ambiguity in its decision-making process. Therefore,…

Machine Learning · Computer Science 2020-03-30 Yusuke Kubo , Yuto Komori , Toyonobu Okuyama , Hiroshi Tokieda

In constructing an econometric or statistical model, we pick relevant features or variables from many candidates. A coalitional game is set up to study the selection problem where the players are the candidates and the payoff function is a…

Machine Learning · Statistics 2021-10-07 Xingwei Hu

We propose a new method to impute missing values in mixed datasets. It is based on a principal components method, the factorial analysis for mixed data, which balances the influence of all the variables that are continuous and categorical…

Applications · Statistics 2013-02-20 Vincent Audigier , François Husson , Julie Josse