English
Related papers

Related papers: A Baseline for Shapley Values in MLPs: from Missin…

200 papers

High-quality estimates of uncertainty and robustness are crucial for numerous real-world applications, especially for deep learning which underlies many deployed ML systems. The ability to compare techniques for improving these estimates is…

Explainable artificial intelligence (XAI) aims to help human decision-makers in understanding complex machine learning (ML) models. One of the hallmarks of XAI are measures of relative feature importance, which are theoretically justified…

Artificial Intelligence · Computer Science 2024-02-12 Joao Marques-Silva , Xuanxiang Huang

Recent studies on multi-label image classification have focused on designing more complex architectures of deep neural networks such as the use of attention mechanisms and region proposal networks. Although performance gains have been…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Qian Wang , Ning Jia , Toby P. Breckon

As machine learning algorithms are deployed ubiquitously to a variety of domains, it is imperative to make these often black-box models transparent. Several recent works explain black-box models by capturing the most influential features…

Shapley values have emerged as a critical tool for explaining which features impact the decisions made by machine learning models. However, computing exact Shapley values is difficult, generally requiring an exponential (in the feature…

Machine learning methods have seen a meteoric rise in their applications in the scientific community. However, little effort has been put into understanding these "black box" models. We show how one can apply integrated gradients (IGs) to…

Machine Learning · Computer Science 2024-12-19 Jai Bardhan , Cyrin Neeraj , Mihir Rawat , Subhadip Mitra

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Shapley values are widely used for model-agnostic data valuation and feature attribution, yet they implicitly assume contributors are interchangeable. This can be problematic when contributors are dependent (e.g., reused/augmented data or…

Machine Learning · Computer Science 2026-02-11 Kiljae Lee , Ziqi Liu , Weijing Tang , Yuan Zhang

Across scientific domains, a fundamental challenge is to characterize and compute the mappings from underlying physical processes to observed signals and measurements. While nonlinear neural networks have achieved considerable success, they…

Machine Learning · Computer Science 2025-08-11 Alexander DeLise , Kyle Loh , Krish Patel , Meredith Teague , Andrea Arnold , Matthias Chung

Return-to-baseline is an important method to impute missing values or unobserved potential outcomes when certain hypothetical strategies are used to handle intercurrent events in clinical trials. Current return-to-baseline approaches seen…

Methodology · Statistics 2021-11-19 Yongming Qu , Biyue Dai

Simplicity bias is the concerning tendency of deep networks to over-depend on simple, weakly predictive features, to the exclusion of stronger, more complex features. This is exacerbated in real-world applications by limited training data…

Machine Learning · Computer Science 2023-06-07 Rishabh Tiwari , Pradeep Shenoy

The increasing complexity of foundational models underscores the necessity for explainability, particularly for fine-tuning, the most widely used training method for adapting models to downstream tasks. Instance attribution, one type of…

Machine Learning · Computer Science 2024-06-10 Jingtan Wang , Xiaoqiang Lin , Rui Qiao , Chuan-Sheng Foo , Bryan Kian Hsiang Low

To demystify the "black box" property of deep neural networks for natural language processing (NLP), several methods have been proposed to interpret their predictions by measuring the change in prediction probability after erasing each…

Computation and Language · Computer Science 2020-10-28 Siwon Kim , Jihun Yi , Eunji Kim , Sungroh Yoon

Measuring the value of individual samples is critical for many data-driven tasks, e.g., the training of a deep learning model. Recent literature witnesses the substantial efforts in developing data valuation methods. The primary data…

Machine Learning · Computer Science 2024-06-06 Ou Wu , Weiyao Zhu , Mengyang Li

Shapley values are widely used to explain black-box models, but they are costly to calculate because they require many model evaluations. We introduce FastSHAP, a method for estimating Shapley values in a single forward pass using a learned…

Machine Learning · Statistics 2022-03-24 Neil Jethani , Mukund Sudarshan , Ian Covert , Su-In Lee , Rajesh Ranganath

Algorithmic fairness is of utmost societal importance, yet state-of-the-art large-scale machine learning models require training with massive datasets that are frequently biased. In this context, pre-processing methods that focus on…

Machine Learning · Computer Science 2024-06-12 Adrian Arnaiz-Rodriguez , Nuria Oliver

Deep Neural Networks (DNNs) have been extensively used in many areas including image processing, medical diagnostics, and autonomous driving. However, DNNs can exhibit erroneous behaviours that may lead to critical errors, especially when…

Software Engineering · Computer Science 2023-04-21 Zohreh Aghababaeyan , Manel Abdellatif , Lionel Briand , Ramesh S , Mojtaba Bagherzadeh

Multi-label classification is a type of classification task, it is used when there are two or more classes, and the data point we want to predict may belong to none of the classes or all of them at the same time. In the real world, many…

Machine Learning · Computer Science 2021-04-26 Shikun Chen

Recent advancements in deep learning have been primarily driven by the use of large models trained on increasingly vast datasets. While neural scaling laws have emerged to predict network performance given a specific level of computational…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Elior Benarous , Sotiris Anagnostidis , Luca Biggio , Thomas Hofmann

The application of Shapley values to high-dimensional, time-series-like data is computationally challenging - and sometimes impossible. For $N$ inputs the problem is $2^N$ hard. In image processing, clusters of pixels, referred to as…

Quantitative Methods · Quantitative Biology 2024-09-30 Lauren Elborough , Duncan Taylor , Melissa Humphries