English
Related papers

Related papers: Best of both worlds: local and global explanations…

200 papers

Existing sample-based methods, like influence functions and representer points, measure the importance of a training point by approximating the effect of its removal from training. As such, they are skewed towards outliers and points that…

Machine Learning · Computer Science 2024-08-13 Lucas Agussurja , Xinyang Lu , Bryan Kian Hsiang Low

Recent work has made important contributions in the development of causally-interpretable meta-analysis. These methods transport treatment effects estimated in a collection of randomized trials to a target population of interest. Ideally,…

Methodology · Statistics 2023-02-08 Justin M. Clark , Kollin W. Rott , James S. Hodges , Jared D. Huling

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

Interpretability of machine learning (ML) models becomes more relevant with their increasing adoption. In this work, we address the interpretability of ML based question answering (QA) models on a combination of knowledge bases (KB) and…

Computation and Language · Computer Science 2019-06-27 Alona Sydorova , Nina Poerner , Benjamin Roth

Real-world clinical problems are often characterized by multimodal data, usually associated with incomplete views and limited sample sizes in their cohorts, posing significant limitations for machine learning algorithms. In this work, we…

In recent years, machine learning researchers have focused on methods to construct flexible and interpretable prediction models. However, an interpretability evaluation, a relationship between generalization performance and an…

Machine Learning · Computer Science 2019-10-08 Jinwei Zhao , Qizhou Wang , Yufei Wang , Yu Liu , Zhenghao Shi , Xinhong Hei

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

Explainability is a longstanding challenge in deep learning, especially in high-stakes domains like healthcare. Common explainability methods highlight image regions that drive an AI model's decision. Humans, however, heavily rely on…

Artificial Intelligence · Computer Science 2023-11-21 Shobhit Agarwal , Yevgeniy R. Semenov , William Lotter

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake

As an emerging interpretable technique, Generalized Additive Models (GAMs) adopt neural networks to individually learn non-linear functions for each feature, which are then combined through a linear model for final predictions. Although…

Machine Learning · Computer Science 2024-08-01 Viet Duong , Qiong Wu , Zhengyi Zhou , Hongjue Zhao , Chenxiang Luo , Eric Zavesky , Huaxiu Yao , Huajie Shao

Graph Neural Networks (GNNs) achieve state-of-the-art performance in various graph-related tasks. However, the black-box nature often limits their interpretability and trustworthiness. Numerous explainability methods have been proposed to…

Machine Learning · Computer Science 2023-11-13 Jialin Chen , Kenza Amara , Junchi Yu , Rex Ying

Optimal treatment rules can improve health outcomes on average by assigning a treatment associated with the most desirable outcome to each individual. Due to an unknown data generation mechanism, it is appealing to use flexible models to…

Methodology · Statistics 2023-11-21 Lingjie Shen , Gijs Geleijnse , Maurits Kaptein

Interpretability is essential for machine learning algorithms in high-stakes application fields such as medical image analysis. However, high-performing black-box neural networks do not provide explanations for their predictions, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Susu Sun , Stefano Woerner , Andreas Maier , Lisa M. Koch , Christian F. Baumgartner

Recently, several methods have leveraged deep generative modeling to produce example-based explanations of image classifiers. Despite producing visually stunning results, these methods are largely disconnected from classical explainability…

Machine Learning · Computer Science 2025-09-11 Philipp Vaeth , Alexander M. Fruehwald , Benjamin Paassen , Magda Gregorova

Translating machine learning (ML) models effectively to clinical practice requires establishing clinicians' trust. Explainability, or the ability of an ML model to justify its outcomes and assist clinicians in rationalizing the model…

Machine Learning · Computer Science 2019-08-08 Sana Tonekaboni , Shalmali Joshi , Melissa D McCradden , Anna Goldenberg

Explainable AI has become a common term in the literature, scrutinized by computer scientists and statisticians and highlighted by psychological or philosophical researchers. One major effort many researchers tackle is constructing general…

Artificial Intelligence · Computer Science 2025-09-12 Carina Newen , Daniel Bodemer , Sonja Glantz , Emmanuel Müller , Magdalena Wischnewski , Lenka Schnaubert

A method for the local and global interpretation of a black-box model on the basis of the well-known generalized additive models is proposed. It can be viewed as an extension or a modification of the algorithm using the neural additive…

Machine Learning · Computer Science 2020-10-16 Andrei V. Konstantinov , Lev V. Utkin

Interpretability aims to explain the behavior of deep neural networks. Despite rapid growth, there is mounting concern that much of this work has not translated into practical impact, raising questions about its relevance and utility. This…

Interpretable classification models are built with the purpose of providing a comprehensible description of the decision logic to an external oversight agent. When considered in isolation, a decision tree, a set of classification rules, or…

Machine Learning · Computer Science 2019-03-18 Riccardo Guidotti , Salvatore Ruggieri

Collaborative reasoning for understanding image-question pairs is a very critical but underexplored topic in interpretable visual question answering systems. Although very recent studies have attempted to use explicit compositional…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Qingxing Cao , Bailin Li , Xiaodan Liang , Liang Lin