English
Related papers

Related papers: Improving Model's Interpretability and Reliability…

200 papers

The lack of interpretability in the field of medical image analysis has significant ethical and legal implications. Existing interpretable methods in this domain encounter several challenges, including dependency on specific models,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Lijie Hu , Songning Lai , Wenshuo Chen , Hongru Xiao , Hongbin Lin , Lu Yu , Jingfeng Zhang , Di Wang

This paper claims that machine learning models deployed in high stakes domains such as medicine must be interpretable, shareable, reproducible and accountable. We argue that these principles should form the foundational design criteria for…

Machine Learning · Computer Science 2025-08-25 Ayyüce Begüm Bektaş , Mithat Gönen

Evaluating explanations of image classifiers regarding ground truth, e.g. segmentation masks defined by human perception, primarily evaluates the quality of the models under consideration rather than the explanation methods themselves.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Hubert Baniecki , Maciej Chrabaszcz , Andreas Holzinger , Bastian Pfeifer , Anna Saranti , Przemyslaw Biecek

Current approaches to explaining the decisions of deep learning systems for medical tasks have focused on visualising the elements that have contributed to each decision. We argue that such approaches are not enough to "open the black box"…

Artificial Intelligence · Computer Science 2018-06-04 William Gale , Luke Oakden-Rayner , Gustavo Carneiro , Andrew P Bradley , Lyle J Palmer

Interpretable insights from predictive models remain critical in bio-statistics, particularly when assessing causality, where classical statistical and machine learning methods often provide inherent clarity. While Neural Networks (NNs)…

Applications · Statistics 2025-05-02 Jean-Baptiste A. Conan

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are the most popular non-linear predictive models used in practice today, yet comparatively little attention has been paid to explaining…

With the ongoing development of deep learning, an increasing number of AI models have surpassed the performance levels of human clinical practitioners. However, the prevalence of AI diagnostic products in actual clinical practice remains…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Chenglong Wang , Yinqiao Yi , Yida Wang , Chengxiu Zhang , Yun Liu , Kensaku Mori , Mei Yuan , Guang Yang

Artificial intelligence-augmented technology represents a considerable opportunity for improving healthcare delivery. Significant progress has been made to demonstrate the value of complex models to enhance clinicians` efficiency in…

Human-Computer Interaction · Computer Science 2025-04-08 Mohammad Golam Kibria , Lauren Kucirka , Javed Mostafa

One of the key challenges when developing a predictive model is the capability to describe the domain knowledge and the cause-effect relationships in a simple way. Decision rules are a useful and important methodology in this context,…

Machine Learning · Computer Science 2021-10-19 Francisco Valente , Jorge Henriques , Simão Paredes , Teresa Rocha , Paulo de Carvalho , João Morais

Deep Learning based models are currently dominating most state-of-the-art solutions for disease prediction. Existing works employ RNNs along with multiple levels of attention mechanisms to provide interpretability. These deep learning…

Machine Learning · Statistics 2022-06-01 Subhadip Maji , Raghav Bali , Sree Harsha Ankem , Kishore V Ayyadevara

The application of deep learning models in medical diagnosis has showcased considerable efficacy in recent years. Nevertheless, a notable limitation involves the inherent lack of explainability during decision-making processes. This study…

Image and Video Processing · Electrical Eng. & Systems 2024-05-01 Konstantinos Pasvantis , Eftychios Protopapadakis

Would you trust physicians if they cannot explain their decisions to you? Medical diagnostics using machine learning gained enormously in importance within the last decade. However, without further enhancements many state-of-the-art machine…

Machine Learning · Computer Science 2022-06-01 Emanuel Slany , Yannik Ott , Stephan Scheele , Jan Paulus , Ute Schmid

Interpretability in machine learning models is important in high-stakes decisions, such as whether to order a biopsy based on a mammographic exam. Mammography poses important challenges that are not present in other computer vision tasks:…

Machine Learning · Computer Science 2021-03-24 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

Large language models (LLMs) show promise for supporting clinicians in diagnostic communication by generating explanations and guidance for patients. Yet their ability to produce outputs that are both understandable and empathetic remains…

Computation and Language · Computer Science 2025-11-04 Jianzhou Yao , Shunchang Liu , Guillaume Drui , Rikard Pettersson , Alessandro Blasimme , Sara Kijewski

Although machine learning (ML) models of AI achieve high performances in medicine, they are not free of errors. Empowering clinicians to identify incorrect model recommendations is crucial for engendering trust in medical AI. Explainable AI…

Artificial Intelligence · Computer Science 2022-12-20 Isil Guzey , Ozlem Ucar , Nukhet Aladag Ciftdemir , Betul Acunas

Interpretability is highly desired for deep neural network-based classifiers, especially when addressing high-stake decisions in medical imaging. Commonly used post-hoc interpretability methods have the limitation that they can produce…

Image and Video Processing · Electrical Eng. & Systems 2024-01-04 Sourya Sengupta , Mark A. Anastasio

Interpretability is essential for deploying deep learning models in symbolic music analysis, yet most research emphasizes model performance over explanation. To address this, we introduce MUSE-Explainer, a new method that helps reveal how…

Sound · Computer Science 2025-10-01 Baptiste Hilaire , Emmanouil Karystinaios , Gerhard Widmer

Lung cancer is the leading cause of cancer death and morbidity worldwide. Many studies have shown machine learning models to be effective at detecting lung nodules from chest X-ray images. However, these techniques have yet to be embraced…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Michael J. Horry , Subrata Chakraborty , Biswajeet Pradhan , Manoranjan Paul , Douglas P. S. Gomes , Anwaar Ul-Haq

Identification of input data points relevant for the classifier (i.e. serve as the support vector) has recently spurred the interest of researchers for both interpretability as well as dataset debugging. This paper presents an in-depth…

Machine Learning · Computer Science 2020-09-30 Dominique Mercier , Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

Interpretable brain network models for disease prediction are of great value for the advancement of neuroscience. GNNs are promising to model complicated network data, but they are prone to overfitting and suffer from poor interpretability,…

Machine Learning · Computer Science 2021-07-13 Hejie Cui , Wei Dai , Yanqiao Zhu , Xiaoxiao Li , Lifang He , Carl Yang