English
Related papers

Related papers: Explaining Black-box Models for Biomedical Text Cl…

200 papers

The pervasive application of algorithmic decision-making is raising concerns on the risk of unintended bias in AI systems deployed in critical settings such as healthcare. The detection and mitigation of biased models is a very delicate…

Machine Learning · Computer Science 2020-11-10 Cecilia Panigutti , Alan Perotti , Andrè Panisson , Paolo Bajardi , Dino Pedreschi

With the advancement of technology for artificial intelligence (AI) based solutions and analytics compute engines, machine learning (ML) models are getting more complex day by day. Most of these models are generally used as a black box…

Machine Learning · Computer Science 2022-10-11 P. Sai Ram Aditya , Mayukha Pal

Engineering LLMs to accelerate life sciences research requires a robust alignment with biomedical knowledge. We observe that biomedical text exhibits a fundamentally different uncertainty structure from general text: dense low-confidence…

Causal concept effect estimation is gaining increasing interest in the field of interpretable machine learning. This general approach explains the behaviors of machine learning models by estimating the causal effect of human-understandable…

Machine Learning · Computer Science 2024-11-15 Jifan Gao , Guanhua Chen

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

Recent advancements in post-hoc and inherently interpretable methods have markedly enhanced the explanations of black box classifier models. These methods operate either through post-analysis or by integrating concept learning during model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Bor-Shiun Wang , Chien-Yi Wang , Wei-Chen Chiu

Along with the successful deployment of deep neural networks in several application domains, the need to unravel the black-box nature of these networks has seen a significant increase recently. Several methods have been introduced to…

Machine Learning · Computer Science 2023-07-06 Adam Ivankay , Mattia Rigotti , Pascal Frossard

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

Machine Learning · Computer Science 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

Abstruse learning algorithms and complex datasets increasingly characterize modern clinical decision support systems (CDSS). As a result, clinicians cannot easily or rapidly scrutinize the CDSS recommendation when facing a difficult…

Artificial Intelligence · Computer Science 2021-11-02 Bojian Hou , Hao Zhang , Gur Ladizhinsky , Gur Ladizhinsky , Stephen Yang , Volodymyr Kuleshov , Fei Wang , Qian Yang

Accurate and interpretable diagnostic models are crucial in the safety-critical field of medicine. We investigate the interpretability of our proposed biomarker-based lung ultrasound diagnostic pipeline to enhance clinicians' diagnostic…

Interpreting the decisions of deep image classifiers remains challenging, particularly in black-box settings where model internals are inaccessible. We introduce OCCAM, a framework for open-set causal concept explanation and ontology…

Artificial Intelligence · Computer Science 2026-05-19 Chiara Maria Russo , Simone Carnemolla , Simone Palazzo , Daniela Giordano , Concetto Spampinato , Matteo Pennisi

Black-box deep learning approaches have showcased significant potential in the realm of medical image analysis. However, the stringent trustworthiness requirements intrinsic to the medical field have catalyzed research into the utilization…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yequan Bie , Luyang Luo , Hao Chen

Interpretability is a pressing issue for decision systems. Many post hoc methods have been proposed to explain the predictions of a single machine learning model. However, business processes and decision systems are rarely centered around a…

Machine Learning · Computer Science 2023-03-22 Gianluigi Lopardo , Damien Garreau , Frederic Precioso , Greger Ottosson

Model interpretability plays a central role in human-AI decision-making systems. Ideally, explanations should be expressed using human-interpretable semantic concepts. Moreover, the causal relations between these concepts should be captured…

Machine Learning · Computer Science 2024-01-29 Ricardo Moreira , Jacopo Bono , Mário Cardoso , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Deep learning-based medical image classification techniques are rapidly advancing in medical image analysis, making it crucial to develop accurate and trustworthy models that can be efficiently deployed across diverse clinical scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hangzhou He , Jiachen Tang , Lei Zhu , Kaiwen Li , Yanye Lu

Explainability is critical for deep learning applications in healthcare which are mandated to provide interpretations to both patients and doctors according to legal regulations and responsibilities. Explainable AI methods, such as feature…

Image and Video Processing · Electrical Eng. & Systems 2023-11-01 Jinze Zhao

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been…

Machine Learning · Computer Science 2024-02-19 Usha Bhalla , Suraj Srinivas , Himabindu Lakkaraju

Interpretability is highly desired for deep neural network-based classifiers, especially when addressing high-stake decisions in medical imaging. Commonly used post-hoc interpretability methods have the limitation that they can produce…

Image and Video Processing · Electrical Eng. & Systems 2024-01-04 Sourya Sengupta , Mark A. Anastasio

Image classification is a primary task in data analysis where explainable models are crucially demanded in various applications. Although amounts of methods have been proposed to obtain explainable knowledge from the black-box classifiers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai