English
Related papers

Related papers: From Explainable to Explained AI: Ideas for Falsif…

200 papers

Although machine learning (ML) models of AI achieve high performances in medicine, they are not free of errors. Empowering clinicians to identify incorrect model recommendations is crucial for engendering trust in medical AI. Explainable AI…

Artificial Intelligence · Computer Science 2022-12-20 Isil Guzey , Ozlem Ucar , Nukhet Aladag Ciftdemir , Betul Acunas

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

This paper surveys visual methods of explainability of Machine Learning (ML) with focus on moving from quasi-explanations that dominate in ML to domain-specific explanation supported by granular visuals. ML interpretation is fundamentally a…

Machine Learning · Computer Science 2021-06-15 Boris Kovalerchuk , Muhammad Aurangzeb Ahmad , Ankur Teredesai

Utilizing potent representations of the large vision-language models (VLMs) to accomplish various downstream tasks has attracted increasing attention. Within this research field, soft prompt learning has become a representative approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yequan Bie , Luyang Luo , Zhixuan Chen , Hao Chen

The overarching goal of Explainable AI is to develop systems that not only exhibit intelligent behaviours, but also are able to explain their rationale and reveal insights. In explainable machine learning, methods that produce a high level…

Artificial Intelligence · Computer Science 2020-05-06 Xiuyi Fan , Siyuan Liu , Thomas C. Henderson

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

Visual explanation methods have an important role in the prognosis of the patients where the annotated data is limited or unavailable. There have been several attempts to use gradient-based attribution methods to localize pathology from…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Ugur Demir , Ismail Irmakci , Elif Keles , Ahmet Topcu , Ziyue Xu , Concetto Spampinato , Sachin Jambawalikar , Evrim Turkbey , Baris Turkbey , Ulas Bagci

Black-box deep learning approaches have showcased significant potential in the realm of medical image analysis. However, the stringent trustworthiness requirements intrinsic to the medical field have catalyzed research into the utilization…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yequan Bie , Luyang Luo , Hao Chen

Explaining machine learning (ML) models using eXplainable AI (XAI) techniques has become essential to make them more transparent and trustworthy. This is especially important in high-stakes domains like healthcare, where understanding model…

Machine Learning · Computer Science 2025-12-04 Felix Tempel , Daniel Groos , Espen Alexander F. Ihlen , Lars Adde , Inga Strümke

Model explainability is essential for the creation of trustworthy Machine Learning models in healthcare. An ideal explanation resembles the decision-making process of a domain expert and is expressed using concepts or terminology that is…

Machine Learning · Computer Science 2021-07-14 Sumedha Singla , Stephen Wallace , Sofia Triantafillou , Kayhan Batmanghelich

The integration of artificial intelligence (AI) into medicine is remarkable, offering advanced diagnostic and therapeutic possibilities. However, the inherent opacity of complex AI models presents significant challenges to their clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Binbin Wen , Yihang Wu , Tareef Daqqaq , Ahmad Chaddad

Security researchers grapple with the surge of malicious files, necessitating swift identification and classification of malware strains for effective protection. Visual classifiers and in particular Convolutional Neural Networks (CNNs)…

Cryptography and Security · Computer Science 2025-03-05 Matteo Brosolo , Vinod Puthuvath , Mauro Conti

In recent years, machine learning (ML) has become a key enabling technology for the sciences and industry. Especially through improvements in methodology, the availability of large databases and increased computational power, today's ML…

Artificial Intelligence · Computer Science 2019-09-27 Wojciech Samek , Klaus-Robert Müller

Explainable AI (XAI) techniques are increasingly important for the validation and responsible use of modern deep learning models, but are difficult to evaluate due to the lack of good ground-truth to compare against. We propose a framework…

Artificial Intelligence · Computer Science 2026-05-19 Amritpal Singh , Andrey Barsky , Mohamed Ali Souibgui , Ernest Valveny , Dimosthenis Karatzas

In the last years, XAI research has mainly been concerned with developing new technical approaches to explain deep learning models. Just recent research has started to acknowledge the need to tailor explanations to different contexts and…

Artificial Intelligence · Computer Science 2021-10-11 Bettina Finzel , David E. Tafler , Stephan Scheele , Ute Schmid

With an increase in deep learning-based methods, the call for explainability of such methods grows, especially in high-stakes decision making areas such as medical image analysis. This survey presents an overview of eXplainable Artificial…

Image and Video Processing · Electrical Eng. & Systems 2022-05-06 Bas H. M. van der Velden , Hugo J. Kuijf , Kenneth G. A. Gilhuijs , Max A. Viergever

Artificial intelligence (AI) has huge potential to improve the health and well-being of people, but adoption in clinical practice is still limited. Lack of transparency is identified as one of the main barriers to implementation, as…

Artificial Intelligence · Computer Science 2021-01-06 Aniek F. Markus , Jan A. Kors , Peter R. Rijnbeek

Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regarding their opacity,…

Machine Learning · Computer Science 2023-08-17 Munib Mesinovic , Peter Watkinson , Tingting Zhu

AI systems' ability to explain their reasoning is critical to their utility and trustworthiness. Deep neural networks have enabled significant progress on many challenging problems such as visual question answering (VQA). However, most of…

Computation and Language · Computer Science 2019-06-05 Jialin Wu , Raymond J. Mooney

Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems. However, these deep models are perceived as "black box" methods considering the lack of understanding of their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Aditya Chattopadhyay , Anirban Sarkar , Prantik Howlader , Vineeth N Balasubramanian