English
Related papers

Related papers: DiffExplainer: Unveiling Black Box Models Via Coun…

200 papers

The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Junlin Hou , Sicen Liu , Yequan Bie , Hongmei Wang , Andong Tan , Luyang Luo , Hao Chen

Classifiers are important components in many computer vision tasks, serving as the foundational backbone of a wide variety of models employed across diverse applications. However, understanding the decision-making process of classifiers…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Tahira Kazimi , Ritika Allada , Pinar Yanardag

Large language models (LLMs) are increasingly used for diagnostic tasks in medicine. In clinical practice, the correct diagnosis can rarely be immediately inferred from the initial patient presentation alone. Rather, reaching a diagnosis…

Artificial Intelligence · Computer Science 2026-02-20 Hui Min Wong , Philip Heesen , Pascal Janetzky , Martin Bendszus , Stefan Feuerriegel

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

Machine Learning · Computer Science 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan

Machine learning technologies for protein function prediction are black box models. Despite their potential to identify key drug targets with high accuracy and accelerate therapy development, the adoption of these methods depends on…

Biomolecules · Quantitative Biology 2025-12-02 Ananya Krishna , Valentina Simon , Arjan Kohli

Diffusion probabilistic models (DPMs) have become the state-of-the-art in high-quality image generation. However, DPMs have an arbitrary noisy latent space with no interpretable or controllable semantics. Although there has been significant…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Chen Zhao , Feng Chen , Xintao Wu

Artificial Intelligence (AI) in skin disease diagnosis has improved significantly, but a major concern is that these models frequently show biased performance across subgroups, especially regarding sensitive attributes such as skin color.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Nusrat Munia , Abdullah-Al-Zubaer Imran

Due to the limited availability of medical data, deep learning approaches for medical image analysis tend to generalise poorly to unseen data. Augmenting data during training with random transformations has been shown to help and became a…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Tian Xia , Pedro Sanchez , Chen Qin , Sotirios A. Tsaftaris

From a simple text prompt, generative-AI image models can create stunningly realistic and creative images bounded, it seems, by only our imagination. These models have achieved this remarkable feat thanks, in part, to the ingestion of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Matyas Bohacek , Hany Farid

We revisit language bottleneck models as an approach to ensuring the explainability of deep learning models for image classification. Because of inevitable information loss incurred in the step of converting images into language, the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Honori Udo , Takafumi Koshinaka

Current approaches to explaining the decisions of deep learning systems for medical tasks have focused on visualising the elements that have contributed to each decision. We argue that such approaches are not enough to "open the black box"…

Artificial Intelligence · Computer Science 2018-06-04 William Gale , Luke Oakden-Rayner , Gustavo Carneiro , Andrew P Bradley , Lyle J Palmer

Algorithms are powerful and necessary tools behind a large part of the information we use every day. However, they may introduce new sources of bias, discrimination and other unfair practices that affect people who are unaware of it.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Francesco Ventura , Tania Cerquitelli

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

Machine Learning · Computer Science 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for…

Machine Learning · Statistics 2019-09-24 Cynthia Rudin

There is a growing concern that the recent progress made in AI, especially regarding the predictive competence of deep learning models, will be undermined by a failure to properly explain their operation and outputs. In response to this…

Machine Learning · Computer Science 2020-09-15 Eoin M. Kenny , Mark T. Keane

With the increasing adoption of predictive models trained using machine learning across a wide range of high-stakes applications, e.g., health care, security, criminal justice, finance, and education, there is a growing need for effective…

Machine Learning · Computer Science 2020-08-04 Aria Khademi , Vasant Honavar

Despite the outstanding performance of deep learning models in clinical prediction tasks, explainability remains a significant challenge. Inspired by transformer architectures, we introduce the Temporal-Feature Cross Attention Mechanism…

Machine Learning · Computer Science 2025-09-22 Yubo Li , Xinyu Yao , Rema Padman

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng