English
Related papers

Related papers: Enhancing Interpretable Image Classification Throu…

200 papers

Goal misalignment, reward sparsity and difficult credit assignment are only a few of the many issues that make it difficult for deep reinforcement learning (RL) agents to learn optimal policies. Unfortunately, the black-box nature of deep…

Machine Learning · Computer Science 2024-10-30 Quentin Delfosse , Sebastian Sztwiertnia , Mark Rothermel , Wolfgang Stammer , Kristian Kersting

Modern deep neural networks have now reached human-level performance across a variety of tasks. However, unlike humans they lack the ability to explain their decisions by showing where and telling what concepts guided them. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Itay Benou , Tammy Riklin-Raviv

The widespread adoption of deep learning models in computer vision has intensified concerns about interpretability. Despite strong performance, these models are often treated as black boxes, with limited systematic investigation of their…

Machine Learning · Computer Science 2026-05-13 Konstantinos P. Panousis , Diego Marcos

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

Concept-based explanations work by mapping complex model computations to human-understandable concepts. Evaluating such explanations is very difficult, as it includes not only the quality of the induced space of possible concepts but also…

Computation and Language · Computer Science 2025-06-05 Antonin Poché , Alon Jacovi , Agustin Martin Picard , Victor Boutin , Fanny Jourdan

While deep learning models often lack interpretability, concept bottleneck models (CBMs) provide inherent explanations via their concept representations. Moreover, they allow users to perform interventional interactions on these concepts by…

Machine Learning · Computer Science 2024-06-05 David Steinmann , Wolfgang Stammer , Felix Friedrich , Kristian Kersting

Explainable AI seeks to bring light to the decision-making processes of black-box models. Traditional saliency-based methods, while highlighting influential data segments, often lack semantic understanding. Recent advancements, such as…

Artificial Intelligence · Computer Science 2023-10-12 Bo Pan , Zhenke Liu , Yifei Zhang , Liang Zhao

Concept bottleneck models (CBM) aim to improve model interpretability by predicting human level "concepts" in a bottleneck within a deep learning model architecture. However, how the predicted concepts are used in predicting the target…

Machine Learning · Computer Science 2025-04-15 Matthew Shen , Aliyah Hsu , Abhineet Agarwal , Bin Yu

Concept Bottleneck Models (CBMs) predict through human-interpretable concepts, but they typically output point concept probabilities that conflate epistemic uncertainty (reducible model underspecification) with aleatoric uncertainty…

Artificial Intelligence · Computer Science 2026-04-28 Tanmoy Mukherjee , Thomas Bailleux , Pierre Marquis , Zied Bouraoui

Concept Bottleneck Models (CBMs) have emerged as a cornerstone approach for interpretable machine learning, providing human-understandable intermediate representations through explicit concept activations. However, this interpretability…

Machine Learning · Computer Science 2026-05-26 Aditya Sridhar

Science and engineering problems fall in the category of complex conceptual problems that require specific conceptual information (CI) like math/logic -related know-how, process information, or engineering guidelines to solve them. Large…

Computation and Language · Computer Science 2024-12-23 Nishtha N. Vaidya , Thomas Runkler , Thomas Hubauer , Veronika Haderlein-Hoegberg , Maja Mlicic Brandt

Concept-Based Models (CBMs) are a class of deep learning models that provide interpretability by explaining predictions through high-level concepts. These models first predict concepts and then use them to perform a downstream task.…

Machine Learning · Computer Science 2025-06-27 David Debot , Pietro Barbiero , Gabriele Dominici , Giuseppe Marra

There is growing interest in concept-based models (CBMs) that combine high-performance and interpretability by acquiring and reasoning with a vocabulary of high-level concepts. A key requirement is that the concepts be interpretable.…

Machine Learning · Computer Science 2022-10-19 Emanuele Marconato , Andrea Passerini , Stefano Teso

In recent years, the black-box nature of deep learning models has limited their application in high-stakes domains such as medical diagnosis and finance, where interpretability is essential. To address this, we propose a novel approach…

Computation and Language · Computer Science 2026-05-26 Yike Sun , Mingkun Xu , Mu You , Zhongzhi He , Henghua Shen , Zehan Tan , Derek F. Wong , Tao Fang

Continuous prompts have become widely adopted for augmenting performance across a wide range of natural language tasks. However, the underlying mechanism of this enhancement remains obscure. Previous studies rely on individual words for…

Computation and Language · Computer Science 2024-12-06 Qian Chen , Dongyang Li , Xiaofeng He

Pretrained language models (PLMs) have made significant strides in various natural language processing tasks. However, the lack of interpretability due to their ``black-box'' nature poses challenges for responsible implementation. Although…

Computation and Language · Computer Science 2023-11-10 Zhen Tan , Lu Cheng , Song Wang , Yuan Bo , Jundong Li , Huan Liu

Artificial intelligence (AI) is transforming scientific research, with explainable AI methods like concept-based models (CMs) showing promise for new discoveries. However, in molecular science, CMs are less common than black-box models like…

Artificial Intelligence · Computer Science 2024-12-17 Zimin Zhang , Qianli Wu , Botao Xia , Fang Sun , Ziniu Hu , Yizhou Sun , Shichang Zhang

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

Concept bottleneck models (CBMs) ensure interpretability by decomposing predictions into human interpretable concepts. Yet the annotations used for training CBMs that enable this transparency are often noisy, and the impact of such…

Machine Learning · Computer Science 2026-02-02 Seonghwan Park , Jueun Mun , Donghyun Oh , Namhoon Lee

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag