English
Related papers

Related papers: Deferring Concept Bottleneck Models: Learning to D…

200 papers

Concept bottleneck model (CBM) is a ubiquitous method that can interpret neural networks using concepts. In CBM, concepts are inserted between the output layer and the last intermediate layer as observable values. This helps in…

Machine Learning · Statistics 2023-03-17 Naoki Hayashi , Yoshihide Sawada

Recent advances in multimodal large language models (LLMs) have shown extreme effectiveness in visual question answering (VQA). However, the design nature of these end-to-end models prevents them from being interpretable to humans,…

Computation and Language · Computer Science 2024-04-16 Xingyu Fu , Ben Zhou , Sihao Chen , Mark Yatskar , Dan Roth

Deep neural networks have achieved remarkable success in computer vision; however, their black-box nature in decision-making limits interpretability and trust, particularly in safety-critical applications. Interpretability is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ran Eisenberg , Amit Rozner , Ethan Fetaya , Ofir Lindenbaum

The main challenges limiting the adoption of deep learning-based solutions in medical workflows are the availability of annotated data and the lack of interpretability of such systems. Concept Bottleneck Models (CBMs) tackle the latter by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Cristiano Patrício , Isabel Rio-Torto , Jaime S. Cardoso , Luís F. Teixeira , João C. Neves

Despite strong average-case performance, deep learning models often exhibit systematic errors on specific population groups, known as error slices. Identifying these groups and the root causes of their failures is critical for model…

Machine Learning · Computer Science 2026-05-29 Yael Konforti , Mateo Espinosa Zarlenga , Elaf Almahmoud , Mateja Jamnik

Learning to defer uncertain predictions to costly experts offers a powerful strategy for improving the accuracy and efficiency of machine learning systems. However, standard training procedures for deferral algorithms typically require…

Machine Learning · Computer Science 2025-10-31 Giulia DeSalvo , Clara Mohri , Mehryar Mohri , Yutao Zhong

Textual Concept Bottleneck Models (TCBMs) are interpretable-by-design models for text classification that predict a set of salient concepts before making the final prediction. This paper proposes Complete Textual Concept Bottleneck Model…

Computation and Language · Computer Science 2025-05-29 Milan Bhan , Yann Choho , Pierre Moreau , Jean-Noel Vittaut , Nicolas Chesneau , Marie-Jeanne Lesot

Concept Bottleneck Models (CBNMs) are deep learning models that provide interpretability by enforcing a bottleneck layer where predictions are based exclusively on human-understandable concepts. However, this constraint also restricts…

Machine Learning · Computer Science 2025-10-17 David Debot , Giuseppe Marra

Concept bottleneck models (CBMs) ensure interpretability by decomposing predictions into human interpretable concepts. Yet the annotations used for training CBMs that enable this transparency are often noisy, and the impact of such…

Machine Learning · Computer Science 2026-02-02 Seonghwan Park , Jueun Mun , Donghyun Oh , Namhoon Lee

Deploying AI-powered systems requires trustworthy models supporting effective human interactions, going beyond raw prediction accuracy. Concept bottleneck models promote trustworthiness by conditioning classification tasks on an…

In recent years, Visual Anomaly Detection (VAD) has gained significant attention due to its ability to identify defects using only normal images during training. Many VAD models work without supervision but are still able to provide visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Arianna Stropeni , Valentina Zaccaria , Francesco Borsatti , Davide Dalle Pezze , Manuel Barusco , Gian Antonio Susto

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

In recent years, the black-box nature of deep learning models has limited their application in high-stakes domains such as medical diagnosis and finance, where interpretability is essential. To address this, we propose a novel approach…

Computation and Language · Computer Science 2026-05-26 Yike Sun , Mingkun Xu , Mu You , Zhongzhi He , Henghua Shen , Zehan Tan , Derek F. Wong , Tao Fang

We introduce Concept Bottleneck Protein Language Models (CB-pLM), a generative masked language model with a layer where each neuron corresponds to an interpretable concept. Our architecture offers three key benefits: i) Control: We can…

Learn-to-Defer is a paradigm that enables learning algorithms to work not in isolation but as a team with human experts. In this paradigm, we permit the system to defer a subset of its tasks to the expert. Although there are currently…

Machine Learning · Computer Science 2024-07-18 Mohammad-Amin Charusaie , Samira Samadi

Concept-based learning enhances prediction accuracy and interpretability by leveraging high-level, human-understandable concepts. However, existing CBL frameworks do not address survival analysis tasks, which involve predicting event times…

Machine Learning · Computer Science 2025-02-11 Stanislav R. Kirpichenko , Lev V. Utkin , Andrei V. Konstantinov , Natalya M. Verbova

Concept Bottleneck Models (CBMs) aim to enhance interpretability by structuring predictions around human-understandable concepts. However, unintended information leakage, where predictive signals bypass the concept bottleneck, compromises…

Machine Learning · Computer Science 2025-07-22 Mikael Makonnen , Moritz Vandenhirtz , Sonia Laguna , Julia E Vogt

Enhancing model interpretability can address spurious correlations by revealing how models draw their predictions. Concept Bottleneck Models (CBMs) can provide a principled way of disclosing and guiding model behaviors through…

Machine Learning · Computer Science 2024-07-15 Jeeyung Kim , Ze Wang , Qiang Qiu

Open-ended grading is central to equitable and personalized education, yet manual grading remains time-consuming and costly, underscoring the need for automated grading systems. Although recent neural and large language model (LLM) based…

Computers and Society · Computer Science 2026-05-28 Chengshuai Zhao , Fan Zhang , Kumar Satvik Chaudhary , Yiwen Li , Lo Pang-Yun Ting , Ying-Chih Chen , Huan Liu

For an explanation of a deep learning model to be effective, it must provide both insight into a model and suggest a corresponding action in order to achieve some objective. Too often, the litany of proposed explainable deep learning…

Machine Learning · Computer Science 2020-10-09 Laura Rieger , Chandan Singh , W. James Murdoch , Bin Yu