中文
相关论文

相关论文: Learning Bottleneck Concepts in Image Classificati…

200 篇论文

Convolutional neural networks (CNN) are known to learn an image representation that captures concepts relevant to the task, but do so in an implicit way that hampers model interpretability. However, one could argue that such a…

计算机视觉与模式识别 · 计算机科学 2020-09-21 Diego Marcos , Ruth Fong , Sylvain Lobry , Remi Flamary , Nicolas Courty , Devis Tuia

Deep neural networks are a key component of behavior prediction and motion generation for self-driving cars. One of their main drawbacks is a lack of transparency: they should provide easy to interpret rationales for what triggers certain…

计算机视觉与模式识别 · 计算机科学 2020-05-12 Jinkyu Kim , Mayank Bansal

Interpretable models are designed to make decisions in a human-interpretable manner. Representatively, Concept Bottleneck Models (CBM) follow a two-step process of concept prediction and class prediction based on the predicted concepts. CBM…

机器学习 · 计算机科学 2023-06-05 Eunji Kim , Dahuin Jung , Sangha Park , Siwon Kim , Sungroh Yoon

Recent advances in deep learning have led to increasingly complex models with deeper layers and more parameters, reducing interpretability and making their decisions harder to understand. While many methods explain black-box reasoning, most…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Nuoye Xiong , Anqi Dong , Ning Wang , Cong Hua , Guangming Zhu , Lin Mei , Peiyi Shen , Liang Zhang

Interpreting a large number of neurons in deep learning is difficult. Our proposed `CLAssifier-DECoder' architecture (ClaDec) facilitates the understanding of the output of an arbitrary layer of neurons or subsets thereof. It uses a decoder…

计算机视觉与模式识别 · 计算机科学 2022-03-09 Johannes Schneider , Michail Vlachos

Concept Bottleneck Models (CBMs) have been proposed as a compromise between white-box and black-box models, aiming to achieve interpretability without sacrificing accuracy. The standard training procedure for CBMs is to predefine a…

机器学习 · 计算机科学 2025-12-05 Jean Feng , Avni Kothari , Luke Zier , Chandan Singh , Yan Shuo Tan

Despite their success, Large-Language Models (LLMs) still face criticism due to their lack of interpretability. Traditional post-hoc interpretation methods, based on attention and gradient-based analysis, offer limited insights as they only…

Concept bottleneck models map from raw inputs to concepts, and then from concepts to targets. Such models aim to incorporate pre-specified, high-level concepts into the learning procedure, and have been motivated to meet three desiderata:…

机器学习 · 计算机科学 2021-05-11 Andrei Margeloiu , Matthew Ashman , Umang Bhatt , Yanzhi Chen , Mateja Jamnik , Adrian Weller

The main challenges limiting the adoption of deep learning-based solutions in medical workflows are the availability of annotated data and the lack of interpretability of such systems. Concept Bottleneck Models (CBMs) tackle the latter by…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Cristiano Patrício , Isabel Rio-Torto , Jaime S. Cardoso , Luís F. Teixeira , João C. Neves

Concept Bottleneck Models (CBMs) tackle the opacity of neural architectures by constructing and explaining their predictions using a set of high-level concepts. A special property of these models is that they permit concept interventions,…

Concept Bottleneck Models (CBMs) improve the explainability of black-box Deep Learning (DL) by introducing intermediate semantic concepts. However, standard CBMs often overlook domain-specific relationships and causal mechanisms, and their…

机器学习 · 计算机科学 2026-01-16 Reza M. Asiyabi , SEOSAW Partnership , Steven Hancock , Casey Ryan

We revisit language bottleneck models as an approach to ensuring the explainability of deep learning models for image classification. Because of inevitable information loss incurred in the step of converting images into language, the…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Honori Udo , Takafumi Koshinaka

Concept Bottleneck Models (CBMs) provide inherent interpretability by first predicting a set of human-understandable concepts and then mapping them to labels through a simple classifier. While users can intervene in the concept space to…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Hangzhou He , Lei Zhu , Kaiwen Li , Xinliang Zhang , Jiakui Hu , Ourui Fu , Zhengjian Yao , Yanye Lu

To increase the trustworthiness of deep neural networks, it is critical to improve the understanding of how they make decisions. This paper introduces a novel unsupervised concept-based model for image classification, named Learnable…

Concept Bottleneck Models (CBMs) enhance interpretability by predicting human-understandable concepts as intermediate representations. However, existing CBMs often suffer from input-to-concept mapping bias and limited controllability, which…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Gaoxiang Huang , Songning Lai , Yutao Yue

While RFML is expected to be a key enabler of future wireless standards, a significant challenge to the widespread adoption of RFML techniques is the lack of explainability in deep learning models. This work investigates the use of CB…

信号处理 · 电气工程与系统科学 2021-01-06 Lauren J. Wong , Sean McPherson

In recent years, Visual Anomaly Detection (VAD) has gained significant attention due to its ability to identify defects using only normal images during training. Many VAD models work without supervision but are still able to provide visual…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Arianna Stropeni , Valentina Zaccaria , Francesco Borsatti , Davide Dalle Pezze , Manuel Barusco , Gian Antonio Susto

This paper addresses explainable AI (XAI) through the lens of Concept Bottleneck Models (CBMs) that do not require explicit concept annotations, relying instead on concepts extracted using CLIP in a zero-shot manner. We show that CLIP,…

计算机视觉与模式识别 · 计算机科学 2025-10-09 Rémi Kazmierczak , Steve Azzolin , Eloïse Berthier , Goran Frehse , Gianni Franchi

Concept bottleneck models (CBMs) have emerged as critical tools in domains where interpretability is paramount. These models rely on predefined textual descriptions, referred to as concepts, to inform their decision-making process and offer…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Maor Dikter , Tsachi Blau , Chaim Baskin

Recent advances in multimodal large language models (LLMs) have shown extreme effectiveness in visual question answering (VQA). However, the design nature of these end-to-end models prevents them from being interpretable to humans,…

计算与语言 · 计算机科学 2024-04-16 Xingyu Fu , Ben Zhou , Sihao Chen , Mark Yatskar , Dan Roth