中文
相关论文

相关论文: CLIP-QDA: An Explainable Concept Bottleneck Model

200 篇论文

The transparency of deep learning models is essential for clinical diagnostics. Concept Bottleneck Model provides clear decision-making processes for diagnosis by transforming the latent space of black-box models into human-understandable…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Yiheng Dong , Yi Lin , Xin Yang

The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive Language-Image Pretraining), which demonstrate exceptional performance in learning complex…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Zhiyu Zhu , Zhibo Jin , Jiayu Zhang , Nan Yang , Jiahao Huang , Jianlong Zhou , Fang Chen

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-stakes applications.…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Yue Yang , Artemis Panagopoulou , Shenghao Zhou , Daniel Jin , Chris Callison-Burch , Mark Yatskar

Concept Bottleneck Models (CBMs) offer inherent interpretability by initially translating images into human-comprehensible concepts, followed by a linear combination of these concepts for classification. However, the annotation of concepts…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Hangzhou He , Lei Zhu , Xinliang Zhang , Shuang Zeng , Qian Chen , Yanye Lu

There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and then map them to output classes. To reduce reliance on…

机器学习 · 计算机科学 2024-07-08 Simon Schrodi , Julian Schur , Max Argus , Thomas Brox

Concept Bottleneck Models (CBMs) are interpretable models that route predictions through a layer of human-interpretable concepts. While widely studied in vision and, more recently, in NLP, CBMs remain largely unexplored in multimodal…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Pierre Moreau , Emeline Pineau Ferrand , Yann Choho , Benjamin Wong , Annabelle Blangero , Milan Bhan

Modern deep neural networks have now reached human-level performance across a variety of tasks. However, unlike humans they lack the ability to explain their decisions by showing where and telling what concepts guided them. In this work, we…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Itay Benou , Tammy Riklin-Raviv

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

计算与语言 · 计算机科学 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Concept Bottleneck Models (CBMs) provide inherent interpretability by first predicting a set of human-understandable concepts and then mapping them to labels through a simple classifier. While users can intervene in the concept space to…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Hangzhou He , Lei Zhu , Kaiwen Li , Xinliang Zhang , Jiakui Hu , Ourui Fu , Zhengjian Yao , Yanye Lu

Recent research on graph neural network (GNN) models successfully applied GNNs to classical graph algorithms and combinatorial optimisation problems. This has numerous benefits, such as allowing applications of algorithms when preconditions…

机器学习 · 计算机科学 2021-07-16 Dobrik Georgiev , Pietro Barbiero , Dmitry Kazhdan , Petar Veličković , Pietro Liò

We introduce Concept Bottleneck Large Language Models (CB-LLMs), a novel framework for building inherently interpretable Large Language Models (LLMs). In contrast to traditional black-box LLMs that rely on limited post-hoc interpretations,…

计算与语言 · 计算机科学 2025-09-09 Chung-En Sun , Tuomas Oikarinen , Berk Ustun , Tsui-Wei Weng

The multimodal deep neural networks, represented by CLIP, have generated rich downstream applications owing to their excellent performance, thus making understanding the decision-making process of CLIP an essential research topic. Due to…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Chenming Shang , Hengyuan Zhang , Hao Wen , Yujiu Yang

Concept Bottleneck Models (CBMs) enhance interpretability by predicting human-understandable concepts as intermediate representations. However, existing CBMs often suffer from input-to-concept mapping bias and limited controllability, which…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Gaoxiang Huang , Songning Lai , Yutao Yue

Concept Bottleneck Models (CBMs) introduce interpretability to black-box deep learning models by predicting labels through human-understandable concepts. However, unlike humans, who identify objects at different levels of abstraction using…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Haodong Xie , Yujun Cai , Rahul Singh Maharjan , Yiwei Wang , Federico Tavella , Angelo Cangelosi

Large-scale pre-trained vision foundation models, such as CLIP, have become de facto backbones for various vision tasks. However, due to their black-box nature, understanding the underlying rules behind these models' predictions and…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Haozhe Chen , Junfeng Yang , Carl Vondrick , Chengzhi Mao

While RFML is expected to be a key enabler of future wireless standards, a significant challenge to the widespread adoption of RFML techniques is the lack of explainability in deep learning models. This work investigates the use of CB…

信号处理 · 电气工程与系统科学 2021-01-06 Lauren J. Wong , Sean McPherson

Deep learning-based medical image classification techniques are rapidly advancing in medical image analysis, making it crucial to develop accurate and trustworthy models that can be efficiently deployed across diverse clinical scenarios.…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Hangzhou He , Jiachen Tang , Lei Zhu , Kaiwen Li , Yanye Lu

With growing demand for interpretability in deep learning, especially in high stakes domains, Concept Bottleneck Models (CBMs) address this by inserting human understandable concepts into the prediction pipeline, but they are generally…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Jiakai Lin , Jinchang Zhang , Guoyu Lu

Interpretable models are designed to make decisions in a human-interpretable manner. Representatively, Concept Bottleneck Models (CBM) follow a two-step process of concept prediction and class prediction based on the predicted concepts. CBM…

机器学习 · 计算机科学 2023-06-05 Eunji Kim , Dahuin Jung , Sangha Park , Siwon Kim , Sungroh Yoon

Interpreting and explaining the behavior of deep neural networks is critical for many tasks. Explainable AI provides a way to address this challenge, mostly by providing per-pixel relevance to the decision. Yet, interpreting such…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara