English
Related papers

Related papers: Concepts from Representations: Post-hoc Concept Bo…

200 papers

Explainable AI (XAI) is crucial for building transparent and trustworthy machine learning systems, especially in high-stakes domains. Concept Bottleneck Models (CBMs) have emerged as a promising ante-hoc approach that provides…

Artificial Intelligence · Computer Science 2026-01-21 Hanwei Zhang , Luo Cheng , Rui Wen , Yang Zhang , Lijun Zhang , Holger Hermanns

Vision-language models (VLMs), such as CLIP and SigLIP, have found remarkable success in classification, retrieval, and generative tasks. For this, VLMs deterministically map images and text descriptions to a joint latent space in which…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Anton Baumann , Rui Li , Marcus Klasson , Santeri Mentu , Shyamgopal Karthik , Zeynep Akata , Arno Solin , Martin Trapp

Pre-trained language models (PLMs) have recently shown great success in text representation field. However, the high computational cost and high-dimensional representation of PLMs pose significant challenges for practical applications. To…

Computation and Language · Computer Science 2023-11-10 Yanzhao Zhang , Dingkun Long , Zehan Li , Pengjun Xie

Recent efforts in interpretable deep learning models have shown that concept-based explanation methods achieve competitive accuracy with standard end-to-end models and enable reasoning and intervention about extracted high-level visual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Jeya Vikranth Jeyakumar , Luke Dickens , Luis Garcia , Yu-Hsi Cheng , Diego Ramirez Echavarria , Joseph Noor , Alessandra Russo , Lance Kaplan , Erik Blasch , Mani Srivastava

Referring Expression Comprehension (REC) is a crucial cross-modal task that objectively evaluates the capabilities of language understanding, image comprehension, and language-to-image grounding. Consequently, it serves as an ideal testing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Junzhuo Liu , Xuzheng Yang , Weiwei Li , Peng Wang

The emergence of large-scale pretrained language models has posed unprecedented challenges in deriving explanations of why the model has made some predictions. Stemmed from the compositional nature of languages, spurious correlations have…

Computation and Language · Computer Science 2023-05-04 Ruochen Zhao , Shafiq Joty , Yongjie Wang , Tan Wang

Models that bridge vision and language, such as CLIP, are key components of multimodal AI, yet their large-scale, uncurated training data introduce severe social and spurious biases. Existing post-hoc debiasing methods often operate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Quentin Guimard , Federico Bartsch , Simone Caldarella , Rahaf Aljundi , Elisa Ricci , Massimiliano Mancini

Machine unlearning in Vision-Language Models (VLMs) is typically performed at the image or instance level, making it difficult to precisely remove target knowledge without affecting unrelated semantics. This issue is especially pronounced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Shen Lin , Jing Lin , Junhao Dong , Piotr Koniusz , Li Xu

The multimodal deep neural networks, represented by CLIP, have generated rich downstream applications owing to their excellent performance, thus making understanding the decision-making process of CLIP an essential research topic. Due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chenming Shang , Hengyuan Zhang , Hao Wen , Yujiu Yang

With growing demand for interpretability in deep learning, especially in high stakes domains, Concept Bottleneck Models (CBMs) address this by inserting human understandable concepts into the prediction pipeline, but they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiakai Lin , Jinchang Zhang , Guoyu Lu

As AI systems grow more capable, it becomes increasingly important that their decisions remain understandable and aligned with human expectations. A key challenge is the limited interpretability of deep models. Post-hoc methods like GradCAM…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Mahdi Alehdaghi , Rajarshi Bhattacharya , Pourya Shamsolmoali , Rafael M. O. Cruz , Maguelonne Heritier , Eric Granger

We introduce Graph Concept Bottleneck (GCB) as a new paradigm for self-explainable text-attributed graph learning. GCB maps graphs into a subspace, concept bottleneck, where each concept is a meaningful phrase, and predictions are made…

Machine Learning · Computer Science 2026-04-15 Xiaoxue Han , Libo Zhang , Zining Zhu , Yue Ning

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

Although multi-view learning has made signifificant progress over the past few decades, it is still challenging due to the diffificulty in modeling complex correlations among different views, especially under the context of view missing. To…

Machine Learning · Computer Science 2020-11-13 Changqing Zhang , Yajie Cui , Zongbo Han , Joey Tianyi Zhou , Huazhu Fu , Qinghua Hu

Deep learning models have achieved strong performance in medical image analysis, but their internal decision processes remain difficult to interpret. Concept Bottleneck Models (CBMs) partially address this limitation by structuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Getamesay Dagnaw , Xuefei Yin , Muhammad Hassan Maqsood , Yanming Zhu , Alan Wee-Chung Liew

Vision-language models learn powerful multimodal embeddings, yet their internal semantics remain opaque. While sparse autoencoders (SAEs) can extract interpretable features, they rely on expanding the representation dimension, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Piotr Kubaty , Patryk Marszałek , Łukasz Struski , Adam Wróbel , Jacek Tabor , Marek Śmieja

Masking strategies commonly employed in natural language processing are still underexplored in vision tasks such as concept learning, where conventional methods typically rely on full images. However, using masked images diversifies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yuwei Sun , Lu Mi , Ippei Fujisawa , Ruiqiao Mei , Jimin Chen , Siyu Zhu , Ryota Kanai

We propose a unified representation learning framework to address the Cross Model Compatibility (CMC) problem in the context of visual search applications. Cross compatibility between different embedding models enables the visual search…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Chien-Yi Wang , Ya-Liang Chang , Shang-Ta Yang , Dong Chen , Shang-Hong Lai

This paper addresses explainable AI (XAI) through the lens of Concept Bottleneck Models (CBMs) that do not require explicit concept annotations, relying instead on concepts extracted using CLIP in a zero-shot manner. We show that CLIP,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Rémi Kazmierczak , Steve Azzolin , Eloïse Berthier , Goran Frehse , Gianni Franchi

Concept Bottleneck Models (CBNMs) are deep learning models that provide interpretability by enforcing a bottleneck layer where predictions are based exclusively on human-understandable concepts. However, this constraint also restricts…

Machine Learning · Computer Science 2025-10-17 David Debot , Giuseppe Marra