English
Related papers

Related papers: CLIF: Concept-Level Influence Functions for Transp…

200 papers

The integration of vision-language models such as CLIP and Concept Bottleneck Models (CBMs) offers a promising approach to explaining deep neural network (DNN) decisions using concepts understandable by humans, addressing the black-box…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Townim F. Chowdhury , Vu Minh Hieu Phan , Kewen Liao , Minh-Son To , Yutong Xie , Anton van den Hengel , Johan W. Verjans , Zhibin Liao

Concept Bottleneck Models (CBMs) improve the explainability of black-box Deep Learning (DL) by introducing intermediate semantic concepts. However, standard CBMs often overlook domain-specific relationships and causal mechanisms, and their…

Machine Learning · Computer Science 2026-01-16 Reza M. Asiyabi , SEOSAW Partnership , Steven Hancock , Casey Ryan

Current deep learning models are not designed to simultaneously address three fundamental questions: predict class labels to solve a given classification task (the "What?"), simulate changes in the situation to evaluate how this impacts…

Machine Learning · Computer Science 2025-02-21 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Giuseppe Marra , Marc Langheinrich

Among the most critical limitations of deep learning NLP models are their lack of interpretability, and their reliance on spurious correlations. Prior work proposed various approaches to interpreting the black-box models to unveil the…

Computation and Language · Computer Science 2021-10-08 Xiaochuang Han , Yulia Tsvetkov

Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existing CBMs assume concepts are conditionally independent given…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Tsui-Wei Weng , Lam M. Nguyen , Tengfei Ma

Recent advances in deep learning have led to increasingly complex models with deeper layers and more parameters, reducing interpretability and making their decisions harder to understand. While many methods explain black-box reasoning, most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Nuoye Xiong , Anqi Dong , Ning Wang , Cong Hua , Guangming Zhu , Lin Mei , Peiyi Shen , Liang Zhang

Existing methods, such as concept bottleneck models (CBMs), have been successful in providing concept-based interpretations for black-box deep learning models. They typically work by predicting concepts given the input and then predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Xinyue Xu , Yi Qin , Lu Mi , Hao Wang , Xiaomeng Li

How can we explain the predictions of a black-box model? In this paper, we use influence functions -- a classic technique from robust statistics -- to trace a model's prediction through the learning algorithm and back to its training data,…

Machine Learning · Statistics 2021-01-01 Pang Wei Koh , Percy Liang

Concept Bottleneck Models (CBMs) are interpretable models that route predictions through a layer of human-interpretable concepts. While widely studied in vision and, more recently, in NLP, CBMs remain largely unexplored in multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Pierre Moreau , Emeline Pineau Ferrand , Yann Choho , Benjamin Wong , Annabelle Blangero , Milan Bhan

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a humanunderstandable concept layer. However, most previous studies focused on cases where the data, including…

Machine Learning · Computer Science 2025-02-04 Lijie Hu , Chenyang Ren , Zhengyu Hu , Hongbin Lin , Cheng-Long Wang , Hui Xiong , Jingfeng Zhang , Di Wang

With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yoshihide Sawada , Keigo Nakamura

The design of interpretable deep learning models working in relational domains poses an open challenge: interpretable deep learning methods, such as Concept Bottleneck Models (CBMs), are not designed to solve relational problems, while…

Machine Learning · Computer Science 2024-10-28 Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra

Concept Bottleneck Models (CBMs) offer interpretable alternatives to black-box predictors by introducing human-relatable concepts before the final output. However, existing CBMs struggle to verify whether predicted concepts correspond to…

Machine Learning · Computer Science 2026-05-15 Yingying Fang , Haijie Xu , Shuang Wu , Mariathasan Anish , Guang Yang

Concept Bottleneck Models (CBMs) enhance the interpretability of neural networks by basing predictions on human-understandable concepts. However, current CBMs typically rely on concept sets extracted from large language models or extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Katharina Prasse , Patrick Knab , Sascha Marton , Christian Bartelt , Margret Keuper

The opaque nature of Large Language Models (LLMs) has led to significant research efforts aimed at enhancing their interpretability, primarily through post-hoc methods. More recent in-hoc approaches, such as Concept Bottleneck Models…

Machine Learning · Computer Science 2025-02-20 Or Raphael Bidusa , Shaul Markovitch

Concept Bottleneck Models (CBMs), which break down the reasoning process into the input-to-concept mapping and the concept-to-label prediction, have garnered significant attention due to their remarkable interpretability achieved by the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Qihan Huang , Jie Song , Jingwen Hu , Haofei Zhang , Yong Wang , Mingli Song

Concept Bottleneck Models (CBMs) provide interpretable prediction by introducing an intermediate Concept Bottleneck Layer (CBL), which encodes human-understandable concepts to explain models' decision. Recent works proposed to utilize Large…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Divyansh Srivastava , Ge Yan , Tsui-Wei Weng

Concept Bottleneck Models (CBMs) decompose image classification into a process governed by interpretable, human-readable concepts. Recent advances in CBMs have used Large Language Models (LLMs) to generate candidate concepts. However, a…

Computation and Language · Computer Science 2025-06-03 Yiwen Jiang , Deval Mehta , Wei Feng , Zongyuan Ge

Concept bottleneck models (CBMs) improve neural network interpretability by introducing an intermediate layer that maps human-understandable concepts to predictions. Recent work has explored the use of vision-language models (VLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Xingbo Du , Qiantong Dou , Lei Fan , Rui Zhang

Interpretability is a crucial factor in building reliable models for various medical applications. Concept Bottleneck Models (CBMs) enable interpretable image classification by utilizing human-understandable concepts as intermediate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Injae Kim , Jongha Kim , Joonmyung Choi , Hyunwoo J. Kim