English
Related papers

Related papers: CoPA: Hierarchical Concept Prompting and Aggregati…

200 papers

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and then map them to output classes. To reduce reliance on…

Machine Learning · Computer Science 2024-07-08 Simon Schrodi , Julian Schur , Max Argus , Thomas Brox

Concept Bottleneck Models (CBMs) offer interpretable alternatives to black-box predictors by introducing human-relatable concepts before the final output. However, existing CBMs struggle to verify whether predicted concepts correspond to…

Machine Learning · Computer Science 2026-05-15 Yingying Fang , Haijie Xu , Shuang Wu , Mariathasan Anish , Guang Yang

Interpretable deep learning aims at developing neural architectures whose decision-making processes could be understood by their users. Among these techniqes, Concept Bottleneck Models enhance the interpretability of neural networks by…

Machine Learning · Computer Science 2024-05-28 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Marc Langhenirich

Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existing CBMs assume concepts are conditionally independent given…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Tsui-Wei Weng , Lam M. Nguyen , Tengfei Ma

Concept Bottleneck Models (CBMs) provide a basis for semantic abstractions within a neural network architecture. Such models have primarily been seen through the lens of interpretability so far, wherein they offer transparency by inferring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Deepika SN Vemuri , Gautham Bellamkonda , Aditya Pola , Vineeth N Balasubramanian

Deep learning-based medical image classification techniques are rapidly advancing in medical image analysis, making it crucial to develop accurate and trustworthy models that can be efficiently deployed across diverse clinical scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hangzhou He , Jiachen Tang , Lei Zhu , Kaiwen Li , Yanye Lu

With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yoshihide Sawada , Keigo Nakamura

Concept Bottleneck Models (CBMs) have become a popular approach to enable interpretability in neural networks by constraining classifier inputs to a set of human-understandable concepts. While effective, current models embed concepts in…

Machine Learning · Computer Science 2026-05-13 Daniel Uyterlinde , Swasti Shreya Mishra , Pascal Mettes

Early detection of melanoma is crucial for preventing severe complications and increasing the chances of successful treatment. Existing deep learning approaches for melanoma skin lesion diagnosis are deemed black-box models, as they omit…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Cristiano Patrício , João C. Neves , Luís F. Teixeira

Recent efforts in interpretable deep learning models have shown that concept-based explanation methods achieve competitive accuracy with standard end-to-end models and enable reasoning and intervention about extracted high-level visual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Jeya Vikranth Jeyakumar , Luke Dickens , Luis Garcia , Yu-Hsi Cheng , Diego Ramirez Echavarria , Joseph Noor , Alessandra Russo , Lance Kaplan , Erik Blasch , Mani Srivastava

Concept Bottleneck Models (CBMs) enhance interpretability by predicting human-understandable concepts as intermediate representations. However, existing CBMs often suffer from input-to-concept mapping bias and limited controllability, which…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Gaoxiang Huang , Songning Lai , Yutao Yue

Concept Bottleneck Models (CBMs) enhance the interpretability of AI systems, particularly by bridging visual input with human-understandable concepts, effectively acting as a form of multimodal interpretability model. However, existing CBMs…

Machine Learning · Computer Science 2025-08-06 Songning Lai , Mingqian Liao , Zhangyi Hu , Jiayu Yang , Wenshuo Chen , Hongru Xiao , Jianheng Tang , Haicheng Liao , Yutao Yue

Existing prompt-based approaches have demonstrated impressive performance in continual learning, leveraging pre-trained large-scale models for classification tasks; however, the tight coupling between foreground-background information and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Huahui Yi , Wei Xu , Ziyuan Qin , Xi Chen , Xiaohu Wu , Kang Li , Qicheng Lao

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

Concept Bottleneck Models (CBMs) introduce interpretability to black-box deep learning models by predicting labels through human-understandable concepts. However, unlike humans, who identify objects at different levels of abstraction using…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Haodong Xie , Yujun Cai , Rahul Singh Maharjan , Yiwei Wang , Federico Tavella , Angelo Cangelosi

Traditional deep learning interpretability methods which are suitable for model users cannot explain network behaviors at the global level and are inflexible at providing fine-grained explanations. As a solution, concept-based explanations…

Human-Computer Interaction · Computer Science 2022-10-26 Jinbin Huang , Aditi Mishra , Bum Chul Kwon , Chris Bryan

The opaque nature of Large Language Models (LLMs) has led to significant research efforts aimed at enhancing their interpretability, primarily through post-hoc methods. More recent in-hoc approaches, such as Concept Bottleneck Models…

Machine Learning · Computer Science 2025-02-20 Or Raphael Bidusa , Shaul Markovitch

Recent advancements in multimodal foundation models (e.g., CLIP) have excelled in zero-shot generalization. Prompt tuning involved in the knowledge transfer from foundation models to downstream tasks has gained significant attention…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xuejing Liu , Wei Tang , Jinghui Lu , Rui Zhao , Zhaojun Guo , Fei Tan

In cross-domain few-shot classification (CFC), recent works mainly focus on adapting a simple transformation head on top of a frozen pre-trained backbone with few labeled data to project embeddings into a task-specific metric space where…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Hongduan Tian , Feng Liu , Zhanke Zhou , Tongliang Liu , Chengqi Zhang , Bo Han