English
Related papers

Related papers: Language in a Bottle: Language Model Guided Concep…

200 papers

We revisit language bottleneck models as an approach to ensuring the explainability of deep learning models for image classification. Because of inevitable information loss incurred in the step of converting images into language, the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Honori Udo , Takafumi Koshinaka

Concept Bottleneck Models (CBMs), which break down the reasoning process into the input-to-concept mapping and the concept-to-label prediction, have garnered significant attention due to their remarkable interpretability achieved by the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Qihan Huang , Jie Song , Jingwen Hu , Haofei Zhang , Yong Wang , Mingli Song

Existing methods, such as concept bottleneck models (CBMs), have been successful in providing concept-based interpretations for black-box deep learning models. They typically work by predicting concepts given the input and then predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Xinyue Xu , Yi Qin , Lu Mi , Hao Wang , Xiaomeng Li

Concept Bottleneck Models (CBMs) are regarded as inherently interpretable because they first predict a set of human-defined concepts which are used to predict a task label. For inherent interpretability to be fully realised, and ensure…

Machine Learning · Computer Science 2024-07-31 Jack Furby , Daniel Cunnington , Dave Braines , Alun Preece

Concept bottleneck models (CBM) aim to produce inherently interpretable models that rely on human-understandable concepts for their predictions. However, existing approaches to design interpretable generative models based on CBMs are not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Akshay Kulkarni , Ge Yan , Chung-En Sun , Tuomas Oikarinen , Tsui-Wei Weng

We propose a novel architecture and method of explainable classification with Concept Bottleneck Models (CBMs). While SOTA approaches to Image Classification task work as a black box, there is a growing demand for models that would provide…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Andrei Semenov , Vladimir Ivanov , Aleksandr Beznosikov , Alexander Gasnikov

Developing high-performing, yet interpretable models remains a critical challenge in modern AI. Concept-based models (CBMs) attempt to address this by extracting human-understandable concepts from a global encoding (e.g., image encoding)…

Machine Learning · Computer Science 2025-10-08 David Steinmann , Wolfgang Stammer , Antonia Wüst , Kristian Kersting

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

Concept Bottleneck Models (CBMs) enhance the interpretability of neural networks by basing predictions on human-understandable concepts. However, current CBMs typically rely on concept sets extracted from large language models or extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Katharina Prasse , Patrick Knab , Sascha Marton , Christian Bartelt , Margret Keuper

Concept Bottleneck Models (CBMs) ground predictions in human-understandable concepts but face fundamental limitations: the absence of a metric to pre-evaluate concept relevance, the "linearity problem" causing recent CBMs to bypass the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Merve Tapli , Quentin Bouniot , Wolfgang Stammer , Zeynep Akata , Emre Akbas

Advancements in foundation models (FMs) have led to a paradigm shift in machine learning. The rich, expressive feature representations from these pre-trained, large-scale FMs are leveraged for multiple downstream tasks, usually via…

Machine Learning · Computer Science 2024-12-19 Jihye Choi , Jayaram Raghuram , Yixuan Li , Somesh Jha

Concept Bottleneck Models (CBMs) provide a basis for semantic abstractions within a neural network architecture. Such models have primarily been seen through the lens of interpretability so far, wherein they offer transparency by inferring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Deepika SN Vemuri , Gautham Bellamkonda , Aditya Pola , Vineeth N Balasubramanian

Concept-based models are an emerging paradigm in deep learning that constrains the inference process to operate through human-interpretable variables, facilitating explainability and human interaction. However, these architectures, on par…

Recently impressive performance has been achieved in Concept Bottleneck Models (CBM) by utilizing the image-text alignment learned by a large pre-trained vision-language model (i.e. CLIP). However, there exist two key limitations in concept…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Minghong Zhong , Guoshuai Zou , Kanghao Chen , Dexia Chen , Ruixuan Wang

We introduce Concept Bottleneck Protein Language Models (CB-pLM), a generative masked language model with a layer where each neuron corresponds to an interpretable concept. Our architecture offers three key benefits: i) Control: We can…

Concept Bottleneck Models (CBMs) aim to improve interpretability in Deep Learning by structuring predictions through human-understandable concepts, but they provide no way to verify whether learned concepts align with the human's intended…

Machine Learning · Computer Science 2026-05-22 Stefano Colamonaco , David Debot , Pietro Barbiero , Giuseppe Marra

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Machine learning is a vital part of many real-world systems, but several concerns remain about the lack of interpretability, explainability and robustness of black-box AI systems. Concept Bottleneck Models (CBM) address some of these…

Machine Learning · Statistics 2025-10-24 Hidde Fokkema , Tim van Erven , Sara Magliacane