English
Related papers

Related papers: Learning New Concepts, Remembering the Old: Contin…

200 papers

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohamed Harmanani , Bining Long , Zhuoxin Guo , Paul F. R. Wilson , Amirhossein Sabour , Minh Nguyen Nhat To , Gabor Fichtinger , Purang Abolmaesumi , Parvin Mousavi

Continual learning (CL) aims to empower machine learning models to learn continually from new data, while building upon previously acquired knowledge without forgetting. As models have evolved from small to large pre-trained architectures,…

Machine Learning · Computer Science 2026-03-31 Dianzhi Yu , Xinni Zhang , Yankai Chen , Aiwei Liu , Yifei Zhang , Philip S. Yu , Irwin King

Concept Bottleneck Models (CBMs) use a set of human-interpretable concepts to predict the final task label, enabling domain experts to not only validate the CBM's predictions, but also intervene on incorrect concepts at test time. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Eric Enouen , Sainyam Galhotra

Current state-of-the-art vision-and-language models are evaluated on tasks either individually or in a multi-task setting, overlooking the challenges of continually learning (CL) tasks as they arrive. Existing CL benchmarks have facilitated…

Computation and Language · Computer Science 2022-11-28 Tejas Srinivasan , Ting-Yun Chang , Leticia Leonor Pinto Alva , Georgios Chochlakis , Mohammad Rostami , Jesse Thomason

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Recent advances in deep learning have led to increasingly complex models with deeper layers and more parameters, reducing interpretability and making their decisions harder to understand. While many methods explain black-box reasoning, most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Nuoye Xiong , Anqi Dong , Ning Wang , Cong Hua , Guangming Zhu , Lin Mei , Peiyi Shen , Liang Zhang

The design of interpretable deep learning models working in relational domains poses an open challenge: interpretable deep learning methods, such as Concept Bottleneck Models (CBMs), are not designed to solve relational problems, while…

Machine Learning · Computer Science 2024-10-28 Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra

Concept bottleneck models (CBMs) are a class of interpretable neural network models that predict the target response of a given input based on its high-level concepts. Unlike the standard end-to-end models, CBMs enable domain experts to…

Machine Learning · Computer Science 2023-07-04 Sungbin Shin , Yohan Jo , Sungsoo Ahn , Namhoon Lee

Concept Bottleneck Models (CBMs) are machine learning models that improve interpretability by grounding their predictions on human-understandable concepts, allowing for targeted interventions in their decision-making process. However, when…

Concept Bottleneck Models (CBMs) enhance interpretability by introducing a layer of human-understandable concepts between inputs and predictions. While recent methods automate concept generation using Large Language Models (LLMs) and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Delong Zhao , Qiang Huang , Di Yan , Yiqun Sun , Jun Yu

Concept Bottleneck Models (CBMs) provide inherent interpretability by first mapping input samples to high-level semantic concepts, followed by a combination of these concepts for the final classification. However, the annotation of…

Machine Learning · Computer Science 2026-03-02 Yangyi Li , Mengdi Huai

Concept bottleneck models (CBM) are a popular way of creating more interpretable neural networks by having hidden layer neurons correspond to human-understandable concepts. However, existing CBMs and their variants have two crucial…

Machine Learning · Computer Science 2023-06-06 Tuomas Oikarinen , Subhro Das , Lam M. Nguyen , Tsui-Wei Weng

Concept Bottleneck Models (CBMs) aim to deliver interpretable predictions by routing decisions through a human-understandable concept layer, yet they often suffer reduced accuracy and concept leakage that undermines faithfulness. We…

Machine Learning · Computer Science 2026-02-17 Karim Galliamov , Syed M Ahsan Kazmi , Adil Khan , Adín Ramírez Rivera

Concept Bottleneck Models (CBMs) have emerged as a promising interpretable method whose final prediction is based on intermediate, human-understandable concepts rather than the raw input. Through time-consuming manual interventions, a user…

Machine Learning · Computer Science 2024-10-18 Moritz Vandenhirtz , Sonia Laguna , Ričards Marcinkevičs , Julia E. Vogt

Concept bottleneck models (CBMs) are inherently interpretable models that make predictions based on human-understandable visual cues, referred to as concepts. As obtaining dense concept annotations with human labeling is demanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Sujin Jeon , Hyundo Lee , Eungseo Kim , Sanghack Lee , Byoung-Tak Zhang , Inwoo Hwang

We introduce Concept Bottleneck Large Language Models (CB-LLMs), a novel framework for building inherently interpretable Large Language Models (LLMs). In contrast to traditional black-box LLMs that rely on limited post-hoc interpretations,…

Computation and Language · Computer Science 2025-09-09 Chung-En Sun , Tuomas Oikarinen , Berk Ustun , Tsui-Wei Weng

Concept Bottleneck Models (CBMs) are regarded as inherently interpretable because they first predict a set of human-defined concepts which are used to predict a task label. For inherent interpretability to be fully realised, and ensure…

Machine Learning · Computer Science 2024-07-31 Jack Furby , Daniel Cunnington , Dave Braines , Alun Preece

Continual learning enables AI systems to acquire new knowledge while retaining previously learned information. While traditional unimodal methods have made progress, the rise of Multimodal Large Language Models (MLLMs) brings new challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Haiyang Guo , Fei Zhu , Hongbo Zhao , Fanhu Zeng , Wenzhuo Liu , Shijie Ma , Da-Han Wang , Xu-Yao Zhang

Current deep learning models are not designed to simultaneously address three fundamental questions: predict class labels to solve a given classification task (the "What?"), simulate changes in the situation to evaluate how this impacts…

Machine Learning · Computer Science 2025-02-21 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Giuseppe Marra , Marc Langheinrich

Advancements in foundation models (FMs) have led to a paradigm shift in machine learning. The rich, expressive feature representations from these pre-trained, large-scale FMs are leveraged for multiple downstream tasks, usually via…

Machine Learning · Computer Science 2024-12-19 Jihye Choi , Jayaram Raghuram , Yixuan Li , Somesh Jha