English
Related papers

Related papers: Bayesian Concept Bottleneck Models with LLM Priors

200 papers

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a new task. This issue is especially pronounced in class incremental learning (CIL), which is…

Machine Learning · Computer Science 2026-04-17 Amirhosein Javadi , Tuomas Oikarinen , Tara Javidi , Tsui-Wei Weng

Concept bottleneck models (CBMs) are inherently interpretable and intervenable neural network models, which explain their final label prediction by the intermediate prediction of high-level semantic concepts. However, they require target…

Machine Learning · Computer Science 2026-04-06 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa , Yasutoshi Ida

Concept Bottleneck Models (CBMs) have emerged as a promising interpretable method whose final prediction is based on intermediate, human-understandable concepts rather than the raw input. Through time-consuming manual interventions, a user…

Machine Learning · Computer Science 2024-10-18 Moritz Vandenhirtz , Sonia Laguna , Ričards Marcinkevičs , Julia E. Vogt

Deep neural networks have achieved remarkable success in computer vision; however, their black-box nature in decision-making limits interpretability and trust, particularly in safety-critical applications. Interpretability is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ran Eisenberg , Amit Rozner , Ethan Fetaya , Ofir Lindenbaum

Accurately assessing student knowledge is central to education. Cognitive Diagnosis (CD) models estimate student proficiency at a fixed point in time, while Knowledge Tracing (KT) methods model evolving knowledge states to predict future…

Computation and Language · Computer Science 2026-02-10 Antonin Berthon , Mihaela van der Schaar

Current deep learning models are not designed to simultaneously address three fundamental questions: predict class labels to solve a given classification task (the "What?"), simulate changes in the situation to evaluate how this impacts…

Machine Learning · Computer Science 2025-02-21 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Giuseppe Marra , Marc Langheinrich

Recent advances in deep learning have led to increasingly complex models with deeper layers and more parameters, reducing interpretability and making their decisions harder to understand. While many methods explain black-box reasoning, most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Nuoye Xiong , Anqi Dong , Ning Wang , Cong Hua , Guangming Zhu , Lin Mei , Peiyi Shen , Liang Zhang

Concept-based models are an emerging paradigm in deep learning that constrains the inference process to operate through human-interpretable variables, facilitating explainability and human interaction. However, these architectures, on par…

Concept Bottleneck Models (CBMs) are interpretable models that predict the target variable through high-level human-understandable concepts, allowing users to intervene on mispredicted concepts to adjust the final output. While recent work…

Machine Learning · Computer Science 2026-03-17 Wiktor Jan Hoffmann , Sonia Laguna , Moritz Vandenhirtz , Emanuele Palumbo , Julia E. Vogt

Pretrained language models (PLMs) have made significant strides in various natural language processing tasks. However, the lack of interpretability due to their ``black-box'' nature poses challenges for responsible implementation. Although…

Computation and Language · Computer Science 2023-11-10 Zhen Tan , Lu Cheng , Song Wang , Yuan Bo , Jundong Li , Huan Liu

Interpretability is a crucial factor in building reliable models for various medical applications. Concept Bottleneck Models (CBMs) enable interpretable image classification by utilizing human-understandable concepts as intermediate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Injae Kim , Jongha Kim , Joonmyung Choi , Hyunwoo J. Kim

Enhancing model interpretability can address spurious correlations by revealing how models draw their predictions. Concept Bottleneck Models (CBMs) can provide a principled way of disclosing and guiding model behaviors through…

Machine Learning · Computer Science 2024-07-15 Jeeyung Kim , Ze Wang , Qiang Qiu

Concept bottleneck models (CBMs) are interpretable models that first predict a set of semantically meaningful features, i.e., concepts, from observations that are subsequently used to condition a downstream task. However, the model's…

Machine Learning · Computer Science 2023-12-04 Renos Zabounidis , Ini Oguntola , Konghao Zhao , Joseph Campbell , Simon Stepputtis , Katia Sycara

We introduce Concept Bottleneck Reward Models (CB-RM), a reward modeling framework that enables interpretable preference learning through selective concept annotation. Unlike standard RLHF methods that rely on opaque reward functions, CB-RM…

Machine Learning · Computer Science 2025-07-22 Sonia Laguna , Katarzyna Kobalczyk , Julia E. Vogt , Mihaela Van der Schaar

This paper introduces a novel Bayesian learning model to explain the behavior of Large Language Models (LLMs), focusing on their core optimization metric of next token prediction. We develop a theoretical framework based on an ideal…

Machine Learning · Computer Science 2024-09-25 Siddhartha Dalal , Vishal Misra

Concept Bottleneck Models (CBMs) aim to enhance interpretability by predicting human-understandable concepts as intermediates for decision-making. However, these models often face challenges in ensuring reliable concept representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yuxuan Cai , Xiyu Wang , Satoshi Tsutsui , Winnie Pang , Bihan Wen

Concept Bottleneck Models (CBMs) aim to deliver interpretable and interventionable predictions by bridging features and labels with human-understandable concepts. While recent CBMs show promising potential, they suffer from information…

Machine Learning · Computer Science 2024-02-12 Ao Sun , Yuanyuan Yuan , Pingchuan Ma , Shuai Wang

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sangwon Kim , Dasom Ahn , Byoung Chul Ko , In-su Jang , Kwang-Ju Kim

The increasing use of neural networks in various applications has lead to increasing apprehensions, underscoring the necessity to understand their operations beyond mere final predictions. As a solution to enhance model transparency,…

Machine Learning · Computer Science 2023-11-21 Ivaxi Sheth , Samira Ebrahimi Kahou
‹ Prev 1 3 4 5 6 7 10 Next ›