English
Related papers

Related papers: Post-hoc Stochastic Concept Bottleneck Models

200 papers

Concept bottleneck models (CBMs) have emerged as critical tools in domains where interpretability is paramount. These models rely on predefined textual descriptions, referred to as concepts, to inform their decision-making process and offer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Maor Dikter , Tsachi Blau , Chaim Baskin

Deep neural networks have achieved remarkable success in computer vision; however, their black-box nature in decision-making limits interpretability and trust, particularly in safety-critical applications. Interpretability is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ran Eisenberg , Amit Rozner , Ethan Fetaya , Ofir Lindenbaum

It is known that neural networks have the problem of being over-confident when directly using the output label distribution to generate uncertainty measures. Existing methods mainly resolve this issue by retraining the entire model to…

Machine Learning · Computer Science 2022-12-15 Maohao Shen , Yuheng Bu , Prasanna Sattigeri , Soumya Ghosh , Subhro Das , Gregory Wornell

Concept Bottleneck Models (CBMs) in medical imaging aim to improve model interpretability by predicting intermediate clinical concepts before final diagnoses. However, most existing CBMs treat concepts as discriminative predictors of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

Existing Score-Based Models (SBMs) can be categorized into constrained SBMs (CSBMs) or unconstrained SBMs (USBMs) according to their parameterization approaches. CSBMs model probability density functions as Boltzmann distributions, and…

Machine Learning · Computer Science 2023-06-06 Chen-Hao Chao , Wei-Fang Sun , Bo-Wun Cheng , Chun-Yi Lee

Concept Bottleneck Models (CBMs) map dense feature representations into human-interpretable concepts which are then combined linearly to make a prediction. However, modern CBMs rely on the CLIP model to obtain image-concept annotations, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fawaz Sammani , Jonas Fischer , Nikos Deligiannis

Predicting socioeconomic indicators from satellite imagery with deep learning has become an increasingly popular research direction. Post-hoc concept-based explanations can be an important step towards broader adoption of these models in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ivica Obadic , Alex Levering , Lars Pennig , Dario Oliveira , Diego Marcos , Xiaoxiang Zhu

Restricted Boltzmann Machines (RBMs) are generative models which can learn useful representations from samples of a dataset in an unsupervised fashion. They have been widely employed as an unsupervised pre-training method in machine…

Machine Learning · Statistics 2013-09-13 Chris Häusler , Alex Susemihl , Martin P Nawrot , Manfred Opper

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

Constrained machine learning enables fairness-aware training, physics-informed neural networks, and integration of symbolic domain knowledge into statistical models. Despite its practical importance, no general method exists for the…

Machine Learning · Computer Science 2026-05-20 Adam Bosák , Andrii Kliachkin , Jana Lepšová , Gilles Bareilles , Jakub Mareček

Sequential Monte Carlo (SMC) methods offer a principled approach to Bayesian uncertainty quantification but are traditionally limited by the need for full-batch gradient evaluations. We introduce a scalable variant by incorporating…

Machine Learning · Statistics 2025-05-20 Andrew Millard , Zheng Zhao , Joshua Murphy , Simon Maskell

Evaluating off-policy decisions using batch data poses significant challenges due to limited sample sizes leading to high variance. To improve Off-Policy Evaluation (OPE), we must identify and address the sources of this variance. Recent…

Machine Learning · Statistics 2024-12-02 Ritam Majumdar , Jack Teversham , Sonali Parbhoo

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

In recent years, the black-box nature of deep learning models has limited their application in high-stakes domains such as medical diagnosis and finance, where interpretability is essential. To address this, we propose a novel approach…

Computation and Language · Computer Science 2026-05-26 Yike Sun , Mingkun Xu , Mu You , Zhongzhi He , Henghua Shen , Zehan Tan , Derek F. Wong , Tao Fang

We seek to learn models that we can interact with using high-level concepts: if the model did not think there was a bone spur in the x-ray, would it still predict severe arthritis? State-of-the-art models today do not typically support the…

Machine Learning · Computer Science 2021-01-01 Pang Wei Koh , Thao Nguyen , Yew Siang Tang , Stephen Mussmann , Emma Pierson , Been Kim , Percy Liang

Bayesian Knowledge Tracing (BKT) is a widely used and interpretable student modeling approach in intelligent tutoring systems and educational data mining. However, most implementations rely on expectation-maximization or related…

Human-Computer Interaction · Computer Science 2026-05-25 Siddhartha Pradhan , Yanping Pei , Morgan Lee , Puyuan Zhang , Erin Ottmar , Adam C. Sales

Concept Bottleneck Models (CBMs) have emerged as a cornerstone approach for interpretable machine learning, providing human-understandable intermediate representations through explicit concept activations. However, this interpretability…

Machine Learning · Computer Science 2026-05-26 Aditya Sridhar

Concept-based (CB) models provide interpretability and support test-time human intervention, while standard neural networks (NN) offer strong task performance but little transparency. Prior work has explored hybrid formulations that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Tores Julie , Sun Rémy , Sassatelli Lucile , Ancarani Elisa , Wu Hui-Yin , Precioso Frédéric

Stochastic differential equation mixed-effects models (SDEMEMs) are flexible hierarchical models that are able to account for random variability inherent in the underlying time-dynamics, as well as the variability between experimental units…

Computation · Statistics 2021-01-22 Samuel Wiqvist , Andrew Golightly , Ashleigh T. McLean , Umberto Picchini

Stochastic embedding transitions introduce a probabilistic mechanism for adjusting token representations dynamically during inference, mitigating the constraints imposed through static or deterministic embeddings. A transition framework was…

Computation and Language · Computer Science 2025-08-11 Stefan Whitaker , Colin Sisate , Marcel Windsor , Nikolai Fairweather , Tarquin Goldborough , Oskar Lindenfeld