English
Related papers

Related papers: On the Concept Trustworthiness in Concept Bottlene…

200 papers

Rising usage of deep neural networks to perform decision making in critical applications like medical diagnosis and financial analysis have raised concerns regarding their reliability and trustworthiness. As automated systems become more…

Machine Learning · Computer Science 2022-11-30 Sanchit Sinha , Mengdi Huai , Jianhui Sun , Aidong Zhang

Evaluating off-policy decisions using batch data poses significant challenges due to limited sample sizes leading to high variance. To improve Off-Policy Evaluation (OPE), we must identify and address the sources of this variance. Recent…

Machine Learning · Statistics 2024-12-02 Ritam Majumdar , Jack Teversham , Sonali Parbhoo

This paper addresses explainable AI (XAI) through the lens of Concept Bottleneck Models (CBMs) that do not require explicit concept annotations, relying instead on concepts extracted using CLIP in a zero-shot manner. We show that CLIP,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Rémi Kazmierczak , Steve Azzolin , Eloïse Berthier , Goran Frehse , Gianni Franchi

With the growing popularity of general-purpose Large Language Models (LLMs), comes a need for more global explanations of model behaviors. Concept-based explanations arise as a promising avenue for explaining high-level patterns learned by…

Artificial Intelligence · Computer Science 2024-10-07 Meng Li , Haoran Jin , Ruixuan Huang , Zhihao Xu , Defu Lian , Zijia Lin , Di Zhang , Xiting Wang

Concept bottleneck models (CBM) aim to improve model interpretability by predicting human level "concepts" in a bottleneck within a deep learning model architecture. However, how the predicted concepts are used in predicting the target…

Machine Learning · Computer Science 2025-04-15 Matthew Shen , Aliyah Hsu , Abhineet Agarwal , Bin Yu

We introduce Concept Bottleneck Protein Language Models (CB-pLM), a generative masked language model with a layer where each neuron corresponds to an interpretable concept. Our architecture offers three key benefits: i) Control: We can…

Deep learning models have achieved strong performance in medical image analysis, but their internal decision processes remain difficult to interpret. Concept Bottleneck Models (CBMs) partially address this limitation by structuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Getamesay Dagnaw , Xuefei Yin , Muhammad Hassan Maqsood , Yanming Zhu , Alan Wee-Chung Liew

Extreme ocean phenomena are challenging not only to predict but to diagnose, as accurate forecasts alone do not reveal the underlying physical drivers. While recent machine learning approaches achieve strong predictive skill, they remain…

Machine Learning · Computer Science 2026-05-14 Sanah Suri , Kieran Ringel , Maike Sonnewald

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

Despite their success in various domains, the growing dependence on GNNs raises a critical concern about the nature of the combinatorial reasoning underlying their predictions, which is often hidden within their black-box architectures.…

Machine Learning · Computer Science 2026-03-03 Yue Niu , Zhaokai Sun , Jiayi Yang , Xiaofeng Cao , Rui Fan , Xin Sun , Hanli Wang , Wei Ye

Long-horizon interactions require language models to manage accumulating information: when to update their state, when to preserve their state, and what to ignore. We study this challenge as \textbf{Contextual Belief Management (CBM)}:…

Artificial Intelligence · Computer Science 2026-05-29 Haoming Xu , Weihong Xu , Zongrui Li , Mengru Wang , Yunzhi Yao , Chiyu Wu , Jin Shang , Yu Gong , Shumin Deng

With growing demand for interpretability in deep learning, especially in high stakes domains, Concept Bottleneck Models (CBMs) address this by inserting human understandable concepts into the prediction pipeline, but they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiakai Lin , Jinchang Zhang , Guoyu Lu

Pretrained language models (PLMs) have made significant strides in various natural language processing tasks. However, the lack of interpretability due to their ``black-box'' nature poses challenges for responsible implementation. Although…

Computation and Language · Computer Science 2023-11-10 Zhen Tan , Lu Cheng , Song Wang , Yuan Bo , Jundong Li , Huan Liu

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

Machine Learning · Computer Science 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic

Concept-based learning enhances prediction accuracy and interpretability by leveraging high-level, human-understandable concepts. However, existing CBL frameworks do not address survival analysis tasks, which involve predicting event times…

Machine Learning · Computer Science 2025-02-11 Stanislav R. Kirpichenko , Lev V. Utkin , Andrei V. Konstantinov , Natalya M. Verbova

Successful group meetings, such as those implemented in group behavioral-change programs, work meetings, and other social contexts, must promote individual goal setting and execution while strengthening the social relationships within the…

Computation and Language · Computer Science 2025-08-07 Xinyu Zhao , Zhen Tan , Maya Enisman , Minjae Seo , Marta R. Durantini , Dolores Albarracin , Tianlong Chen

Deep learning has advanced NLP, but interpretability remains limited, especially in healthcare and finance. Concept bottleneck models tie predictions to human concepts in vision, but NLP versions either use binary activations that harm text…

Computation and Language · Computer Science 2026-03-31 Yibo Yang

Concept-based Models are a class of inherently explainable networks that improve upon standard Deep Neural Networks by providing a rationale behind their predictions using human-understandable `concepts'. With these models being highly…

Machine Learning · Computer Science 2025-06-06 Sanchit Sinha , Aidong Zhang

We introduce the Consensus-Bottleneck Asset Pricing Model (CB-APM), which embeds aggregate analyst consensus as a structural bottleneck, treating professional beliefs as a sufficient statistic for the market's high-dimensional information…

Pricing of Securities · Quantitative Finance 2026-04-27 Changeun Kim , Younwoo Jeong , Bong-Gyu Jang

Recent advancements in post-hoc and inherently interpretable methods have markedly enhanced the explanations of black box classifier models. These methods operate either through post-analysis or by integrating concept learning during model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Bor-Shiun Wang , Chien-Yi Wang , Wei-Chen Chiu