English
Related papers

Related papers: Constructing Concept-based Models to Mitigate Spur…

200 papers

We seek to learn models that we can interact with using high-level concepts: if the model did not think there was a bone spur in the x-ray, would it still predict severe arthritis? State-of-the-art models today do not typically support the…

Machine Learning · Computer Science 2021-01-01 Pang Wei Koh , Thao Nguyen , Yew Siang Tang , Stephen Mussmann , Emma Pierson , Been Kim , Percy Liang

With growing demand for interpretability in deep learning, especially in high stakes domains, Concept Bottleneck Models (CBMs) address this by inserting human understandable concepts into the prediction pipeline, but they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiakai Lin , Jinchang Zhang , Guoyu Lu

Concept Bottleneck Models (CBMs) enable interpretable image classification by structuring predictions around human-understandable concepts, but extending this paradigm to video remains challenging due to the difficulty of extracting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Patrick Knab , Sascha Marton , Philipp J. Schubert , Drago Guggiana , Christian Bartelt

Concept bottleneck models map from raw inputs to concepts, and then from concepts to targets. Such models aim to incorporate pre-specified, high-level concepts into the learning procedure, and have been motivated to meet three desiderata:…

Machine Learning · Computer Science 2021-05-11 Andrei Margeloiu , Matthew Ashman , Umang Bhatt , Yanzhi Chen , Mateja Jamnik , Adrian Weller

Concept Bottleneck Models (CBMs) enhance the interpretability of end-to-end neural networks by introducing a layer of concepts and predicting the class label from the concept predictions. A key property of CBMs is that they support…

Machine Learning · Computer Science 2026-03-03 Weixin Chen , Han Zhao

Deep learning has achieved remarkable success in image recognition, yet their inherent opacity poses challenges for deployment in critical domains. Concept-based interpretations aim to address this by explaining model reasoning through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shizhan Gong , Xiaofan Zhang , Qi Dou

Large Language Models (LLMs) are so powerful that they sometimes learn correlations between labels and features that are irrelevant to the task, leading to poor generalization on out-of-distribution data. We propose explanation-based…

Computation and Language · Computer Science 2023-06-07 Josh Magnus Ludan , Yixuan Meng , Tai Nguyen , Saurabh Shah , Qing Lyu , Marianna Apidianaki , Chris Callison-Burch

Machine learning models are known to learn spurious correlations, i.e., features having strong relations with class labels but no causal relation. Relying on those correlations leads to poor performance in the data groups without these…

Machine Learning · Computer Science 2026-04-28 Phuong Quynh Le , Jörg Schlötterer , Christin Seifert

As machine learning (ML) models and datasets increase in complexity, the demand for methods that enhance explainability and interpretability becomes paramount. Prototypes, by encapsulating essential characteristics within data, offer…

Machine Learning · Computer Science 2024-08-20 Orfeas Menis-Mastromichalakis , Giorgos Filandrianos , Jason Liartis , Edmund Dervakos , Giorgos Stamou

Recent advances in deep learning have led to increasingly complex models with deeper layers and more parameters, reducing interpretability and making their decisions harder to understand. While many methods explain black-box reasoning, most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Nuoye Xiong , Anqi Dong , Ning Wang , Cong Hua , Guangming Zhu , Lin Mei , Peiyi Shen , Liang Zhang

Despite strong average-case performance, deep learning models often exhibit systematic errors on specific population groups, known as error slices. Identifying these groups and the root causes of their failures is critical for model…

Machine Learning · Computer Science 2026-05-29 Yael Konforti , Mateo Espinosa Zarlenga , Elaf Almahmoud , Mateja Jamnik

Concept-based models perform prediction using a set of concepts that are interpretable to stakeholders. However, such models often involve a fixed, large number of concepts, which may place a substantial cognitive load on stakeholders. We…

Human-Computer Interaction · Computer Science 2023-06-16 Matthew Barker , Katherine M. Collins , Krishnamurthy Dvijotham , Adrian Weller , Umang Bhatt

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

Computation and Language · Computer Science 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

We introduce structural causal bottleneck models (SCBMs), a novel class of structural causal models. At the core of SCBMs lies the assumption that causal effects between high-dimensional variables only depend on low-dimensional summary…

Machine Learning · Statistics 2026-03-17 Simon Bing , Jonas Wahl , Jakob Runge

Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence research. While contemporary methods enable the automatic discovery of complex patterns, they are prone to failure when…

Machine Learning · Computer Science 2026-05-05 Samuel J. Bell , Skyler Wang

Concept-based Models are a class of inherently explainable networks that improve upon standard Deep Neural Networks by providing a rationale behind their predictions using human-understandable `concepts'. With these models being highly…

Machine Learning · Computer Science 2025-06-06 Sanchit Sinha , Aidong Zhang

Concept bottleneck models have been successfully used for explainable machine learning by encoding information within the model with a set of human-defined concepts. In the context of human-assisted or autonomous driving, explainability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jessica Echterhoff , An Yan , Kyungtae Han , Amr Abdelraouf , Rohit Gupta , Julian McAuley

Concept-based approaches, which aim to identify human-understandable concepts within a model's internal representations, are a promising method for interpreting embeddings from deep neural network models, such as CLIP. While these…

Machine Learning · Computer Science 2025-06-18 Jitian Zhao , Chenghui Li , Frederic Sala , Karl Rohe

Interpretability is a crucial aspect of machine learning models that enables humans to understand and trust the decision-making process of these models. In many real-world applications, the interpretability of models is essential for legal,…

Machine Learning · Statistics 2023-07-18 Shree Charran R , Sandipan Das Mahapatra

In recent years, the black-box nature of deep learning models has limited their application in high-stakes domains such as medical diagnosis and finance, where interpretability is essential. To address this, we propose a novel approach…

Computation and Language · Computer Science 2026-05-26 Yike Sun , Mingkun Xu , Mu You , Zhongzhi He , Henghua Shen , Zehan Tan , Derek F. Wong , Tao Fang