English
Related papers

Related papers: Shortcuts and Identifiability in Concept-based Mod…

200 papers

There is growing interest in concept-based models (CBMs) that combine high-performance and interpretability by acquiring and reasoning with a vocabulary of high-level concepts. A key requirement is that the concepts be interpretable.…

Machine Learning · Computer Science 2022-10-19 Emanuele Marconato , Andrea Passerini , Stefano Teso

Concept-based explainability methods use human-understandable intermediaries to produce explanations for machine learning models. These methods assume concept predictions can help understand a model's internal reasoning. In this work, we…

Machine Learning · Computer Science 2025-06-26 Naveen Raman , Mateo Espinosa Zarlenga , Juyeon Heo , Mateja Jamnik

To increase the trustworthiness of deep neural networks, it is critical to improve the understanding of how they make decisions. This paper introduces a novel unsupervised concept-based model for image classification, named Learnable…

Machine Learning · Computer Science 2025-06-04 Francesco De Santis , Philippe Bich , Gabriele Ciravegna , Pietro Barbiero , Danilo Giordano , Tania Cerquitelli

Concept-based explanation methods, such as Concept Activation Vectors, are potent means to quantify how abstract or high-level characteristics of input data influence the predictions of complex deep neural networks. However, applying them…

Machine Learning · Computer Science 2023-10-18 Thomas Decker , Michael Lebacher , Volker Tresp

Shapes of cognition is a new conceptual paradigm for the computational cognitive modeling of Language-Endowed Intelligent Agents (LEIAs). Shapes are remembered constellations of sensory, linguistic, conceptual, episodic, and procedural…

Artificial Intelligence · Computer Science 2025-09-17 Marjorie McShane , Sergei Nirenburg , Sanjay Oruganti , Jesse English

Concept bottleneck models (CBMs) are a class of interpretable neural network models that predict the target response of a given input based on its high-level concepts. Unlike the standard end-to-end models, CBMs enable domain experts to…

Machine Learning · Computer Science 2023-07-04 Sungbin Shin , Yohan Jo , Sungsoo Ahn , Namhoon Lee

Models with transparent inner structure and high classification performance are required to reduce potential risk and provide trust for users in domains like health care, finance, security, etc. However, existing models are hard to…

Machine Learning · Computer Science 2020-02-21 Zhuo Wang , Wei Zhang , Ning Liu , Jianyong Wang

Pre-trained language models (PLMs) have been prevailing in state-of-the-art methods for natural language processing, and knowledge-enhanced PLMs are further proposed to promote model performance in knowledge-intensive tasks. However,…

Computation and Language · Computer Science 2024-01-12 Xintao Wang , Zhouhong Gu , Jiaqing Liang , Dakuan Lu , Yanghua Xiao , Wei Wang

The opaque nature of Large Language Models (LLMs) has led to significant research efforts aimed at enhancing their interpretability, primarily through post-hoc methods. More recent in-hoc approaches, such as Concept Bottleneck Models…

Machine Learning · Computer Science 2025-02-20 Or Raphael Bidusa , Shaul Markovitch

Concept Bottleneck Models (CBMs) have garnered increasing attention due to their ability to provide concept-based explanations for black-box deep learning models while achieving high final prediction accuracy using human-like concepts.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Lijie Hu , Tianhao Huang , Huanyi Xie , Xilin Gong , Chenyang Ren , Zhengyu Hu , Lu Yu , Ping Ma , Di Wang

We seek to learn models that we can interact with using high-level concepts: if the model did not think there was a bone spur in the x-ray, would it still predict severe arthritis? State-of-the-art models today do not typically support the…

Machine Learning · Computer Science 2021-01-01 Pang Wei Koh , Thao Nguyen , Yew Siang Tang , Stephen Mussmann , Emma Pierson , Been Kim , Percy Liang

Concept-based learning enhances prediction accuracy and interpretability by leveraging high-level, human-understandable concepts. However, existing CBL frameworks do not address survival analysis tasks, which involve predicting event times…

Machine Learning · Computer Science 2025-02-11 Stanislav R. Kirpichenko , Lev V. Utkin , Andrei V. Konstantinov , Natalya M. Verbova

We consider the problem of visually explaining similarity models, i.e., explaining why a model predicts two images to be similar in addition to producing a scalar score. While much recent work in visual model interpretability has focused on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu

Concept probing has recently gained popularity as a way for humans to peek into what is encoded within artificial neural networks. In concept probing, additional classifiers are trained to map the internal representations of a model into…

Machine Learning · Computer Science 2025-07-28 Manuel de Sousa Ribeiro , Afonso Leote , João Leite

Neurosymbolic systems promise to combine deep neural network's (DNN) processing of raw sensor inputs with few-shot performance of symbolic artificial intelligence. Two-stage approaches explicitly decouple DNN based perception from…

Machine Learning · Computer Science 2026-05-12 Sparsh Tiwari , Bettina Finzel , Gesina Schwalbe

With the advent of semantic web, various tools and techniques have been introduced for presenting and organizing knowledge. Concept hierarchies are one such technique which gained significant attention due to its usefulness in creating…

Artificial Intelligence · Computer Science 2016-11-30 V. S. Anoop , S. Asharaf , P. Deepak

An important line of research attempts to explain CNN image classifier predictions and intermediate layer representations in terms of human-understandable concepts. Previous work supports that deep representations are linearly separable…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Alexandros Doumanoglou , Stylianos Asteriadis , Dimitrios Zarpalas

Object recognition has become a crucial part of machine learning and computer vision recently. The current approach to object recognition involves Deep Learning and uses Convolutional Neural Networks to learn the pixel patterns of the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Abrar Ahmed , Anish Bikmal

In this paper, we address the challenging problem of 3D concept grounding (i.e. segmenting and learning visual concepts) by looking at RGBD images and reasoning about paired questions and answers. Existing visual reasoning approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Yining Hong , Yilun Du , Chunru Lin , Joshua B. Tenenbaum , Chuang Gan

Neurosymbolic AI is growing in popularity thanks to its ability to combine neural perception and symbolic reasoning in end-to-end trainable models. However, recent findings reveal these are prone to shortcut reasoning, i.e., to learning…

Machine Learning · Computer Science 2026-02-02 Luca Andolfi , Eleonora Giunchiglia