English
Related papers

Related papers: Knowledge graphs for empirical concept retrieval

200 papers

Humans use abstract concepts for understanding instead of hard features. Recent interpretability research has focused on human-centered concept explanations of neural networks. Concept Activation Vectors (CAVs) estimate a model's…

Machine Learning · Computer Science 2023-11-28 Avani Gupta , Saurabh Saini , P J Narayanan

Convolutional neural network (CNN) models for computer vision are powerful but lack explainability in their most basic form. This deficiency remains a key challenge when applying CNNs in important domains. Recent work on explanations…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Ruihan Zhang , Prashan Madumal , Tim Miller , Krista A. Ehinger , Benjamin I. P. Rubinstein

Explainable AI (XAI) aims to address the human need for safe and reliable AI systems. However, numerous surveys emphasize the absence of a sound mathematical formalization of key XAI notions -- remarkably including the term "explanation"…

Artificial Intelligence · Computer Science 2023-09-19 Pietro Barbiero , Stefano Fioravanti , Francesco Giannini , Alberto Tonda , Pietro Lio , Elena Di Lavore

Attribution methods, which employ heatmaps to identify the most influential regions of an image that impact model decisions, have gained widespread popularity as a type of explainability method. However, recent research has exposed the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Thomas Fel , Agustin Picard , Louis Bethune , Thibaut Boissin , David Vigouroux , Julien Colin , Rémi Cadène , Thomas Serre

In safety-critical applications, practitioners are reluctant to trust neural networks when no interpretable explanations are available. Many attempts to provide such explanations revolve around pixel-based attributions or use previously…

Machine Learning · Computer Science 2022-07-25 Armeen Taeb , Nicolo Ruggeri , Carina Schnuck , Fanny Yang

Concept induction, which is based on formal logical reasoning over description logics, has been used in ontology engineering in order to create ontology (TBox) axioms from the base data (ABox) graph. In this paper, we show that it can also…

With a growing interest in understanding neural network prediction strategies, Concept Activation Vectors (CAVs) have emerged as a popular tool for modeling human-understandable concepts in the latent space. Commonly, CAVs are computed by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Frederik Pahde , Maximilian Dreyer , Leander Weber , Moritz Weckbecker , Christopher J. Anders , Thomas Wiegand , Wojciech Samek , Sebastian Lapuschkin

In this report we present a new model of concepts, based on the framework of variational autoencoders, which is designed to have attractive properties such as factored conceptual domains, and at the same time be learnable from data. The…

Machine Learning · Computer Science 2022-03-23 Razin A. Shaikh , Sara Sabrina Zemljic , Sean Tull , Stephen Clark

The conversational search paradigm introduces a step change over the traditional search paradigm by allowing users to interact with search agents in a multi-turn and natural fashion. The conversation flows naturally and is usually centered…

Computation and Language · Computer Science 2021-04-15 Mariana Leite , Rafael Ferreira , David Semedo , João Magalhães

As an emerging interpretable technique, Generalized Additive Models (GAMs) adopt neural networks to individually learn non-linear functions for each feature, which are then combined through a linear model for final predictions. Although…

Machine Learning · Computer Science 2024-08-01 Viet Duong , Qiong Wu , Zhengyi Zhou , Hongjue Zhao , Chenxiang Luo , Eric Zavesky , Huaxiu Yao , Huajie Shao

In this paper we provide a comprehensive introduction to knowledge graphs, which have recently garnered significant attention from both industry and academia in scenarios that require exploiting diverse, dynamic, large-scale collections of…

Human knowledge provides a formal understanding of the world. Knowledge graphs that represent structural relations between entities have become an increasingly popular research direction towards cognition and human-level intelligence. In…

Computation and Language · Computer Science 2021-04-02 Shaoxiong Ji , Shirui Pan , Erik Cambria , Pekka Marttinen , Philip S. Yu

Interactive recommender systems have emerged as a promising paradigm to overcome the limitations of the primitive user feedback used by traditional recommender systems (e.g., clicks, item consumption, ratings). They allow users to express…

Concept-based interpretability methods aim to explain deep neural network model predictions using a predefined set of semantic concepts. These methods evaluate a trained model on a new, "probe" dataset and correlate model predictions with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Ruth Fong , Olga Russakovsky

Concept-based machine learning methods have increasingly gained importance due to the growing interest in making neural networks interpretable. However, concept annotations are generally challenging to obtain, making it crucial to leverage…

Machine Learning · Computer Science 2024-11-06 Alba Carballo-Castro , Sonia Laguna , Moritz Vandenhirtz , Julia E. Vogt

Concept-based interpretations of black-box models are often more intuitive for humans to understand. The most widely adopted approach for concept-based interpretation is Concept Activation Vector (CAV). CAV relies on learning a linear…

Machine Learning · Computer Science 2024-02-07 Andrew Bai , Chih-Kuan Yeh , Pradeep Ravikumar , Neil Y. C. Lin , Cho-Jui Hsieh

A core assumption of Explainable AI (XAI) is that explanations are useful to users -- that is, users will do something with the explanations. Prior work, however, does not clearly connect the information provided in explanations to user…

Human-Computer Interaction · Computer Science 2026-01-29 Gennie Mansi , Julia Kim , Mark Riedl

Natural language definitions of terms can serve as a rich source of knowledge, but structuring them into a comprehensible semantic model is essential to enable them to be used in semantic interpretation tasks. We propose a method and…

Computation and Language · Computer Science 2018-06-21 Vivian S. Silva , André Freitas , Siegfried Handschuh

We explore the interpretability of 3D geometric deep learning models in the context of Computer-Aided Design (CAD). The field of parametric CAD can be limited by the difficulty of expressing high-level design concepts in terms of a few…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Stefan Druc , Aditya Balu , Peter Wooldridge , Adarsh Krishnamurthy , Soumik Sarkar

The large success of deep learning based methods in Visual Question Answering (VQA) has concurrently increased the demand for explainable methods. Most methods in Explainable Artificial Intelligence (XAI) focus on generating post-hoc…

Computation and Language · Computer Science 2024-03-28 Pascal Tilli , Ngoc Thang Vu