English
Related papers

Related papers: Human-Centered Concept Explanations for Neural Net…

200 papers

Humans use abstract concepts for understanding instead of hard features. Recent interpretability research has focused on human-centered concept explanations of neural networks. Concept Activation Vectors (CAVs) estimate a model's…

Machine Learning · Computer Science 2023-11-28 Avani Gupta , Saurabh Saini , P J Narayanan

Concept Activation Vectors (CAVs) offer insights into neural network decision-making by linking human friendly concepts to the model's internal feature extraction process. However, when a new set of CAVs is discovered, they must still be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Laines Schmalwasser , Jakob Gawlikowski , Joachim Denzler , Julia Niebling

Concepts such as objects, patterns, and shapes are how humans understand the world. Building on this intuition, concept-based explainability methods aim to study representations learned by deep neural networks in relation to…

Machine Learning · Computer Science 2025-05-26 Laines Schmalwasser , Niklas Penzel , Joachim Denzler , Julia Niebling

Concept-based explanations translate the internal representations of deep learning models into a language that humans are familiar with: concepts. One popular method for finding concepts is Concept Activation Vectors (CAVs), which are…

Machine Learning · Computer Science 2025-02-14 Angus Nicolson , Lisa Schut , J. Alison Noble , Yarin Gal

Traditional deep learning interpretability methods which are suitable for model users cannot explain network behaviors at the global level and are inflexible at providing fine-grained explanations. As a solution, concept-based explanations…

Human-Computer Interaction · Computer Science 2022-10-26 Jinbin Huang , Aditi Mishra , Bum Chul Kwon , Chris Bryan

The interpretation of deep neural networks (DNNs) has become a key topic as more and more people apply them to solve various problems and making critical decisions. Concept-based explanations have recently become a popular approach for…

Human-Computer Interaction · Computer Science 2021-08-10 Zhenge Zhao , Panpan Xu , Carlos Scheidegger , Liu Ren

The interpretation of deep learning models is a challenge due to their size, complexity, and often opaque internal state. In addition, many systems, such as image classifiers, operate on low-level features rather than high-level concepts.…

Machine Learning · Statistics 2019-04-05 Been Kim , Martin Wattenberg , Justin Gilmer , Carrie Cai , James Wexler , Fernanda Viegas , Rory Sayres

*Concept-based explanations* offer a promising approach for explaining the predictions of deep neural networks in terms of high-level, human-understandable concepts. However, existing methods either do not establish a causal connection…

Machine Learning · Computer Science 2026-05-08 Ronaldo Canizales , Divya Gopinath , Corina Păsăreanu , Ravi Mangal

Concept-based explanation methods, such as Concept Activation Vectors, are potent means to quantify how abstract or high-level characteristics of input data influence the predictions of complex deep neural networks. However, applying them…

Machine Learning · Computer Science 2023-10-18 Thomas Decker , Michael Lebacher , Volker Tresp

Deep neural networks are complex and opaque. As they enter application in a variety of important and safety critical domains, users seek methods to explain their output predictions. We develop an approach to explaining deep neural networks…

Artificial Intelligence · Computer Science 2018-02-05 Michael Harradon , Jeff Druce , Brian Ruttenberg

The focus of recent research has shifted from merely improving the metrics based performance of Deep Neural Networks (DNNs) to DNNs which are more interpretable to humans. The field of eXplainable Artificial Intelligence (XAI) has observed…

Artificial Intelligence · Computer Science 2024-03-26 Avani Gupta , P J Narayanan

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable…

Machine Learning · Computer Science 2024-10-28 Ashish Ramayee Asokan , Nidarshan Kumar , Anirudh Venkata Ragam , Shylaja S Sharath

With a growing interest in understanding neural network prediction strategies, Concept Activation Vectors (CAVs) have emerged as a popular tool for modeling human-understandable concepts in the latent space. Commonly, CAVs are computed by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Frederik Pahde , Maximilian Dreyer , Leander Weber , Moritz Weckbecker , Christopher J. Anders , Thomas Wiegand , Wojciech Samek , Sebastian Lapuschkin

Concept-based interpretability methods are a popular form of explanation for deep learning models which provide explanations in the form of high-level human interpretable concepts. These methods typically find concept activation vectors…

Machine Learning · Computer Science 2024-08-19 Angus Nicolson , Yarin Gal , J. Alison Noble

Concept-based explainability methods provide insight into deep learning systems by constructing explanations using human-understandable concepts. While the literature on human reasoning demonstrates that we exploit relationships between…

Machine Learning · Computer Science 2024-05-29 Naveen Raman , Mateo Espinosa Zarlenga , Mateja Jamnik

Interpretability has become an important topic of research as more machine learning (ML) models are deployed and widely used to make important decisions. Most of the current explanation methods provide explanations through feature…

Machine Learning · Statistics 2019-10-09 Amirata Ghorbani , James Wexler , James Zou , Been Kim

Uncertainty in machine learning refers to the degree of confidence or lack thereof in a model's predictions. While uncertainty quantification methods exist, explanations of uncertainty, especially in high-dimensional settings, remain an…

Machine Learning · Computer Science 2025-07-30 Isaac Roberts , Alexander Schulz , Sarah Schroeder , Fabian Hinder , Barbara Hammer

Concept-based explanations permit to understand the predictions of a deep neural network (DNN) through the lens of concepts specified by users. Existing methods assume that the examples illustrating a concept are mapped in a fixed direction…

Machine Learning · Computer Science 2022-09-30 Jonathan Crabbé , Mihaela van der Schaar

Using attention weights to identify information that is important for models' decision-making is a popular approach to interpret attention-based neural networks. This is commonly realized in practice through the generation of a heat-map for…

Information Retrieval · Computer Science 2021-06-01 Tian Shi , Xuchao Zhang , Ping Wang , Chandan K. Reddy

Interpreting the inner workings of deep learning models is crucial for establishing trust and ensuring model safety. Concept-based explanations have emerged as a superior approach that is more interpretable than feature attribution…

Machine Learning · Computer Science 2023-07-17 Mara Graziani , Laura O' Mahony , An-Phi Nguyen , Henning Müller , Vincent Andrearczyk
‹ Prev 1 2 3 10 Next ›