English
Related papers

Related papers: Corpus-level and Concept-based Explanations for In…

200 papers

Interpretable clustering algorithms aim to group similar data points while explaining the obtained groups to support knowledge discovery and pattern recognition tasks. While most approaches to interpretable clustering construct clusters…

Machine Learning · Computer Science 2024-08-27 Nakul Upadhya , Eldan Cohen

Contrastive explanations clarify why an event occurred in contrast to another. They are more inherently intuitive to humans to both produce and comprehend. We propose a methodology to produce contrastive explanations for classification…

Computation and Language · Computer Science 2021-09-15 Alon Jacovi , Swabha Swayamdipta , Shauli Ravfogel , Yanai Elazar , Yejin Choi , Yoav Goldberg

Concept explanation is a popular approach for examining how human-interpretable concepts impact the predictions of a model. However, most existing methods for concept explanations are tailored to specific models. To address this issue, this…

Machine Learning · Computer Science 2024-01-17 Zhili Feng , Michal Moshkovitz , Dotan Di Castro , J. Zico Kolter

Network-based procedures for topic detection in huge text collections offer an intuitive alternative to probabilistic topic models. We present in detail a method that is especially designed with the requirements of domain experts in mind.…

Computation and Language · Computer Science 2021-07-27 Andreas Hamm , Simon Odrowski

We propose a topic-dependent attention model for sentiment classification and topic extraction. Our model assumes that a global topic embedding is shared across documents and employs an attention mechanism to derive local topic embedding…

Computation and Language · Computer Science 2019-08-20 Gabriele Pergola , Lin Gui , Yulan He

Visual attention plays an important role to understand images and demonstrates its effectiveness in generating natural language descriptions of images. On the other hand, recent studies show that language associated with an image can steer…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Jonghwan Mun , Minsu Cho , Bohyung Han

Layer-wise Relevance Propagation (LRP) and saliency maps have been recently used to explain the predictions of Deep Learning models, specifically in the domain of text classification. Given different attribution-based explanations to…

Information Retrieval · Computer Science 2018-12-04 Wenting Xiong , Iftitahu Ni'mah , Juan M. G. Huesca , Werner van Ipenburg , Jan Veldsink , Mykola Pechenizkiy

Concept Bottleneck Models (CBMs) are neural networks designed to conjoin high performance with ante-hoc interpretability. CBMs work by first mapping inputs (e.g., images) to high-level concepts (e.g., visible objects and their properties)…

Machine Learning · Computer Science 2026-05-12 Nicola Debole , Pietro Barbiero , Francesco Giannini , Andrea Passerini , Stefano Teso , Emanuele Marconato

Diverse and extensive work has recently been conducted on text-conditioned human motion generation. However, progress in the reverse direction, motion captioning, has seen less comparable advancement. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Karim Radouane , Julien Lagarde , Sylvie Ranwez , Andon Tchechmedjiev

Interpretability of machine learning (ML) models becomes more relevant with their increasing adoption. In this work, we address the interpretability of ML based question answering (QA) models on a combination of knowledge bases (KB) and…

Computation and Language · Computer Science 2019-06-27 Alona Sydorova , Nina Poerner , Benjamin Roth

With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yoshihide Sawada , Keigo Nakamura

Concept-bottleneck models (CBMs) are neural classifiers that compute predictions from high-level concepts extracted from the input. CBMs ensure stakeholders can understand the concepts -- and the predictions they entail -- by learning these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Nicola Debole , Andrea Passerini , Stefano Teso , Andrea Pugnana , Emanuele Marconato

Gradient-based explanation methods play an important role in the field of interpreting complex deep neural networks for NLP models. However, the existing work has shown that the gradients of a model are unstable and easily manipulable,…

Computation and Language · Computer Science 2023-02-22 Zhenxiao Cheng , Jie Zhou , Wen Wu , Qin Chen , Liang He

The debate around the interpretability of attention mechanisms is centered on whether attention scores can be used as a proxy for the relative amounts of signal carried by sub-components of data. We propose to study the interpretability of…

Machine Learning · Computer Science 2022-07-27 Jonathan Haab , Nicolas Deutschmann , Maria Rodríguez Martínez

In this introductory article we present the basics of an approach to implementing computational interpreting of natural language aiming to model the meanings of words and phrases. Unlike other approaches, we attempt to define the meanings…

Computation and Language · Computer Science 2019-08-12 Michael Kapustin , Pavlo Kapustin

The Concept Bottleneck Models (CBMs) of Koh et al. [2020] provide a means to ensure that a neural network based classifier bases its predictions solely on human understandable concepts. The concept labels, or rationales as we refer to them,…

Machine Learning · Computer Science 2022-12-20 Joshua Lockhart , Daniele Magazzeni , Manuela Veloso

Human explanations of high-level decisions are often expressed in terms of key concepts the decisions are based on. In this paper, we study such concept-based explainability for Deep Neural Networks (DNNs). First, we define the notion of…

Machine Learning · Computer Science 2022-02-09 Chih-Kuan Yeh , Been Kim , Sercan O. Arik , Chun-Liang Li , Tomas Pfister , Pradeep Ravikumar

Explainability of neural network prediction is essential to understand feature importance and gain interpretable insight into neural network performance. However, explanations of neural network outcomes are mostly limited to visualization,…

Machine Learning · Computer Science 2023-07-13 Arnab Neelim Mazumder , Niall Lyons , Ashutosh Pandey , Avik Santra , Tinoosh Mohsenin

Decision-making usually takes five steps: identifying the problem, collecting data, extracting evidence, identifying pro and con arguments, and making decisions. Focusing on extracting evidence, this paper presents a hybrid model that…

Information Retrieval · Computer Science 2021-02-04 Patrick Abels , Zahra Ahmadi , Sophie Burkhardt , Benjamin Schiller , Iryna Gurevych , Stefan Kramer

Several large cloze-style context-question-answer datasets have been introduced recently: the CNN and Daily Mail news data and the Children's Book Test. Thanks to the size of these datasets, the associated text comprehension task is well…

Computation and Language · Computer Science 2016-06-27 Rudolf Kadlec , Martin Schmid , Ondrej Bajgar , Jan Kleindienst