English
Related papers

Related papers: Explaining with Contrastive Phrasal Highlighting: …

200 papers

State-of-the-art NLP methods achieve human-like performance on many tasks, but make errors nevertheless. Characterizing these errors in easily interpretable terms gives insight into whether a classifier is prone to making systematic errors,…

Computation and Language · Computer Science 2023-11-21 Michael A. Hedderich , Jonas Fischer , Dietrich Klakow , Jilles Vreeken

Pre-trained language models (PLMs) have made significant advances in natural language inference (NLI) tasks, however their sensitivity to textual perturbations and dependence on large datasets indicate an over-reliance on shallow…

Machine Learning · Computer Science 2025-02-14 Mingyue Liu , Ryo Ueda , Zhen Wan , Katsumi Inoue , Chris G. Willcocks

The main objective of explanations is to transmit knowledge to humans. This work proposes to construct informative explanations for predictions made from machine learning models. Motivated by the observations from social sciences, our…

Artificial Intelligence · Computer Science 2018-05-29 Freddy Lecue , Jiewen Wu

Neural predictive models have achieved remarkable performance improvements in various natural language processing tasks. However, most neural predictive models suffer from the lack of explainability of predictions, limiting their practical…

Computation and Language · Computer Science 2021-06-01 Dongfang Li , Jingcong Tao , Qingcai Chen , Baotian Hu

Layer-wise Relevance Propagation (LRP) and saliency maps have been recently used to explain the predictions of Deep Learning models, specifically in the domain of text classification. Given different attribution-based explanations to…

Information Retrieval · Computer Science 2018-12-04 Wenting Xiong , Iftitahu Ni'mah , Juan M. G. Huesca , Werner van Ipenburg , Jan Veldsink , Mykola Pechenizkiy

In the recent advances of natural language processing, the scale of the state-of-the-art models and datasets is usually extensive, which challenges the application of sample-based explanation methods in many aspects, such as explanation…

Computation and Language · Computer Science 2021-06-10 Wei Zhang , Ziming Huang , Yada Zhu , Guangnan Ye , Xiaodong Cui , Fan Zhang

Language Generation Models produce words based on the previous context. Although existing methods offer input attributions as explanations for a model's prediction, it is still unclear how prior words affect the model's decision throughout…

Computation and Language · Computer Science 2023-05-23 Javier Ferrando , Gerard I. Gállego , Ioannis Tsiamas , Marta R. Costa-jussà

How predictable a word is can be quantified in two ways: using human responses to the cloze task or using probabilities from language models (LMs).When used as predictors of processing effort, LM probabilities outperform probabilities…

Computation and Language · Computer Science 2026-05-27 Sathvik Nair , Byung-Doh Oh

Many high-performing machine learning models are not interpretable. As they are increasingly used in decision scenarios that can critically affect individuals, it is necessary to develop tools to better understand their outputs. Popular…

Artificial Intelligence · Computer Science 2023-05-30 Laura State , Salvatore Ruggieri , Franco Turini

Visual explanations are logical arguments based on visual features that justify the predictions made by neural networks. Current modes of visual explanations answer questions of the form $`Why \text{ } P?'$. These $Why$ questions operate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Mohit Prabhushankar , Gukyeong Kwon , Dogancan Temel , Ghassan AlRegib

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

Computation and Language · Computer Science 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Supervised learning in Neural Machine Translation (NMT) typically follows a teacher forcing paradigm where reference tokens constitute the conditioning context in the model's prediction, instead of its own previous predictions. In order to…

Computation and Language · Computer Science 2023-07-18 Nathaniel Berger , Miriam Exel , Matthias Huck , Stefan Riezler

As the application of deep neural networks proliferates in numerous areas such as medical imaging, video surveillance, and self driving cars, the need for explaining the decisions of these models has become a hot research topic, both at the…

Machine Learning · Computer Science 2021-06-01 Ronny Luss , Pin-Yu Chen , Amit Dhurandhar , Prasanna Sattigeri , Yunfeng Zhang , Karthikeyan Shanmugam , Chun-Chen Tu

Explaining the predictions of neural models in clinical NLP remains a significant challenge, especially for complex tasks involving long, unstructured medical texts. While post-hoc methods like LIME and SHAP are widely used, they often fall…

Computation and Language · Computer Science 2026-05-28 Kristian Miok , Matej Klemen , Blaz Škrlj , Marko Robnik Šikonja

Transformer language models are state of the art in a multitude of NLP tasks. Despite these successes, their opaqueness remains problematic. Recent methods aiming to provide interpretability and explainability to black-box models primarily…

Computation and Language · Computer Science 2022-03-14 Felix Friedrich , Patrick Schramowski , Christopher Tauchmann , Kristian Kersting

Developing explainability methods for Natural Language Processing (NLP) models is a challenging task, for two main reasons. First, the high dimensionality of the data (large number of tokens) results in low coverage and in turn small…

Computation and Language · Computer Science 2023-03-08 Peyman Jalali , Nengfeng Zhou , Yufei Yu

We propose Automatic Feature Explanation using Contrasting Concepts (FALCON), an interpretability framework to explain features of image representations. For a target feature, FALCON captions its highly activating cropped images using a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Neha Kalibhat , Shweta Bhardwaj , Bayan Bruss , Hamed Firooz , Maziar Sanjabi , Soheil Feizi

We build on abduction-based explanations for ma-chine learning and develop a method for computing local explanations for neural network models in natural language processing (NLP). Our explanations comprise a subset of the words of the…

Artificial Intelligence · Computer Science 2021-10-19 Emanuele La Malfa , Agnieszka Zbrzezny , Rhiannon Michelmore , Nicola Paoletti , Marta Kwiatkowska

This paper shows that a popular approach to the supervised embedding of documents for classification, namely, contrastive Word Mover's Embedding, can be significantly enhanced by adding interpretability. This interpretability is achieved by…

Computation and Language · Computer Science 2021-11-02 Ruijie Jiang , Julia Gouvea , Eric Miller , David Hammer , Shuchin Aeron

Despite exciting progress in causal language models, the expressiveness of the representations is largely limited due to poor discrimination ability. To remedy this issue, we present ContraCLM, a novel contrastive learning framework at both…