English
Related papers

Related papers: Investigating sanity checks for saliency maps with…

200 papers

Since the early 2000s, computational visual saliency has been a very active research area. Each year, more and more new models are published in the main computer vision conferences. Nowadays, one of the big challenges is to find a way to…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Nicolas Riche , Matthieu Duvinage , Matei Mancas , Bernard Gosselin , Thierry Dutoit

As Graph Neural Networks (GNNs) become more pervasive, it becomes paramount to build reliable tools for explaining their predictions. A core desideratum is that explanations are \textit{faithful}, \ie that they portray an accurate picture…

Machine Learning · Computer Science 2025-04-11 Steve Azzolin , Antonio Longa , Stefano Teso , Andrea Passerini

To investigate the use of saliency-map analysis to aid in searches for transient signals, such as fast radio bursts and individual pulses from radio pulsars. We aim to demonstrate that saliency maps provide the means to understand…

Instrumentation and Methods for Astrophysics · Physics 2020-09-30 C. Zhang , C. Wang , G. Hobbs , C. J. Russell , D. Li , S. -B. Zhang , S. Dai , J. -W. Wu , Z. -C. Pan , W. -W. Zhu , L. Toomey , Z. -Y. Ren

Recent research at the intersection of AI explainability and fairness has focused on how explanations can improve human-plus-AI task performance as assessed by fairness measures. We propose to characterize what constitutes an explanation…

Computation and Language · Computer Science 2023-10-24 Tin Nguyen , Jiannan Xu , Aayushi Roy , Hal Daumé , Marine Carpuat

There is growing interest in incorporating eye-tracking data and other implicit measures of human language processing into natural language processing (NLP) pipelines. The data from human language processing contain unique insight into…

Computation and Language · Computer Science 2023-10-24 Karin de Langis , Dongyeop Kang

Model-based mutation testing uses altered test models to derive test cases that are able to reveal whether a modelled fault has been implemented. This requires conformance checking between the original and the mutated model. This paper…

Software Engineering · Computer Science 2012-02-29 Bernhard K. Aichernig , Elisabeth Jöbstl

Saliency post-hoc explainability methods are important tools for understanding increasingly complex NLP models. While these methods can reflect the model's reasoning, they may not align with human intuition, making the explanations not…

Computation and Language · Computer Science 2024-08-20 Lucas E. Resck , Marcos M. Raimundo , Jorge Poco

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

The large size and complex decision mechanisms of state-of-the-art text classifiers make it difficult for humans to understand their predictions, leading to a potential lack of trust by the users. These issues have led to the adoption of…

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that our novel method of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Zhenyue Qin , Jie Wu

As multimodal learning finds applications in a wide variety of high-stakes societal tasks, investigating their robustness becomes important. Existing work has focused on understanding the robustness of vision-and-language models to…

Machine Learning · Computer Science 2022-11-07 Gaurav Verma , Vishwa Vinay , Ryan A. Rossi , Srijan Kumar

Gradient-based analysis methods, such as saliency map visualizations and adversarial input perturbations, have found widespread use in interpreting neural NLP models due to their simplicity, flexibility, and most importantly, their…

Computation and Language · Computer Science 2020-10-13 Junlin Wang , Jens Tuyls , Eric Wallace , Sameer Singh

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das

We introduce models for saliency prediction for mobile user interfaces. A mobile interface may include elements like buttons, text, etc. in addition to natural images which enable performing a variety of tasks. Saliency in natural images is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Prakhar Gupta , Shubh Gupta , Ajaykrishnan Jayagopal , Sourav Pal , Ritwik Sinha

Understanding the predictions made by Artificial Intelligence (AI) systems is becoming more and more important as deep learning models are used for increasingly complex and high-stakes tasks. Saliency mapping -- a popular visual attribution…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jessica Cooper , Ognjen Arandjelović , David J Harrison

Identifying the salience (i.e. importance) of discourse units is an important task in language understanding. While events play important roles in text documents, little research exists on analyzing their saliency status. This paper…

Computation and Language · Computer Science 2018-09-10 Zhengzhong Liu , Chenyan Xiong , Teruko Mitamura , Eduard Hovy

Evaluating explanations of image classifiers regarding ground truth, e.g. segmentation masks defined by human perception, primarily evaluates the quality of the models under consideration rather than the explanation methods themselves.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Hubert Baniecki , Maciej Chrabaszcz , Andreas Holzinger , Bastian Pfeifer , Anna Saranti , Przemyslaw Biecek

The objective of this paper is to assess the quality of explanation heatmaps for image classification tasks. To assess the quality of explainability methods, we approach the task through the lens of accuracy and stability. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Lassi Raatikainen , Esa Rahtu

Research in interpretable machine learning proposes different computational and human subject approaches to evaluate model saliency explanations. These approaches measure different qualities of explanations to achieve diverse goals in…

Human-Computer Interaction · Computer Science 2020-06-30 Sina Mohseni , Jeremy E. Block , Eric D. Ragan

Large Language Models (LLMs) excel at text summarization, a task that requires models to select content based on its importance. However, the exact notion of salience that LLMs have internalized remains unclear. To bridge this gap, we…

Computation and Language · Computer Science 2025-05-28 Jan Trienes , Jörg Schlötterer , Junyi Jessy Li , Christin Seifert